2024-03-11T21:43:47.507 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-11T21:43:47.508 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi --description orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} --verbose --archive /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942 --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942/orig.config.yaml 2024-03-11T21:43:47.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T21:43:47.612 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942 branch: squid description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} email: ceph-qa@ceph.com first_in_suite: false job_id: '7591942' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) mon_bind_msgr2: false sha1: 94a539707733325322964c6a187c6a1b41be1daf ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: 94a539707733325322964c6a187c6a1b41be1daf extra_packages: - cephadm workunit: branch: squid sha1: fbcdfe674e56d1ea7a0810744e5915bb07961be5 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 3176 sha1: 94a539707733325322964c6a187c6a1b41be1daf sleep_before_teardown: 0 subset: 14/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_fbcdfe674e56d1ea7a0810744e5915bb07961be5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: fbcdfe674e56d1ea7a0810744e5915bb07961be5 targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDq6Jp+Jpy1mZulEafdt+/jRF01q1gQ+AU1DSVb4CgSijPPq2SPtntHuMpBCuYRR+Scc/EgUk6oVbXCTRI58BqQ= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLYFMuTAiJq1vsAZh/Vru1rCJJNcrplW2PhH8Mk3LQY+o19fqKyUmwuHYECAWTMx4vyR5VK8iM5kTNysFzIYBg= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-11_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-11T21:43:47.612 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_fbcdfe674e56d1ea7a0810744e5915bb07961be5/qa; will attempt to use it 2024-03-11T21:43:47.613 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_fbcdfe674e56d1ea7a0810744e5915bb07961be5/qa/tasks 2024-03-11T21:43:47.613 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-11T21:43:47.615 INFO:teuthology.task.internal:Checking packages... 2024-03-11T21:43:47.638 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '94a539707733325322964c6a187c6a1b41be1daf' 2024-03-11T21:43:47.639 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-11T21:43:47.639 INFO:teuthology.packaging:ref: None 2024-03-11T21:43:47.639 INFO:teuthology.packaging:tag: None 2024-03-11T21:43:47.639 INFO:teuthology.packaging:branch: squid 2024-03-11T21:43:47.639 INFO:teuthology.packaging:sha1: 94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:43:47.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-03-11T21:43:47.871 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1607-g94a53970-1jammy 2024-03-11T21:43:47.872 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-11T21:43:47.879 INFO:teuthology.task.internal:no buildpackages task found 2024-03-11T21:43:47.880 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-11T21:43:47.900 INFO:teuthology.task.internal:Saving configuration 2024-03-11T21:43:47.912 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-11T21:43:47.926 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-11T21:43:47.953 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-11 21:36:34.473368', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHhqc9mAh5h094tIKdJK2iSfC+/gc+IqbEU0Ba3zlR3c'} 2024-03-11T21:43:47.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-11 21:36:34.471396', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO2pqD+UgG3I4TlIn14hgq2kGxpEHnA+jXpMDK/NoZQv'} 2024-03-11T21:43:47.978 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-11T21:43:47.984 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-03-11T21:43:47.984 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-03-11T21:43:47.985 INFO:teuthology.run_tasks:Running task console_log... 2024-03-11T21:43:48.067 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4fe6dff3a0>, signals=[15]) 2024-03-11T21:43:48.067 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-11T21:43:48.075 INFO:teuthology.task.internal:Opening connections... 2024-03-11T21:43:48.075 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-03-11T21:43:48.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:43:48.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-03-11T21:43:48.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:43:48.250 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-11T21:43:48.257 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-03-11T21:43:48.263 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-03-11T21:43:48.263 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-03-11T21:43:48.311 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="22.04" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=jammy 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-11T21:43:48.312 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=jammy 2024-03-11T21:43:48.313 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-03-11T21:43:48.333 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-03-11T21:43:48.338 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-03-11T21:43:48.339 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-03-11T21:43:48.387 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-11T21:43:48.388 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2024-03-11T21:43:48.389 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-03-11T21:43:48.408 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-11T21:43:48.417 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-11T21:43:48.442 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-11T21:43:48.442 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-03-11T21:43:48.447 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-03-11T21:43:48.451 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-11T21:43:48.473 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-11T21:43:48.473 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-03-11T21:43:48.493 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-03-11T21:43:48.523 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-11T21:43:48.581 INFO:teuthology.run_tasks:Running task kernel... 2024-03-11T21:43:48.595 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-11T21:43:48.596 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-11T21:43:48.596 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-11T21:43:48.596 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-11T21:43:48.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-11T21:43:48.601 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-03-11T21:43:48.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-11T21:43:48.602 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-03-11T21:43:48.647 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-56-generic 2024-03-11T21:43:48.648 INFO:teuthology.task.kernel:Running kernel on smithi187: 5.15.0-56-generic 2024-03-11T21:43:48.648 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-03-11T21:43:48.649 INFO:teuthology.orchestra.run.smithi049.stdout:5.15.0-56-generic 2024-03-11T21:43:48.649 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.15.0-56-generic 2024-03-11T21:43:48.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get clean 2024-03-11T21:43:48.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-03-11T21:43:48.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-03-11T21:43:48.935 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-11T21:43:49.035 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-11T21:43:49.035 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-11T21:43:49.040 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-11T21:43:49.088 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-11T21:43:49.122 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-11T21:43:49.146 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,241 kB] 2024-03-11T21:43:49.256 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [419 kB] 2024-03-11T21:43:49.261 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [223 kB] 2024-03-11T21:43:49.265 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-11T21:43:49.266 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,526 kB] 2024-03-11T21:43:49.293 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-11T21:43:49.294 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [253 kB] 2024-03-11T21:43:49.298 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-11T21:43:49.298 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [597 kB] 2024-03-11T21:43:49.306 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-03-11T21:43:49.314 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-11T21:43:49.318 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-11T21:43:49.318 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-11T21:43:49.318 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-11T21:43:49.324 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-11T21:43:49.352 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-11T21:43:49.450 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-11T21:43:49.450 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,241 kB] 2024-03-11T21:43:49.485 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-11T21:43:49.589 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,460 kB] 2024-03-11T21:43:49.623 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,460 kB] 2024-03-11T21:43:49.859 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [419 kB] 2024-03-11T21:43:49.878 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [223 kB] 2024-03-11T21:43:49.887 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-11T21:43:49.888 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,526 kB] 2024-03-11T21:43:49.889 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [585 kB] 2024-03-11T21:43:49.924 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [585 kB] 2024-03-11T21:43:49.928 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [283 kB] 2024-03-11T21:43:49.944 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-11T21:43:49.945 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,559 kB] 2024-03-11T21:43:49.963 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [283 kB] 2024-03-11T21:43:49.978 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-11T21:43:49.979 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-11T21:43:49.979 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,559 kB] 2024-03-11T21:43:49.980 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [253 kB] 2024-03-11T21:43:49.991 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-11T21:43:49.991 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-03-11T21:43:50.015 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-11T21:43:50.016 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [259 kB] 2024-03-11T21:43:50.021 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-11T21:43:50.022 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [597 kB] 2024-03-11T21:43:50.038 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-11T21:43:50.039 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [259 kB] 2024-03-11T21:43:50.045 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-11T21:43:50.185 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [693 kB] 2024-03-11T21:43:50.200 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-11T21:43:50.209 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [693 kB] 2024-03-11T21:43:50.604 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-11T21:43:50.610 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-11T21:43:50.610 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-11T21:43:50.624 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-11T21:43:50.626 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-11T21:43:50.770 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,054 kB] 2024-03-11T21:43:50.789 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,054 kB] 2024-03-11T21:43:50.880 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [238 kB] 2024-03-11T21:43:50.899 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-11T21:43:50.900 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [238 kB] 2024-03-11T21:43:50.901 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-11T21:43:50.902 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-11T21:43:50.905 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-11T21:43:50.906 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-11T21:43:50.906 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-03-11T21:43:50.908 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-03-11T21:43:50.910 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-03-11T21:43:50.920 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-11T21:43:50.921 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-11T21:43:50.922 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-11T21:43:50.925 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-11T21:43:50.925 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-11T21:43:50.926 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-03-11T21:43:50.929 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-03-11T21:43:50.931 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-03-11T21:43:51.075 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-11T21:43:51.096 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-11T21:43:51.158 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-03-11T21:43:51.163 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-03-11T21:43:51.179 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-03-11T21:43:51.184 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-03-11T21:43:51.282 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-03-11T21:43:51.303 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-03-11T21:43:51.333 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-11T21:43:51.355 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-11T21:43:55.665 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 12.1 MB in 3s (4,839 kB/s) 2024-03-11T21:43:55.903 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 12.1 MB in 3s (4,830 kB/s) 2024-03-11T21:43:57.109 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-03-11T21:43:57.127 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-11T21:43:57.225 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-03-11T21:43:57.291 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-03-11T21:43:57.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-11T21:43:57.374 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-03-11T21:43:57.407 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-03-11T21:43:57.407 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-03-11T21:43:57.556 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-03-11T21:43:57.556 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-11T21:43:57.557 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-11T21:43:57.557 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-11T21:43:57.557 INFO:teuthology.orchestra.run.smithi187.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-11T21:43:57.557 INFO:teuthology.orchestra.run.smithi187.stdout: python2.7-minimal 2024-03-11T21:43:57.557 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-11T21:43:57.558 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-03-11T21:43:57.558 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-11T21:43:57.558 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-generic linux-image-5.15.0-100-generic 2024-03-11T21:43:57.559 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-5.15.0-100-generic linux-modules-extra-5.15.0-100-generic 2024-03-11T21:43:57.560 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-03-11T21:43:57.560 INFO:teuthology.orchestra.run.smithi187.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-11T21:43:57.560 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-03-11T21:43:57.560 INFO:teuthology.orchestra.run.smithi187.stdout: thermald 2024-03-11T21:43:57.574 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-03-11T21:43:57.575 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-03-11T21:43:57.607 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-03-11T21:43:57.608 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-11T21:43:57.608 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.15.0-100-generic linux-modules-5.15.0-100-generic 2024-03-11T21:43:57.608 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-extra-5.15.0-100-generic 2024-03-11T21:43:57.609 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2024-03-11T21:43:57.610 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-11T21:43:57.751 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-03-11T21:43:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-11T21:43:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-11T21:43:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-11T21:43:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-11T21:43:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: python2.7-minimal 2024-03-11T21:43:57.752 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-11T21:43:57.754 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-03-11T21:43:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: linux-generic linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-11T21:43:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: linux-headers-generic linux-image-5.15.0-100-generic 2024-03-11T21:43:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: linux-modules-5.15.0-100-generic linux-modules-extra-5.15.0-100-generic 2024-03-11T21:43:57.755 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-03-11T21:43:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-11T21:43:57.755 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2024-03-11T21:43:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: thermald 2024-03-11T21:43:57.789 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 5 newly installed, 0 to remove and 288 not upgraded. 2024-03-11T21:43:57.790 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 113 MB of archives. 2024-03-11T21:43:57.790 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-11T21:43:57.790 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-100-generic amd64 5.15.0-100.110 [22.6 MB] 2024-03-11T21:43:57.806 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-03-11T21:43:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-11T21:43:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.15.0-100-generic linux-modules-5.15.0-100-generic 2024-03-11T21:43:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: linux-modules-extra-5.15.0-100-generic 2024-03-11T21:43:57.808 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2024-03-11T21:43:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-11T21:43:57.867 INFO:teuthology.orchestra.run.smithi049.stdout:3 upgraded, 5 newly installed, 0 to remove and 288 not upgraded. 2024-03-11T21:43:57.867 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 113 MB of archives. 2024-03-11T21:43:57.868 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-11T21:43:57.868 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-100-generic amd64 5.15.0-100.110 [22.6 MB] 2024-03-11T21:43:58.413 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-100-generic amd64 5.15.0-100.110 [11.5 MB] 2024-03-11T21:43:58.560 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-100-generic amd64 5.15.0-100.110 [63.8 MB] 2024-03-11T21:43:59.195 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-100-generic amd64 5.15.0-100.110 [11.5 MB] 2024-03-11T21:43:59.682 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-100-generic amd64 5.15.0-100.110 [63.8 MB] 2024-03-11T21:43:59.774 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.100.97 [1,696 B] 2024-03-11T21:43:59.774 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.100.97 [2,454 B] 2024-03-11T21:43:59.774 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100 all 5.15.0-100.110 [12.3 MB] 2024-03-11T21:44:00.020 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100-generic amd64 5.15.0-100.110 [2,858 kB] 2024-03-11T21:44:00.072 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.100.97 [2,292 B] 2024-03-11T21:44:00.501 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 113 MB in 2s (50.2 MB/s) 2024-03-11T21:44:00.657 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-modules-5.15.0-100-generic. 2024-03-11T21:44:01.909 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.100.97 [1,696 B] 2024-03-11T21:44:01.909 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.100.97 [2,454 B] 2024-03-11T21:44:01.909 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100 all 5.15.0-100.110 [12.3 MB] 2024-03-11T21:44:02.656 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-11T21:44:02.661 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../0-linux-modules-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:02.747 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:02.769 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100-generic amd64 5.15.0-100.110 [2,858 kB] 2024-03-11T21:44:02.896 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.100.97 [2,292 B] 2024-03-11T21:44:03.285 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 113 MB in 5s (21.4 MB/s) 2024-03-11T21:44:03.464 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-5.15.0-100-generic. 2024-03-11T21:44:05.015 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-image-5.15.0-100-generic. 2024-03-11T21:44:05.036 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../1-linux-image-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:05.120 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:05.466 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-11T21:44:05.471 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-linux-modules-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:05.536 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:06.010 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-100-generic. 2024-03-11T21:44:06.031 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:06.060 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:07.564 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-5.15.0-100-generic. 2024-03-11T21:44:07.586 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-linux-image-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:07.684 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:08.117 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-100-generic. 2024-03-11T21:44:08.138 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:08.176 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:12.307 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../3-linux-generic_5.15.0.100.97_amd64.deb ... 2024-03-11T21:44:12.406 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-11T21:44:12.723 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.100.97_amd64.deb ... 2024-03-11T21:44:12.851 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-11T21:44:13.162 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-headers-5.15.0-100. 2024-03-11T21:44:13.185 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../5-linux-headers-5.15.0-100_5.15.0-100.110_all.deb ... 2024-03-11T21:44:13.220 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-11T21:44:14.739 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-linux-generic_5.15.0.100.97_amd64.deb ... 2024-03-11T21:44:14.864 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-11T21:44:15.188 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.100.97_amd64.deb ... 2024-03-11T21:44:15.293 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-11T21:44:15.546 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-100. 2024-03-11T21:44:15.568 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-linux-headers-5.15.0-100_5.15.0-100.110_all.deb ... 2024-03-11T21:44:15.612 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-11T21:44:19.052 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-headers-5.15.0-100-generic. 2024-03-11T21:44:19.089 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../6-linux-headers-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:19.126 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:21.640 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-100-generic. 2024-03-11T21:44:21.677 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../6-linux-headers-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-11T21:44:21.715 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:21.796 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.100.97_amd64.deb ... 2024-03-11T21:44:21.912 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-11T21:44:22.237 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-11T21:44:22.367 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:22.493 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-generic (5.15.0.100.97) ... 2024-03-11T21:44:22.614 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:23.948 INFO:teuthology.orchestra.run.smithi049.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-11T21:44:23.948 INFO:teuthology.orchestra.run.smithi049.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-11T21:44:23.948 INFO:teuthology.orchestra.run.smithi049.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-100-generic 2024-03-11T21:44:23.948 INFO:teuthology.orchestra.run.smithi049.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:24.117 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.100.97_amd64.deb ... 2024-03-11T21:44:24.501 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-11T21:44:25.392 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-11T21:44:25.497 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:25.560 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:25.598 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-generic (5.15.0.100.97) ... 2024-03-11T21:44:25.702 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:26.978 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-generic (5.15.0.100.97) ... 2024-03-11T21:44:27.020 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-11T21:44:27.021 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-11T21:44:27.021 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-100-generic 2024-03-11T21:44:27.021 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:27.122 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-generic (5.15.0.100.97) ... 2024-03-11T21:44:27.178 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:27.247 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:27.322 INFO:teuthology.orchestra.run.smithi049.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-11T21:44:27.322 INFO:teuthology.orchestra.run.smithi049.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:28.571 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:29.956 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-generic (5.15.0.100.97) ... 2024-03-11T21:44:30.057 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-generic (5.15.0.100.97) ... 2024-03-11T21:44:30.158 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-11T21:44:30.228 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-11T21:44:30.228 INFO:teuthology.orchestra.run.smithi187.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:41.520 INFO:teuthology.orchestra.run.smithi049.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-11T21:44:41.520 INFO:teuthology.orchestra.run.smithi049.stdout:Sourcing file `/etc/default/grub' 2024-03-11T21:44:41.527 INFO:teuthology.orchestra.run.smithi049.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-11T21:44:41.547 INFO:teuthology.orchestra.run.smithi049.stdout:Generating grub configuration file ... 2024-03-11T21:44:41.838 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-11T21:44:41.855 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:42.152 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-11T21:44:42.158 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-11T21:44:42.223 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-11T21:44:42.229 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-11T21:44:42.401 INFO:teuthology.orchestra.run.smithi049.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-11T21:44:42.402 INFO:teuthology.orchestra.run.smithi049.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-11T21:44:42.402 INFO:teuthology.orchestra.run.smithi049.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-11T21:44:42.437 INFO:teuthology.orchestra.run.smithi049.stdout:done 2024-03-11T21:44:42.855 DEBUG:teuthology.orchestra.run.smithi049:> dpkg -s linux-image-generic 2024-03-11T21:44:42.873 INFO:teuthology.orchestra.run.smithi049.stdout:Package: linux-image-generic 2024-03-11T21:44:42.873 INFO:teuthology.orchestra.run.smithi049.stdout:Status: install ok installed 2024-03-11T21:44:42.873 INFO:teuthology.orchestra.run.smithi049.stdout:Priority: optional 2024-03-11T21:44:42.873 INFO:teuthology.orchestra.run.smithi049.stdout:Section: kernel 2024-03-11T21:44:42.873 INFO:teuthology.orchestra.run.smithi049.stdout:Installed-Size: 21 2024-03-11T21:44:42.873 INFO:teuthology.orchestra.run.smithi049.stdout:Maintainer: Ubuntu Kernel Team 2024-03-11T21:44:42.873 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: amd64 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout:Source: linux-meta 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout:Version: 5.15.0.100.97 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout:Recommends: thermald 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout:Description: Generic Linux kernel image 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout: This package will always depend on the latest generic kernel image 2024-03-11T21:44:42.874 INFO:teuthology.orchestra.run.smithi049.stdout: available. 2024-03-11T21:44:42.874 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-100-generic 2024-03-11T21:44:42.874 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-11T21:44:42.874 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-11T21:44:42.875 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-11T21:44:42.875 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-03-11T21:44:42.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get clean 2024-03-11T21:44:43.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-03-11T21:44:43.235 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-11T21:44:43.235 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-11T21:44:43.287 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-11T21:44:43.345 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-11T21:44:44.622 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-03-11T21:44:44.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-11T21:44:44.695 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-03-11T21:44:44.875 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-03-11T21:44:44.876 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-03-11T21:44:44.986 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-11T21:44:44.987 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub' 2024-03-11T21:44:45.005 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-11T21:44:45.024 INFO:teuthology.orchestra.run.smithi187.stdout:Generating grub configuration file ... 2024-03-11T21:44:45.037 INFO:teuthology.orchestra.run.smithi049.stdout:linux-image-generic is already the newest version (5.15.0.100.97). 2024-03-11T21:44:45.037 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-03-11T21:44:45.037 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-11T21:44:45.037 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-11T21:44:45.037 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-11T21:44:45.037 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-11T21:44:45.038 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-11T21:44:45.038 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-11T21:44:45.077 INFO:teuthology.orchestra.run.smithi049.stdout:0 upgraded, 0 newly installed, 0 to remove and 288 not upgraded. 2024-03-11T21:44:45.079 DEBUG:teuthology.orchestra.run.smithi049:> dpkg -s linux-image-generic 2024-03-11T21:44:45.138 INFO:teuthology.orchestra.run.smithi049.stdout:Package: linux-image-generic 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Status: install ok installed 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Priority: optional 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Section: kernel 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Installed-Size: 21 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Maintainer: Ubuntu Kernel Team 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: amd64 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Source: linux-meta 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Version: 5.15.0.100.97 2024-03-11T21:44:45.139 INFO:teuthology.orchestra.run.smithi049.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-11T21:44:45.140 INFO:teuthology.orchestra.run.smithi049.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-11T21:44:45.140 INFO:teuthology.orchestra.run.smithi049.stdout:Recommends: thermald 2024-03-11T21:44:45.140 INFO:teuthology.orchestra.run.smithi049.stdout:Description: Generic Linux kernel image 2024-03-11T21:44:45.140 INFO:teuthology.orchestra.run.smithi049.stdout: This package will always depend on the latest generic kernel image 2024-03-11T21:44:45.140 INFO:teuthology.orchestra.run.smithi049.stdout: available. 2024-03-11T21:44:45.140 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-03-11T21:44:45.187 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.jeWRZL6pGR 2024-03-11T21:44:45.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jeWRZL6pGR 2024-03-11T21:44:45.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.jeWRZL6pGR 2024-03-11T21:44:45.357 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-11T21:44:45.362 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.jeWRZL6pGR is 10KB 2024-03-11T21:44:45.371 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:45.375 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.jeWRZL6pGR 2024-03-11T21:44:45.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-11T21:44:45.434 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:44:45.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-11T21:44:45.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-11T21:44:45.503 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-100-generic 2024-03-11T21:44:45.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo update-grub 2024-03-11T21:44:45.753 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-11T21:44:45.759 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-11T21:44:45.835 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-11T21:44:45.841 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-11T21:44:46.006 INFO:teuthology.orchestra.run.smithi187.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-11T21:44:46.007 INFO:teuthology.orchestra.run.smithi187.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-11T21:44:46.007 INFO:teuthology.orchestra.run.smithi187.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-11T21:44:46.043 INFO:teuthology.orchestra.run.smithi187.stdout:done 2024-03-11T21:44:46.430 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-03-11T21:44:46.451 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.100.97 2024-03-11T21:44:46.452 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-11T21:44:46.452 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-11T21:44:46.452 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-03-11T21:44:46.452 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-03-11T21:44:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-03-11T21:44:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-03-11T21:44:46.452 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-100-generic 2024-03-11T21:44:46.452 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-11T21:44:46.452 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-11T21:44:46.452 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-11T21:44:46.452 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2024-03-11T21:44:46.453 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-03-11T21:44:46.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-03-11T21:44:46.698 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2024-03-11T21:44:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-11T21:44:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-03-11T21:44:46.729 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-11T21:44:46.729 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-11T21:44:46.742 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-11T21:44:46.764 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-11T21:44:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-11T21:44:46.875 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:47.090 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-11T21:44:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-11T21:44:47.137 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-11T21:44:47.142 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-11T21:44:47.264 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-11T21:44:47.265 INFO:teuthology.orchestra.run.smithi049.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-11T21:44:47.265 INFO:teuthology.orchestra.run.smithi049.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-11T21:44:47.284 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-03-11T21:44:47.293 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-03-11T21:44:48.070 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-03-11T21:44:48.086 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-11T21:44:48.147 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-03-11T21:44:48.340 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-03-11T21:44:48.341 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-03-11T21:44:48.515 INFO:teuthology.orchestra.run.smithi187.stdout:linux-image-generic is already the newest version (5.15.0.100.97). 2024-03-11T21:44:48.515 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-03-11T21:44:48.515 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-11T21:44:48.515 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-11T21:44:48.515 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-11T21:44:48.515 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-11T21:44:48.516 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-11T21:44:48.516 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-11T21:44:48.556 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 0 newly installed, 0 to remove and 288 not upgraded. 2024-03-11T21:44:48.558 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-03-11T21:44:48.573 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.100.97 2024-03-11T21:44:48.574 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-11T21:44:48.574 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-11T21:44:48.574 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-03-11T21:44:48.574 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-03-11T21:44:48.574 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-03-11T21:44:48.574 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-03-11T21:44:48.574 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-03-11T21:44:48.622 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.yp1y0iX6VQ 2024-03-11T21:44:48.623 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub/grub.cfg /tmp/tmp.yp1y0iX6VQ 2024-03-11T21:44:48.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.yp1y0iX6VQ 2024-03-11T21:44:48.794 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.yp1y0iX6VQ is 10KB 2024-03-11T21:44:48.806 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.yp1y0iX6VQ 2024-03-11T21:44:48.812 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-11T21:44:48.866 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:44:48.867 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-11T21:44:48.867 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-11T21:44:48.929 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-100-generic 2024-03-11T21:44:48.929 DEBUG:teuthology.orchestra.run.smithi187:> sudo update-grub 2024-03-11T21:44:50.130 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2024-03-11T21:44:50.130 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-11T21:44:50.133 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-03-11T21:44:50.361 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-11T21:44:50.366 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-11T21:44:50.651 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-11T21:44:50.656 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-11T21:44:50.694 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-11T21:44:50.700 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-11T21:44:50.844 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-11T21:44:50.845 INFO:teuthology.orchestra.run.smithi187.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-11T21:44:50.845 INFO:teuthology.orchestra.run.smithi187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-11T21:44:50.860 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-03-11T21:44:50.869 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-03-11T21:45:17.322 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-11T21:45:17.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:45:17.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:45:20.874 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-11T21:45:20.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T21:45:20.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:45:35.774 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-11T21:45:39.362 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T21:45:44.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:45:44.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:45:47.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-11T21:45:48.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T21:45:48.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:45:51.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T21:45:59.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:45:59.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:46:02.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-11T21:46:03.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T21:46:03.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:46:17.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:46:17.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:46:20.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-11T21:46:21.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-03-11T21:46:36.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T21:46:36.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:46:37.202 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-03-11T21:46:38.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T21:46:38.190 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-100-generic"... 2024-03-11T21:46:38.190 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-03-11T21:46:38.236 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-100-generic 2024-03-11T21:46:38.237 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-100-generic vs 5.15.0-100-generic 2024-03-11T21:46:38.237 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-11T21:46:38.237 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-11T21:46:38.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:46:38.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:46:39.238 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-11T21:46:39.238 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-11T21:46:39.323 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2024-03-11T21:46:39.342 DEBUG:teuthology.parallel:result is None 2024-03-11T21:46:57.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-11T21:47:18.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:47:18.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:47:19.088 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-03-11T21:47:19.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:47:19.821 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-100-generic"... 2024-03-11T21:47:19.822 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-03-11T21:47:19.868 INFO:teuthology.orchestra.run.smithi049.stdout:5.15.0-100-generic 2024-03-11T21:47:19.868 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-100-generic vs 5.15.0-100-generic 2024-03-11T21:47:19.868 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-11T21:47:19.868 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-11T21:47:20.869 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-11T21:47:20.870 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-11T21:47:21.201 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2024-03-11T21:47:21.246 DEBUG:teuthology.parallel:result is None 2024-03-11T21:47:21.246 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-11T21:47:21.253 INFO:teuthology.task.internal:Creating test directory... 2024-03-11T21:47:21.254 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-11T21:47:21.256 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-11T21:47:21.262 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-11T21:47:21.268 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-11T21:47:21.279 INFO:teuthology.task.internal:Creating archive directory... 2024-03-11T21:47:21.279 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-11T21:47:21.305 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-11T21:47:21.383 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-11T21:47:21.395 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-11T21:47:21.395 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-11T21:47:21.397 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-11T21:47:21.418 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-11T21:47:21.426 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-11T21:47:21.427 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-11T21:47:21.436 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-11T21:47:21.437 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-11T21:47:21.444 INFO:teuthology.task.internal:Configuring sudo... 2024-03-11T21:47:21.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-11T21:47:21.485 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-11T21:47:21.498 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-11T21:47:21.507 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-11T21:47:21.507 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-11T21:47:21.537 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-11T21:47:21.546 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-11T21:47:21.589 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-11T21:47:21.636 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:47:21.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-11T21:47:21.700 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-11T21:47:21.705 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-11T21:47:21.754 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:47:21.754 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-11T21:47:21.826 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-03-11T21:47:21.828 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-03-11T21:47:21.906 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-11T21:47:21.913 INFO:teuthology.task.internal:Starting timer... 2024-03-11T21:47:21.913 INFO:teuthology.run_tasks:Running task pcp... 2024-03-11T21:47:21.961 INFO:teuthology.run_tasks:Running task selinux... 2024-03-11T21:47:21.969 DEBUG:teuthology.task.selinux:Excluding smithi049: OS 'ubuntu' does not support SELinux 2024-03-11T21:47:21.969 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux 2024-03-11T21:47:21.970 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-11T21:47:21.970 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-11T21:47:21.970 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-11T21:47:21.970 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-11T21:47:21.979 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-11T21:47:21.984 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-11T21:47:22.108 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-11T21:47:22.123 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-11T21:47:22.125 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-11T21:54:23.563 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-03-11T21:54:23.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:54:23.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:54:23.647 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-03-11T21:54:23.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-11T21:54:23.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T21:54:23.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T21:54:23.800 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-03-11T21:54:23.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-03-11T21:54:23.875 INFO:teuthology.run_tasks:Running task clock... 2024-03-11T21:54:23.884 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-11T21:54:23.884 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-11T21:54:23.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-11T21:54:23.887 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-11T21:54:23.887 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-11T21:54:23.914 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-11T21:54:23.915 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Command line: ntpd -gq 2024-03-11T21:54:23.915 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: ---------------------------------------------------- 2024-03-11T21:54:23.915 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: ntp-4 is maintained by Network Time Foundation, 2024-03-11T21:54:23.915 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-11T21:54:23.915 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: corporation. Support and training for ntp-4 are 2024-03-11T21:54:23.915 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: available at https://www.nwtime.org/support 2024-03-11T21:54:23.915 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: ---------------------------------------------------- 2024-03-11T21:54:23.916 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: proto: precision = 0.065 usec (-24) 2024-03-11T21:54:23.916 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: basedate set to 2022-02-04 2024-03-11T21:54:23.916 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: gps base set to 2022-02-06 (week 2196) 2024-03-11T21:54:23.916 INFO:teuthology.orchestra.run.smithi049.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-11T21:54:23.917 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-11T21:54:23.917 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: restrict ::: KOD does nothing without LIMITED. 2024-03-11T21:54:23.917 INFO:teuthology.orchestra.run.smithi049.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-11T21:54:23.918 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Listen and drop on 0 v6wildcard [::]:123 2024-03-11T21:54:23.918 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-11T21:54:23.918 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Listen normally on 2 lo 127.0.0.1:123 2024-03-11T21:54:23.918 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Listen normally on 3 ens1f0 172.21.15.49:123 2024-03-11T21:54:23.918 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Listen normally on 4 lo [::1]:123 2024-03-11T21:54:23.918 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1566%4]:123 2024-03-11T21:54:23.918 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:23 ntpd[17044]: Listening on routing socket on fd #22 for interface updates 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Command line: ntpd -gq 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: ---------------------------------------------------- 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: ntp-4 is maintained by Network Time Foundation, 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: corporation. Support and training for ntp-4 are 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: available at https://www.nwtime.org/support 2024-03-11T21:54:23.941 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: ---------------------------------------------------- 2024-03-11T21:54:23.942 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: proto: precision = 0.060 usec (-24) 2024-03-11T21:54:23.942 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: basedate set to 2022-02-04 2024-03-11T21:54:23.942 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: gps base set to 2022-02-06 (week 2196) 2024-03-11T21:54:23.942 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-11T21:54:23.943 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-11T21:54:23.943 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: restrict ::: KOD does nothing without LIMITED. 2024-03-11T21:54:23.943 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-11T21:54:23.944 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Listen and drop on 0 v6wildcard [::]:123 2024-03-11T21:54:23.944 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-11T21:54:23.944 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Listen normally on 2 lo 127.0.0.1:123 2024-03-11T21:54:23.944 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Listen normally on 3 enp3s0f1 172.21.15.187:123 2024-03-11T21:54:23.944 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Listen normally on 4 lo [::1]:123 2024-03-11T21:54:23.944 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123 2024-03-11T21:54:23.944 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:23 ntpd[17178]: Listening on routing socket on fd #22 for interface updates 2024-03-11T21:54:24.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:24 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:24.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:24 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:24.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:24 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:24.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:24 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:24.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:24 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:24.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:24 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:25 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:25 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:25.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:25 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:25 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:25 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:25 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:26.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:26.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:26.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:26.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:26.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:26.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:26 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:26.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:26 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:26.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:26 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:26.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:26 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:26.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:26 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:26.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:26 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:26.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:26 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:27.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:27 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:27.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:27 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:27.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:27 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:27.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:27 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:27.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:27 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:27.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:27 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:27.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:27 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:27.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:27 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:27.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:27 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:27.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:27 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:27.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:27 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:27.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:27 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:28.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:28.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:28 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:28.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:28.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:28 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:29 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:29 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:29 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:29.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:29 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:29.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:29 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:29.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:29 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:29.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:29 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:29.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:29 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:29.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:29 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:29.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:29 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:29.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:29 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:29.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:29 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:30.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:30 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:30.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.942 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:11 Mar 21:54:30 ntpd[17178]: ntpd: time slew -0.006432 s 2024-03-11T21:54:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew -0.006432s 2024-03-11T21:54:30.944 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-11T21:54:30.944 INFO:teuthology.orchestra.run.smithi187.stderr:11 Mar 21:54:30 ntpd[17178]: can't open /var/log/ntpstats/loopstats.20240311: Permission denied 2024-03-11T21:54:31.004 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-03-11T21:54:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-03-11T21:54:31.005 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.005 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.005 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.005 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-11T21:54:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: can't open /var/log/ntpstats/rawstats.20240311: Permission denied 2024-03-11T21:54:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-11T21:54:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: can't open /var/log/ntpstats/peerstats.20240311: Permission denied 2024-03-11T21:54:31.916 INFO:teuthology.orchestra.run.smithi049.stdout:11 Mar 21:54:31 ntpd[17044]: ntpd: time slew +0.000859 s 2024-03-11T21:54:31.916 INFO:teuthology.orchestra.run.smithi049.stdout:ntpd: time slew +0.000859s 2024-03-11T21:54:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-11T21:54:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:11 Mar 21:54:31 ntpd[17044]: can't open /var/log/ntpstats/loopstats.20240311: Permission denied 2024-03-11T21:54:31.968 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2024-03-11T21:54:31.968 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2024-03-11T21:54:31.968 INFO:teuthology.orchestra.run.smithi049.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.968 INFO:teuthology.orchestra.run.smithi049.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.968 INFO:teuthology.orchestra.run.smithi049.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.968 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-11T21:54:31.969 INFO:teuthology.run_tasks:Running task install... 2024-03-11T21:54:31.977 DEBUG:teuthology.task.install:project ceph 2024-03-11T21:54:31.977 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '94a539707733325322964c6a187c6a1b41be1daf'}, 'extra_packages': ['cephadm']} 2024-03-11T21:54:31.977 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '94a539707733325322964c6a187c6a1b41be1daf'} 2024-03-11T21:54:31.978 INFO:teuthology.task.install:Using flavor: default 2024-03-11T21:54:31.983 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-11T21:54:31.983 INFO:teuthology.task.install:extra packages: [] 2024-03-11T21:54:31.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-key list | grep Ceph 2024-03-11T21:54:31.984 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-key list | grep Ceph 2024-03-11T21:54:32.048 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-11T21:54:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-11T21:54:32.077 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-11T21:54:32.077 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph.com (release key) 2024-03-11T21:54:32.078 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-11T21:54:32.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:54:32.101 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-11T21:54:32.101 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph.com (release key) 2024-03-11T21:54:32.102 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-11T21:54:32.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:54:32.485 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default/ 2024-03-11T21:54:32.485 INFO:teuthology.task.install.deb:Package version is 19.0.0-1607-g94a53970-1jammy 2024-03-11T21:54:32.612 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:54:32.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-11T21:54:32.626 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-03-11T21:54:32.847 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy InRelease 2024-03-11T21:54:32.868 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-11T21:54:32.891 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-11T21:54:32.923 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-11T21:54:32.923 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-11T21:54:32.955 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-03-11T21:54:32.976 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-11T21:54:32.994 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-11T21:54:33.076 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-11T21:54:33.274 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 28.8 kB in 0s (61.9 kB/s) 2024-03-11T21:54:33.510 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default/ 2024-03-11T21:54:33.510 INFO:teuthology.task.install.deb:Package version is 19.0.0-1607-g94a53970-1jammy 2024-03-11T21:54:33.772 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:54:33.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-11T21:54:33.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-03-11T21:54:34.013 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-11T21:54:34.014 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy InRelease 2024-03-11T21:54:34.034 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-11T21:54:34.057 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-11T21:54:34.078 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-11T21:54:34.078 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-11T21:54:34.106 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-03-11T21:54:34.159 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-11T21:54:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-11T21:54:34.243 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-03-11T21:54:34.258 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1607-g94a53970-1jammy cephadm=19.0.0-1607-g94a53970-1jammy ceph-mds=19.0.0-1607-g94a53970-1jammy ceph-mgr=19.0.0-1607-g94a53970-1jammy ceph-common=19.0.0-1607-g94a53970-1jammy ceph-fuse=19.0.0-1607-g94a53970-1jammy ceph-test=19.0.0-1607-g94a53970-1jammy ceph-volume=19.0.0-1607-g94a53970-1jammy radosgw=19.0.0-1607-g94a53970-1jammy python3-rados=19.0.0-1607-g94a53970-1jammy python3-rgw=19.0.0-1607-g94a53970-1jammy python3-cephfs=19.0.0-1607-g94a53970-1jammy python3-rbd=19.0.0-1607-g94a53970-1jammy libcephfs2=19.0.0-1607-g94a53970-1jammy libcephfs-dev=19.0.0-1607-g94a53970-1jammy librados2=19.0.0-1607-g94a53970-1jammy librbd1=19.0.0-1607-g94a53970-1jammy rbd-fuse=19.0.0-1607-g94a53970-1jammy 2024-03-11T21:54:34.309 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-03-11T21:54:34.381 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 28.8 kB in 0s (69.8 kB/s) 2024-03-11T21:54:34.482 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-03-11T21:54:34.482 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-03-11T21:54:34.642 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-03-11T21:54:34.642 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-11T21:54:34.642 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-11T21:54:34.642 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-11T21:54:34.643 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-11T21:54:34.643 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-11T21:54:34.644 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-11T21:54:34.644 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-03-11T21:54:34.644 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-11T21:54:34.644 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-11T21:54:34.644 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-11T21:54:34.644 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-11T21:54:34.645 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-11T21:54:34.646 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet zip 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-03-11T21:54:34.647 INFO:teuthology.orchestra.run.smithi187.stdout: btrfs-tools 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-11T21:54:34.746 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-11T21:54:34.747 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-11T21:54:34.748 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-11T21:54:34.748 INFO:teuthology.orchestra.run.smithi187.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-11T21:54:34.934 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 118 newly installed, 0 to remove and 275 not upgraded. 2024-03-11T21:54:34.934 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 176 MB of archives. 2024-03-11T21:54:34.934 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 730 MB of additional disk space will be used. 2024-03-11T21:54:34.934 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-11T21:54:34.964 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1607-g94a53970-1jammy [3,532 kB] 2024-03-11T21:54:35.325 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-03-11T21:54:35.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1607-g94a53970-1jammy cephadm=19.0.0-1607-g94a53970-1jammy ceph-mds=19.0.0-1607-g94a53970-1jammy ceph-mgr=19.0.0-1607-g94a53970-1jammy ceph-common=19.0.0-1607-g94a53970-1jammy ceph-fuse=19.0.0-1607-g94a53970-1jammy ceph-test=19.0.0-1607-g94a53970-1jammy ceph-volume=19.0.0-1607-g94a53970-1jammy radosgw=19.0.0-1607-g94a53970-1jammy python3-rados=19.0.0-1607-g94a53970-1jammy python3-rgw=19.0.0-1607-g94a53970-1jammy python3-cephfs=19.0.0-1607-g94a53970-1jammy python3-rbd=19.0.0-1607-g94a53970-1jammy libcephfs2=19.0.0-1607-g94a53970-1jammy libcephfs-dev=19.0.0-1607-g94a53970-1jammy librados2=19.0.0-1607-g94a53970-1jammy librbd1=19.0.0-1607-g94a53970-1jammy rbd-fuse=19.0.0-1607-g94a53970-1jammy 2024-03-11T21:54:35.354 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-11T21:54:35.367 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-11T21:54:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-03-11T21:54:35.448 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-11T21:54:35.448 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1607-g94a53970-1jammy [3,212 kB] 2024-03-11T21:54:35.600 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-03-11T21:54:35.601 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-03-11T21:54:35.669 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1607-g94a53970-1jammy [710 kB] 2024-03-11T21:54:35.677 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-11T21:54:35.689 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-11T21:54:35.707 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1607-g94a53970-1jammy [356 kB] 2024-03-11T21:54:35.719 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-11T21:54:35.729 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-11T21:54:35.730 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-11T21:54:35.731 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-11T21:54:35.735 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1607-g94a53970-1jammy [32.8 kB] 2024-03-11T21:54:35.737 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1607-g94a53970-1jammy [180 kB] 2024-03-11T21:54:35.741 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1607-g94a53970-1jammy [64.8 kB] 2024-03-11T21:54:35.743 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1607-g94a53970-1jammy [330 kB] 2024-03-11T21:54:35.749 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-11T21:54:35.770 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1607-g94a53970-1jammy [6,568 kB] 2024-03-11T21:54:35.785 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-03-11T21:54:35.785 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-11T21:54:35.785 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-11T21:54:35.786 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-11T21:54:35.786 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-11T21:54:35.786 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-11T21:54:35.786 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-11T21:54:35.787 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-03-11T21:54:35.787 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-11T21:54:35.787 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-11T21:54:35.788 INFO:teuthology.orchestra.run.smithi049.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-11T21:54:35.788 INFO:teuthology.orchestra.run.smithi049.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-11T21:54:35.788 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-11T21:54:35.788 INFO:teuthology.orchestra.run.smithi049.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-11T21:54:35.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet zip 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-11T21:54:35.790 INFO:teuthology.orchestra.run.smithi049.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-11T21:54:35.791 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2024-03-11T21:54:35.791 INFO:teuthology.orchestra.run.smithi049.stdout: btrfs-tools 2024-03-11T21:54:35.897 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-03-11T21:54:35.897 INFO:teuthology.orchestra.run.smithi049.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-11T21:54:35.897 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-11T21:54:35.897 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-11T21:54:35.897 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-11T21:54:35.897 INFO:teuthology.orchestra.run.smithi049.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-11T21:54:35.897 INFO:teuthology.orchestra.run.smithi049.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-11T21:54:35.898 INFO:teuthology.orchestra.run.smithi049.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-11T21:54:35.898 INFO:teuthology.orchestra.run.smithi049.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-11T21:54:35.899 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-11T21:54:35.900 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-11T21:54:35.900 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-11T21:54:35.900 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-11T21:54:35.900 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-11T21:54:35.900 INFO:teuthology.orchestra.run.smithi049.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-11T21:54:35.919 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-11T21:54:35.964 INFO:teuthology.orchestra.run.smithi049.stdout:0 upgraded, 118 newly installed, 0 to remove and 275 not upgraded. 2024-03-11T21:54:35.964 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 176 MB of archives. 2024-03-11T21:54:35.964 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 730 MB of additional disk space will be used. 2024-03-11T21:54:35.964 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-11T21:54:36.059 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1607-g94a53970-1jammy [112 kB] 2024-03-11T21:54:36.061 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1607-g94a53970-1jammy [465 kB] 2024-03-11T21:54:36.065 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-11T21:54:36.068 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-11T21:54:36.071 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1607-g94a53970-1jammy [24.1 MB] 2024-03-11T21:54:36.087 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-11T21:54:36.121 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1607-g94a53970-1jammy [3,532 kB] 2024-03-11T21:54:36.153 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-11T21:54:36.158 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-11T21:54:36.171 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-11T21:54:36.176 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-11T21:54:36.176 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-11T21:54:36.177 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-11T21:54:36.187 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-11T21:54:36.189 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-11T21:54:36.191 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-11T21:54:36.193 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-11T21:54:36.204 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-11T21:54:36.206 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-11T21:54:36.209 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-11T21:54:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-11T21:54:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-11T21:54:36.224 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-11T21:54:36.225 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-11T21:54:36.225 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-11T21:54:36.226 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-11T21:54:36.226 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-11T21:54:36.243 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-11T21:54:36.243 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-11T21:54:36.244 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-11T21:54:36.247 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-11T21:54:36.247 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-11T21:54:36.263 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-11T21:54:36.263 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-11T21:54:36.264 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-11T21:54:36.264 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-11T21:54:36.265 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-11T21:54:36.282 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-11T21:54:36.283 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-11T21:54:36.284 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-11T21:54:36.289 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-11T21:54:36.290 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-11T21:54:36.302 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-11T21:54:36.303 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-11T21:54:36.304 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-11T21:54:36.306 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-11T21:54:36.307 INFO:teuthology.orchestra.run.smithi049.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-11T21:54:36.321 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-11T21:54:36.321 INFO:teuthology.orchestra.run.smithi049.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-11T21:54:36.323 INFO:teuthology.orchestra.run.smithi049.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-11T21:54:36.325 INFO:teuthology.orchestra.run.smithi049.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-11T21:54:36.325 INFO:teuthology.orchestra.run.smithi049.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-11T21:54:36.326 INFO:teuthology.orchestra.run.smithi049.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-11T21:54:36.341 INFO:teuthology.orchestra.run.smithi049.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-11T21:54:36.356 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-11T21:54:36.358 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-11T21:54:36.409 INFO:teuthology.orchestra.run.smithi049.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-11T21:54:36.410 INFO:teuthology.orchestra.run.smithi049.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-11T21:54:36.412 INFO:teuthology.orchestra.run.smithi049.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-11T21:54:36.412 INFO:teuthology.orchestra.run.smithi049.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-11T21:54:36.414 INFO:teuthology.orchestra.run.smithi049.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-11T21:54:36.437 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-11T21:54:36.444 INFO:teuthology.orchestra.run.smithi049.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-11T21:54:36.446 INFO:teuthology.orchestra.run.smithi049.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-11T21:54:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-11T21:54:36.471 INFO:teuthology.orchestra.run.smithi049.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-11T21:54:36.471 INFO:teuthology.orchestra.run.smithi049.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-11T21:54:36.484 INFO:teuthology.orchestra.run.smithi049.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-11T21:54:36.485 INFO:teuthology.orchestra.run.smithi049.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-11T21:54:36.485 INFO:teuthology.orchestra.run.smithi049.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-11T21:54:36.486 INFO:teuthology.orchestra.run.smithi049.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-11T21:54:36.486 INFO:teuthology.orchestra.run.smithi049.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-11T21:54:36.487 INFO:teuthology.orchestra.run.smithi049.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-11T21:54:36.489 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-11T21:54:36.491 INFO:teuthology.orchestra.run.smithi049.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-11T21:54:36.504 INFO:teuthology.orchestra.run.smithi049.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-11T21:54:36.505 INFO:teuthology.orchestra.run.smithi049.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-11T21:54:36.506 INFO:teuthology.orchestra.run.smithi049.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-11T21:54:36.510 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-11T21:54:36.516 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-11T21:54:36.518 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-11T21:54:36.523 INFO:teuthology.orchestra.run.smithi049.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-11T21:54:36.526 INFO:teuthology.orchestra.run.smithi049.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-11T21:54:36.527 INFO:teuthology.orchestra.run.smithi049.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-11T21:54:36.528 INFO:teuthology.orchestra.run.smithi049.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-11T21:54:36.529 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-11T21:54:36.530 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-11T21:54:36.533 INFO:teuthology.orchestra.run.smithi049.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-11T21:54:36.533 INFO:teuthology.orchestra.run.smithi049.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-11T21:54:36.537 INFO:teuthology.orchestra.run.smithi049.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-11T21:54:36.543 INFO:teuthology.orchestra.run.smithi049.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-11T21:54:36.544 INFO:teuthology.orchestra.run.smithi049.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-11T21:54:36.544 INFO:teuthology.orchestra.run.smithi049.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-11T21:54:36.564 INFO:teuthology.orchestra.run.smithi049.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-11T21:54:36.565 INFO:teuthology.orchestra.run.smithi049.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-11T21:54:36.573 INFO:teuthology.orchestra.run.smithi049.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-11T21:54:36.573 INFO:teuthology.orchestra.run.smithi049.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-11T21:54:36.573 INFO:teuthology.orchestra.run.smithi049.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-11T21:54:36.576 INFO:teuthology.orchestra.run.smithi049.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-11T21:54:36.576 INFO:teuthology.orchestra.run.smithi049.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-11T21:54:36.695 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-11T21:54:36.780 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-11T21:54:36.807 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-11T21:54:37.026 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-11T21:54:37.027 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-11T21:54:37.091 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1607-g94a53970-1jammy [5,073 kB] 2024-03-11T21:54:37.171 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1607-g94a53970-1jammy [243 kB] 2024-03-11T21:54:37.171 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-11T21:54:37.173 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1607-g94a53970-1jammy [124 kB] 2024-03-11T21:54:37.175 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1607-g94a53970-1jammy [1,519 kB] 2024-03-11T21:54:37.191 INFO:teuthology.orchestra.run.smithi187.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-11T21:54:37.204 INFO:teuthology.orchestra.run.smithi187.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-11T21:54:37.209 INFO:teuthology.orchestra.run.smithi187.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-11T21:54:37.231 INFO:teuthology.orchestra.run.smithi187.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1607-g94a53970-1jammy [6,240 kB] 2024-03-11T21:54:37.234 INFO:teuthology.orchestra.run.smithi187.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-11T21:54:37.238 INFO:teuthology.orchestra.run.smithi187.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-11T21:54:37.405 INFO:teuthology.orchestra.run.smithi187.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-11T21:54:37.547 INFO:teuthology.orchestra.run.smithi187.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1607-g94a53970-1jammy [22.7 MB] 2024-03-11T21:54:37.738 INFO:teuthology.orchestra.run.smithi187.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-11T21:54:37.769 INFO:teuthology.orchestra.run.smithi187.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-11T21:54:37.779 INFO:teuthology.orchestra.run.smithi187.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-11T21:54:37.901 INFO:teuthology.orchestra.run.smithi049.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1607-g94a53970-1jammy [3,212 kB] 2024-03-11T21:54:37.981 INFO:teuthology.orchestra.run.smithi187.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-11T21:54:37.982 INFO:teuthology.orchestra.run.smithi187.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-11T21:54:37.988 INFO:teuthology.orchestra.run.smithi187.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-11T21:54:37.994 INFO:teuthology.orchestra.run.smithi187.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-11T21:54:38.009 INFO:teuthology.orchestra.run.smithi187.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-11T21:54:38.030 INFO:teuthology.orchestra.run.smithi187.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-11T21:54:38.036 INFO:teuthology.orchestra.run.smithi187.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-11T21:54:38.211 INFO:teuthology.orchestra.run.smithi187.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-11T21:54:38.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1607-g94a53970-1jammy [14.0 kB] 2024-03-11T21:54:38.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1607-g94a53970-1jammy [865 kB] 2024-03-11T21:54:38.381 INFO:teuthology.orchestra.run.smithi187.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1607-g94a53970-1jammy [2,185 kB] 2024-03-11T21:54:38.419 INFO:teuthology.orchestra.run.smithi187.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1607-g94a53970-1jammy [776 kB] 2024-03-11T21:54:38.429 INFO:teuthology.orchestra.run.smithi187.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1607-g94a53970-1jammy [144 kB] 2024-03-11T21:54:38.430 INFO:teuthology.orchestra.run.smithi187.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1607-g94a53970-1jammy [1,921 kB] 2024-03-11T21:54:38.473 INFO:teuthology.orchestra.run.smithi187.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-11T21:54:38.490 INFO:teuthology.orchestra.run.smithi187.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1607-g94a53970-1jammy [8,625 kB] 2024-03-11T21:54:38.650 INFO:teuthology.orchestra.run.smithi187.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-11T21:54:38.664 INFO:teuthology.orchestra.run.smithi187.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-11T21:54:38.686 INFO:teuthology.orchestra.run.smithi187.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-11T21:54:38.748 INFO:teuthology.orchestra.run.smithi187.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-11T21:54:38.802 INFO:teuthology.orchestra.run.smithi187.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1607-g94a53970-1jammy [14.2 kB] 2024-03-11T21:54:38.802 INFO:teuthology.orchestra.run.smithi187.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1607-g94a53970-1jammy [49.9 MB] 2024-03-11T21:54:39.024 INFO:teuthology.orchestra.run.smithi049.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1607-g94a53970-1jammy [710 kB] 2024-03-11T21:54:39.036 INFO:teuthology.orchestra.run.smithi187.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-11T21:54:39.038 INFO:teuthology.orchestra.run.smithi187.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-11T21:54:39.041 INFO:teuthology.orchestra.run.smithi187.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-11T21:54:39.042 INFO:teuthology.orchestra.run.smithi187.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-11T21:54:39.044 INFO:teuthology.orchestra.run.smithi187.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-11T21:54:39.271 INFO:teuthology.orchestra.run.smithi187.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-11T21:54:39.339 INFO:teuthology.orchestra.run.smithi049.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1607-g94a53970-1jammy [356 kB] 2024-03-11T21:54:39.429 INFO:teuthology.orchestra.run.smithi049.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1607-g94a53970-1jammy [32.8 kB] 2024-03-11T21:54:39.430 INFO:teuthology.orchestra.run.smithi049.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1607-g94a53970-1jammy [180 kB] 2024-03-11T21:54:39.510 INFO:teuthology.orchestra.run.smithi049.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1607-g94a53970-1jammy [64.8 kB] 2024-03-11T21:54:39.512 INFO:teuthology.orchestra.run.smithi049.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1607-g94a53970-1jammy [330 kB] 2024-03-11T21:54:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1607-g94a53970-1jammy [6,568 kB] 2024-03-11T21:54:39.701 INFO:teuthology.orchestra.run.smithi187.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-11T21:54:39.706 INFO:teuthology.orchestra.run.smithi187.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-11T21:54:39.995 INFO:teuthology.orchestra.run.smithi187.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-11T21:54:39.996 INFO:teuthology.orchestra.run.smithi187.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-11T21:54:39.998 INFO:teuthology.orchestra.run.smithi187.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-11T21:54:40.000 INFO:teuthology.orchestra.run.smithi187.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-11T21:54:40.001 INFO:teuthology.orchestra.run.smithi187.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-11T21:54:40.003 INFO:teuthology.orchestra.run.smithi187.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-11T21:54:40.004 INFO:teuthology.orchestra.run.smithi187.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-11T21:54:40.005 INFO:teuthology.orchestra.run.smithi187.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-11T21:54:40.187 INFO:teuthology.orchestra.run.smithi187.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-11T21:54:40.597 INFO:teuthology.orchestra.run.smithi187.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-11T21:54:40.700 INFO:teuthology.orchestra.run.smithi187.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-11T21:54:40.701 INFO:teuthology.orchestra.run.smithi187.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-11T21:54:40.836 INFO:teuthology.orchestra.run.smithi187.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-11T21:54:40.872 INFO:teuthology.orchestra.run.smithi187.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-11T21:54:40.873 INFO:teuthology.orchestra.run.smithi187.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1607-g94a53970-1jammy [121 kB] 2024-03-11T21:54:40.875 INFO:teuthology.orchestra.run.smithi187.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-11T21:54:40.875 INFO:teuthology.orchestra.run.smithi187.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1607-g94a53970-1jammy [38.4 kB] 2024-03-11T21:54:40.876 INFO:teuthology.orchestra.run.smithi187.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-11T21:54:40.876 INFO:teuthology.orchestra.run.smithi187.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1607-g94a53970-1jammy [13.0 MB] 2024-03-11T21:54:40.892 INFO:teuthology.orchestra.run.smithi187.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-11T21:54:40.896 INFO:teuthology.orchestra.run.smithi187.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-11T21:54:40.919 INFO:teuthology.orchestra.run.smithi187.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-11T21:54:41.083 INFO:teuthology.orchestra.run.smithi187.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-11T21:54:41.237 INFO:teuthology.orchestra.run.smithi187.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1607-g94a53970-1jammy [91.5 kB] 2024-03-11T21:54:41.350 INFO:teuthology.orchestra.run.smithi187.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-11T21:54:41.367 INFO:teuthology.orchestra.run.smithi187.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-11T21:54:41.380 INFO:teuthology.orchestra.run.smithi049.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1607-g94a53970-1jammy [112 kB] 2024-03-11T21:54:41.383 INFO:teuthology.orchestra.run.smithi049.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1607-g94a53970-1jammy [465 kB] 2024-03-11T21:54:41.453 INFO:teuthology.orchestra.run.smithi049.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1607-g94a53970-1jammy [24.1 MB] 2024-03-11T21:54:41.519 INFO:teuthology.orchestra.run.smithi187.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-11T21:54:41.548 INFO:teuthology.orchestra.run.smithi187.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-11T21:54:41.705 INFO:teuthology.orchestra.run.smithi187.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-11T21:54:41.707 INFO:teuthology.orchestra.run.smithi187.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-11T21:54:41.709 INFO:teuthology.orchestra.run.smithi187.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-11T21:54:41.731 INFO:teuthology.orchestra.run.smithi187.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-11T21:54:41.736 INFO:teuthology.orchestra.run.smithi187.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-11T21:54:42.402 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 176 MB in 7s (24.8 MB/s) 2024-03-11T21:54:42.562 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-11T21:54:42.657 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-11T21:54:42.662 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-11T21:54:42.736 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-11T21:54:43.048 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-11T21:54:43.074 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-11T21:54:43.114 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-11T21:54:43.459 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-11T21:54:43.485 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-11T21:54:43.525 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-11T21:54:43.946 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-11T21:54:43.973 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-11T21:54:44.021 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:54:44.399 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-11T21:54:44.425 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-11T21:54:44.465 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:54:44.810 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-11T21:54:44.837 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-11T21:54:44.872 INFO:teuthology.orchestra.run.smithi049.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1607-g94a53970-1jammy [5,073 kB] 2024-03-11T21:54:44.876 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:54:45.238 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-11T21:54:45.264 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-11T21:54:45.305 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-11T21:54:45.454 INFO:teuthology.orchestra.run.smithi049.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1607-g94a53970-1jammy [243 kB] 2024-03-11T21:54:45.487 INFO:teuthology.orchestra.run.smithi049.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1607-g94a53970-1jammy [124 kB] 2024-03-11T21:54:45.491 INFO:teuthology.orchestra.run.smithi049.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1607-g94a53970-1jammy [1,519 kB] 2024-03-11T21:54:45.583 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librados2. 2024-03-11T21:54:45.609 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../007-librados2_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:45.641 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librados2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:45.671 INFO:teuthology.orchestra.run.smithi049.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1607-g94a53970-1jammy [6,240 kB] 2024-03-11T21:54:46.085 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librbd1. 2024-03-11T21:54:46.111 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../008-librbd1_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:46.151 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librbd1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:46.387 INFO:teuthology.orchestra.run.smithi049.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1607-g94a53970-1jammy [22.7 MB] 2024-03-11T21:54:46.605 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs2. 2024-03-11T21:54:46.631 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:46.671 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:46.940 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rados. 2024-03-11T21:54:46.955 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:46.990 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rados (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:47.285 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-11T21:54:47.297 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:54:47.334 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-argparse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:47.606 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cephfs. 2024-03-11T21:54:47.618 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:47.662 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cephfs (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:47.981 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-11T21:54:48.008 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:54:48.048 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:48.376 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-11T21:54:48.402 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-11T21:54:48.442 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-11T21:54:48.747 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-prettytable. 2024-03-11T21:54:48.762 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-11T21:54:48.797 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-11T21:54:49.075 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rbd. 2024-03-11T21:54:49.102 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:49.141 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rbd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:49.494 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-11T21:54:49.521 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-11T21:54:49.561 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-11T21:54:49.839 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-11T21:54:49.863 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-11T21:54:49.897 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-11T21:54:49.971 INFO:teuthology.orchestra.run.smithi049.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1607-g94a53970-1jammy [14.0 kB] 2024-03-11T21:54:49.972 INFO:teuthology.orchestra.run.smithi049.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1607-g94a53970-1jammy [865 kB] 2024-03-11T21:54:50.063 INFO:teuthology.orchestra.run.smithi049.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1607-g94a53970-1jammy [2,185 kB] 2024-03-11T21:54:50.167 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-11T21:54:50.182 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-11T21:54:50.216 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-11T21:54:50.359 INFO:teuthology.orchestra.run.smithi049.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1607-g94a53970-1jammy [776 kB] 2024-03-11T21:54:50.477 INFO:teuthology.orchestra.run.smithi049.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1607-g94a53970-1jammy [144 kB] 2024-03-11T21:54:50.499 INFO:teuthology.orchestra.run.smithi049.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1607-g94a53970-1jammy [1,921 kB] 2024-03-11T21:54:50.553 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua5.1. 2024-03-11T21:54:50.580 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-11T21:54:50.620 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-11T21:54:50.717 INFO:teuthology.orchestra.run.smithi049.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1607-g94a53970-1jammy [8,625 kB] 2024-03-11T21:54:50.957 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-any. 2024-03-11T21:54:50.972 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-11T21:54:51.015 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-11T21:54:51.554 INFO:teuthology.orchestra.run.smithi049.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1607-g94a53970-1jammy [14.2 kB] 2024-03-11T21:54:51.555 INFO:teuthology.orchestra.run.smithi049.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1607-g94a53970-1jammy [49.9 MB] 2024-03-11T21:54:51.726 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package zip. 2024-03-11T21:54:51.753 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-11T21:54:51.784 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking zip (3.0-12build2) ... 2024-03-11T21:54:52.096 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package unzip. 2024-03-11T21:54:52.122 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-11T21:54:52.162 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-11T21:54:52.550 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package luarocks. 2024-03-11T21:54:52.576 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-11T21:54:52.616 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-11T21:54:53.025 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librgw2. 2024-03-11T21:54:53.051 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../025-librgw2_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:53.091 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librgw2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:53.638 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rgw. 2024-03-11T21:54:53.650 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:53.685 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:53.955 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-11T21:54:53.981 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-11T21:54:54.021 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-11T21:54:54.341 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libradosstriper1. 2024-03-11T21:54:54.367 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:54.408 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libradosstriper1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:54.803 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-common. 2024-03-11T21:54:54.829 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:54.869 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:55.057 INFO:teuthology.orchestra.run.smithi049.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1607-g94a53970-1jammy [121 kB] 2024-03-11T21:54:55.059 INFO:teuthology.orchestra.run.smithi049.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1607-g94a53970-1jammy [38.4 kB] 2024-03-11T21:54:55.060 INFO:teuthology.orchestra.run.smithi049.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1607-g94a53970-1jammy [13.0 MB] 2024-03-11T21:54:55.506 INFO:teuthology.orchestra.run.smithi049.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/94a539707733325322964c6a187c6a1b41be1daf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1607-g94a53970-1jammy [91.5 kB] 2024-03-11T21:54:56.097 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 176 MB in 20s (8,971 kB/s) 2024-03-11T21:54:56.228 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-11T21:54:56.275 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-base. 2024-03-11T21:54:56.302 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:56.314 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-11T21:54:56.320 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-11T21:54:56.351 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-base (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:56.402 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-11T21:54:56.738 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-11T21:54:56.765 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-11T21:54:56.904 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-11T21:54:57.141 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-11T21:54:57.157 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-11T21:54:57.199 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-11T21:54:57.216 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-11T21:54:57.231 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-11T21:54:57.271 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-11T21:54:57.532 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cheroot. 2024-03-11T21:54:57.548 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-11T21:54:57.591 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-11T21:54:57.636 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-11T21:54:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-11T21:54:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:54:57.911 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-11T21:54:57.937 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-11T21:54:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-11T21:54:58.089 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-11T21:54:58.116 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-11T21:54:58.147 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:54:58.280 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-11T21:54:58.307 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-11T21:54:58.347 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-11T21:54:58.450 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-11T21:54:58.477 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-11T21:54:58.526 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:54:58.633 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-11T21:54:58.660 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-11T21:54:58.700 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-11T21:54:58.870 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-11T21:54:58.897 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-11T21:54:58.937 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-11T21:54:58.961 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempora. 2024-03-11T21:54:58.987 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-11T21:54:59.028 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-11T21:54:59.232 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librados2. 2024-03-11T21:54:59.258 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../007-librados2_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:59.298 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librados2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:59.330 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-portend. 2024-03-11T21:54:59.357 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-11T21:54:59.406 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-11T21:54:59.684 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librbd1. 2024-03-11T21:54:59.700 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../008-librbd1_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:54:59.708 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-11T21:54:59.735 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-11T21:54:59.742 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librbd1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:54:59.775 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-11T21:55:00.028 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-11T21:55:00.055 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-11T21:55:00.086 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-11T21:55:00.179 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs2. 2024-03-11T21:55:00.206 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:00.245 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:00.482 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-natsort. 2024-03-11T21:55:00.508 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-11T21:55:00.522 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rados. 2024-03-11T21:55:00.538 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:00.565 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-11T21:55:00.572 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rados (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:00.875 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-11T21:55:00.876 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-logutils. 2024-03-11T21:55:00.902 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:00.903 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-11T21:55:00.942 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-argparse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:00.943 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-11T21:55:01.186 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cephfs. 2024-03-11T21:55:01.202 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:01.213 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-11T21:55:01.236 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cephfs (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:01.239 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-11T21:55:01.271 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-11T21:55:01.488 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-11T21:55:01.512 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:01.547 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:01.574 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-mako. 2024-03-11T21:55:01.601 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-11T21:55:01.657 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-11T21:55:01.875 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-11T21:55:01.902 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-11T21:55:01.942 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-11T21:55:01.977 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-11T21:55:02.004 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-11T21:55:02.044 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-11T21:55:02.261 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-prettytable. 2024-03-11T21:55:02.288 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-11T21:55:02.313 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-11T21:55:02.328 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-11T21:55:02.340 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-11T21:55:02.380 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-11T21:55:02.614 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rbd. 2024-03-11T21:55:02.642 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:02.650 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webob. 2024-03-11T21:55:02.677 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-11T21:55:02.680 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rbd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:02.717 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-11T21:55:02.983 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-11T21:55:03.010 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-11T21:55:03.041 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-11T21:55:03.061 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-waitress. 2024-03-11T21:55:03.088 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-11T21:55:03.130 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-11T21:55:03.311 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-11T21:55:03.338 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-11T21:55:03.377 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-11T21:55:03.506 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempita. 2024-03-11T21:55:03.532 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-11T21:55:03.589 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-11T21:55:03.688 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-11T21:55:03.704 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-11T21:55:03.746 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-11T21:55:03.959 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-paste. 2024-03-11T21:55:03.985 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-11T21:55:04.025 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-11T21:55:04.050 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua5.1. 2024-03-11T21:55:04.077 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-11T21:55:04.116 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-11T21:55:04.403 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-any. 2024-03-11T21:55:04.420 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-11T21:55:04.429 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-11T21:55:04.447 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-11T21:55:04.469 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-11T21:55:04.495 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-11T21:55:04.713 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package zip. 2024-03-11T21:55:04.729 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-11T21:55:04.771 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking zip (3.0-12build2) ... 2024-03-11T21:55:04.865 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-11T21:55:04.891 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-11T21:55:04.940 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-11T21:55:05.100 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package unzip. 2024-03-11T21:55:05.127 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-11T21:55:05.166 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-11T21:55:05.251 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webtest. 2024-03-11T21:55:05.278 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-11T21:55:05.318 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-11T21:55:05.504 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package luarocks. 2024-03-11T21:55:05.530 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-11T21:55:05.562 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-11T21:55:05.638 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pecan. 2024-03-11T21:55:05.664 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-11T21:55:05.712 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-11T21:55:05.953 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librgw2. 2024-03-11T21:55:05.980 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../025-librgw2_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:06.019 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librgw2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:06.059 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-certifi. 2024-03-11T21:55:06.086 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-11T21:55:06.126 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-11T21:55:06.454 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-idna. 2024-03-11T21:55:06.480 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-11T21:55:06.520 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-11T21:55:06.546 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rgw. 2024-03-11T21:55:06.562 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:06.596 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-urllib3. 2024-03-11T21:55:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-11T21:55:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-11T21:55:06.891 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-11T21:55:06.918 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-11T21:55:06.958 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-11T21:55:07.261 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libradosstriper1. 2024-03-11T21:55:07.287 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:07.327 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libradosstriper1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:08.019 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests. 2024-03-11T21:55:08.045 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-11T21:55:08.085 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-11T21:55:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-common. 2024-03-11T21:55:08.141 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:08.363 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-11T21:55:08.389 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-11T21:55:08.421 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-11T21:55:08.531 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:08.716 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-11T21:55:08.732 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:08.766 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:09.138 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-11T21:55:09.164 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:09.204 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:09.482 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-11T21:55:09.498 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-11T21:55:09.532 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-11T21:55:09.744 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-base. 2024-03-11T21:55:09.771 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:09.802 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-openssl. 2024-03-11T21:55:09.812 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-base (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:09.828 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-11T21:55:09.868 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-11T21:55:10.213 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr. 2024-03-11T21:55:10.240 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:10.356 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-11T21:55:10.373 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-11T21:55:10.406 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-11T21:55:10.676 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cheroot. 2024-03-11T21:55:10.683 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mon. 2024-03-11T21:55:10.703 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-11T21:55:10.710 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:10.741 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mon (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:10.742 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-11T21:55:11.012 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-11T21:55:11.028 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-11T21:55:11.062 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-11T21:55:11.348 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-11T21:55:11.370 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-osd. 2024-03-11T21:55:11.375 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-11T21:55:11.397 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:11.414 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-11T21:55:11.436 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-osd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:11.717 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-11T21:55:11.744 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-11T21:55:11.784 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-11T21:55:12.047 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempora. 2024-03-11T21:55:12.074 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-11T21:55:12.105 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-11T21:55:12.408 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-portend. 2024-03-11T21:55:12.435 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-11T21:55:12.474 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-11T21:55:12.698 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph. 2024-03-11T21:55:12.725 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../066-ceph_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:12.765 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:12.777 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-11T21:55:12.804 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-11T21:55:12.950 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-11T21:55:13.068 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-fuse. 2024-03-11T21:55:13.094 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:13.126 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-11T21:55:13.374 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-11T21:55:13.413 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-11T21:55:13.521 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mds. 2024-03-11T21:55:13.548 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:13.587 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mds (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:13.734 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-natsort. 2024-03-11T21:55:13.761 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-11T21:55:13.800 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-11T21:55:13.982 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephadm. 2024-03-11T21:55:14.009 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../069-cephadm_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:14.049 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:14.070 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-logutils. 2024-03-11T21:55:14.097 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-11T21:55:14.136 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-11T21:55:14.326 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-11T21:55:14.342 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-11T21:55:14.376 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-11T21:55:14.464 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-11T21:55:14.492 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-11T21:55:14.531 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-11T21:55:14.687 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-11T21:55:14.718 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-11T21:55:14.745 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-11T21:55:14.834 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-mako. 2024-03-11T21:55:14.861 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-11T21:55:14.900 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-11T21:55:15.237 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-11T21:55:15.263 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-11T21:55:15.303 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-11T21:55:15.539 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-11T21:55:15.566 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-11T21:55:15.606 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-11T21:55:15.801 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-babel. 2024-03-11T21:55:15.829 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-11T21:55:15.867 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-11T21:55:15.900 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webob. 2024-03-11T21:55:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-11T21:55:15.967 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-11T21:55:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jinja2. 2024-03-11T21:55:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-11T21:55:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-11T21:55:16.295 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-waitress. 2024-03-11T21:55:16.318 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-11T21:55:16.364 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-11T21:55:16.640 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-11T21:55:16.667 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:16.673 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempita. 2024-03-11T21:55:16.699 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-11T21:55:16.706 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-11T21:55:17.009 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-paste. 2024-03-11T21:55:17.025 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-11T21:55:17.043 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-11T21:55:17.058 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-11T21:55:17.071 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-11T21:55:17.110 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-11T21:55:17.387 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-11T21:55:17.387 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-routes. 2024-03-11T21:55:17.413 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-11T21:55:17.415 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-11T21:55:17.453 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-11T21:55:17.454 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-11T21:55:17.723 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-11T21:55:17.738 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-11T21:55:17.773 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-11T21:55:17.825 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-11T21:55:17.852 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:17.891 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:18.026 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webtest. 2024-03-11T21:55:18.053 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-11T21:55:18.092 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-11T21:55:18.344 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-11T21:55:18.360 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-11T21:55:18.402 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-11T21:55:18.412 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pecan. 2024-03-11T21:55:18.439 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-11T21:55:18.512 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-11T21:55:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-certifi. 2024-03-11T21:55:18.902 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-11T21:55:18.906 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-joblib. 2024-03-11T21:55:18.934 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-11T21:55:18.958 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-11T21:55:18.972 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-11T21:55:19.277 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-idna. 2024-03-11T21:55:19.305 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-11T21:55:19.310 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-11T21:55:19.337 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-11T21:55:19.344 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-11T21:55:19.377 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-11T21:55:19.630 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-urllib3. 2024-03-11T21:55:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-11T21:55:19.671 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn. 2024-03-11T21:55:19.680 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-11T21:55:19.698 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-11T21:55:19.770 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-11T21:55:19.992 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests. 2024-03-11T21:55:20.019 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-11T21:55:20.058 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-11T21:55:20.370 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-11T21:55:20.396 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-11T21:55:20.435 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-11T21:55:20.479 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-11T21:55:20.507 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:20.640 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:20.714 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-11T21:55:20.730 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:20.772 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:21.135 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-11T21:55:21.163 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:21.193 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:21.480 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-11T21:55:21.507 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-11T21:55:21.546 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-11T21:55:21.594 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cachetools. 2024-03-11T21:55:21.621 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-11T21:55:21.660 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-11T21:55:21.849 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-openssl. 2024-03-11T21:55:21.876 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-11T21:55:21.915 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-11T21:55:21.963 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-11T21:55:21.990 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-11T21:55:22.030 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-11T21:55:22.227 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr. 2024-03-11T21:55:22.254 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:22.293 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:22.392 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-11T21:55:22.419 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-11T21:55:22.458 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-11T21:55:22.672 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mon. 2024-03-11T21:55:22.699 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:22.738 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mon (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:22.770 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rsa. 2024-03-11T21:55:22.798 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-11T21:55:23.011 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-11T21:55:23.324 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-google-auth. 2024-03-11T21:55:23.351 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-11T21:55:23.390 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-11T21:55:23.617 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-osd. 2024-03-11T21:55:23.644 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:23.683 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-osd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:23.727 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-11T21:55:23.754 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-11T21:55:23.793 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-11T21:55:24.063 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-websocket. 2024-03-11T21:55:24.090 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-11T21:55:24.121 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-11T21:55:24.450 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-11T21:55:24.477 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-11T21:55:24.516 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-11T21:55:24.778 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph. 2024-03-11T21:55:24.793 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../066-ceph_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:24.836 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:25.139 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-fuse. 2024-03-11T21:55:25.166 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:25.197 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-11T21:55:25.205 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:25.213 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:25.246 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:25.558 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mds. 2024-03-11T21:55:25.583 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-11T21:55:25.585 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:25.610 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-11T21:55:25.625 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mds (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:25.649 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-11T21:55:25.995 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephadm. 2024-03-11T21:55:25.995 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-11T21:55:26.022 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-11T21:55:26.022 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../069-cephadm_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:26.060 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-11T21:55:26.061 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:26.322 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package jq. 2024-03-11T21:55:26.338 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-11T21:55:26.372 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-11T21:55:26.380 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-11T21:55:26.407 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-11T21:55:26.447 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-11T21:55:26.602 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package socat. 2024-03-11T21:55:26.629 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-11T21:55:26.668 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-11T21:55:26.775 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-11T21:55:26.802 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-11T21:55:26.841 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-11T21:55:26.979 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package xmlstarlet. 2024-03-11T21:55:26.995 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-11T21:55:27.038 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-11T21:55:27.391 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-test. 2024-03-11T21:55:27.407 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:27.450 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-test (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:27.854 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-babel. 2024-03-11T21:55:27.882 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-11T21:55:27.921 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-11T21:55:28.240 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jinja2. 2024-03-11T21:55:28.268 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-11T21:55:28.307 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-11T21:55:28.651 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-11T21:55:28.679 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:28.718 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:29.097 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-11T21:55:29.124 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-11T21:55:29.162 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-11T21:55:29.457 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-routes. 2024-03-11T21:55:29.484 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-11T21:55:29.515 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-11T21:55:29.596 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-volume. 2024-03-11T21:55:29.623 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:29.662 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-volume (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:29.844 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-11T21:55:29.871 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:29.910 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:29.966 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-11T21:55:29.982 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:30.024 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs-dev (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:30.305 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-11T21:55:30.321 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-11T21:55:30.344 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-11T21:55:30.363 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-11T21:55:30.371 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-11T21:55:30.410 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-11T21:55:30.723 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-11T21:55:30.751 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-11T21:55:30.781 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-11T21:55:30.850 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-joblib. 2024-03-11T21:55:30.877 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-11T21:55:30.916 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-11T21:55:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package nvme-cli. 2024-03-11T21:55:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-11T21:55:31.236 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-11T21:55:31.252 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-11T21:55:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-11T21:55:31.286 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-11T21:55:31.564 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn. 2024-03-11T21:55:31.591 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-11T21:55:31.630 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-11T21:55:31.707 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pkg-config. 2024-03-11T21:55:31.735 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-11T21:55:31.773 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-11T21:55:32.026 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-11T21:55:32.042 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-11T21:55:32.084 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-11T21:55:32.364 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-11T21:55:32.392 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:32.507 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:32.612 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-11T21:55:32.640 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-11T21:55:32.679 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-11T21:55:32.948 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastescript. 2024-03-11T21:55:32.964 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-11T21:55:32.998 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-11T21:55:33.302 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pluggy. 2024-03-11T21:55:33.330 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-11T21:55:33.368 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-11T21:55:33.519 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cachetools. 2024-03-11T21:55:33.536 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-11T21:55:33.586 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-11T21:55:33.679 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-psutil. 2024-03-11T21:55:33.707 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-11T21:55:33.745 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-11T21:55:33.847 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-11T21:55:33.875 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-11T21:55:33.914 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-11T21:55:34.082 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-py. 2024-03-11T21:55:34.109 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-11T21:55:34.148 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-11T21:55:34.226 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-11T21:55:34.254 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-11T21:55:34.292 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-11T21:55:34.485 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pygments. 2024-03-11T21:55:34.512 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-11T21:55:34.551 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-11T21:55:34.603 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rsa. 2024-03-11T21:55:34.631 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-11T21:55:34.670 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-11T21:55:35.015 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-google-auth. 2024-03-11T21:55:35.043 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-11T21:55:35.072 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-11T21:55:35.081 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-11T21:55:35.100 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-11T21:55:35.147 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-11T21:55:35.410 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-11T21:55:35.437 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-11T21:55:35.466 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-toml. 2024-03-11T21:55:35.476 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-11T21:55:35.494 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-11T21:55:35.533 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-11T21:55:35.712 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-websocket. 2024-03-11T21:55:35.740 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-11T21:55:35.779 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-11T21:55:35.836 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pytest. 2024-03-11T21:55:35.864 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-11T21:55:35.902 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-11T21:55:36.091 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-11T21:55:36.118 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-11T21:55:36.157 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-11T21:55:36.297 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplejson. 2024-03-11T21:55:36.325 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-11T21:55:36.372 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-11T21:55:36.674 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-11T21:55:36.702 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-11T21:55:36.749 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-11T21:55:36.821 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-11T21:55:36.838 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:36.879 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:37.157 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-11T21:55:37.184 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-11T21:55:37.215 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-11T21:55:37.543 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-11T21:55:37.545 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package radosgw. 2024-03-11T21:55:37.571 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-11T21:55:37.573 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../116-radosgw_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:37.609 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-11T21:55:37.611 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking radosgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:37.870 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package jq. 2024-03-11T21:55:37.887 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-11T21:55:37.929 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-11T21:55:38.174 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package socat. 2024-03-11T21:55:38.202 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-11T21:55:38.239 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-11T21:55:38.535 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package xmlstarlet. 2024-03-11T21:55:38.562 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-11T21:55:38.601 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-11T21:55:38.652 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package rbd-fuse. 2024-03-11T21:55:38.679 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:38.739 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking rbd-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:39.085 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-11T21:55:39.222 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-test. 2024-03-11T21:55:39.250 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-test (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:39.345 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-11T21:55:39.462 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-11T21:55:39.706 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-11T21:55:40.047 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-11T21:55:40.469 INFO:teuthology.orchestra.run.smithi187.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-11T21:55:40.773 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:41.316 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user cephadm....done 2024-03-11T21:55:41.471 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-11T21:55:41.701 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-volume. 2024-03-11T21:55:41.729 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1607-g94a53970-1jammy_all.deb ... 2024-03-11T21:55:41.738 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-11T21:55:41.767 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-volume (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:42.007 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-11T21:55:42.054 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-11T21:55:42.071 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:42.112 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs-dev (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:42.149 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-11T21:55:42.409 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-11T21:55:42.424 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-11T21:55:42.452 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-11T21:55:42.490 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-11T21:55:42.677 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-11T21:55:42.828 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-11T21:55:42.828 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-11T21:55:42.856 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-11T21:55:42.894 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-11T21:55:43.146 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-11T21:55:43.290 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package nvme-cli. 2024-03-11T21:55:43.318 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-11T21:55:43.357 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-11T21:55:43.523 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-11T21:55:43.757 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-11T21:55:43.787 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package pkg-config. 2024-03-11T21:55:43.815 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-11T21:55:43.853 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-11T21:55:44.042 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-11T21:55:44.123 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-11T21:55:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-11T21:55:44.181 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-11T21:55:44.310 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-11T21:55:44.569 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-11T21:55:44.576 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-11T21:55:44.604 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-11T21:55:44.642 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-11T21:55:44.845 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-11T21:55:44.945 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastescript. 2024-03-11T21:55:44.973 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-11T21:55:45.011 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-11T21:55:45.097 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-argparse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:45.331 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pluggy. 2024-03-11T21:55:45.347 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-11T21:55:45.359 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-11T21:55:45.398 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-11T21:55:45.448 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-11T21:55:45.558 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-11T21:55:45.676 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-11T21:55:45.709 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-psutil. 2024-03-11T21:55:45.737 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-11T21:55:45.775 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-11T21:55:45.935 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-11T21:55:46.103 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-py. 2024-03-11T21:55:46.131 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-11T21:55:46.178 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-11T21:55:46.337 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-11T21:55:46.367 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-11T21:55:46.438 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-11T21:55:46.507 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pygments. 2024-03-11T21:55:46.535 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-11T21:55:46.564 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-11T21:55:46.573 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-11T21:55:46.949 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-11T21:55:47.044 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-11T21:55:47.049 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-11T21:55:47.072 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-11T21:55:47.110 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-11T21:55:47.318 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-11T21:55:47.413 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-toml. 2024-03-11T21:55:47.441 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-11T21:55:47.471 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-11T21:55:47.593 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-11T21:55:47.749 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pytest. 2024-03-11T21:55:47.777 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-11T21:55:47.815 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-11T21:55:47.911 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up zip (3.0-12build2) ... 2024-03-11T21:55:48.037 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-11T21:55:48.102 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplejson. 2024-03-11T21:55:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-11T21:55:48.160 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-11T21:55:48.390 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-11T21:55:48.404 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-11T21:55:48.445 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-11T21:55:48.714 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-11T21:55:48.957 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-11T21:55:49.058 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-11T21:55:49.133 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package radosgw. 2024-03-11T21:55:49.162 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../116-radosgw_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:49.176 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-11T21:55:49.191 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking radosgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:49.477 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-11T21:55:49.861 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-11T21:55:50.052 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-fuse. 2024-03-11T21:55:50.069 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1607-g94a53970-1jammy_amd64.deb ... 2024-03-11T21:55:50.110 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:50.112 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-11T21:55:50.401 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-11T21:55:50.505 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-11T21:55:50.651 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-11T21:55:50.777 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-11T21:55:50.798 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-11T21:55:51.052 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-11T21:55:51.133 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-11T21:55:51.363 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-11T21:55:51.392 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-11T21:55:51.518 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:51.775 INFO:teuthology.orchestra.run.smithi049.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-11T21:55:51.828 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-idna (3.3-1) ... 2024-03-11T21:55:51.837 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:52.145 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-11T21:55:52.296 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user cephadm....done 2024-03-11T21:55:52.451 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-11T21:55:52.770 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-11T21:55:52.995 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-11T21:55:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-11T21:55:53.326 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-11T21:55:53.356 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-11T21:55:53.586 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:55:53.599 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-11T21:55:53.720 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-11T21:55:53.725 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-11T21:55:53.979 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-11T21:55:54.035 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-11T21:55:54.447 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-11T21:55:54.573 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-11T21:55:54.587 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-11T21:55:54.838 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-11T21:55:54.883 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-11T21:55:55.115 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-11T21:55:55.142 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-11T21:55:55.375 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-11T21:55:55.402 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:55:55.511 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-11T21:55:55.626 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-11T21:55:55.804 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-11T21:55:55.885 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-11T21:55:56.063 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-11T21:55:56.145 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-argparse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:55:56.323 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-11T21:55:56.404 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-11T21:55:56.505 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-11T21:55:56.565 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-11T21:55:56.631 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-11T21:55:56.757 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-11T21:55:56.850 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-11T21:55:57.017 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-11T21:55:57.118 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-11T21:55:57.244 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-11T21:55:57.390 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-11T21:55:57.423 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-11T21:55:57.487 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-11T21:55:57.503 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-11T21:55:57.604 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-11T21:55:57.612 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-11T21:55:57.888 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-11T21:55:57.980 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-11T21:55:58.106 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-11T21:55:58.181 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-11T21:55:58.432 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-11T21:55:58.449 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-11T21:55:58.550 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-11T21:55:58.676 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-11T21:55:58.708 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-11T21:55:58.973 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-11T21:55:59.019 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-11T21:55:59.026 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up zip (3.0-12build2) ... 2024-03-11T21:55:59.129 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-11T21:55:59.153 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-11T21:55:59.497 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-11T21:55:59.739 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-11T21:55:59.855 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-11T21:55:59.865 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-11T21:56:00.105 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-11T21:56:00.142 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:56:00.206 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-11T21:56:00.268 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-11T21:56:00.316 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-11T21:56:00.602 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-11T21:56:00.610 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-11T21:56:00.895 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-11T21:56:01.002 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-11T21:56:01.154 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-11T21:56:01.261 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-11T21:56:01.280 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-11T21:56:01.564 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-11T21:56:01.654 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-11T21:56:01.824 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-11T21:56:01.947 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-11T21:56:02.194 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-11T21:56:02.299 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-11T21:56:02.533 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-11T21:56:02.587 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-11T21:56:02.701 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:02.872 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-11T21:56:03.002 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-idna (3.3-1) ... 2024-03-11T21:56:03.249 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-11T21:56:03.328 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-11T21:56:03.384 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librados2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:03.510 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:03.636 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-11T21:56:03.972 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:04.081 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libradosstriper1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:04.182 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-11T21:56:04.451 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librbd1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:04.568 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-modules-core (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:04.642 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-11T21:56:04.694 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:04.908 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-11T21:56:04.908 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-11T21:56:05.019 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:56:05.153 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-11T21:56:05.371 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs-dev (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:05.413 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-11T21:56:05.496 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rados (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:05.514 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-11T21:56:05.622 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librgw2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:05.648 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-11T21:56:05.748 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-11T21:56:05.958 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-11T21:56:06.217 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-11T21:56:06.468 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:56:06.595 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-11T21:56:06.921 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-11T21:56:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rbd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:07.061 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up rbd-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:07.172 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-11T21:56:07.187 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:07.313 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cephfs (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:07.423 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:07.423 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-11T21:56:07.666 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-11T21:56:07.907 INFO:teuthology.orchestra.run.smithi187.stdout:Adding group ceph....done 2024-03-11T21:56:07.917 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-11T21:56:08.193 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-11T21:56:08.301 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user ceph....done 2024-03-11T21:56:08.319 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-11T21:56:08.460 INFO:teuthology.orchestra.run.smithi187.stdout:Setting system user ceph properties....done 2024-03-11T21:56:08.474 INFO:teuthology.orchestra.run.smithi187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-11T21:56:08.604 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-11T21:56:08.609 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-11T21:56:08.730 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-11T21:56:08.906 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-11T21:56:09.026 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-11T21:56:09.341 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-11T21:56:09.365 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-test (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:09.508 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up radosgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:09.583 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-11T21:56:09.718 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-11T21:56:09.843 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-11T21:56:09.941 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-11T21:56:09.972 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-11T21:56:09.972 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-11T21:56:10.220 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-11T21:56:10.346 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-11T21:56:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-base (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:10.756 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-11T21:56:10.759 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-11T21:56:11.007 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-11T21:56:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-11T21:56:11.246 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mds (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:11.393 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-11T21:56:11.468 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-11T21:56:11.468 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-11T21:56:11.519 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-11T21:56:11.837 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-11T21:56:11.939 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:12.141 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-11T21:56:12.141 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-11T21:56:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-11T21:56:12.430 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-11T21:56:12.548 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-11T21:56:12.598 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-osd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:12.824 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-11T21:56:12.867 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-11T21:56:12.867 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-11T21:56:13.117 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-11T21:56:13.350 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:13.471 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-11T21:56:13.476 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:13.635 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mon (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:13.830 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-11T21:56:13.831 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-11T21:56:13.855 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-11T21:56:14.132 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-11T21:56:14.278 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:14.421 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:14.476 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-11T21:56:14.530 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-dashboard (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:14.602 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librados2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:14.656 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-volume (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:14.728 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:14.863 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-11T21:56:15.149 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libradosstriper1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:15.401 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-11T21:56:15.589 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-11T21:56:15.678 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librbd1 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:15.748 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-11T21:56:15.813 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-modules-core (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:15.922 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:15.926 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-11T21:56:16.123 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-11T21:56:16.123 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-11T21:56:16.624 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs-dev (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:16.750 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rados (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:16.884 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librgw2 (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:17.011 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-11T21:56:17.187 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-11T21:56:17.873 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-11T21:56:17.880 DEBUG:teuthology.parallel:result is None 2024-03-11T21:56:18.282 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rbd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:18.400 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-fuse (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:18.526 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cephfs (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-common (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout:Adding group ceph....done 2024-03-11T21:56:19.706 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user ceph....done 2024-03-11T21:56:19.919 INFO:teuthology.orchestra.run.smithi049.stdout:Setting system user ceph properties....done 2024-03-11T21:56:19.938 INFO:teuthology.orchestra.run.smithi049.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-11T21:56:20.092 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-11T21:56:20.437 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-11T21:56:20.888 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-test (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:21.013 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up radosgw (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:21.471 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-11T21:56:21.471 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-11T21:56:21.924 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-base (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:22.274 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-11T21:56:22.750 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mds (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:22.989 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-11T21:56:22.990 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-11T21:56:23.444 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-11T21:56:23.671 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-11T21:56:24.162 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-osd (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:24.426 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-11T21:56:24.426 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-11T21:56:24.888 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:24.989 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:25.149 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mon (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:25.359 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-11T21:56:25.359 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-11T21:56:25.847 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-cephadm (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:25.998 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:26.124 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-dashboard (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:26.250 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-volume (19.0.0-1607-g94a53970-1jammy) ... 2024-03-11T21:56:26.586 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-11T21:56:26.687 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-11T21:56:26.842 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-11T21:56:27.965 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-11T21:56:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-11T21:56:28.640 DEBUG:teuthology.parallel:result is None 2024-03-11T21:56:28.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:56:28.798 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-query -W -f '${Version}' ceph 2024-03-11T21:56:28.818 INFO:teuthology.orchestra.run.smithi049.stdout:19.0.0-1607-g94a53970-1jammy 2024-03-11T21:56:28.818 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1607-g94a53970-1jammy 2024-03-11T21:56:28.819 INFO:teuthology.task.install:The correct ceph version 19.0.0-1607-g94a53970-1jammy is installed. 2024-03-11T21:56:28.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:56:29.518 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-query -W -f '${Version}' ceph 2024-03-11T21:56:29.538 INFO:teuthology.orchestra.run.smithi187.stdout:19.0.0-1607-g94a53970-1jammy 2024-03-11T21:56:29.538 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1607-g94a53970-1jammy 2024-03-11T21:56:29.538 INFO:teuthology.task.install:The correct ceph version 19.0.0-1607-g94a53970-1jammy is installed. 2024-03-11T21:56:29.540 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-11T21:56:29.541 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:56:29.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-11T21:56:29.555 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:56:29.555 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-11T21:56:29.595 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-11T21:56:29.595 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:56:29.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-03-11T21:56:29.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-11T21:56:29.667 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:56:29.667 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-03-11T21:56:29.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-11T21:56:29.733 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-11T21:56:29.733 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:56:29.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-11T21:56:29.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-11T21:56:29.802 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:56:29.802 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-11T21:56:29.815 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-11T21:56:29.869 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-11T21:56:29.869 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:56:29.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-03-11T21:56:29.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-11T21:56:29.940 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:56:29.940 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-03-11T21:56:29.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-11T21:56:30.010 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-11T21:56:30.114 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'mon_bind_msgr2': False, 'sha1': '94a539707733325322964c6a187c6a1b41be1daf', 'cephadm_mode': 'cephadm-package'} 2024-03-11T21:56:30.114 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:56:30.114 INFO:tasks.cephadm:Cluster fsid is 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:56:30.114 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-11T21:56:30.114 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.49:6789]', 'mon.c': '[v1:172.21.15.49:6790]', 'mon.b': '[v1:172.21.15.187:6789]'} 2024-03-11T21:56:30.115 INFO:tasks.cephadm:First mon is mon.a on smithi049 2024-03-11T21:56:30.115 INFO:tasks.cephadm:First mgr is y 2024-03-11T21:56:30.115 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-11T21:56:30.115 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2024-03-11T21:56:30.130 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname $(hostname -s) 2024-03-11T21:56:30.154 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf on all hosts... 2024-03-11T21:56:30.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf pull 2024-03-11T21:56:30.176 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf pull 2024-03-11T21:56:30.342 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf... 2024-03-11T21:56:30.350 INFO:teuthology.orchestra.run.smithi187.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf... 2024-03-11T21:57:42.696 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-03-11T21:57:42.697 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev)", 2024-03-11T21:57:42.697 INFO:teuthology.orchestra.run.smithi187.stdout: "image_id": "a6477a474d71b439ad6caa1ffdec0c8e4b844b029f7201a2e5a0a3cf1e1a739e", 2024-03-11T21:57:42.697 INFO:teuthology.orchestra.run.smithi187.stdout: "repo_digests": [ 2024-03-11T21:57:42.697 INFO:teuthology.orchestra.run.smithi187.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bbe755e768640cafd345af8384e9f3b099ff2fb85ebf0601e0883dbf412b887b" 2024-03-11T21:57:42.697 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-03-11T21:57:42.697 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-03-11T21:57:47.381 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-11T21:57:47.381 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev)", 2024-03-11T21:57:47.381 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "a6477a474d71b439ad6caa1ffdec0c8e4b844b029f7201a2e5a0a3cf1e1a739e", 2024-03-11T21:57:47.381 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2024-03-11T21:57:47.382 INFO:teuthology.orchestra.run.smithi049.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bbe755e768640cafd345af8384e9f3b099ff2fb85ebf0601e0883dbf412b887b" 2024-03-11T21:57:47.382 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-11T21:57:47.382 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-11T21:57:47.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2024-03-11T21:57:47.430 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph 2024-03-11T21:57:47.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2024-03-11T21:57:47.485 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /etc/ceph 2024-03-11T21:57:47.500 INFO:tasks.cephadm:Writing seed config... 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [global] ms type = async 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-03-11T21:57:47.502 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-11T21:57:47.503 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-11T21:57:47.503 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-03-11T21:57:47.503 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-03-11T21:57:47.503 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-11T21:57:47.503 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:57:47.503 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-11T21:57:47.534 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 377df5b0-dff2-11ee-95c8-87774f69a715 mon election default strategy = 1 ms bind msgr2 = False ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-03-11T21:57:47.534 DEBUG:teuthology.orchestra.run.smithi049:mon.a> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a.service 2024-03-11T21:57:47.583 DEBUG:teuthology.orchestra.run.smithi049:mgr.y> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.y.service 2024-03-11T21:57:47.626 INFO:tasks.cephadm:Bootstrapping... 2024-03-11T21:57:47.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf -v bootstrap --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.49:6789]' --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-11T21:57:47.837 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-03-11T21:57:47.837 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf', '-v', 'bootstrap', '--fsid', '377df5b0-dff2-11ee-95c8-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-addrv', '[v1:172.21.15.49:6789]', '--skip-admin-label'] 2024-03-11T21:57:47.838 INFO:teuthology.orchestra.run.smithi049.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-11T21:57:47.838 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying podman|docker is present... 2024-03-11T21:57:47.838 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying lvm2 is present... 2024-03-11T21:57:47.838 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying time synchronization is in place... 2024-03-11T21:57:47.845 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-11T21:57:47.845 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-11T21:57:47.850 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-11T21:57:47.850 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.854 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-03-11T21:57:47.854 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-03-11T21:57:47.858 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-03-11T21:57:47.858 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.862 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-03-11T21:57:47.862 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout masked 2024-03-11T21:57:47.865 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-03-11T21:57:47.866 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.869 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-03-11T21:57:47.869 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-03-11T21:57:47.873 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-03-11T21:57:47.873 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.877 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-03-11T21:57:47.883 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-03-11T21:57:47.883 INFO:teuthology.orchestra.run.smithi049.stdout:Unit ntp.service is enabled and running 2024-03-11T21:57:47.883 INFO:teuthology.orchestra.run.smithi049.stdout:Repeating the final host check... 2024-03-11T21:57:47.883 INFO:teuthology.orchestra.run.smithi049.stdout:docker (/usr/bin/docker) is present 2024-03-11T21:57:47.883 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl is present 2024-03-11T21:57:47.883 INFO:teuthology.orchestra.run.smithi049.stdout:lvcreate is present 2024-03-11T21:57:47.886 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-11T21:57:47.886 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-11T21:57:47.890 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-11T21:57:47.890 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.893 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-03-11T21:57:47.893 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-03-11T21:57:47.897 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-03-11T21:57:47.897 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.900 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-03-11T21:57:47.900 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout masked 2024-03-11T21:57:47.904 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-03-11T21:57:47.904 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.907 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-03-11T21:57:47.907 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-03-11T21:57:47.911 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-03-11T21:57:47.911 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-03-11T21:57:47.915 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-03-11T21:57:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-03-11T21:57:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:Unit ntp.service is enabled and running 2024-03-11T21:57:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:Host looks OK 2024-03-11T21:57:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:Cluster fsid: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:57:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:Acquiring lock 139623641149120 on /run/cephadm/377df5b0-dff2-11ee-95c8-87774f69a715.lock 2024-03-11T21:57:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:Lock 139623641149120 acquired on /run/cephadm/377df5b0-dff2-11ee-95c8-87774f69a715.lock 2024-03-11T21:57:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 6789 ... 2024-03-11T21:57:47.920 INFO:teuthology.orchestra.run.smithi049.stdout:Base mon IP(s) is [172.21.15.49:6789], mon addrv is [v1:172.21.15.49:6789] 2024-03-11T21:57:47.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-03-11T21:57:47.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-03-11T21:57:47.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.49 2024-03-11T21:57:47.924 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-11T21:57:47.924 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-03-11T21:57:47.925 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1790sec hoplimit 64 pref medium 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-03-11T21:57:47.927 INFO:teuthology.orchestra.run.smithi049.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20'] 2024-03-11T21:57:47.928 INFO:teuthology.orchestra.run.smithi049.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-11T21:57:47.928 INFO:teuthology.orchestra.run.smithi049.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf... 2024-03-11T21:57:48.274 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/docker: stdout 94a539707733325322964c6a187c6a1b41be1daf: Pulling from ceph-ci/ceph 2024-03-11T21:57:48.275 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/docker: stdout Digest: sha256:bbe755e768640cafd345af8384e9f3b099ff2fb85ebf0601e0883dbf412b887b 2024-03-11T21:57:48.275 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:57:48.275 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf 2024-03-11T21:57:49.667 INFO:teuthology.orchestra.run.smithi049.stdout:ceph: stdout ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev) 2024-03-11T21:57:49.668 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph version: ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev) 2024-03-11T21:57:49.668 INFO:teuthology.orchestra.run.smithi049.stdout:Extracting ceph user uid/gid from container image... 2024-03-11T21:57:50.990 INFO:teuthology.orchestra.run.smithi049.stdout:stat: stdout 167 167 2024-03-11T21:57:50.990 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial keys... 2024-03-11T21:57:52.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQBffu9l4X4TKRAAIz0urgA3TMcKvT8u2HhQPw== 2024-03-11T21:57:53.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQBgfu9lDY8vORAA1ttOt1gJ8HjLHQldZn0L1w== 2024-03-11T21:57:54.837 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQBifu9lVOgZDhAAqDC4rSamODmjaug5l2I0Ug== 2024-03-11T21:57:54.839 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial monmap... 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool for a [v1:172.21.15.49:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = quincy 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: set fsid to 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:57:56.133 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mon... 2024-03-11T21:57:57.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-11T21:57:57.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 1 imported monmap: 2024-03-11T21:57:57.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-03-11T21:57:57.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr fsid 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:57:57.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-03-11T21:57:55.591787+0000 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr created 2024-03-11T21:57:55.591787+0000 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 0: v1:172.21.15.49:6789/0 mon.a 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 0 /usr/bin/ceph-mon: set fsid to 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: RocksDB version: 7.9.2 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Git sha 0 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Compile date 2024-03-08 02:48:09 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: DB SUMMARY 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: DB Session ID: A7OUE0QKCHZZY9Q9ID8E 2024-03-11T21:57:57.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.error_if_exists: 0 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.create_if_missing: 1 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.paranoid_checks: 1 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.env: 0x55ed963c8ae0 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.info_log: 0x55ed980e4b20 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-11T21:57:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.statistics: (nil) 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.use_fsync: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.max_log_file_size: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.allow_fallocate: 1 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.use_direct_reads: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.db_log_dir: 2024-03-11T21:57:57.463 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.wal_dir: 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.834+0000 7f9d1122ec80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.write_buffer_manager: 0x55ed980b9360 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-11T21:57:57.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.unordered_write: 0 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.row_cache: None 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.wal_filter: None 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.two_write_queues: 0 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-11T21:57:57.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.wal_compression: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.atomic_flush: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.log_readahead_size: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_background_jobs: 2 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_background_compactions: -1 2024-03-11T21:57:57.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_subcompactions: 1 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_open_files: -1 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_background_flushes: -1 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Compression algorithms supported: 2024-03-11T21:57:57.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kZSTD supported: 0 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kXpressCompression supported: 0 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kZlibCompression supported: 1 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kSnappyCompression supported: 1 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kLZ4Compression supported: 1 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: kBZip2Compression supported: 0 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-11T21:57:57.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.merge_operator: 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_filter: None 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ed980e4c40) 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-03-11T21:57:57.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x55ed980e9090 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-03-11T21:57:57.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-03-11T21:57:57.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression: NoCompression 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.num_levels: 7 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-11T21:57:57.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-11T21:57:57.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-11T21:57:57.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-11T21:57:57.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.table_properties_collectors: 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.inplace_update_support: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.bloom_locality: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.max_successive_merges: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-11T21:57:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.ttl: 2592000 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.enable_blob_files: false 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.min_blob_size: 0 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-11T21:57:57.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 40381d7b-8c33-4691-a5c4-dcf3057eeae6 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ed981b4000 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d1122ec80 4 rocksdb: DB pointer 0x55ed981a4000 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d013a6700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.838+0000 7f9d013a6700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T21:57:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x55ed980e9090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr 2024-03-11T21:57:57.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.842+0000 7f9d1122ec80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-03-11T21:57:57.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.842+0000 7f9d1122ec80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-03-11T21:57:57.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-11T21:57:56.842+0000 7f9d1122ec80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-03-11T21:57:57.481 INFO:teuthology.orchestra.run.smithi049.stdout:create mon.a on 2024-03-11T21:57:57.709 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-03-11T21:57:57.904 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-03-11T21:57:58.121 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-377df5b0-dff2-11ee-95c8-87774f69a715.target -> /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715.target. 2024-03-11T21:57:58.121 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-377df5b0-dff2-11ee-95c8-87774f69a715.target -> /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715.target. 2024-03-11T21:57:58.408 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a 2024-03-11T21:57:58.408 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a.service: Unit ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a.service not loaded. 2024-03-11T21:57:58.600 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715.target.wants/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a.service -> /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service. 2024-03-11T21:57:58.609 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld does not appear to be present 2024-03-11T21:57:58.609 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-03-11T21:57:58.609 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon to start... 2024-03-11T21:57:58.609 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon... 2024-03-11T21:58:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:57:59 smithi049 bash[20946]: cluster 2024-03-11T21:57:59.857530+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-03-11T21:58:00.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout cluster: 2024-03-11T21:58:00.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout id: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:58:00.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-11T21:58:00.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:00.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout services: 2024-03-11T21:58:00.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.158624s) 2024-03-11T21:58:00.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout data: 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pgs: 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f5797456700 1 Processor -- start 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f5797456700 1 -- start start 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f5797456700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5790108e20 con 0x7f57901049f0 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f57951f2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f57901049f0 0x7f5790104e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60910/0 (socket says 172.21.15.49:60910) 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f57951f2700 1 -- 172.21.15.49:0/3397194037 learned_addr learned my addr 172.21.15.49:0/3397194037 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:00.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f578ffff700 1 -- 172.21.15.49:0/3397194037 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780749444 0 0) 0x7f5790108e20 con 0x7f57901049f0 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f578ffff700 1 -- 172.21.15.49:0/3397194037 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57780057c0 con 0x7f57901049f0 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f578ffff700 1 -- 172.21.15.49:0/3397194037 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007503125 0 0) 0x7f57780057c0 con 0x7f57901049f0 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f578ffff700 1 -- 172.21.15.49:0/3397194037 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790109fc0 con 0x7f57901049f0 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f578ffff700 1 -- 172.21.15.49:0/3397194037 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5780001900 con 0x7f57901049f0 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f578ffff700 1 -- 172.21.15.49:0/3397194037 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5780001b20 con 0x7f57901049f0 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.890+0000 7f578ffff700 1 -- 172.21.15.49:0/3397194037 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5780001e60 con 0x7f57901049f0 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/3397194037 >> v1:172.21.15.49:6789/0 conn(0x7f57901049f0 legacy=0x7f5790104e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/3397194037 shutdown_connections 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/3397194037 >> 172.21.15.49:0/3397194037 conn(0x7f57900fff70 msgr2=0x7f57901023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/3397194037 shutdown_connections 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/3397194037 wait complete. 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 Processor -- start 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- start start 2024-03-11T21:58:00.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f579019b530 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f57951f2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f57901049f0 0x7f579019ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60918/0 (socket says 172.21.15.49:60918) 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f57951f2700 1 -- 172.21.15.49:0/1400970528 learned_addr learned my addr 172.21.15.49:0/1400970528 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152693869 0 0) 0x7f579019b530 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5778006090 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 868585139 0 0) 0x7f5778006090 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f579019b530 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5780001800 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1037063187 0 0) 0x7f579019b530 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579019b6c0 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579019b970 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f579019f4c0 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5780004ea0 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f57800051a0 con 0x7f57901049f0 2024-03-11T21:58:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f5780005690 con 0x7f57901049f0 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f5780006cd0 con 0x7f57901049f0 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.894+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c005150 con 0x7f57901049f0 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:57:59.898+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f5780005b70 con 0x7f57901049f0 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:00.034+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f577c005c10 con 0x7f57901049f0 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:00.034+0000 7f578e7fc700 1 -- 172.21.15.49:0/1400970528 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (unknown 1155462804 0 4121169637) 0x7f5780005d10 con 0x7f57901049f0 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:00.038+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 >> v1:172.21.15.49:6789/0 conn(0x7f57901049f0 legacy=0x7f579019ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:00.038+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 shutdown_connections 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:00.038+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 >> 172.21.15.49:0/1400970528 conn(0x7f57900fff70 msgr2=0x7f57901023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:00.038+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 shutdown_connections 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:00.038+0000 7f5797456700 1 -- 172.21.15.49:0/1400970528 wait complete. 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:mon is available 2024-03-11T21:58:00.549 INFO:teuthology.orchestra.run.smithi049.stdout:Assimilating anything we can from ceph.conf... 2024-03-11T21:58:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:00 smithi049 bash[20946]: cluster 2024-03-11T21:57:59.881663+0000 mon.a (mon.0) 2 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-03-11T21:58:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:00 smithi049 bash[20946]: cluster 2024-03-11T21:57:59.881889+0000 mon.a (mon.0) 3 : cluster 0 monmap e1: 1 mons at {a=v1:172.21.15.49:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T21:58:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:00 smithi049 bash[20946]: cluster 2024-03-11T21:57:59.884928+0000 mon.a (mon.0) 4 : cluster 0 fsmap 2024-03-11T21:58:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:00 smithi049 bash[20946]: cluster 2024-03-11T21:57:59.888334+0000 mon.a (mon.0) 5 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-03-11T21:58:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:00 smithi049 bash[20946]: cluster 2024-03-11T21:57:59.888988+0000 mon.a (mon.0) 6 : cluster 0 mgrmap e1: no daemons active 2024-03-11T21:58:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:00 smithi049 bash[20946]: audit 2024-03-11T21:58:00.040228+0000 mon.a (mon.0) 7 : audit 0 from='client.? v1:172.21.15.49:0/1400970528' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_host = [v1:172.21.15.49:6789] 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-11T21:58:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f621c555700 1 Processor -- start 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f621c555700 1 -- start start 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f621c555700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6214079760 con 0x7f6214104350 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f621a2f1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6214104350 0x7f6214106780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60928/0 (socket says 172.21.15.49:60928) 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f621a2f1700 1 -- 172.21.15.49:0/1395004545 learned_addr learned my addr 172.21.15.49:0/1395004545 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f62192ef700 1 -- 172.21.15.49:0/1395004545 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549238780 0 0) 0x7f6214079760 con 0x7f6214104350 2024-03-11T21:58:01.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f62192ef700 1 -- 172.21.15.49:0/1395004545 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62000035b0 con 0x7f6214104350 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f62192ef700 1 -- 172.21.15.49:0/1395004545 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 29007536 0 0) 0x7f62000035b0 con 0x7f6214104350 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f62192ef700 1 -- 172.21.15.49:0/1395004545 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214108eb0 con 0x7f6214104350 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f62192ef700 1 -- 172.21.15.49:0/1395004545 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f6210001900 con 0x7f6214104350 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f62192ef700 1 -- 172.21.15.49:0/1395004545 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6210001b90 con 0x7f6214104350 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.286+0000 7f62192ef700 1 -- 172.21.15.49:0/1395004545 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f6210001ed0 con 0x7f6214104350 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/1395004545 >> v1:172.21.15.49:6789/0 conn(0x7f6214104350 legacy=0x7f6214106780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/1395004545 shutdown_connections 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/1395004545 >> 172.21.15.49:0/1395004545 conn(0x7f62140fff70 msgr2=0x7f62141023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/1395004545 shutdown_connections 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/1395004545 wait complete. 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 Processor -- start 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- start start 2024-03-11T21:58:01.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f621419f9b0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621a2f1700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6214104350 0x7f621419f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60932/0 (socket says 172.21.15.49:60932) 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621a2f1700 1 -- 172.21.15.49:0/332062814 learned_addr learned my addr 172.21.15.49:0/332062814 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721053510 0 0) 0x7f621419f9b0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62000031f0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1561936389 0 0) 0x7f62000031f0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f621419f9b0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f62100018c0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1443144666 0 0) 0x7f621419f9b0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621419fb40 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621419fdf0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f62141a3940 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6210004ea0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f62100051a0 con 0x7f6214104350 2024-03-11T21:58:01.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f6210005710 con 0x7f6214104350 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f6210006db0 con 0x7f6214104350 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.290+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f8005150 con 0x7f6214104350 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.294+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f6210005c00 con 0x7f6214104350 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.426+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f61f8005980 con 0x7f6214104350 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.430+0000 7f620b7fe700 1 -- 172.21.15.49:0/332062814 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+317 (unknown 1213389831 0 3699995643) 0x7f6210005eb0 con 0x7f6214104350 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.430+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 >> v1:172.21.15.49:6789/0 conn(0x7f6214104350 legacy=0x7f621419f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.430+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 shutdown_connections 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.430+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 >> 172.21.15.49:0/332062814 conn(0x7f62140fff70 msgr2=0x7f6214102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.430+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 shutdown_connections 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:01.430+0000 7f621c555700 1 -- 172.21.15.49:0/332062814 wait complete. 2024-03-11T21:58:01.972 INFO:teuthology.orchestra.run.smithi049.stdout:Generating new minimal ceph.conf... 2024-03-11T21:58:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:01 smithi049 bash[20946]: audit 2024-03-11T21:58:01.429675+0000 mon.a (mon.0) 8 : audit 1 from='client.? v1:172.21.15.49:0/332062814' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-11T21:58:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:01 smithi049 bash[20946]: audit 2024-03-11T21:58:01.433582+0000 mon.a (mon.0) 9 : audit 1 from='client.? v1:172.21.15.49:0/332062814' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-11T21:58:03.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:03 smithi049 bash[20946]: audit 2024-03-11T21:58:02.952647+0000 mon.a (mon.0) 10 : audit 0 from='client.? v1:172.21.15.49:0/3763975374' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T21:58:03.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 Processor -- start 2024-03-11T21:58:03.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- start start 2024-03-11T21:58:03.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f180c07e5a0 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f180c07c110 0x7f180c07c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60938/0 (socket says 172.21.15.49:60938) 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180b7fe700 1 -- 172.21.15.49:0/16397823 learned_addr learned my addr 172.21.15.49:0/16397823 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180a7fc700 1 -- 172.21.15.49:0/16397823 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063928451 0 0) 0x7f180c07e5a0 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180a7fc700 1 -- 172.21.15.49:0/16397823 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f00035b0 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180a7fc700 1 -- 172.21.15.49:0/16397823 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3179866510 0 0) 0x7f17f00035b0 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180a7fc700 1 -- 172.21.15.49:0/16397823 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c07f740 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180a7fc700 1 -- 172.21.15.49:0/16397823 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f17fc001580 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180a7fc700 1 -- 172.21.15.49:0/16397823 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f17fc001c10 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180a7fc700 1 -- 172.21.15.49:0/16397823 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f17fc0057b0 con 0x7f180c07c110 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- 172.21.15.49:0/16397823 >> v1:172.21.15.49:6789/0 conn(0x7f180c07c110 legacy=0x7f180c07c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- 172.21.15.49:0/16397823 shutdown_connections 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- 172.21.15.49:0/16397823 >> 172.21.15.49:0/16397823 conn(0x7f180c07b0e0 msgr2=0x7f180c105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:03.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- 172.21.15.49:0/16397823 shutdown_connections 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- 172.21.15.49:0/16397823 wait complete. 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 Processor -- start 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- start start 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f1811ac1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f180c1a0160 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f180c07c110 0x7f180c19fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60942/0 (socket says 172.21.15.49:60942) 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.814+0000 7f180b7fe700 1 -- 172.21.15.49:0/3763975374 learned_addr learned my addr 172.21.15.49:0/3763975374 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711545814 0 0) 0x7f180c1a0160 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f0005540 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4190282187 0 0) 0x7f17f0005540 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f180c1a0160 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f17fc001080 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3459153329 0 0) 0x7f180c1a0160 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c1a02f0 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c1a05a0 con 0x7f180c07c110 2024-03-11T21:58:03.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c1a40f0 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f17fc0049d0 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f17fc0014e0 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f17fc006390 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f17fc0079c0 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.818+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f4005150 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.822+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f17fc004e70 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.946+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f17f4005400 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.946+0000 7f1808ff9700 1 -- 172.21.15.49:0/3763975374 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+147 (unknown 1452402520 0 697088251) 0x7f17fc005b10 con 0x7f180c07c110 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.950+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 >> v1:172.21.15.49:6789/0 conn(0x7f180c07c110 legacy=0x7f180c19fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.950+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 shutdown_connections 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.950+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 >> 172.21.15.49:0/3763975374 conn(0x7f180c07b0e0 msgr2=0x7f180c1062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.950+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 shutdown_connections 2024-03-11T21:58:03.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:02.950+0000 7f1811ac1700 1 -- 172.21.15.49:0/3763975374 wait complete. 2024-03-11T21:58:03.483 INFO:teuthology.orchestra.run.smithi049.stdout:Restarting the monitor... 2024-03-11T21:58:03.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:03 smithi049 systemd[1]: Stopping Ceph mon.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T21:58:03.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:03 smithi049 bash[20946]: debug 2024-03-11T21:58:03.622+0000 7ff692ba0700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-11T21:58:03.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:03 smithi049 bash[20946]: debug 2024-03-11T21:58:03.622+0000 7ff692ba0700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-11T21:58:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-11T21:58:04.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:04 smithi049 bash[21329]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-mon-a 2024-03-11T21:58:04.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:04 smithi049 bash[21392]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-mon-a 2024-03-11T21:58:04.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:04 smithi049 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-11T21:58:04.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:04 smithi049 systemd[1]: Stopped Ceph mon.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T21:58:04.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:04 smithi049 systemd[1]: Started Ceph mon.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T21:58:05.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.534+0000 7ffa944f6c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.534+0000 7ffa944f6c80 0 ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev), process ceph-mon, pid 7 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.534+0000 7ffa944f6c80 0 pidfile_write: ignore empty --pid-file 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 0 load: jerasure load: lrc 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: RocksDB version: 7.9.2 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Git sha 0 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Compile date 2024-03-08 02:48:09 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: DB SUMMARY 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: DB Session ID: F8CMO9M3Y56WYWAMLJDZ 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: CURRENT file: CURRENT 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: IDENTITY file: IDENTITY 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-11T21:58:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 85532 ; 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.error_if_exists: 0 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.create_if_missing: 0 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.paranoid_checks: 1 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.env: 0x557f5a43dae0 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.info_log: 0x557f5bfe9940 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.statistics: (nil) 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.use_fsync: 0 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_log_file_size: 0 2024-03-11T21:58:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.allow_fallocate: 1 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.use_direct_reads: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.db_log_dir: 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.wal_dir: 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-11T21:58:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.write_buffer_manager: 0x557f5bfbd400 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-11T21:58:05.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.unordered_write: 0 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.row_cache: None 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.wal_filter: None 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-11T21:58:05.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.two_write_queues: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.wal_compression: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.atomic_flush: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.log_readahead_size: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-11T21:58:05.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_background_jobs: 2 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_background_compactions: -1 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_subcompactions: 1 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_open_files: -1 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-11T21:58:05.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_background_flushes: -1 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Compression algorithms supported: 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kZSTD supported: 0 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kXpressCompression supported: 0 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kZlibCompression supported: 1 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kSnappyCompression supported: 1 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kLZ4Compression supported: 1 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: kBZip2Compression supported: 0 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-11T21:58:05.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.merge_operator: 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_filter: None 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557f5bfe9a40) 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: cache_index_and_filter_blocks: 1 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: pin_top_level_index_and_filter: 1 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: index_type: 0 2024-03-11T21:58:05.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: data_block_index_type: 0 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: index_shortening: 1 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: data_block_hash_table_util_ratio: 0.750000 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: checksum: 4 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: no_block_cache: 0 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_cache: 0x557f5bfeb090 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_cache_name: BinnedLRUCache 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_cache_options: 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: capacity : 536870912 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: num_shard_bits : 4 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: strict_capacity_limit : 0 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: high_pri_pool_ratio: 0.000 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_cache_compressed: (nil) 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: persistent_cache: (nil) 2024-03-11T21:58:05.781 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_size: 4096 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_size_deviation: 10 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_restart_interval: 16 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: index_block_restart_interval: 1 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: metadata_block_size: 4096 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: partition_filters: 0 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: use_delta_encoding: 1 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: filter_policy: bloomfilter 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: whole_key_filtering: 1 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: verify_compression: 0 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: read_amp_bytes_per_bit: 0 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: format_version: 5 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: enable_index_compression: 1 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: block_align: 0 2024-03-11T21:58:05.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: max_auto_readahead_size: 262144 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: prepopulate_block_cache: 0 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: initial_auto_readahead_size: 8192 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: num_file_reads_for_auto_readahead: 2 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression: NoCompression 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.num_levels: 7 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-11T21:58:05.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-11T21:58:05.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-11T21:58:05.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-11T21:58:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.table_properties_collectors: 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.inplace_update_support: 0 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.bloom_locality: 0 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.max_successive_merges: 0 2024-03-11T21:58:05.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.ttl: 2592000 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.enable_blob_files: false 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.min_blob_size: 0 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-11T21:58:05.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.538+0000 7ffa944f6c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 40381d7b-8c33-4691-a5c4-dcf3057eeae6 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194285549313, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194285550320, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81866, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 264, "table_properties": {"data_size": 80065, "index_size": 211, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10703, "raw_average_key_size": 47, "raw_value_size": 74040, "raw_average_value_size": 332, "num_data_blocks": 10, "num_entries": 223, "num_filter_entries": 223, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710194285, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "40381d7b-8c33-4691-a5c4-dcf3057eeae6", "db_session_id": "F8CMO9M3Y56WYWAMLJDZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194285550431, "job": 1, "event": "recovery_finished"} 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557f5c0e0000 2024-03-11T21:58:05.789 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 4 rocksdb: DB pointer 0x557f5c0ca000 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.546+0000 7ffa944f6c80 0 starting mon.a rank 0 at public addrs v1:172.21.15.49:6789/0 at bind addrs v1:172.21.15.49:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa82c66700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa82c66700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: ** DB Stats ** 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: ** Compaction Stats [default] ** 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T21:58:05.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: L0 2/0 81.75 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Sum 2/0 81.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: ** Compaction Stats [default] ** 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: AddFile(Total Files): cumulative 0, interval 0 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-11T21:58:05.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: AddFile(Keys): cumulative 0, interval 0 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Cumulative compaction: 0.00 GB write, 9.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Interval compaction: 0.00 GB write, 9.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Block cache BinnedLRUCache@0x557f5bfeb090#7 capacity: 512.00 MB usage: 26.66 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: Block cache entry stats(count,size,portion): DataBlock(3,25.48 KB,0.00486076%) FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: ** File Read Latency Histogram By Level [default] ** 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 1 mon.a@-1(???) e1 preinit fsid 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 0 mon.a@-1(???).mds e1 new map 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 0 mon.a@-1(???).mds e1 print_map 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: e1 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: legacy client fscid: -1 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: 2024-03-11T21:58:05.792 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: No filesystems configured 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: debug 2024-03-11T21:58:05.550+0000 7ffa944f6c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: cluster 2024-03-11T21:58:05.573482+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: cluster 2024-03-11T21:58:05.573547+0000 mon.a (mon.0) 2 : cluster 0 monmap e1: 1 mons at {a=v1:172.21.15.49:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: cluster 2024-03-11T21:58:05.573949+0000 mon.a (mon.0) 3 : cluster 0 fsmap 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: cluster 2024-03-11T21:58:05.573972+0000 mon.a (mon.0) 4 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-03-11T21:58:05.793 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:05 smithi049 bash[21434]: cluster 2024-03-11T21:58:05.574319+0000 mon.a (mon.0) 5 : cluster 0 mgrmap e1: no daemons active 2024-03-11T21:58:06.378 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.626+0000 7f9b789d4700 1 Processor -- start 2024-03-11T21:58:06.378 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.626+0000 7f9b789d4700 1 -- start start 2024-03-11T21:58:06.378 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.626+0000 7f9b789d4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9b74109fb0 con 0x7f9b74103df0 2024-03-11T21:58:06.378 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.626+0000 7f9b7259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9b74103df0 0x7f9b74104210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41294/0 (socket says 172.21.15.49:41294) 2024-03-11T21:58:06.378 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.626+0000 7f9b7259c700 1 -- 172.21.15.49:0/2895550451 learned_addr learned my addr 172.21.15.49:0/2895550451 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:06.378 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.626+0000 7f9b7159a700 1 -- 172.21.15.49:0/2895550451 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746698680 0 0) 0x7f9b74109fb0 con 0x7f9b74103df0 2024-03-11T21:58:06.378 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.626+0000 7f9b7159a700 1 -- 172.21.15.49:0/2895550451 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c0035b0 con 0x7f9b74103df0 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b7159a700 1 -- 172.21.15.49:0/2895550451 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141243341 0 0) 0x7f9b5c0035b0 con 0x7f9b74103df0 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b7159a700 1 -- 172.21.15.49:0/2895550451 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7410b150 con 0x7f9b74103df0 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b7159a700 1 -- 172.21.15.49:0/2895550451 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9b64001580 con 0x7f9b74103df0 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b7159a700 1 -- 172.21.15.49:0/2895550451 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f9b64001ce0 con 0x7f9b74103df0 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b7159a700 1 -- 172.21.15.49:0/2895550451 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9b64005960 con 0x7f9b74103df0 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- 172.21.15.49:0/2895550451 >> v1:172.21.15.49:6789/0 conn(0x7f9b74103df0 legacy=0x7f9b74104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- 172.21.15.49:0/2895550451 shutdown_connections 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- 172.21.15.49:0/2895550451 >> 172.21.15.49:0/2895550451 conn(0x7f9b740ff700 msgr2=0x7f9b74101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- 172.21.15.49:0/2895550451 shutdown_connections 2024-03-11T21:58:06.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- 172.21.15.49:0/2895550451 wait complete. 2024-03-11T21:58:06.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 Processor -- start 2024-03-11T21:58:06.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- start start 2024-03-11T21:58:06.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9b74199b60 con 0x7f9b74103df0 2024-03-11T21:58:06.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b7259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9b74103df0 0x7f9b74199450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41302/0 (socket says 172.21.15.49:41302) 2024-03-11T21:58:06.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b7259c700 1 -- 172.21.15.49:0/513588517 learned_addr learned my addr 172.21.15.49:0/513588517 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:06.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831271556 0 0) 0x7f9b74199b60 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c0054f0 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1432454360 0 0) 0x7f9b5c0054f0 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9b74199b60 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9b64004870 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 569589251 0 0) 0x7f9b74199b60 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74199cf0 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b74199fa0 con 0x7f9b74103df0 2024-03-11T21:58:06.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7419daf0 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f9b64001190 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9b640060e0 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f9b640066d0 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.630+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f9b64007d30 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.634+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b54005150 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.634+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f9b64004f30 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.762+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 --> v1:172.21.15.49:6789/0 -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f9b54005980 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.766+0000 7f9b637fe700 1 -- 172.21.15.49:0/513588517 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (unknown 534127980 0 0) 0x7f9b64005640 con 0x7f9b74103df0 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.766+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 >> v1:172.21.15.49:6789/0 conn(0x7f9b74103df0 legacy=0x7f9b74199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.766+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 shutdown_connections 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.766+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 >> 172.21.15.49:0/513588517 conn(0x7f9b740ff700 msgr2=0x7f9b74101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.766+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 shutdown_connections 2024-03-11T21:58:06.384 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:05.766+0000 7f9b789d4700 1 -- 172.21.15.49:0/513588517 wait complete. 2024-03-11T21:58:06.385 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-11T21:58:06.403 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-11T21:58:06.403 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mgr... 2024-03-11T21:58:06.403 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-11T21:58:06.403 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-11T21:58:06.720 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.y 2024-03-11T21:58:06.720 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.y.service: Unit ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.y.service not loaded. 2024-03-11T21:58:06.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:06 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T21:58:06.924 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715.target.wants/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.y.service -> /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service. 2024-03-11T21:58:06.932 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld does not appear to be present 2024-03-11T21:58:06.932 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-03-11T21:58:06.932 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld does not appear to be present 2024-03-11T21:58:06.932 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-11T21:58:06.932 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr to start... 2024-03-11T21:58:06.932 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr... 2024-03-11T21:58:07.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:06 smithi049 bash[21434]: audit 2024-03-11T21:58:05.770717+0000 mon.a (mon.0) 6 : audit 1 from='client.? v1:172.21.15.49:0/513588517' entity='client.admin' 2024-03-11T21:58:07.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:06 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T21:58:08.515 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:08 smithi049 bash[21434]: audit 2024-03-11T21:58:08.350572+0000 mon.a (mon.0) 7 : audit 0 from='client.? v1:172.21.15.49:0/2441884788' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-11T21:58:08.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:08 smithi049 bash[21686]: debug 2024-03-11T21:58:08.217+0000 7f398769c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "377df5b0-dff2-11ee-95c8-87774f69a715", 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-11T21:58:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-11T21:58:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:08.874 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-11T21:58:08.874 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-11T21:58:08.874 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-11T21:58:08.881 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-11T21:58:08.882 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-11T21:58:08.882 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-11T21:58:08.882 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:08.882 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-11T21:58:08.882 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-11T21:58:08.882 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-11T21:58:08.882 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-11T21:58:08.883 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-11T21:58:08.883 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-11T21:58:08.884 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-03-11T21:57:59.883522+0000", 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 Processor -- start 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 -- start start 2024-03-11T21:58:08.885 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f484c078e50 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485222a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f484c1043e0 0x7f484c104800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41326/0 (socket says 172.21.15.49:41326) 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485222a700 1 -- 172.21.15.49:0/871900084 learned_addr learned my addr 172.21.15.49:0/871900084 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f4851228700 1 -- 172.21.15.49:0/871900084 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88084448 0 0) 0x7f484c078e50 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f4851228700 1 -- 172.21.15.49:0/871900084 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48380035b0 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f4851228700 1 -- 172.21.15.49:0/871900084 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 293427644 0 0) 0x7f48380035b0 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f4851228700 1 -- 172.21.15.49:0/871900084 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c105f20 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f4851228700 1 -- 172.21.15.49:0/871900084 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f4848001580 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f4851228700 1 -- 172.21.15.49:0/871900084 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f4848001ce0 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f4851228700 1 -- 172.21.15.49:0/871900084 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f4848005960 con 0x7f484c1043e0 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 -- 172.21.15.49:0/871900084 >> v1:172.21.15.49:6789/0 conn(0x7f484c1043e0 legacy=0x7f484c104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 -- 172.21.15.49:0/871900084 shutdown_connections 2024-03-11T21:58:08.886 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 -- 172.21.15.49:0/871900084 >> 172.21.15.49:0/871900084 conn(0x7f484c0fff80 msgr2=0x7f484c1023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 -- 172.21.15.49:0/871900084 shutdown_connections 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.201+0000 7f485448e700 1 -- 172.21.15.49:0/871900084 wait complete. 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485448e700 1 Processor -- start 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485448e700 1 -- start start 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485448e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f484c19bd30 con 0x7f484c1043e0 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485222a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f484c1043e0 0x7f484c19b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41330/0 (socket says 172.21.15.49:41330) 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485222a700 1 -- 172.21.15.49:0/2441884788 learned_addr learned my addr 172.21.15.49:0/2441884788 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848754127 0 0) 0x7f484c19bd30 con 0x7f484c1043e0 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48380054f0 con 0x7f484c1043e0 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1021768108 0 0) 0x7f48380054f0 con 0x7f484c1043e0 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f484c19bd30 con 0x7f484c1043e0 2024-03-11T21:58:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f4848004870 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 913083058 0 0) 0x7f484c19bd30 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c19bec0 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c19c170 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c19fcc0 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f4848004a40 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f4848006070 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f4848006680 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f4848007da0 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.205+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4830005150 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.209+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f4848005640 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.345+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4830005400 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.345+0000 7f48437fe700 1 -- 172.21.15.49:0/2441884788 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 2696831775) 0x7f4848005860 con 0x7f484c1043e0 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.345+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 >> v1:172.21.15.49:6789/0 conn(0x7f484c1043e0 legacy=0x7f484c19b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.345+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 shutdown_connections 2024-03-11T21:58:08.889 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.345+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 >> 172.21.15.49:0/2441884788 conn(0x7f484c0fff80 msgr2=0x7f484c1023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:08.889 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.345+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 shutdown_connections 2024-03-11T21:58:08.889 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:08.345+0000 7f485448e700 1 -- 172.21.15.49:0/2441884788 wait complete. 2024-03-11T21:58:08.889 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (1/15)... 2024-03-11T21:58:10.191 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:09 smithi049 bash[21686]: debug 2024-03-11T21:58:09.841+0000 7f398769c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-11T21:58:10.191 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:09 smithi049 bash[21686]: debug 2024-03-11T21:58:09.941+0000 7f398769c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-11T21:58:10.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:10 smithi049 bash[21686]: debug 2024-03-11T21:58:10.197+0000 7f398769c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-11T21:58:11.233 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:11 smithi049 bash[21686]: debug 2024-03-11T21:58:11.017+0000 7f398769c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-11T21:58:11.233 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:11 smithi049 bash[21686]: debug 2024-03-11T21:58:11.129+0000 7f398769c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-11T21:58:11.500 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:11 smithi049 bash[21686]: debug 2024-03-11T21:58:11.237+0000 7f398769c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-11T21:58:11.770 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:11 smithi049 bash[21686]: debug 2024-03-11T21:58:11.601+0000 7f398769c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-11T21:58:11.770 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:11 smithi049 bash[21686]: debug 2024-03-11T21:58:11.721+0000 7f398769c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-11T21:58:12.189 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:11 smithi049 bash[21686]: debug 2024-03-11T21:58:11.829+0000 7f398769c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-11T21:58:12.190 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:11 smithi049 bash[21434]: audit 2024-03-11T21:58:11.843755+0000 mon.a (mon.0) 8 : audit 0 from='client.? v1:172.21.15.49:0/2836115449' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-11T21:58:12.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:12.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:58:12.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "377df5b0-dff2-11ee-95c8-87774f69a715", 2024-03-11T21:58:12.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-03-11T21:58:12.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-11T21:58:12.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-11T21:58:12.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:12.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-11T21:58:12.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:12.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-11T21:58:12.353 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-11T21:58:12.353 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-11T21:58:12.353 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-11T21:58:12.353 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-11T21:58:12.353 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:12.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-03-11T21:57:59.883522+0000", 2024-03-11T21:58:12.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849fb57700 1 Processor -- start 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849fb57700 1 -- start start 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849fb57700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8498109f40 con 0x7f8498105b10 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849d8f3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8498105b10 0x7f8498105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41346/0 (socket says 172.21.15.49:41346) 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849d8f3700 1 -- 172.21.15.49:0/3068892256 learned_addr learned my addr 172.21.15.49:0/3068892256 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849c8f1700 1 -- 172.21.15.49:0/3068892256 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566612811 0 0) 0x7f8498109f40 con 0x7f8498105b10 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849c8f1700 1 -- 172.21.15.49:0/3068892256 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84840035b0 con 0x7f8498105b10 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849c8f1700 1 -- 172.21.15.49:0/3068892256 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2328120377 0 0) 0x7f84840035b0 con 0x7f8498105b10 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849c8f1700 1 -- 172.21.15.49:0/3068892256 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849810b0e0 con 0x7f8498105b10 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849c8f1700 1 -- 172.21.15.49:0/3068892256 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8494001580 con 0x7f8498105b10 2024-03-11T21:58:12.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849c8f1700 1 -- 172.21.15.49:0/3068892256 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f8494001c10 con 0x7f8498105b10 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.693+0000 7f849c8f1700 1 -- 172.21.15.49:0/3068892256 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8494005780 con 0x7f8498105b10 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/3068892256 >> v1:172.21.15.49:6789/0 conn(0x7f8498105b10 legacy=0x7f8498105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/3068892256 shutdown_connections 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/3068892256 >> 172.21.15.49:0/3068892256 conn(0x7f84981010d0 msgr2=0x7f84981034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/3068892256 shutdown_connections 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/3068892256 wait complete. 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 Processor -- start 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- start start 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f849819f4f0 con 0x7f8498105b10 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849d8f3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8498105b10 0x7f849807b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:41350/0 (socket says 172.21.15.49:41350) 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849d8f3700 1 -- 172.21.15.49:0/2836115449 learned_addr learned my addr 172.21.15.49:0/2836115449 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246415470 0 0) 0x7f849819f4f0 con 0x7f8498105b10 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8484005540 con 0x7f8498105b10 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 754858238 0 0) 0x7f8484005540 con 0x7f8498105b10 2024-03-11T21:58:12.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f849819f4f0 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8494001080 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3571547226 0 0) 0x7f849819f4f0 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84981a0690 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849819f6e0 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f849819fbe0 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f8494005620 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8494006140 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f8494006730 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f8494007df0 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.697+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847c005150 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.701+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f8494001a50 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.837+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f847c005400 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.837+0000 7f848effd700 1 -- 172.21.15.49:0/2836115449 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 2666637084) 0x7f8494005a90 con 0x7f8498105b10 2024-03-11T21:58:12.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.841+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 >> v1:172.21.15.49:6789/0 conn(0x7f8498105b10 legacy=0x7f849807b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.841+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 shutdown_connections 2024-03-11T21:58:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.841+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 >> 172.21.15.49:0/2836115449 conn(0x7f84981010d0 msgr2=0x7f84981034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.841+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 shutdown_connections 2024-03-11T21:58:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:11.841+0000 7f849fb57700 1 -- 172.21.15.49:0/2836115449 wait complete. 2024-03-11T21:58:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (2/15)... 2024-03-11T21:58:12.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:12 smithi049 bash[21686]: debug 2024-03-11T21:58:12.193+0000 7f398769c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-11T21:58:12.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:12 smithi049 bash[21686]: debug 2024-03-11T21:58:12.441+0000 7f398769c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-11T21:58:13.020 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:12 smithi049 bash[21686]: debug 2024-03-11T21:58:12.705+0000 7f398769c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-11T21:58:13.020 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:12 smithi049 bash[21686]: debug 2024-03-11T21:58:12.821+0000 7f398769c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-11T21:58:13.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:13 smithi049 bash[21686]: debug 2024-03-11T21:58:13.101+0000 7f398769c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-11T21:58:13.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:13 smithi049 bash[21686]: debug 2024-03-11T21:58:13.349+0000 7f398769c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-11T21:58:14.020 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:13 smithi049 bash[21686]: debug 2024-03-11T21:58:13.765+0000 7f398769c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-11T21:58:14.020 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:13 smithi049 bash[21686]: debug 2024-03-11T21:58:13.885+0000 7f398769c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-11T21:58:14.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:14 smithi049 bash[21686]: debug 2024-03-11T21:58:14.137+0000 7f398769c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-11T21:58:15.406 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:15 smithi049 bash[21686]: debug 2024-03-11T21:58:15.181+0000 7f398769c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-11T21:58:15.406 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:15 smithi049 bash[21686]: debug 2024-03-11T21:58:15.297+0000 7f398769c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-11T21:58:15.710 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:15 smithi049 bash[21686]: debug 2024-03-11T21:58:15.597+0000 7f398769c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-11T21:58:15.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:15 smithi049 bash[21434]: audit 2024-03-11T21:58:15.402674+0000 mon.a (mon.0) 9 : audit 0 from='client.? v1:172.21.15.49:0/962803694' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-11T21:58:15.926 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:15.926 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:58:15.926 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "377df5b0-dff2-11ee-95c8-87774f69a715", 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-11T21:58:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:15.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-11T21:58:15.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-11T21:58:15.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:15.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-11T21:58:15.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:15.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-11T21:58:15.935 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-11T21:58:15.935 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-11T21:58:15.935 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-11T21:58:15.935 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:15.936 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:15.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-03-11T21:57:59.883522+0000", 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 Processor -- start 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 -- start start 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7ed0078e90 con 0x7f7ed01043a0 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7eced9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7ed01043a0 0x7f7ed01047c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48330/0 (socket says 172.21.15.49:48330) 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7eced9d700 1 -- 172.21.15.49:0/2249914695 learned_addr learned my addr 172.21.15.49:0/2249914695 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ecdd9b700 1 -- 172.21.15.49:0/2249914695 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356877862 0 0) 0x7f7ed0078e90 con 0x7f7ed01043a0 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ecdd9b700 1 -- 172.21.15.49:0/2249914695 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb80035b0 con 0x7f7ed01043a0 2024-03-11T21:58:15.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ecdd9b700 1 -- 172.21.15.49:0/2249914695 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719734991 0 0) 0x7f7eb80035b0 con 0x7f7ed01043a0 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ecdd9b700 1 -- 172.21.15.49:0/2249914695 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0105ee0 con 0x7f7ed01043a0 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ecdd9b700 1 -- 172.21.15.49:0/2249914695 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7ec0001580 con 0x7f7ed01043a0 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ecdd9b700 1 -- 172.21.15.49:0/2249914695 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f7ec0001c10 con 0x7f7ed01043a0 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ecdd9b700 1 -- 172.21.15.49:0/2249914695 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7ec00057b0 con 0x7f7ed01043a0 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 -- 172.21.15.49:0/2249914695 >> v1:172.21.15.49:6789/0 conn(0x7f7ed01043a0 legacy=0x7f7ed01047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 -- 172.21.15.49:0/2249914695 shutdown_connections 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 -- 172.21.15.49:0/2249914695 >> 172.21.15.49:0/2249914695 conn(0x7f7ed00fff80 msgr2=0x7f7ed01023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 -- 172.21.15.49:0/2249914695 shutdown_connections 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.253+0000 7f7ed50c0700 1 -- 172.21.15.49:0/2249914695 wait complete. 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7ed50c0700 1 Processor -- start 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7ed50c0700 1 -- start start 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7ed50c0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7ed019bd30 con 0x7f7ed01043a0 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eced9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7ed01043a0 0x7f7ed019b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48344/0 (socket says 172.21.15.49:48344) 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eced9d700 1 -- 172.21.15.49:0/962803694 learned_addr learned my addr 172.21.15.49:0/962803694 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:15.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282792287 0 0) 0x7f7ed019bd30 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb8005540 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3840120519 0 0) 0x7f7eb8005540 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7ed019bd30 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7ec0001080 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 98108908 0 0) 0x7f7ed019bd30 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed019bec0 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed019c170 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed019fcc0 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f7ec0004900 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7ec0006240 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f7ec0006870 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f7ec0007f20 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.257+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc005150 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.261+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f7ec0005b20 con 0x7f7ed01043a0 2024-03-11T21:58:15.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.397+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7ebc005400 con 0x7f7ed01043a0 2024-03-11T21:58:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.397+0000 7f7eb7fff700 1 -- 172.21.15.49:0/962803694 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 2381243812) 0x7f7ec0004eb0 con 0x7f7ed01043a0 2024-03-11T21:58:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.397+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 >> v1:172.21.15.49:6789/0 conn(0x7f7ed01043a0 legacy=0x7f7ed019b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.397+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 shutdown_connections 2024-03-11T21:58:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.397+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 >> 172.21.15.49:0/962803694 conn(0x7f7ed00fff80 msgr2=0x7f7ed01023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.397+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 shutdown_connections 2024-03-11T21:58:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:15.397+0000 7f7ed50c0700 1 -- 172.21.15.49:0/962803694 wait complete. 2024-03-11T21:58:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (3/15)... 2024-03-11T21:58:16.020 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:15 smithi049 bash[21686]: debug 2024-03-11T21:58:15.713+0000 7f398769c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-11T21:58:16.445 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21686]: debug 2024-03-11T21:58:16.181+0000 7f398769c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-11T21:58:16.445 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21686]: debug 2024-03-11T21:58:16.301+0000 7f398769c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-11T21:58:16.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: cluster 2024-03-11T21:58:16.331241+0000 mon.a (mon.0) 10 : cluster 1 Activating manager daemon y 2024-03-11T21:58:16.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: cluster 2024-03-11T21:58:16.338446+0000 mon.a (mon.0) 11 : cluster 0 mgrmap e2: y(active, starting, since 0.00752451s) 2024-03-11T21:58:16.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.340124+0000 mon.a (mon.0) 12 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-11T21:58:16.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.340336+0000 mon.a (mon.0) 13 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-11T21:58:16.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.340520+0000 mon.a (mon.0) 14 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-11T21:58:16.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.340682+0000 mon.a (mon.0) 15 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-11T21:58:16.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.340872+0000 mon.a (mon.0) 16 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.341081+0000 mon.a (mon.0) 17 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.341246+0000 mon.a (mon.0) 18 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.341604+0000 mon.a (mon.0) 19 : audit 0 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: cluster 2024-03-11T21:58:16.347876+0000 mon.a (mon.0) 20 : cluster 1 Manager daemon y is now available 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.360690+0000 mon.a (mon.0) 21 : audit 1 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.363602+0000 mon.a (mon.0) 22 : audit 1 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.366962+0000 mon.a (mon.0) 23 : audit 1 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.368593+0000 mon.a (mon.0) 24 : audit 1 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' 2024-03-11T21:58:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:16 smithi049 bash[21434]: audit 2024-03-11T21:58:16.370867+0000 mon.a (mon.0) 25 : audit 1 from='mgr.14100 v1:172.21.15.49:0/1701125540' entity='mgr.y' 2024-03-11T21:58:18.618 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:18 smithi049 bash[21434]: cluster 2024-03-11T21:58:17.344710+0000 mon.a (mon.0) 26 : cluster 0 mgrmap e3: y(active, since 1.01379s) 2024-03-11T21:58:20.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:20.021 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:58:20.021 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "377df5b0-dff2-11ee-95c8-87774f69a715", 2024-03-11T21:58:20.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-03-11T21:58:20.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-11T21:58:20.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-11T21:58:20.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-11T21:58:20.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:20.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-11T21:58:20.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-11T21:58:20.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-11T21:58:20.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-03-11T21:57:59.883522+0000", 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f858d61a700 1 Processor -- start 2024-03-11T21:58:20.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f858d61a700 1 -- start start 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f858d61a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f858807a390 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8586ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f858807b790 0x7f8588079bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48408/0 (socket says 172.21.15.49:48408) 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8586ffd700 1 -- 172.21.15.49:0/3621753445 learned_addr learned my addr 172.21.15.49:0/3621753445 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8585ffb700 1 -- 172.21.15.49:0/3621753445 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353653752 0 0) 0x7f858807a390 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8585ffb700 1 -- 172.21.15.49:0/3621753445 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85700035b0 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8585ffb700 1 -- 172.21.15.49:0/3621753445 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1960424413 0 0) 0x7f85700035b0 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8585ffb700 1 -- 172.21.15.49:0/3621753445 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858807a520 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8585ffb700 1 -- 172.21.15.49:0/3621753445 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8578001580 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8585ffb700 1 -- 172.21.15.49:0/3621753445 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f8578001ce0 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.821+0000 7f8585ffb700 1 -- 172.21.15.49:0/3621753445 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8578005960 con 0x7f858807b790 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/3621753445 >> v1:172.21.15.49:6789/0 conn(0x7f858807b790 legacy=0x7f8588079bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/3621753445 shutdown_connections 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/3621753445 >> 172.21.15.49:0/3621753445 conn(0x7f85881010b0 msgr2=0x7f85881034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:20.027 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/3621753445 shutdown_connections 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/3621753445 wait complete. 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 Processor -- start 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- start start 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8588109470 con 0x7f858807b790 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f8586ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f858807b790 0x7f8588108d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48420/0 (socket says 172.21.15.49:48420) 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f8586ffd700 1 -- 172.21.15.49:0/891468320 learned_addr learned my addr 172.21.15.49:0/891468320 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308072747 0 0) 0x7f8588109470 con 0x7f858807b790 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85700054f0 con 0x7f858807b790 2024-03-11T21:58:20.028 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2367932325 0 0) 0x7f85700054f0 con 0x7f858807b790 2024-03-11T21:58:20.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8588109470 con 0x7f858807b790 2024-03-11T21:58:20.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8578004870 con 0x7f858807b790 2024-03-11T21:58:20.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2654686146 0 0) 0x7f8588109470 con 0x7f858807b790 2024-03-11T21:58:20.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588109600 con 0x7f858807b790 2024-03-11T21:58:20.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85881058a0 con 0x7f858807b790 2024-03-11T21:58:20.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8588105da0 con 0x7f858807b790 2024-03-11T21:58:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f8578004a40 con 0x7f858807b790 2024-03-11T21:58:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8578006030 con 0x7f858807b790 2024-03-11T21:58:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 3) v1 ==== 45617+0+0 (unknown 1785018835 0 0) 0x7f85780113d0 con 0x7f858807b790 2024-03-11T21:58:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8574005150 con 0x7f858807b790 2024-03-11T21:58:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.825+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f8578046c50 con 0x7f858807b790 2024-03-11T21:58:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:18.833+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8578012c40 con 0x7f858807b790 2024-03-11T21:58:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.337+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mgrmap(e 4) v1 ==== 45723+0+0 (unknown 4237815892 0 0) 0x7f857802a6c0 con 0x7f858807b790 2024-03-11T21:58:20.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.361+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8574005400 con 0x7f858807b790 2024-03-11T21:58:20.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.361+0000 7f856ffff700 1 -- 172.21.15.49:0/891468320 <== mon.0 v1:172.21.15.49:6789/0 11 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 1450579129) 0x7f8578012c40 con 0x7f858807b790 2024-03-11T21:58:20.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.365+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 >> v1:172.21.15.49:6800/653572163 conn(0x7f8570039e10 legacy=0x7f857003c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:20.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.365+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 >> v1:172.21.15.49:6789/0 conn(0x7f858807b790 legacy=0x7f8588108d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:20.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.365+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 shutdown_connections 2024-03-11T21:58:20.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.365+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 >> 172.21.15.49:0/891468320 conn(0x7f85881010b0 msgr2=0x7f8588109f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:20.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.365+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 shutdown_connections 2024-03-11T21:58:20.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:19.365+0000 7f858d61a700 1 -- 172.21.15.49:0/891468320 wait complete. 2024-03-11T21:58:20.032 INFO:teuthology.orchestra.run.smithi049.stdout:mgr is available 2024-03-11T21:58:20.659 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:20 smithi049 bash[21434]: cluster 2024-03-11T21:58:19.344350+0000 mon.a (mon.0) 27 : cluster 0 mgrmap e4: y(active, since 3s) 2024-03-11T21:58:20.660 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:20 smithi049 bash[21434]: audit 2024-03-11T21:58:19.365974+0000 mon.a (mon.0) 28 : audit 0 from='client.? v1:172.21.15.49:0/891468320' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-11T21:58:21.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:21 smithi049 bash[21434]: audit 2024-03-11T21:58:21.236489+0000 mon.a (mon.0) 29 : audit 1 from='client.? v1:172.21.15.49:0/2990410791' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-11T21:58:21.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:21.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-03-11T21:58:21.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:58:21.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-11T21:58:21.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.849+0000 7fe720f21700 1 Processor -- start 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.849+0000 7fe720f21700 1 -- start start 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.849+0000 7fe720f21700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe71c10c140 con 0x7fe71c107d10 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe71c107d10 0x7fe71c108130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48428/0 (socket says 172.21.15.49:48428) 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71a59c700 1 -- 172.21.15.49:0/2536249507 learned_addr learned my addr 172.21.15.49:0/2536249507 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71959a700 1 -- 172.21.15.49:0/2536249507 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837204639 0 0) 0x7fe71c10c140 con 0x7fe71c107d10 2024-03-11T21:58:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71959a700 1 -- 172.21.15.49:0/2536249507 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7080035b0 con 0x7fe71c107d10 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71959a700 1 -- 172.21.15.49:0/2536249507 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4029543542 0 0) 0x7fe7080035b0 con 0x7fe71c107d10 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71959a700 1 -- 172.21.15.49:0/2536249507 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c10d2e0 con 0x7fe71c107d10 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71959a700 1 -- 172.21.15.49:0/2536249507 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fe704001580 con 0x7fe71c107d10 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71959a700 1 -- 172.21.15.49:0/2536249507 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fe704001ce0 con 0x7fe71c107d10 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71959a700 1 -- 172.21.15.49:0/2536249507 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fe704005960 con 0x7fe71c107d10 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- 172.21.15.49:0/2536249507 >> v1:172.21.15.49:6789/0 conn(0x7fe71c107d10 legacy=0x7fe71c108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- 172.21.15.49:0/2536249507 shutdown_connections 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- 172.21.15.49:0/2536249507 >> 172.21.15.49:0/2536249507 conn(0x7fe71c07b0e0 msgr2=0x7fe71c105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- 172.21.15.49:0/2536249507 shutdown_connections 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- 172.21.15.49:0/2536249507 wait complete. 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 Processor -- start 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- start start 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe71c19bd90 con 0x7fe71c107d10 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe71c107d10 0x7fe71c19b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48436/0 (socket says 172.21.15.49:48436) 2024-03-11T21:58:21.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe71a59c700 1 -- 172.21.15.49:0/2990410791 learned_addr learned my addr 172.21.15.49:0/2990410791 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642468736 0 0) 0x7fe71c19bd90 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7080054f0 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4035458917 0 0) 0x7fe7080054f0 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe71c19bd90 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fe704005940 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 740680617 0 0) 0x7fe71c19bd90 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c19bf20 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c19c1d0 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.853+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c19fd20 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.857+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fe704001080 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.857+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fe704005ff0 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.857+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 4) v1 ==== 45723+0+0 (unknown 4237815892 0 0) 0x7fe704011420 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.857+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc005120 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.857+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7fe704046d90 con 0x7fe71c107d10 2024-03-11T21:58:21.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:20.861+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fe704012c30 con 0x7fe71c107d10 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.229+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe6fc005950 con 0x7fe71c107d10 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.229+0000 7fe7137fe700 1 -- 172.21.15.49:0/2990410791 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+282 (unknown 1187553405 0 405224514) 0x7fe7040342c0 con 0x7fe71c107d10 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.233+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 >> v1:172.21.15.49:6800/653572163 conn(0x7fe708039f40 legacy=0x7fe70803c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.233+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 >> v1:172.21.15.49:6789/0 conn(0x7fe71c107d10 legacy=0x7fe71c19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.233+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 shutdown_connections 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.233+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 >> 172.21.15.49:0/2990410791 conn(0x7fe71c07b0e0 msgr2=0x7fe71c1924a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.233+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 shutdown_connections 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:21.233+0000 7fe720f21700 1 -- 172.21.15.49:0/2990410791 wait complete. 2024-03-11T21:58:21.859 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling cephadm module... 2024-03-11T21:58:23.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:23 smithi049 bash[21434]: audit 2024-03-11T21:58:23.234139+0000 mon.a (mon.0) 30 : audit 1 from='client.? v1:172.21.15.49:0/4147090776' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-11T21:58:23.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:23 smithi049 bash[21686]: ignoring --setuser ceph since I am not root 2024-03-11T21:58:23.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:23 smithi049 bash[21686]: ignoring --setgroup ceph since I am not root 2024-03-11T21:58:23.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:23 smithi049 bash[21686]: debug 2024-03-11T21:58:23.496+0000 7f6dbc9f7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-11T21:58:23.875 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.732+0000 7f18cc117700 1 Processor -- start 2024-03-11T21:58:23.875 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.732+0000 7f18cc117700 1 -- start start 2024-03-11T21:58:23.875 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f18c4109f40 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c9eb3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f18c4105b10 0x7f18c4105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48438/0 (socket says 172.21.15.49:48438) 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c9eb3700 1 -- 172.21.15.49:0/1189372797 learned_addr learned my addr 172.21.15.49:0/1189372797 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c8eb1700 1 -- 172.21.15.49:0/1189372797 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687626134 0 0) 0x7f18c4109f40 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c8eb1700 1 -- 172.21.15.49:0/1189372797 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18ac0035b0 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c8eb1700 1 -- 172.21.15.49:0/1189372797 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394314601 0 0) 0x7f18ac0035b0 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c8eb1700 1 -- 172.21.15.49:0/1189372797 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c410b0e0 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c8eb1700 1 -- 172.21.15.49:0/1189372797 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f18b4001900 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c8eb1700 1 -- 172.21.15.49:0/1189372797 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f18b4002060 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c8eb1700 1 -- 172.21.15.49:0/1189372797 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f18b4005ce0 con 0x7f18c4105b10 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- 172.21.15.49:0/1189372797 >> v1:172.21.15.49:6789/0 conn(0x7f18c4105b10 legacy=0x7f18c4105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- 172.21.15.49:0/1189372797 shutdown_connections 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- 172.21.15.49:0/1189372797 >> 172.21.15.49:0/1189372797 conn(0x7f18c41010b0 msgr2=0x7f18c41034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- 172.21.15.49:0/1189372797 shutdown_connections 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- 172.21.15.49:0/1189372797 wait complete. 2024-03-11T21:58:23.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 Processor -- start 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- start start 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f18c419bd70 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c9eb3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f18c4105b10 0x7f18c419b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48448/0 (socket says 172.21.15.49:48448) 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c9eb3700 1 -- 172.21.15.49:0/4147090776 learned_addr learned my addr 172.21.15.49:0/4147090776 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908821811 0 0) 0x7f18c419bd70 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18ac0054f0 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1413941845 0 0) 0x7f18ac0054f0 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f18c419bd70 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f18b4005cc0 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2413016329 0 0) 0x7f18c419bd70 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c419bf00 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c419c1b0 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c419fd00 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.736+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f18b4001ea0 con 0x7f18c4105b10 2024-03-11T21:58:23.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.740+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f18b4006430 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.740+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 4) v1 ==== 45723+0+0 (unknown 4237815892 0 0) 0x7f18b4011860 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.740+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b0005120 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.740+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f18b40471f0 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:22.744+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f18b4013070 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.232+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f18b00053d0 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.284+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (unknown 2263024820 0 0) 0x7f18b4015150 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.288+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 >> v1:172.21.15.49:6800/653572163 conn(0x7f18ac039ef0 legacy=0x7f18ac03c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.288+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 >> v1:172.21.15.49:6789/0 conn(0x7f18c4105b10 legacy=0x7f18c419b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.288+0000 7f18c2ffd700 1 -- 172.21.15.49:0/4147090776 <== mon.0 v1:172.21.15.49:6789/0 11 ==== mgrmap(e 5) v1 ==== 45734+0+0 (unknown 2947858942 0 0) 0x7f18b4005a10 con 0x7f18c4105b10 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.288+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 shutdown_connections 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.288+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 >> 172.21.15.49:0/4147090776 conn(0x7f18c41010b0 msgr2=0x7f18c41014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.288+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 shutdown_connections 2024-03-11T21:58:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:23.288+0000 7f18cc117700 1 -- 172.21.15.49:0/4147090776 wait complete. 2024-03-11T21:58:24.539 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:24 smithi049 bash[21434]: audit 2024-03-11T21:58:23.286024+0000 mon.a (mon.0) 31 : audit 1 from='client.? v1:172.21.15.49:0/4147090776' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-11T21:58:24.540 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:24 smithi049 bash[21434]: cluster 2024-03-11T21:58:23.291532+0000 mon.a (mon.0) 32 : cluster 0 mgrmap e5: y(active, since 6s) 2024-03-11T21:58:25.396 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:25 smithi049 bash[21434]: audit 2024-03-11T21:58:25.197950+0000 mon.a (mon.0) 33 : audit 0 from='client.? v1:172.21.15.49:0/2697265520' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-11T21:58:25.396 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:25 smithi049 bash[21686]: debug 2024-03-11T21:58:25.128+0000 7f6dbc9f7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-11T21:58:25.396 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:25 smithi049 bash[21686]: debug 2024-03-11T21:58:25.232+0000 7f6dbc9f7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-11T21:58:25.770 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:25 smithi049 bash[21686]: debug 2024-03-11T21:58:25.488+0000 7f6dbc9f7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.700+0000 7fbf98ca8700 1 Processor -- start 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.700+0000 7fbf98ca8700 1 -- start start 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.700+0000 7fbf98ca8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbf94078e50 con 0x7fbf941043e0 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbf941043e0 0x7fbf94104800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47822/0 (socket says 172.21.15.49:47822) 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9259c700 1 -- 172.21.15.49:0/2812774265 learned_addr learned my addr 172.21.15.49:0/2812774265 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9159a700 1 -- 172.21.15.49:0/2812774265 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922223547 0 0) 0x7fbf94078e50 con 0x7fbf941043e0 2024-03-11T21:58:25.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9159a700 1 -- 172.21.15.49:0/2812774265 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf7c0035b0 con 0x7fbf941043e0 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9159a700 1 -- 172.21.15.49:0/2812774265 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1893493944 0 0) 0x7fbf7c0035b0 con 0x7fbf941043e0 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9159a700 1 -- 172.21.15.49:0/2812774265 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94105f20 con 0x7fbf941043e0 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9159a700 1 -- 172.21.15.49:0/2812774265 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbf84001580 con 0x7fbf941043e0 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9159a700 1 -- 172.21.15.49:0/2812774265 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fbf84001c10 con 0x7fbf941043e0 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9159a700 1 -- 172.21.15.49:0/2812774265 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbf840057b0 con 0x7fbf941043e0 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2812774265 >> v1:172.21.15.49:6789/0 conn(0x7fbf941043e0 legacy=0x7fbf94104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2812774265 shutdown_connections 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2812774265 >> 172.21.15.49:0/2812774265 conn(0x7fbf940fff80 msgr2=0x7fbf941023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2812774265 shutdown_connections 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2812774265 wait complete. 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 Processor -- start 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- start start 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbf9419bd10 con 0x7fbf941043e0 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9259c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbf941043e0 0x7fbf9419b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47826/0 (socket says 172.21.15.49:47826) 2024-03-11T21:58:25.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf9259c700 1 -- 172.21.15.49:0/2697265520 learned_addr learned my addr 172.21.15.49:0/2697265520 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324051542 0 0) 0x7fbf9419bd10 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf7c005540 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2404537247 0 0) 0x7fbf7c005540 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf9419bd10 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbf84001080 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 229887091 0 0) 0x7fbf9419bd10 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9419bea0 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9419c150 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9419fca0 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fbf840049d0 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.704+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbf840061a0 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.708+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 5) v1 ==== 45734+0+0 (unknown 2947858942 0 0) 0x7fbf840115d0 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.708+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf74005150 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.708+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7fbf84046ff0 con 0x7fbf941043e0 2024-03-11T21:58:25.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.708+0000 7fbf91d9b700 1 -- 172.21.15.49:0/2697265520 >> v1:172.21.15.49:6800/653572163 conn(0x7fbf7c039ee0 legacy=0x7fbf7c03c3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/653572163 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.712+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fbf84012e30 con 0x7fbf941043e0 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:24.912+0000 7fbf91d9b700 1 -- 172.21.15.49:0/2697265520 >> v1:172.21.15.49:6800/653572163 conn(0x7fbf7c039ee0 legacy=0x7fbf7c03c3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/653572163 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.196+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fbf74005c10 con 0x7fbf941043e0 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.196+0000 7fbf837fe700 1 -- 172.21.15.49:0/2697265520 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (unknown 3768197548 0 15966916) 0x7fbf84014f10 con 0x7fbf941043e0 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.196+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 >> v1:172.21.15.49:6800/653572163 conn(0x7fbf7c039ee0 legacy=0x7fbf7c03c3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.196+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 >> v1:172.21.15.49:6789/0 conn(0x7fbf941043e0 legacy=0x7fbf9419b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.196+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 shutdown_connections 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.196+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 >> 172.21.15.49:0/2697265520 conn(0x7fbf940fff80 msgr2=0x7fbf941023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.200+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 shutdown_connections 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:25.200+0000 7fbf98ca8700 1 -- 172.21.15.49:0/2697265520 wait complete. 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-03-11T21:58:25.784 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 5... 2024-03-11T21:58:26.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:26 smithi049 bash[21686]: debug 2024-03-11T21:58:26.316+0000 7f6dbc9f7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-11T21:58:26.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:26 smithi049 bash[21686]: debug 2024-03-11T21:58:26.432+0000 7f6dbc9f7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-11T21:58:26.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:26 smithi049 bash[21686]: debug 2024-03-11T21:58:26.540+0000 7f6dbc9f7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-11T21:58:27.271 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:26 smithi049 bash[21686]: debug 2024-03-11T21:58:26.904+0000 7f6dbc9f7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-11T21:58:27.271 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:27 smithi049 bash[21686]: debug 2024-03-11T21:58:27.024+0000 7f6dbc9f7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-11T21:58:27.271 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:27 smithi049 bash[21686]: debug 2024-03-11T21:58:27.132+0000 7f6dbc9f7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-11T21:58:27.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:27 smithi049 bash[21686]: debug 2024-03-11T21:58:27.500+0000 7f6dbc9f7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-11T21:58:27.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:27 smithi049 bash[21686]: debug 2024-03-11T21:58:27.744+0000 7f6dbc9f7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-11T21:58:28.271 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:28 smithi049 bash[21686]: debug 2024-03-11T21:58:28.012+0000 7f6dbc9f7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-11T21:58:28.271 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:28 smithi049 bash[21686]: debug 2024-03-11T21:58:28.128+0000 7f6dbc9f7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-11T21:58:28.655 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:28 smithi049 bash[21686]: debug 2024-03-11T21:58:28.412+0000 7f6dbc9f7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-11T21:58:29.021 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:28 smithi049 bash[21686]: debug 2024-03-11T21:58:28.660+0000 7f6dbc9f7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-11T21:58:29.447 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:29 smithi049 bash[21686]: debug 2024-03-11T21:58:29.076+0000 7f6dbc9f7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-11T21:58:29.447 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:29 smithi049 bash[21686]: debug 2024-03-11T21:58:29.200+0000 7f6dbc9f7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-11T21:58:29.447 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:29 smithi049 bash[21686]: debug 2024-03-11T21:58:29.452+0000 7f6dbc9f7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-11T21:58:30.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:30 smithi049 bash[21686]: debug 2024-03-11T21:58:30.484+0000 7f6dbc9f7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-11T21:58:30.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:30 smithi049 bash[21686]: debug 2024-03-11T21:58:30.604+0000 7f6dbc9f7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-11T21:58:31.271 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:30 smithi049 bash[21686]: debug 2024-03-11T21:58:30.904+0000 7f6dbc9f7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-11T21:58:31.271 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21686]: debug 2024-03-11T21:58:31.020+0000 7f6dbc9f7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-11T21:58:31.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21686]: debug 2024-03-11T21:58:31.488+0000 7f6dbc9f7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-11T21:58:31.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21686]: debug 2024-03-11T21:58:31.608+0000 7f6dbc9f7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-11T21:58:31.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: cluster 2024-03-11T21:58:31.634570+0000 mon.a (mon.0) 34 : cluster 1 Active manager daemon y restarted 2024-03-11T21:58:31.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: cluster 2024-03-11T21:58:31.634998+0000 mon.a (mon.0) 35 : cluster 1 Activating manager daemon y 2024-03-11T21:58:31.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: cluster 2024-03-11T21:58:31.641977+0000 mon.a (mon.0) 36 : cluster 0 osdmap e2: 0 total, 0 up, 0 in 2024-03-11T21:58:31.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: cluster 2024-03-11T21:58:31.642220+0000 mon.a (mon.0) 37 : cluster 0 mgrmap e6: y(active, starting, since 0.00740832s) 2024-03-11T21:58:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: audit 2024-03-11T21:58:31.646003+0000 mon.a (mon.0) 38 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T21:58:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: audit 2024-03-11T21:58:31.647379+0000 mon.a (mon.0) 39 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-11T21:58:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: audit 2024-03-11T21:58:31.648333+0000 mon.a (mon.0) 40 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-11T21:58:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: audit 2024-03-11T21:58:31.648496+0000 mon.a (mon.0) 41 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-11T21:58:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: audit 2024-03-11T21:58:31.648655+0000 mon.a (mon.0) 42 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-11T21:58:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:31 smithi049 bash[21434]: cluster 2024-03-11T21:58:31.670951+0000 mon.a (mon.0) 43 : cluster 1 Manager daemon y is now available 2024-03-11T21:58:33.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: cephadm 2024-03-11T21:58:31.689567+0000 mgr.y (mgr.14120) 1 : cephadm 1 Found migration_current of "None". Setting to last migration. 2024-03-11T21:58:33.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:31.693606+0000 mon.a (mon.0) 44 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:31.697309+0000 mon.a (mon.0) 45 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:31.701487+0000 mon.a (mon.0) 46 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:31.703181+0000 mon.a (mon.0) 47 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:31.708248+0000 mon.a (mon.0) 48 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:31.717700+0000 mon.a (mon.0) 49 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:31.720752+0000 mon.a (mon.0) 50 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:32.045529+0000 mon.a (mon.0) 51 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:32.050370+0000 mon.a (mon.0) 52 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: cephadm 2024-03-11T21:58:32.347357+0000 mgr.y (mgr.14120) 2 : cephadm 1 [11/Mar/2024:21:58:32] ENGINE Bus STARTING 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: audit 2024-03-11T21:58:32.578227+0000 mon.a (mon.0) 53 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:58:33.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:32 smithi049 bash[21434]: cluster 2024-03-11T21:58:32.647422+0000 mon.a (mon.0) 54 : cluster 0 mgrmap e7: y(active, since 1.01262s) 2024-03-11T21:58:33.288 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 Processor -- start 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- start start 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f599c109f10 con 0x7f599c105ae0 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f599affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f599c105ae0 0x7f599c105f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47840/0 (socket says 172.21.15.49:47840) 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f599affd700 1 -- 172.21.15.49:0/4144302315 learned_addr learned my addr 172.21.15.49:0/4144302315 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f5999ffb700 1 -- 172.21.15.49:0/4144302315 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137830311 0 0) 0x7f599c109f10 con 0x7f599c105ae0 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f5999ffb700 1 -- 172.21.15.49:0/4144302315 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59840035b0 con 0x7f599c105ae0 2024-03-11T21:58:33.289 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f5999ffb700 1 -- 172.21.15.49:0/4144302315 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 738005496 0 0) 0x7f59840035b0 con 0x7f599c105ae0 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f5999ffb700 1 -- 172.21.15.49:0/4144302315 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c10b0b0 con 0x7f599c105ae0 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f5999ffb700 1 -- 172.21.15.49:0/4144302315 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f598c001580 con 0x7f599c105ae0 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f5999ffb700 1 -- 172.21.15.49:0/4144302315 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f598c001ce0 con 0x7f599c105ae0 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f5999ffb700 1 -- 172.21.15.49:0/4144302315 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f598c005960 con 0x7f599c105ae0 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- 172.21.15.49:0/4144302315 >> v1:172.21.15.49:6789/0 conn(0x7f599c105ae0 legacy=0x7f599c105f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- 172.21.15.49:0/4144302315 shutdown_connections 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- 172.21.15.49:0/4144302315 >> 172.21.15.49:0/4144302315 conn(0x7f599c101040 msgr2=0x7f599c1034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- 172.21.15.49:0/4144302315 shutdown_connections 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- 172.21.15.49:0/4144302315 wait complete. 2024-03-11T21:58:33.290 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 Processor -- start 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.572+0000 7f59a18c8700 1 -- start start 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a18c8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f599c199b00 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f599affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f599c105ae0 0x7f599c1993f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47848/0 (socket says 172.21.15.49:47848) 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f599affd700 1 -- 172.21.15.49:0/3720260134 learned_addr learned my addr 172.21.15.49:0/3720260134 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309839631 0 0) 0x7f599c199b00 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59840054f0 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 149681880 0 0) 0x7f59840054f0 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f599c199b00 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f598c005940 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2816039560 0 0) 0x7f599c199b00 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c199c90 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c199f40 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c19da90 con 0x7f599c105ae0 2024-03-11T21:58:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f598c001080 con 0x7f599c105ae0 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f598c005ff0 con 0x7f599c105ae0 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 5) v1 ==== 45734+0+0 (unknown 2947858942 0 0) 0x7f598c011420 con 0x7f599c105ae0 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6800/653572163 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f598403dc60 con 0x7f5984039f90 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 118287349 0 0) 0x7f598c046de0 con 0x7f599c105ae0 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.576+0000 7f599a7fc700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6800/653572163 conn(0x7f5984039f90 legacy=0x7f598403c450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/653572163 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:26.780+0000 7f599a7fc700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6800/653572163 conn(0x7f5984039f90 legacy=0x7f598403c450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/653572163 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:27.184+0000 7f599a7fc700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6800/653572163 conn(0x7f5984039f90 legacy=0x7f598403c450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/653572163 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:27.988+0000 7f599a7fc700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6800/653572163 conn(0x7f5984039f90 legacy=0x7f598403c450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/653572163 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:29.592+0000 7f599a7fc700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6800/653572163 conn(0x7f5984039f90 legacy=0x7f598403c450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/653572163 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:31.636+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mgrmap(e 6) v1 ==== 45536+0+0 (unknown 808613491 0 0) 0x7f598c004ec0 con 0x7f599c105ae0 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:31.636+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6800/653572163 conn(0x7f5984039f90 legacy=0x7f598403c450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.640+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mgrmap(e 7) v1 ==== 45628+0+0 (unknown 4275118364 0 0) 0x7f598c047d20 con 0x7f599c105ae0 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.640+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6800/2600502005 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f598403dc60 con 0x7f598403e9b0 2024-03-11T21:58:33.292 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.644+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (unknown 0 0 4109177037) 0x7f598403dc60 con 0x7f598403e9b0 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 --> v1:172.21.15.49:6800/2600502005 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f5988002630 con 0x7f598403e9b0 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a08c6700 1 -- 172.21.15.49:0/3720260134 <== mgr.14120 v1:172.21.15.49:6800/2600502005 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (unknown 0 0 96372106) 0x7f5988002630 con 0x7f598403e9b0 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6800/2600502005 conn(0x7f598403e9b0 legacy=0x7f5984040da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 >> v1:172.21.15.49:6789/0 conn(0x7f599c105ae0 legacy=0x7f599c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 shutdown_connections 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 >> 172.21.15.49:0/3720260134 conn(0x7f599c101040 msgr2=0x7f599c1034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 shutdown_connections 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:32.656+0000 7f59a18c8700 1 -- 172.21.15.49:0/3720260134 wait complete. 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 5 is available 2024-03-11T21:58:33.293 INFO:teuthology.orchestra.run.smithi049.stdout:Setting orchestrator backend to cephadm... 2024-03-11T21:58:33.945 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:33 smithi049 bash[21434]: cephadm 2024-03-11T21:58:32.468776+0000 mgr.y (mgr.14120) 3 : cephadm 1 [11/Mar/2024:21:58:32] ENGINE Serving on https://172.21.15.49:7150 2024-03-11T21:58:33.945 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:33 smithi049 bash[21434]: cephadm 2024-03-11T21:58:32.570222+0000 mgr.y (mgr.14120) 4 : cephadm 1 [11/Mar/2024:21:58:32] ENGINE Serving on http://172.21.15.49:8765 2024-03-11T21:58:33.945 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:33 smithi049 bash[21434]: cephadm 2024-03-11T21:58:32.570352+0000 mgr.y (mgr.14120) 5 : cephadm 1 [11/Mar/2024:21:58:32] ENGINE Bus STARTED 2024-03-11T21:58:33.946 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:33 smithi049 bash[21434]: audit 2024-03-11T21:58:32.644662+0000 mgr.y (mgr.14120) 6 : audit 0 from='client.14124 v1:172.21.15.49:0/3720260134' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-11T21:58:33.946 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:33 smithi049 bash[21434]: audit 2024-03-11T21:58:32.658497+0000 mgr.y (mgr.14120) 7 : audit 0 from='client.14124 v1:172.21.15.49:0/3720260134' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-11T21:58:35.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:34 smithi049 bash[21434]: cluster 2024-03-11T21:58:33.699906+0000 mon.a (mon.0) 55 : cluster 0 mgrmap e8: y(active, since 2s) 2024-03-11T21:58:35.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:34 smithi049 bash[21434]: audit 2024-03-11T21:58:34.540629+0000 mon.a (mon.0) 56 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:35.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:34 smithi049 bash[21434]: audit 2024-03-11T21:58:34.600850+0000 mon.a (mon.0) 57 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 Processor -- start 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- start start 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7584109f40 con 0x7f7584105b10 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7582d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7584105b10 0x7f7584105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38778/0 (socket says 172.21.15.49:38778) 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7582d9d700 1 -- 172.21.15.49:0/3652304379 learned_addr learned my addr 172.21.15.49:0/3652304379 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7581d9b700 1 -- 172.21.15.49:0/3652304379 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418386425 0 0) 0x7f7584109f40 con 0x7f7584105b10 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7581d9b700 1 -- 172.21.15.49:0/3652304379 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f756c0035b0 con 0x7f7584105b10 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7581d9b700 1 -- 172.21.15.49:0/3652304379 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 531223156 0 0) 0x7f756c0035b0 con 0x7f7584105b10 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7581d9b700 1 -- 172.21.15.49:0/3652304379 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758410b0e0 con 0x7f7584105b10 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7581d9b700 1 -- 172.21.15.49:0/3652304379 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7574001580 con 0x7f7584105b10 2024-03-11T21:58:35.118 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7581d9b700 1 -- 172.21.15.49:0/3652304379 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f7574001c10 con 0x7f7584105b10 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7581d9b700 1 -- 172.21.15.49:0/3652304379 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7574005780 con 0x7f7584105b10 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- 172.21.15.49:0/3652304379 >> v1:172.21.15.49:6789/0 conn(0x7f7584105b10 legacy=0x7f7584105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- 172.21.15.49:0/3652304379 shutdown_connections 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- 172.21.15.49:0/3652304379 >> 172.21.15.49:0/3652304379 conn(0x7f75841010b0 msgr2=0x7f75841034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- 172.21.15.49:0/3652304379 shutdown_connections 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- 172.21.15.49:0/3652304379 wait complete. 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 Processor -- start 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- start start 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f758905e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7584199b70 con 0x7f7584105b10 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7582d9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7584105b10 0x7f7584199460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38784/0 (socket says 172.21.15.49:38784) 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.124+0000 7f7582d9d700 1 -- 172.21.15.49:0/1678923727 learned_addr learned my addr 172.21.15.49:0/1678923727 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:35.119 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255730548 0 0) 0x7f7584199b70 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f756c005540 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2791881882 0 0) 0x7f756c005540 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7584199b70 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7574001080 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2951274963 0 0) 0x7f7584199b70 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7584199d00 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7584199fb0 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f758419db00 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f7574001a10 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f75740060e0 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7570005150 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7f7574011510 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.128+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f7574047050 con 0x7f7584105b10 2024-03-11T21:58:35.120 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.132+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f7574012dc0 con 0x7f7584105b10 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.532+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 --> v1:172.21.15.49:6800/2600502005 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f7570000bc0 con 0x7f756c039e90 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.540+0000 7f756bfff700 1 -- 172.21.15.49:0/1678923727 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f7570000bc0 con 0x7f756c039e90 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.540+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 >> v1:172.21.15.49:6800/2600502005 conn(0x7f756c039e90 legacy=0x7f756c03c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.544+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 >> v1:172.21.15.49:6789/0 conn(0x7f7584105b10 legacy=0x7f7584199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.544+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 shutdown_connections 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.544+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 >> 172.21.15.49:0/1678923727 conn(0x7f75841010b0 msgr2=0x7f75841034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.544+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 shutdown_connections 2024-03-11T21:58:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:34.544+0000 7f758905e700 1 -- 172.21.15.49:0/1678923727 wait complete. 2024-03-11T21:58:36.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:35 smithi049 bash[21434]: audit 2024-03-11T21:58:34.535571+0000 mgr.y (mgr.14120) 8 : audit 0 from='client.14132 v1:172.21.15.49:0/1678923727' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.932+0000 7f0df2daa700 1 Processor -- start 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.932+0000 7f0df2daa700 1 -- start start 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.932+0000 7f0df2daa700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0dec104380 con 0x7f0dec103850 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.932+0000 7f0df0b46700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0dec103850 0x7f0dec103c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38798/0 (socket says 172.21.15.49:38798) 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.932+0000 7f0df0b46700 1 -- 172.21.15.49:0/4036544801 learned_addr learned my addr 172.21.15.49:0/4036544801 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.932+0000 7f0deb7fe700 1 -- 172.21.15.49:0/4036544801 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338145008 0 0) 0x7f0dec104380 con 0x7f0dec103850 2024-03-11T21:58:36.895 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.932+0000 7f0deb7fe700 1 -- 172.21.15.49:0/4036544801 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd80035b0 con 0x7f0dec103850 2024-03-11T21:58:36.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0deb7fe700 1 -- 172.21.15.49:0/4036544801 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193790822 0 0) 0x7f0dd80035b0 con 0x7f0dec103850 2024-03-11T21:58:36.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0deb7fe700 1 -- 172.21.15.49:0/4036544801 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec10b1d0 con 0x7f0dec103850 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0deb7fe700 1 -- 172.21.15.49:0/4036544801 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0ddc001580 con 0x7f0dec103850 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0deb7fe700 1 -- 172.21.15.49:0/4036544801 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f0ddc001c10 con 0x7f0dec103850 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0deb7fe700 1 -- 172.21.15.49:0/4036544801 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0ddc005780 con 0x7f0dec103850 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- 172.21.15.49:0/4036544801 >> v1:172.21.15.49:6789/0 conn(0x7f0dec103850 legacy=0x7f0dec103c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- 172.21.15.49:0/4036544801 shutdown_connections 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- 172.21.15.49:0/4036544801 >> 172.21.15.49:0/4036544801 conn(0x7f0dec0ff2d0 msgr2=0x7f0dec101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- 172.21.15.49:0/4036544801 shutdown_connections 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- 172.21.15.49:0/4036544801 wait complete. 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 Processor -- start 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- start start 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0dec19f4c0 con 0x7f0dec103850 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df0b46700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0dec103850 0x7f0dec106a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38804/0 (socket says 172.21.15.49:38804) 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df0b46700 1 -- 172.21.15.49:0/1390442655 learned_addr learned my addr 172.21.15.49:0/1390442655 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319983602 0 0) 0x7f0dec19f4c0 con 0x7f0dec103850 2024-03-11T21:58:36.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd8005540 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 635654269 0 0) 0x7f0dd8005540 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0dec19f4c0 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0ddc001080 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3386679815 0 0) 0x7f0dec19f4c0 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec1a0660 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec19f6b0 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec19fbb0 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f0ddc001a90 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.936+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0ddc006080 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.940+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7f0ddc011490 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.940+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f0ddc046fa0 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.940+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc005150 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:35.944+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0ddc012d40 con 0x7f0dec103850 2024-03-11T21:58:36.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.312+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 --> v1:172.21.15.49:6800/2600502005 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dcc000bc0 con 0x7f0dd8039f20 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.312+0000 7f0de9ffb700 1 -- 172.21.15.49:0/1390442655 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (unknown 0 0 2070689548) 0x7f0dcc000bc0 con 0x7f0dd8039f20 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.316+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 >> v1:172.21.15.49:6800/2600502005 conn(0x7f0dd8039f20 legacy=0x7f0dd803c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.316+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 >> v1:172.21.15.49:6789/0 conn(0x7f0dec103850 legacy=0x7f0dec106a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.316+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 shutdown_connections 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.316+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 >> 172.21.15.49:0/1390442655 conn(0x7f0dec0ff2d0 msgr2=0x7f0dec107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.316+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 shutdown_connections 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:36.316+0000 7f0df2daa700 1 -- 172.21.15.49:0/1390442655 wait complete. 2024-03-11T21:58:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:Generating ssh key... 2024-03-11T21:58:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:36 smithi049 bash[21434]: audit 2024-03-11T21:58:36.314505+0000 mgr.y (mgr.14120) 9 : audit 0 from='client.14134 v1:172.21.15.49:0/1390442655' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:58:38.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21434]: audit 2024-03-11T21:58:38.169971+0000 mgr.y (mgr.14120) 10 : audit 0 from='client.14136 v1:172.21.15.49:0/637682966' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:58:38.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21434]: cephadm 2024-03-11T21:58:38.170258+0000 mgr.y (mgr.14120) 11 : cephadm 1 Generating ssh key... 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: Generating public/private rsa key pair. 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: Your identification has been saved in /tmp/tmpas8ey2ql/key. 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: Your public key has been saved in /tmp/tmpas8ey2ql/key.pub. 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: The key fingerprint is: 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: SHA256:VCBq2RXOO8cRcFqERtgV1iendkmCca22qaKDupZX1tI ceph-377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: The key's randomart image is: 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: +---[RSA 3072]----+ 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | .+*B@=.. | 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | +.=+*.o+ = | 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | + ..= . O . | 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | . . o .= o | 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | oS oo + | 2024-03-11T21:58:38.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | + Eo o | 2024-03-11T21:58:38.773 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | . + . . | 2024-03-11T21:58:38.773 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | o o . . . | 2024-03-11T21:58:38.773 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: | .o+ .o . | 2024-03-11T21:58:38.773 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:38 smithi049 bash[21686]: +----[SHA256]-----+ 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.780+0000 7f1e513e3700 1 Processor -- start 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.780+0000 7f1e513e3700 1 -- start start 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.780+0000 7f1e513e3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f1e4c07a350 con 0x7f1e4c07b750 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e4affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e4c07b750 0x7f1e4c079bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38814/0 (socket says 172.21.15.49:38814) 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e4affd700 1 -- 172.21.15.49:0/2585701065 learned_addr learned my addr 172.21.15.49:0/2585701065 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e49ffb700 1 -- 172.21.15.49:0/2585701065 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351552908 0 0) 0x7f1e4c07a350 con 0x7f1e4c07b750 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e49ffb700 1 -- 172.21.15.49:0/2585701065 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e380035b0 con 0x7f1e4c07b750 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e49ffb700 1 -- 172.21.15.49:0/2585701065 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938162704 0 0) 0x7f1e380035b0 con 0x7f1e4c07b750 2024-03-11T21:58:39.180 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e49ffb700 1 -- 172.21.15.49:0/2585701065 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c07a4e0 con 0x7f1e4c07b750 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e49ffb700 1 -- 172.21.15.49:0/2585701065 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f1e3c001580 con 0x7f1e4c07b750 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e49ffb700 1 -- 172.21.15.49:0/2585701065 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f1e3c001c10 con 0x7f1e4c07b750 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e49ffb700 1 -- 172.21.15.49:0/2585701065 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f1e3c0057b0 con 0x7f1e4c07b750 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- 172.21.15.49:0/2585701065 >> v1:172.21.15.49:6789/0 conn(0x7f1e4c07b750 legacy=0x7f1e4c079bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- 172.21.15.49:0/2585701065 shutdown_connections 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- 172.21.15.49:0/2585701065 >> 172.21.15.49:0/2585701065 conn(0x7f1e4c1010b0 msgr2=0x7f1e4c1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- 172.21.15.49:0/2585701065 shutdown_connections 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- 172.21.15.49:0/2585701065 wait complete. 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 Processor -- start 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- start start 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f1e4c19bd60 con 0x7f1e4c07b750 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e4affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1e4c07b750 0x7f1e4c19b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38828/0 (socket says 172.21.15.49:38828) 2024-03-11T21:58:39.181 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e4affd700 1 -- 172.21.15.49:0/637682966 learned_addr learned my addr 172.21.15.49:0/637682966 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060587009 0 0) 0x7f1e4c19bd60 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e38005540 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3648055244 0 0) 0x7f1e38005540 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1e4c19bd60 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f1e3c001080 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 439764824 0 0) 0x7f1e4c19bd60 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c19bef0 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.784+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c19c1a0 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.788+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c19fcf0 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.788+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f1e3c0049b0 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.788+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f1e3c006280 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.788+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7f1e3c006400 con 0x7f1e4c07b750 2024-03-11T21:58:39.182 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.788+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c005150 con 0x7f1e4c07b750 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.788+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f1e3c047120 con 0x7f1e4c07b750 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:37.792+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f1e3c007c70 con 0x7f1e4c07b750 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.168+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 --> v1:172.21.15.49:6800/2600502005 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e2c000bc0 con 0x7f1e38039ee0 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.596+0000 7f1e43fff700 1 -- 172.21.15.49:0/637682966 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f1e2c000bc0 con 0x7f1e38039ee0 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.600+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 >> v1:172.21.15.49:6800/2600502005 conn(0x7f1e38039ee0 legacy=0x7f1e3803c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.600+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 >> v1:172.21.15.49:6789/0 conn(0x7f1e4c07b750 legacy=0x7f1e4c19b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.600+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 shutdown_connections 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.600+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 >> 172.21.15.49:0/637682966 conn(0x7f1e4c1010b0 msgr2=0x7f1e4c10c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.600+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 shutdown_connections 2024-03-11T21:58:39.183 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:38.600+0000 7f1e513e3700 1 -- 172.21.15.49:0/637682966 wait complete. 2024-03-11T21:58:40.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:39 smithi049 bash[21434]: audit 2024-03-11T21:58:38.593032+0000 mon.a (mon.0) 58 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:40.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:39 smithi049 bash[21434]: audit 2024-03-11T21:58:38.597304+0000 mon.a (mon.0) 59 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:40.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD9TcYFEvDxdI58xu23nXi8eWrddnCZAVzXDWlMmdBTQ6TEmJ1k9djs9Kjfg2ixIVxegNia8S0Cf+DMJ2EmKWPcWoQ8+YjBHPRTBAbXS7Ysxf5EgeewiIm1xfESFjGDV8L2SXubVRsaYpeuh59semuTUqHcY3G2sfucZIXa8P5FUuTsqSeBwPO4rHa3gWbdOkg1aDM8hgk6ws9RNQ9RPfgVblEOo8LhmYRrU2JDM7LlW405xAN9fRZzy/aP0QPETyhKtK1rDRSsLZkofkZI0OcbBo7cDdXmBbtuESeMXODAWxLjJaO2FdDi5EqBuonSokeFunJ4VZMXhdb1C9LpDvnJHSBYZz9lQ4xdNZZ7/sB46hRJ9nkv7XTU8QLGzeeisXutpH0JJgZ2z7H1PD4rlsVyzJWE/Ol2cIbSEiJsckibwfRx9zlkabO+WsVHYxZOndQZ9RirnvDgzh7+iUIFOTO3tMfTxrYRjh+2s1z/T2PCpJDIc2DsxTeRbOXgQsYKC1s= ceph-377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:58:40.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 Processor -- start 2024-03-11T21:58:40.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 -- start start 2024-03-11T21:58:40.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fee4c109f40 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee50c62700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fee4c105b10 0x7fee4c105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38836/0 (socket says 172.21.15.49:38836) 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee50c62700 1 -- 172.21.15.49:0/3447422518 learned_addr learned my addr 172.21.15.49:0/3447422518 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee4b7fe700 1 -- 172.21.15.49:0/3447422518 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312299655 0 0) 0x7fee4c109f40 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee4b7fe700 1 -- 172.21.15.49:0/3447422518 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee3c0035b0 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee4b7fe700 1 -- 172.21.15.49:0/3447422518 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044696193 0 0) 0x7fee3c0035b0 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee4b7fe700 1 -- 172.21.15.49:0/3447422518 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c10b0e0 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee4b7fe700 1 -- 172.21.15.49:0/3447422518 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fee40001580 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee4b7fe700 1 -- 172.21.15.49:0/3447422518 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fee40001c10 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee4b7fe700 1 -- 172.21.15.49:0/3447422518 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fee40005780 con 0x7fee4c105b10 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 -- 172.21.15.49:0/3447422518 >> v1:172.21.15.49:6789/0 conn(0x7fee4c105b10 legacy=0x7fee4c105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:40.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 -- 172.21.15.49:0/3447422518 shutdown_connections 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 -- 172.21.15.49:0/3447422518 >> 172.21.15.49:0/3447422518 conn(0x7fee4c1010d0 msgr2=0x7fee4c1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 -- 172.21.15.49:0/3447422518 shutdown_connections 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.004+0000 7fee52ec6700 1 -- 172.21.15.49:0/3447422518 wait complete. 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee52ec6700 1 Processor -- start 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee52ec6700 1 -- start start 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee52ec6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fee4c19f4f0 con 0x7fee4c105b10 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee50c62700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fee4c105b10 0x7fee4c07b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38840/0 (socket says 172.21.15.49:38840) 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee50c62700 1 -- 172.21.15.49:0/2553329652 learned_addr learned my addr 172.21.15.49:0/2553329652 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102527608 0 0) 0x7fee4c19f4f0 con 0x7fee4c105b10 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee3c005540 con 0x7fee4c105b10 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2567412075 0 0) 0x7fee3c005540 con 0x7fee4c105b10 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fee4c19f4f0 con 0x7fee4c105b10 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fee40001080 con 0x7fee4c105b10 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2209595530 0 0) 0x7fee4c19f4f0 con 0x7fee4c105b10 2024-03-11T21:58:40.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c1a0690 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c19f6e0 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c19fbe0 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fee40001a10 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fee400060a0 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7fee400114d0 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee30005150 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.008+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7fee40047020 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.012+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fee40012dd0 con 0x7fee4c105b10 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.388+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 --> v1:172.21.15.49:6800/2600502005 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fee30000bc0 con 0x7fee3c039e90 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.392+0000 7fee49ffb700 1 -- 172.21.15.49:0/2553329652 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (unknown 0 0 2379427029) 0x7fee30000bc0 con 0x7fee3c039e90 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.392+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 >> v1:172.21.15.49:6800/2600502005 conn(0x7fee3c039e90 legacy=0x7fee3c03c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.392+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 >> v1:172.21.15.49:6789/0 conn(0x7fee4c105b10 legacy=0x7fee4c07b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.392+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 shutdown_connections 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.392+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 >> 172.21.15.49:0/2553329652 conn(0x7fee4c1010d0 msgr2=0x7fee4c1034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:40.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.392+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 shutdown_connections 2024-03-11T21:58:40.981 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:40.392+0000 7fee52ec6700 1 -- 172.21.15.49:0/2553329652 wait complete. 2024-03-11T21:58:40.981 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-11T21:58:40.981 INFO:teuthology.orchestra.run.smithi049.stdout:Adding key to root@localhost authorized_keys... 2024-03-11T21:58:40.981 INFO:teuthology.orchestra.run.smithi049.stdout:Adding host smithi049... 2024-03-11T21:58:41.664 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:41 smithi049 bash[21434]: audit 2024-03-11T21:58:40.392689+0000 mgr.y (mgr.14120) 12 : audit 0 from='client.14138 v1:172.21.15.49:0/2553329652' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:58:42.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:42 smithi049 bash[21434]: audit 2024-03-11T21:58:42.244531+0000 mgr.y (mgr.14120) 13 : audit 0 from='client.14140 v1:172.21.15.49:0/513607092' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:58:43.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:43 smithi049 bash[21434]: cephadm 2024-03-11T21:58:42.889677+0000 mgr.y (mgr.14120) 14 : cephadm 1 Deploying cephadm binary to smithi049 2024-03-11T21:58:48.596 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Added host 'smithi049' with addr '172.21.15.49' 2024-03-11T21:58:48.597 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa3ab5f6700 1 Processor -- start 2024-03-11T21:58:48.597 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa3ab5f6700 1 -- start start 2024-03-11T21:58:48.597 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa3ab5f6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa3a407a390 con 0x7fa3a407b790 2024-03-11T21:58:48.597 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa3a9392700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3a407b790 0x7fa3a4079bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38842/0 (socket says 172.21.15.49:38842) 2024-03-11T21:58:48.597 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa3a9392700 1 -- 172.21.15.49:0/3041948434 learned_addr learned my addr 172.21.15.49:0/3041948434 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:48.597 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa39bfff700 1 -- 172.21.15.49:0/3041948434 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44501280 0 0) 0x7fa3a407a390 con 0x7fa3a407b790 2024-03-11T21:58:48.597 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa39bfff700 1 -- 172.21.15.49:0/3041948434 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3900035b0 con 0x7fa3a407b790 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa39bfff700 1 -- 172.21.15.49:0/3041948434 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 653874017 0 0) 0x7fa3900035b0 con 0x7fa3a407b790 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa39bfff700 1 -- 172.21.15.49:0/3041948434 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a407a520 con 0x7fa3a407b790 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa39bfff700 1 -- 172.21.15.49:0/3041948434 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fa39c001900 con 0x7fa3a407b790 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa39bfff700 1 -- 172.21.15.49:0/3041948434 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fa39c001f90 con 0x7fa3a407b790 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.852+0000 7fa39bfff700 1 -- 172.21.15.49:0/3041948434 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fa39c005b30 con 0x7fa3a407b790 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/3041948434 >> v1:172.21.15.49:6789/0 conn(0x7fa3a407b790 legacy=0x7fa3a4079bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/3041948434 shutdown_connections 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/3041948434 >> 172.21.15.49:0/3041948434 conn(0x7fa3a41010b0 msgr2=0x7fa3a41034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/3041948434 shutdown_connections 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/3041948434 wait complete. 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 Processor -- start 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- start start 2024-03-11T21:58:48.598 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa3a419bd30 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3a9392700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa3a407b790 0x7fa3a419b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38846/0 (socket says 172.21.15.49:38846) 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3a9392700 1 -- 172.21.15.49:0/513607092 learned_addr learned my addr 172.21.15.49:0/513607092 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031929345 0 0) 0x7fa3a419bd30 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa390005540 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 450518057 0 0) 0x7fa390005540 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa3a419bd30 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fa39c001400 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4119025731 0 0) 0x7fa3a419bd30 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a419bec0 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a419c170 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a419fcc0 con 0x7fa3a407b790 2024-03-11T21:58:48.599 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7fa39c004d30 con 0x7fa3a407b790 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fa39c006450 con 0x7fa3a407b790 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7fa39c011880 con 0x7fa3a407b790 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa388005150 con 0x7fa3a407b790 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.856+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7fa39c047360 con 0x7fa3a407b790 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:41.864+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fa39c0130e0 con 0x7fa3a407b790 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:42.240+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 --> v1:172.21.15.49:6800/2600502005 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}) v1 -- 0x7fa388000bc0 con 0x7fa390039f30 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:47.915+0000 7fa39a7fc700 1 -- 172.21.15.49:0/513607092 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (unknown 0 0 635971403) 0x7fa388000bc0 con 0x7fa390039f30 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:47.919+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 >> v1:172.21.15.49:6800/2600502005 conn(0x7fa390039f30 legacy=0x7fa39003c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:47.919+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 >> v1:172.21.15.49:6789/0 conn(0x7fa3a407b790 legacy=0x7fa3a419b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:47.919+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 shutdown_connections 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:47.919+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 >> 172.21.15.49:0/513607092 conn(0x7fa3a41010b0 msgr2=0x7fa3a4109fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:47.919+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 shutdown_connections 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:47.919+0000 7fa3ab5f6700 1 -- 172.21.15.49:0/513607092 wait complete. 2024-03-11T21:58:48.600 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying unmanaged mon service... 2024-03-11T21:58:49.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:48 smithi049 bash[21434]: audit 2024-03-11T21:58:47.918987+0000 mon.a (mon.0) 60 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:49.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:48 smithi049 bash[21434]: cephadm 2024-03-11T21:58:47.919675+0000 mgr.y (mgr.14120) 15 : cephadm 1 Added host smithi049 2024-03-11T21:58:49.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:48 smithi049 bash[21434]: audit 2024-03-11T21:58:47.956656+0000 mon.a (mon.0) 61 : audit 0 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:58:51.190 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-11T21:58:51.190 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.103+0000 7f9cc9913700 1 Processor -- start 2024-03-11T21:58:51.190 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.103+0000 7f9cc9913700 1 -- start start 2024-03-11T21:58:51.190 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc40796e0 con 0x7f9cc4106610 2024-03-11T21:58:51.190 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc2ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9cc4106610 0x7f9cc4108a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42224/0 (socket says 172.21.15.49:42224) 2024-03-11T21:58:51.190 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc2ffd700 1 -- 172.21.15.49:0/1816341997 learned_addr learned my addr 172.21.15.49:0/1816341997 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:51.190 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc27fc700 1 -- 172.21.15.49:0/1816341997 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350905748 0 0) 0x7f9cc40796e0 con 0x7f9cc4106610 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc27fc700 1 -- 172.21.15.49:0/1816341997 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb00035b0 con 0x7f9cc4106610 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc27fc700 1 -- 172.21.15.49:0/1816341997 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110271837 0 0) 0x7f9cb00035b0 con 0x7f9cc4106610 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc27fc700 1 -- 172.21.15.49:0/1816341997 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc410b130 con 0x7f9cc4106610 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc27fc700 1 -- 172.21.15.49:0/1816341997 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9cb4001580 con 0x7f9cc4106610 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc27fc700 1 -- 172.21.15.49:0/1816341997 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f9cb4001ce0 con 0x7f9cc4106610 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc27fc700 1 -- 172.21.15.49:0/1816341997 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9cb4005960 con 0x7f9cc4106610 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- 172.21.15.49:0/1816341997 >> v1:172.21.15.49:6789/0 conn(0x7f9cc4106610 legacy=0x7f9cc4108a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- 172.21.15.49:0/1816341997 shutdown_connections 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- 172.21.15.49:0/1816341997 >> 172.21.15.49:0/1816341997 conn(0x7f9cc40fffa0 msgr2=0x7f9cc4102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:51.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- 172.21.15.49:0/1816341997 shutdown_connections 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- 172.21.15.49:0/1816341997 wait complete. 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 Processor -- start 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- start start 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc9913700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc419f490 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc2ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9cc4106610 0x7f9cc4105e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42232/0 (socket says 172.21.15.49:42232) 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc2ffd700 1 -- 172.21.15.49:0/3372231854 learned_addr learned my addr 172.21.15.49:0/3372231854 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153714563 0 0) 0x7f9cc419f490 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb00054f0 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 246833653 0 0) 0x7f9cb00054f0 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cc419f490 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9cb4004870 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3257182321 0 0) 0x7f9cc419f490 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.107+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc41a0630 con 0x7f9cc4106610 2024-03-11T21:58:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.111+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc419f680 con 0x7f9cc4106610 2024-03-11T21:58:51.195 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.111+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc419fb80 con 0x7f9cc4106610 2024-03-11T21:58:51.196 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.111+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 3474583554 0 0) 0x7f9cb4004a40 con 0x7f9cc4106610 2024-03-11T21:58:51.196 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.111+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9cb4006160 con 0x7f9cc4106610 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.111+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7f9cb4006430 con 0x7f9cc4106610 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.111+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca4005150 con 0x7f9cc4106610 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.111+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f9cb40470c0 con 0x7f9cc4106610 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.115+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9cb4007220 con 0x7f9cc4106610 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.511+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 --> v1:172.21.15.49:6800/2600502005 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9ca4000bc0 con 0x7f9cb0039f00 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.519+0000 7f9cc8911700 1 -- 172.21.15.49:0/3372231854 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 3265049985) 0x7f9ca4000bc0 con 0x7f9cb0039f00 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.523+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 >> v1:172.21.15.49:6800/2600502005 conn(0x7f9cb0039f00 legacy=0x7f9cb003c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.523+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 >> v1:172.21.15.49:6789/0 conn(0x7f9cc4106610 legacy=0x7f9cc4105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.523+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 shutdown_connections 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.523+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 >> 172.21.15.49:0/3372231854 conn(0x7f9cc40fffa0 msgr2=0x7f9cc4190270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.523+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 shutdown_connections 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:50.523+0000 7f9cc9913700 1 -- 172.21.15.49:0/3372231854 wait complete. 2024-03-11T21:58:51.197 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying unmanaged mgr service... 2024-03-11T21:58:51.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:51 smithi049 bash[21434]: audit 2024-03-11T21:58:50.515783+0000 mgr.y (mgr.14120) 16 : audit 0 from='client.14142 v1:172.21.15.49:0/3372231854' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:58:51.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:51 smithi049 bash[21434]: cephadm 2024-03-11T21:58:50.517694+0000 mgr.y (mgr.14120) 17 : cephadm 1 Saving service mon spec with placement count:5 2024-03-11T21:58:51.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:51 smithi049 bash[21434]: audit 2024-03-11T21:58:50.522365+0000 mon.a (mon.0) 62 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:51.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:51 smithi049 bash[21434]: audit 2024-03-11T21:58:50.832734+0000 mon.a (mon.0) 63 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:51.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:51 smithi049 bash[21434]: audit 2024-03-11T21:58:51.378288+0000 mon.a (mon.0) 64 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:52.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:52 smithi049 bash[21434]: cluster 2024-03-11T21:58:51.649813+0000 mgr.y (mgr.14120) 18 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:58:52.813 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:52 smithi049 bash[21434]: audit 2024-03-11T21:58:52.467191+0000 mon.a (mon.0) 65 : audit 1 from='mgr.14120 v1:172.21.15.49:0/1165476656' entity='mgr.y' 2024-03-11T21:58:53.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-11T21:58:53.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 Processor -- start 2024-03-11T21:58:53.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- start start 2024-03-11T21:58:53.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcee010c140 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcedeffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcee0107d10 0x7fcee0108130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42236/0 (socket says 172.21.15.49:42236) 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcedeffd700 1 -- 172.21.15.49:0/2979124292 learned_addr learned my addr 172.21.15.49:0/2979124292 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fceddffb700 1 -- 172.21.15.49:0/2979124292 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311888370 0 0) 0x7fcee010c140 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fceddffb700 1 -- 172.21.15.49:0/2979124292 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec80035b0 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fceddffb700 1 -- 172.21.15.49:0/2979124292 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 828068421 0 0) 0x7fcec80035b0 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fceddffb700 1 -- 172.21.15.49:0/2979124292 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee010d2e0 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fceddffb700 1 -- 172.21.15.49:0/2979124292 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fced0001580 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fceddffb700 1 -- 172.21.15.49:0/2979124292 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fced0001c30 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fceddffb700 1 -- 172.21.15.49:0/2979124292 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fced0005770 con 0x7fcee0107d10 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- 172.21.15.49:0/2979124292 >> v1:172.21.15.49:6789/0 conn(0x7fcee0107d10 legacy=0x7fcee0108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- 172.21.15.49:0/2979124292 shutdown_connections 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- 172.21.15.49:0/2979124292 >> 172.21.15.49:0/2979124292 conn(0x7fcee007b0e0 msgr2=0x7fcee0105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- 172.21.15.49:0/2979124292 shutdown_connections 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- 172.21.15.49:0/2979124292 wait complete. 2024-03-11T21:58:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 Processor -- start 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- start start 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcee5673700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcee019bdb0 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcedeffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcee0107d10 0x7fcee019b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42240/0 (socket says 172.21.15.49:42240) 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.051+0000 7fcedeffd700 1 -- 172.21.15.49:0/205911325 learned_addr learned my addr 172.21.15.49:0/205911325 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42211138 0 0) 0x7fcee019bdb0 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec8005540 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4187857235 0 0) 0x7fcec8005540 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcee019bdb0 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fced0001080 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 594532116 0 0) 0x7fcee019bdb0 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee019bf40 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee019c1f0 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee019fd40 con 0x7fcee0107d10 2024-03-11T21:58:53.018 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fced0004870 con 0x7fcee0107d10 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fced0006120 con 0x7fcee0107d10 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7fced0011550 con 0x7fcee0107d10 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc005120 con 0x7fcee0107d10 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.055+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7fced0047060 con 0x7fcee0107d10 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.059+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fced0012db0 con 0x7fcee0107d10 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.455+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 --> v1:172.21.15.49:6800/2600502005 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fcecc000b90 con 0x7fcec8039f30 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.463+0000 7fcec7fff700 1 -- 172.21.15.49:0/205911325 <== mgr.14120 v1:172.21.15.49:6800/2600502005 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 325935098) 0x7fcecc000b90 con 0x7fcec8039f30 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.467+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 >> v1:172.21.15.49:6800/2600502005 conn(0x7fcec8039f30 legacy=0x7fcec803c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.467+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 >> v1:172.21.15.49:6789/0 conn(0x7fcee0107d10 legacy=0x7fcee019b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.467+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 shutdown_connections 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.467+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 >> 172.21.15.49:0/205911325 conn(0x7fcee007b0e0 msgr2=0x7fcee01924c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.467+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 shutdown_connections 2024-03-11T21:58:53.019 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:52.467+0000 7fcee5673700 1 -- 172.21.15.49:0/205911325 wait complete. 2024-03-11T21:58:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:53 smithi049 bash[21434]: audit 2024-03-11T21:58:52.461809+0000 mgr.y (mgr.14120) 19 : audit 0 from='client.14144 v1:172.21.15.49:0/205911325' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:58:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:53 smithi049 bash[21434]: cephadm 2024-03-11T21:58:52.464400+0000 mgr.y (mgr.14120) 20 : cephadm 1 Saving service mgr spec with placement count:2 2024-03-11T21:58:54.925 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 Processor -- start 2024-03-11T21:58:54.926 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 -- start start 2024-03-11T21:58:54.926 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f744010d3a0 con 0x7f744010c7e0 2024-03-11T21:58:54.926 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f744010c7e0 0x7f744010cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35100/0 (socket says 172.21.15.49:35100) 2024-03-11T21:58:54.926 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743effd700 1 -- 172.21.15.49:0/1051926936 learned_addr learned my addr 172.21.15.49:0/1051926936 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743dffb700 1 -- 172.21.15.49:0/1051926936 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228651779 0 0) 0x7f744010d3a0 con 0x7f744010c7e0 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743dffb700 1 -- 172.21.15.49:0/1051926936 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c0035b0 con 0x7f744010c7e0 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743dffb700 1 -- 172.21.15.49:0/1051926936 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027766738 0 0) 0x7f742c0035b0 con 0x7f744010c7e0 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743dffb700 1 -- 172.21.15.49:0/1051926936 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74401116a0 con 0x7f744010c7e0 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743dffb700 1 -- 172.21.15.49:0/1051926936 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7430001580 con 0x7f744010c7e0 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743dffb700 1 -- 172.21.15.49:0/1051926936 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f7430001d00 con 0x7f744010c7e0 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f743dffb700 1 -- 172.21.15.49:0/1051926936 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7430005960 con 0x7f744010c7e0 2024-03-11T21:58:54.927 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 -- 172.21.15.49:0/1051926936 >> v1:172.21.15.49:6789/0 conn(0x7f744010c7e0 legacy=0x7f744010cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:54.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 -- 172.21.15.49:0/1051926936 shutdown_connections 2024-03-11T21:58:54.928 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 -- 172.21.15.49:0/1051926936 >> 172.21.15.49:0/1051926936 conn(0x7f744007b0e0 msgr2=0x7f744007d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:54.929 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 -- 172.21.15.49:0/1051926936 shutdown_connections 2024-03-11T21:58:54.929 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.935+0000 7f7445756700 1 -- 172.21.15.49:0/1051926936 wait complete. 2024-03-11T21:58:54.929 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7445756700 1 Processor -- start 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7445756700 1 -- start start 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7445756700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f74401a0130 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f743effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f744010c7e0 0x7f744019fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35116/0 (socket says 172.21.15.49:35116) 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f743effd700 1 -- 172.21.15.49:0/1243489482 learned_addr learned my addr 172.21.15.49:0/1243489482 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947007385 0 0) 0x7f74401a0130 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c0054f0 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3017519102 0 0) 0x7f742c0054f0 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f74401a0130 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7430001080 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3204046754 0 0) 0x7f74401a0130 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74401a02c0 con 0x7f744010c7e0 2024-03-11T21:58:54.930 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74401a0570 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f74401a40c0 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f7430004a60 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f7430006190 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7f74300115c0 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7420005150 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.939+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f7430047080 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:53.943+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f7430012e30 con 0x7f744010c7e0 2024-03-11T21:58:54.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.311+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 --> v1:172.21.15.49:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f7420005400 con 0x7f744010c7e0 2024-03-11T21:58:54.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.315+0000 7f7437fff700 1 -- 172.21.15.49:0/1243489482 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (unknown 2684808024 0 0) 0x7f7430014f10 con 0x7f744010c7e0 2024-03-11T21:58:54.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.319+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 >> v1:172.21.15.49:6800/2600502005 conn(0x7f742c039f40 legacy=0x7f742c03c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:54.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.319+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 >> v1:172.21.15.49:6789/0 conn(0x7f744010c7e0 legacy=0x7f744019fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:54.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.319+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 shutdown_connections 2024-03-11T21:58:54.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.319+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 >> 172.21.15.49:0/1243489482 conn(0x7f744007b0e0 msgr2=0x7f744010dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:54.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.319+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 shutdown_connections 2024-03-11T21:58:54.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:54.319+0000 7f7445756700 1 -- 172.21.15.49:0/1243489482 wait complete. 2024-03-11T21:58:55.595 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:55 smithi049 bash[21434]: cluster 2024-03-11T21:58:53.650255+0000 mgr.y (mgr.14120) 21 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:58:55.595 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:55 smithi049 bash[21434]: audit 2024-03-11T21:58:54.318249+0000 mon.a (mon.0) 66 : audit 1 from='client.? v1:172.21.15.49:0/1243489482' entity='client.admin' 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 Processor -- start 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- start start 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0878109f40 con 0x7f0878105b10 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087cd3a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0878105b10 0x7f0878105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35124/0 (socket says 172.21.15.49:35124) 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087cd3a700 1 -- 172.21.15.49:0/1696492228 learned_addr learned my addr 172.21.15.49:0/1696492228 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f08777fe700 1 -- 172.21.15.49:0/1696492228 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682830106 0 0) 0x7f0878109f40 con 0x7f0878105b10 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f08777fe700 1 -- 172.21.15.49:0/1696492228 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08600035b0 con 0x7f0878105b10 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f08777fe700 1 -- 172.21.15.49:0/1696492228 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1634090910 0 0) 0x7f08600035b0 con 0x7f0878105b10 2024-03-11T21:58:56.761 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f08777fe700 1 -- 172.21.15.49:0/1696492228 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087810b0e0 con 0x7f0878105b10 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f08777fe700 1 -- 172.21.15.49:0/1696492228 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0868001580 con 0x7f0878105b10 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f08777fe700 1 -- 172.21.15.49:0/1696492228 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f0868001d00 con 0x7f0878105b10 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f08777fe700 1 -- 172.21.15.49:0/1696492228 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0868005960 con 0x7f0878105b10 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- 172.21.15.49:0/1696492228 >> v1:172.21.15.49:6789/0 conn(0x7f0878105b10 legacy=0x7f0878105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- 172.21.15.49:0/1696492228 shutdown_connections 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- 172.21.15.49:0/1696492228 >> 172.21.15.49:0/1696492228 conn(0x7f08781010b0 msgr2=0x7f08781034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- 172.21.15.49:0/1696492228 shutdown_connections 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- 172.21.15.49:0/1696492228 wait complete. 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 Processor -- start 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- start start 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087ef9e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0878199b20 con 0x7f0878105b10 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087cd3a700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0878105b10 0x7f0878199410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35134/0 (socket says 172.21.15.49:35134) 2024-03-11T21:58:56.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.811+0000 7f087cd3a700 1 -- 172.21.15.49:0/2111527360 learned_addr learned my addr 172.21.15.49:0/2111527360 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425577657 0 0) 0x7f0878199b20 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08600054f0 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1347105642 0 0) 0x7f08600054f0 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0878199b20 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0868001080 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2472570556 0 0) 0x7f0878199b20 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878199cb0 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0878199f60 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f087819dab0 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f08680049f0 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0868006130 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7f0868005610 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0864005150 con 0x7f0878105b10 2024-03-11T21:58:56.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.815+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f0868047130 con 0x7f0878105b10 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:55.819+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0868005bb0 con 0x7f0878105b10 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.187+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 --> v1:172.21.15.49:6789/0 -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f0864005980 con 0x7f0878105b10 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.191+0000 7f0875ffb700 1 -- 172.21.15.49:0/2111527360 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (unknown 1496729260 0 0) 0x7f086801e5b0 con 0x7f0878105b10 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.195+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 >> v1:172.21.15.49:6800/2600502005 conn(0x7f0860039ef0 legacy=0x7f086003c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.195+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 >> v1:172.21.15.49:6789/0 conn(0x7f0878105b10 legacy=0x7f0878199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.195+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 shutdown_connections 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.195+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 >> 172.21.15.49:0/2111527360 conn(0x7f08781010b0 msgr2=0x7f08781034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.195+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 shutdown_connections 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:56.195+0000 7f087ef9e700 1 -- 172.21.15.49:0/2111527360 wait complete. 2024-03-11T21:58:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling the dashboard module... 2024-03-11T21:58:57.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:57 smithi049 bash[21434]: cluster 2024-03-11T21:58:55.650589+0000 mgr.y (mgr.14120) 22 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:58:57.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:57 smithi049 bash[21434]: audit 2024-03-11T21:58:56.193648+0000 mon.a (mon.0) 67 : audit 1 from='client.? v1:172.21.15.49:0/2111527360' entity='client.admin' 2024-03-11T21:58:58.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:58 smithi049 bash[21434]: audit 2024-03-11T21:58:58.139409+0000 mon.a (mon.0) 68 : audit 1 from='client.? v1:172.21.15.49:0/4054532972' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-11T21:58:58.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:58 smithi049 bash[21686]: ignoring --setuser ceph since I am not root 2024-03-11T21:58:58.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:58 smithi049 bash[21686]: ignoring --setgroup ceph since I am not root 2024-03-11T21:58:58.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:58:58 smithi049 bash[21686]: debug 2024-03-11T21:58:58.391+0000 7f2bc69a7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-11T21:58:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.635+0000 7fb62f27c700 1 Processor -- start 2024-03-11T21:58:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.635+0000 7fb62f27c700 1 -- start start 2024-03-11T21:58:58.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.635+0000 7fb62f27c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb6281049b0 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.635+0000 7fb62d018700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb628103df0 0x7fb628104210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35142/0 (socket says 172.21.15.49:35142) 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.635+0000 7fb62d018700 1 -- 172.21.15.49:0/3314394307 learned_addr learned my addr 172.21.15.49:0/3314394307 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.635+0000 7fb61ffff700 1 -- 172.21.15.49:0/3314394307 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245604597 0 0) 0x7fb6281049b0 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61ffff700 1 -- 172.21.15.49:0/3314394307 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6140035b0 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61ffff700 1 -- 172.21.15.49:0/3314394307 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4043790978 0 0) 0x7fb6140035b0 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61ffff700 1 -- 172.21.15.49:0/3314394307 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62810b0b0 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61ffff700 1 -- 172.21.15.49:0/3314394307 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fb624001580 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61ffff700 1 -- 172.21.15.49:0/3314394307 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fb624001c30 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61ffff700 1 -- 172.21.15.49:0/3314394307 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fb624005770 con 0x7fb628103df0 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- 172.21.15.49:0/3314394307 >> v1:172.21.15.49:6789/0 conn(0x7fb628103df0 legacy=0x7fb628104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- 172.21.15.49:0/3314394307 shutdown_connections 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- 172.21.15.49:0/3314394307 >> 172.21.15.49:0/3314394307 conn(0x7fb6280ff730 msgr2=0x7fb628101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- 172.21.15.49:0/3314394307 shutdown_connections 2024-03-11T21:58:58.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- 172.21.15.49:0/3314394307 wait complete. 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 Processor -- start 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- start start 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb62819bdc0 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62d018700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb628103df0 0x7fb62819b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35156/0 (socket says 172.21.15.49:35156) 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62d018700 1 -- 172.21.15.49:0/4054532972 learned_addr learned my addr 172.21.15.49:0/4054532972 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939146195 0 0) 0x7fb62819bdc0 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb614005540 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2284229868 0 0) 0x7fb614005540 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb62819bdc0 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fb624001080 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2098014144 0 0) 0x7fb62819bdc0 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62819bf50 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62819c200 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62819fd50 con 0x7fb628103df0 2024-03-11T21:58:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fb624004940 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fb6240061f0 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.639+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 8) v1 ==== 45734+0+0 (unknown 2300079619 0 0) 0x7fb624011620 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.643+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7fb6240470f0 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.643+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c005120 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:57.647+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb624016b90 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.135+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fb60c0053d0 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.195+0000 7fb61e7fc700 1 -- 172.21.15.49:0/4054532972 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (unknown 1498667528 0 0) 0x7fb624014f60 con 0x7fb628103df0 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.199+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 >> v1:172.21.15.49:6800/2600502005 conn(0x7fb614039ee0 legacy=0x7fb61403c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.199+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 >> v1:172.21.15.49:6789/0 conn(0x7fb628103df0 legacy=0x7fb62819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.199+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 shutdown_connections 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.199+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 >> 172.21.15.49:0/4054532972 conn(0x7fb6280ff730 msgr2=0x7fb6280ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.199+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 shutdown_connections 2024-03-11T21:58:58.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:58.199+0000 7fb62f27c700 1 -- 172.21.15.49:0/4054532972 wait complete. 2024-03-11T21:58:59.492 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:59 smithi049 bash[21434]: audit 2024-03-11T21:58:58.197491+0000 mon.a (mon.0) 69 : audit 1 from='client.? v1:172.21.15.49:0/4054532972' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-11T21:58:59.492 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:58:59 smithi049 bash[21434]: cluster 2024-03-11T21:58:58.202765+0000 mon.a (mon.0) 70 : cluster 0 mgrmap e9: y(active, since 26s) 2024-03-11T21:59:00.398 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:00 smithi049 bash[21434]: audit 2024-03-11T21:59:00.184983+0000 mon.a (mon.0) 71 : audit 0 from='client.? v1:172.21.15.49:0/507528138' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-11T21:59:00.398 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:00 smithi049 bash[21686]: debug 2024-03-11T21:59:00.059+0000 7f2bc69a7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-11T21:59:00.398 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:00 smithi049 bash[21686]: debug 2024-03-11T21:59:00.199+0000 7f2bc69a7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-11T21:59:00.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:00 smithi049 bash[21686]: debug 2024-03-11T21:59:00.459+0000 7f2bc69a7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f544032c700 1 Processor -- start 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f544032c700 1 -- start start 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f544032c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5438105d50 con 0x7f5438103df0 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543e0c8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5438103df0 0x7f5438104210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35188/0 (socket says 172.21.15.49:35188) 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543e0c8700 1 -- 172.21.15.49:0/2640300904 learned_addr learned my addr 172.21.15.49:0/2640300904 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:00.821 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543d0c6700 1 -- 172.21.15.49:0/2640300904 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913882506 0 0) 0x7f5438105d50 con 0x7f5438103df0 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543d0c6700 1 -- 172.21.15.49:0/2640300904 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54240035b0 con 0x7f5438103df0 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543d0c6700 1 -- 172.21.15.49:0/2640300904 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359391736 0 0) 0x7f54240035b0 con 0x7f5438103df0 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543d0c6700 1 -- 172.21.15.49:0/2640300904 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438105ee0 con 0x7f5438103df0 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543d0c6700 1 -- 172.21.15.49:0/2640300904 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5434001580 con 0x7f5438103df0 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543d0c6700 1 -- 172.21.15.49:0/2640300904 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f5434001d00 con 0x7f5438103df0 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.683+0000 7f543d0c6700 1 -- 172.21.15.49:0/2640300904 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5434005960 con 0x7f5438103df0 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- 172.21.15.49:0/2640300904 >> v1:172.21.15.49:6789/0 conn(0x7f5438103df0 legacy=0x7f5438104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- 172.21.15.49:0/2640300904 shutdown_connections 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- 172.21.15.49:0/2640300904 >> 172.21.15.49:0/2640300904 conn(0x7f54380ff700 msgr2=0x7f5438101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- 172.21.15.49:0/2640300904 shutdown_connections 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- 172.21.15.49:0/2640300904 wait complete. 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 Processor -- start 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- start start 2024-03-11T21:59:00.822 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f543819bd60 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f543e0c8700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5438103df0 0x7f543819b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35196/0 (socket says 172.21.15.49:35196) 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f543e0c8700 1 -- 172.21.15.49:0/507528138 learned_addr learned my addr 172.21.15.49:0/507528138 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905622373 0 0) 0x7f543819bd60 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54240054f0 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4061795206 0 0) 0x7f54240054f0 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f543819bd60 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5434001080 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3577130034 0 0) 0x7f543819bd60 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543819bef0 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543819c1a0 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f543819fcf0 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f5434004a60 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5434006210 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.687+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 9) v1 ==== 45747+0+0 (unknown 3869601487 0 0) 0x7f5434011710 con 0x7f5438103df0 2024-03-11T21:59:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.691+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c005150 con 0x7f5438103df0 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.691+0000 7f543d8c7700 1 -- 172.21.15.49:0/507528138 >> v1:172.21.15.49:6800/2600502005 conn(0x7f5424039f00 legacy=0x7f542403c3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/2600502005 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.691+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f54340480b0 con 0x7f5438103df0 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.695+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f5434012fd0 con 0x7f5438103df0 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:58:59.895+0000 7f543d8c7700 1 -- 172.21.15.49:0/507528138 >> v1:172.21.15.49:6800/2600502005 conn(0x7f5424039f00 legacy=0x7f542403c3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/2600502005 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.179+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f541c005c10 con 0x7f5438103df0 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.183+0000 7f542f7fe700 1 -- 172.21.15.49:0/507528138 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (unknown 2005831594 0 1748205903) 0x7f54340150b0 con 0x7f5438103df0 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.183+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 >> v1:172.21.15.49:6800/2600502005 conn(0x7f5424039f00 legacy=0x7f542403c3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.183+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 >> v1:172.21.15.49:6789/0 conn(0x7f5438103df0 legacy=0x7f543819b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.183+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 shutdown_connections 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.183+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 >> 172.21.15.49:0/507528138 conn(0x7f54380ff700 msgr2=0x7f5438101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.187+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 shutdown_connections 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:00.187+0000 7f544032c700 1 -- 172.21.15.49:0/507528138 wait complete. 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-03-11T21:59:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 9... 2024-03-11T21:59:01.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:01 smithi049 bash[21686]: debug 2024-03-11T21:59:01.291+0000 7f2bc69a7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-11T21:59:01.771 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:01 smithi049 bash[21686]: debug 2024-03-11T21:59:01.403+0000 7f2bc69a7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-11T21:59:01.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:01 smithi049 bash[21686]: debug 2024-03-11T21:59:01.515+0000 7f2bc69a7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-11T21:59:02.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:01 smithi049 bash[21686]: debug 2024-03-11T21:59:01.883+0000 7f2bc69a7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-11T21:59:02.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:02 smithi049 bash[21686]: debug 2024-03-11T21:59:02.003+0000 7f2bc69a7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-11T21:59:02.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:02 smithi049 bash[21686]: debug 2024-03-11T21:59:02.111+0000 7f2bc69a7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-11T21:59:02.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:02 smithi049 bash[21686]: debug 2024-03-11T21:59:02.482+0000 7f2bc69a7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-11T21:59:02.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:02 smithi049 bash[21686]: debug 2024-03-11T21:59:02.726+0000 7f2bc69a7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-11T21:59:03.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:03 smithi049 bash[21686]: debug 2024-03-11T21:59:02.998+0000 7f2bc69a7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-11T21:59:03.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:03 smithi049 bash[21686]: debug 2024-03-11T21:59:03.114+0000 7f2bc69a7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-11T21:59:03.647 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:03 smithi049 bash[21686]: debug 2024-03-11T21:59:03.398+0000 7f2bc69a7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-11T21:59:04.021 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:03 smithi049 bash[21686]: debug 2024-03-11T21:59:03.650+0000 7f2bc69a7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-11T21:59:04.441 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:04 smithi049 bash[21686]: debug 2024-03-11T21:59:04.066+0000 7f2bc69a7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-11T21:59:04.441 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:04 smithi049 bash[21686]: debug 2024-03-11T21:59:04.190+0000 7f2bc69a7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-11T21:59:04.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:04 smithi049 bash[21686]: debug 2024-03-11T21:59:04.446+0000 7f2bc69a7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-11T21:59:05.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:05 smithi049 bash[21686]: debug 2024-03-11T21:59:05.482+0000 7f2bc69a7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-11T21:59:05.772 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:05 smithi049 bash[21686]: debug 2024-03-11T21:59:05.602+0000 7f2bc69a7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-11T21:59:06.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:05 smithi049 bash[21686]: debug 2024-03-11T21:59:05.906+0000 7f2bc69a7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-11T21:59:06.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21686]: debug 2024-03-11T21:59:06.026+0000 7f2bc69a7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-11T21:59:06.746 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21686]: debug 2024-03-11T21:59:06.494+0000 7f2bc69a7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-11T21:59:06.746 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21686]: debug 2024-03-11T21:59:06.622+0000 7f2bc69a7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-11T21:59:06.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: cluster 2024-03-11T21:59:06.646990+0000 mon.a (mon.0) 72 : cluster 1 Active manager daemon y restarted 2024-03-11T21:59:06.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: cluster 2024-03-11T21:59:06.647301+0000 mon.a (mon.0) 73 : cluster 1 Activating manager daemon y 2024-03-11T21:59:06.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: cluster 2024-03-11T21:59:06.653030+0000 mon.a (mon.0) 74 : cluster 0 osdmap e3: 0 total, 0 up, 0 in 2024-03-11T21:59:06.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: cluster 2024-03-11T21:59:06.653225+0000 mon.a (mon.0) 75 : cluster 0 mgrmap e10: y(active, starting, since 0.00605672s) 2024-03-11T21:59:06.747 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: audit 2024-03-11T21:59:06.654898+0000 mon.a (mon.0) 76 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T21:59:06.747 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: audit 2024-03-11T21:59:06.656620+0000 mon.a (mon.0) 77 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-11T21:59:06.747 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: audit 2024-03-11T21:59:06.657504+0000 mon.a (mon.0) 78 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-11T21:59:06.747 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: audit 2024-03-11T21:59:06.657698+0000 mon.a (mon.0) 79 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-11T21:59:06.747 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: audit 2024-03-11T21:59:06.657897+0000 mon.a (mon.0) 80 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-11T21:59:06.747 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:06 smithi049 bash[21434]: cluster 2024-03-11T21:59:06.683090+0000 mon.a (mon.0) 81 : cluster 1 Manager daemon y is now available 2024-03-11T21:59:08.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:07 smithi049 bash[21434]: audit 2024-03-11T21:59:06.717950+0000 mon.a (mon.0) 82 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:59:08.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:07 smithi049 bash[21434]: audit 2024-03-11T21:59:06.720847+0000 mon.a (mon.0) 83 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:59:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:07 smithi049 bash[21434]: audit 2024-03-11T21:59:06.740129+0000 mon.a (mon.0) 84 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T21:59:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:07 smithi049 bash[21434]: audit 2024-03-11T21:59:06.743633+0000 mon.a (mon.0) 85 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T21:59:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:07 smithi049 bash[21434]: cluster 2024-03-11T21:59:07.659041+0000 mon.a (mon.0) 86 : cluster 0 mgrmap e11: y(active, since 1.01187s) 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 Processor -- start 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 -- start start 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f12dc07a390 con 0x7f12dc07b790 2024-03-11T21:59:08.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12db7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12dc07b790 0x7f12dc079bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35208/0 (socket says 172.21.15.49:35208) 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12db7fe700 1 -- 172.21.15.49:0/453328122 learned_addr learned my addr 172.21.15.49:0/453328122 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12da7fc700 1 -- 172.21.15.49:0/453328122 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870444831 0 0) 0x7f12dc07a390 con 0x7f12dc07b790 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12da7fc700 1 -- 172.21.15.49:0/453328122 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c40035b0 con 0x7f12dc07b790 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12da7fc700 1 -- 172.21.15.49:0/453328122 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944939693 0 0) 0x7f12c40035b0 con 0x7f12dc07b790 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12da7fc700 1 -- 172.21.15.49:0/453328122 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc07a520 con 0x7f12dc07b790 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12da7fc700 1 -- 172.21.15.49:0/453328122 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f12cc001580 con 0x7f12dc07b790 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12da7fc700 1 -- 172.21.15.49:0/453328122 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f12cc001c30 con 0x7f12dc07b790 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12da7fc700 1 -- 172.21.15.49:0/453328122 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f12cc0057e0 con 0x7f12dc07b790 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 -- 172.21.15.49:0/453328122 >> v1:172.21.15.49:6789/0 conn(0x7f12dc07b790 legacy=0x7f12dc079bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 -- 172.21.15.49:0/453328122 shutdown_connections 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 -- 172.21.15.49:0/453328122 >> 172.21.15.49:0/453328122 conn(0x7f12dc101070 msgr2=0x7f12dc1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 -- 172.21.15.49:0/453328122 shutdown_connections 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.699+0000 7f12e1d37700 1 -- 172.21.15.49:0/453328122 wait complete. 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12e1d37700 1 Processor -- start 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12e1d37700 1 -- start start 2024-03-11T21:59:08.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12e1d37700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f12dc19bdc0 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12db7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f12dc07b790 0x7f12dc19b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35210/0 (socket says 172.21.15.49:35210) 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12db7fe700 1 -- 172.21.15.49:0/2946821701 learned_addr learned my addr 172.21.15.49:0/2946821701 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598264521 0 0) 0x7f12dc19bdc0 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c4005540 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2383549302 0 0) 0x7f12c4005540 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f12dc19bdc0 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f12cc000ed0 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4265173797 0 0) 0x7f12dc19bdc0 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc19bf50 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc19c200 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc19fd50 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f12cc001a90 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f12cc006200 con 0x7f12dc07b790 2024-03-11T21:59:08.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 9) v1 ==== 45747+0+0 (unknown 3869601487 0 0) 0x7f12cc011640 con 0x7f12dc07b790 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6800/2600502005 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12c403dc00 con 0x7f12c4039f30 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 394034891 0 0) 0x7f12cc047190 con 0x7f12dc07b790 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.703+0000 7f12daffd700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6800/2600502005 conn(0x7f12c4039f30 legacy=0x7f12c403c3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/2600502005 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:01.907+0000 7f12daffd700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6800/2600502005 conn(0x7f12c4039f30 legacy=0x7f12c403c3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/2600502005 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:02.311+0000 7f12daffd700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6800/2600502005 conn(0x7f12c4039f30 legacy=0x7f12c403c3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/2600502005 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:03.114+0000 7f12daffd700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6800/2600502005 conn(0x7f12c4039f30 legacy=0x7f12c403c3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/2600502005 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:04.718+0000 7f12daffd700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6800/2600502005 conn(0x7f12c4039f30 legacy=0x7f12c403c3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/2600502005 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:06.646+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mgrmap(e 10) v1 ==== 45549+0+0 (unknown 2834962288 0 0) 0x7f12cc012bc0 con 0x7f12dc07b790 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:06.646+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6800/2600502005 conn(0x7f12c4039f30 legacy=0x7f12c403c3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.650+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mgrmap(e 11) v1 ==== 45641+0+0 (unknown 2425528019 0 0) 0x7f12cc048a50 con 0x7f12dc07b790 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.650+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6800/4076252288 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12c403dc00 con 0x7f12c403ea90 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.650+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (unknown 0 0 4109177037) 0x7f12c403dc00 con 0x7f12c403ea90 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.662+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 --> v1:172.21.15.49:6800/4076252288 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f12c8002630 con 0x7f12c403ea90 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.662+0000 7f12d8ff9700 1 -- 172.21.15.49:0/2946821701 <== mgr.14152 v1:172.21.15.49:6800/4076252288 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (unknown 0 0 3086460295) 0x7f12c8002630 con 0x7f12c403ea90 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.666+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6800/4076252288 conn(0x7f12c403ea90 legacy=0x7f12c4040e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:08.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.666+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 >> v1:172.21.15.49:6789/0 conn(0x7f12dc07b790 legacy=0x7f12dc19b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:08.314 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.666+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 shutdown_connections 2024-03-11T21:59:08.314 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.666+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 >> 172.21.15.49:0/2946821701 conn(0x7f12dc101070 msgr2=0x7f12dc10a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:08.314 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.666+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 shutdown_connections 2024-03-11T21:59:08.314 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:07.666+0000 7f12e1d37700 1 -- 172.21.15.49:0/2946821701 wait complete. 2024-03-11T21:59:08.314 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 9 is available 2024-03-11T21:59:08.314 INFO:teuthology.orchestra.run.smithi049.stdout:Generating a dashboard self-signed certificate... 2024-03-11T21:59:08.985 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:08 smithi049 bash[21434]: cephadm 2024-03-11T21:59:07.417792+0000 mgr.y (mgr.14152) 1 : cephadm 1 [11/Mar/2024:21:59:07] ENGINE Bus STARTING 2024-03-11T21:59:08.985 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:08 smithi049 bash[21434]: cephadm 2024-03-11T21:59:07.519676+0000 mgr.y (mgr.14152) 2 : cephadm 1 [11/Mar/2024:21:59:07] ENGINE Serving on http://172.21.15.49:8765 2024-03-11T21:59:08.985 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:08 smithi049 bash[21434]: cephadm 2024-03-11T21:59:07.640292+0000 mgr.y (mgr.14152) 3 : cephadm 1 [11/Mar/2024:21:59:07] ENGINE Serving on https://172.21.15.49:7150 2024-03-11T21:59:08.985 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:08 smithi049 bash[21434]: cephadm 2024-03-11T21:59:07.640482+0000 mgr.y (mgr.14152) 4 : cephadm 1 [11/Mar/2024:21:59:07] ENGINE Bus STARTED 2024-03-11T21:59:08.985 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:08 smithi049 bash[21434]: audit 2024-03-11T21:59:07.655896+0000 mgr.y (mgr.14152) 5 : audit 0 from='client.14156 v1:172.21.15.49:0/2946821701' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-11T21:59:08.985 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:08 smithi049 bash[21434]: audit 2024-03-11T21:59:07.668527+0000 mgr.y (mgr.14152) 6 : audit 0 from='client.14156 v1:172.21.15.49:0/2946821701' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-11T21:59:10.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:09 smithi049 bash[21434]: cluster 2024-03-11T21:59:08.706820+0000 mon.a (mon.0) 87 : cluster 0 mgrmap e12: y(active, since 2s) 2024-03-11T21:59:10.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:09 smithi049 bash[21434]: audit 2024-03-11T21:59:09.673819+0000 mon.a (mon.0) 88 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:10.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:09 smithi049 bash[21434]: audit 2024-03-11T21:59:09.676232+0000 mon.a (mon.0) 89 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:10.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-11T21:59:10.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.154+0000 7fbd4dbd9700 1 Processor -- start 2024-03-11T21:59:10.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.154+0000 7fbd4dbd9700 1 -- start start 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.154+0000 7fbd4dbd9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbd48109f40 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd477fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbd48105b10 0x7fbd48105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:32862/0 (socket says 172.21.15.49:32862) 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd477fe700 1 -- 172.21.15.49:0/1848962646 learned_addr learned my addr 172.21.15.49:0/1848962646 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd467fc700 1 -- 172.21.15.49:0/1848962646 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719603962 0 0) 0x7fbd48109f40 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd467fc700 1 -- 172.21.15.49:0/1848962646 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd300035b0 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd467fc700 1 -- 172.21.15.49:0/1848962646 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405925230 0 0) 0x7fbd300035b0 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd467fc700 1 -- 172.21.15.49:0/1848962646 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4810b0e0 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd467fc700 1 -- 172.21.15.49:0/1848962646 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbd38001900 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd467fc700 1 -- 172.21.15.49:0/1848962646 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fbd38002080 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd467fc700 1 -- 172.21.15.49:0/1848962646 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbd38005ce0 con 0x7fbd48105b10 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/1848962646 >> v1:172.21.15.49:6789/0 conn(0x7fbd48105b10 legacy=0x7fbd48105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/1848962646 shutdown_connections 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/1848962646 >> 172.21.15.49:0/1848962646 conn(0x7fbd481010b0 msgr2=0x7fbd481034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/1848962646 shutdown_connections 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/1848962646 wait complete. 2024-03-11T21:59:10.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 Processor -- start 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- start start 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbd4819f460 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd477fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbd48105b10 0x7fbd4807b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:32872/0 (socket says 172.21.15.49:32872) 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd477fe700 1 -- 172.21.15.49:0/2842794252 learned_addr learned my addr 172.21.15.49:0/2842794252 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798900027 0 0) 0x7fbd4819f460 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd300054f0 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1812380937 0 0) 0x7fbd300054f0 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd4819f460 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbd38001400 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3290727773 0 0) 0x7fbd4819f460 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd481a0600 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4819f650 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4819fb50 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fbd38004d70 con 0x7fbd48105b10 2024-03-11T21:59:10.249 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.158+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fbd380064f0 con 0x7fbd48105b10 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.162+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 12) v1 ==== 45747+0+0 (unknown 538448952 0 0) 0x7fbd38011910 con 0x7fbd48105b10 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.162+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd34005150 con 0x7fbd48105b10 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.162+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7fbd38047500 con 0x7fbd48105b10 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.166+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fbd38016ed0 con 0x7fbd48105b10 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.542+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd34000bc0 con 0x7fbd30039f90 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.670+0000 7fbd44ff9700 1 -- 172.21.15.49:0/2842794252 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (unknown 0 0 3317752739) 0x7fbd34000bc0 con 0x7fbd30039f90 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.674+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 >> v1:172.21.15.49:6800/4076252288 conn(0x7fbd30039f90 legacy=0x7fbd3003c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.674+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 >> v1:172.21.15.49:6789/0 conn(0x7fbd48105b10 legacy=0x7fbd4807b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.674+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 shutdown_connections 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.674+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 >> 172.21.15.49:0/2842794252 conn(0x7fbd481010b0 msgr2=0x7fbd481034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.674+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 shutdown_connections 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:09.674+0000 7fbd4dbd9700 1 -- 172.21.15.49:0/2842794252 wait complete. 2024-03-11T21:59:10.250 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial admin user... 2024-03-11T21:59:11.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:10 smithi049 bash[21434]: audit 2024-03-11T21:59:09.549528+0000 mgr.y (mgr.14152) 7 : audit 0 from='client.14164 v1:172.21.15.49:0/2842794252' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$L.HvYctc.RzQ0d0rz7eUQuzaIFs0ms8yiPANuExEQdpVjgA3AiBku", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1710194351, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.114+0000 7f9275992700 1 Processor -- start 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.114+0000 7f9275992700 1 -- start start 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.114+0000 7f9275992700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f927010c140 con 0x7f9270107d10 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.114+0000 7f926effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9270107d10 0x7f9270108130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:32886/0 (socket says 172.21.15.49:32886) 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.114+0000 7f926effd700 1 -- 172.21.15.49:0/1244400282 learned_addr learned my addr 172.21.15.49:0/1244400282 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.114+0000 7f926dffb700 1 -- 172.21.15.49:0/1244400282 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733365906 0 0) 0x7f927010c140 con 0x7f9270107d10 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.114+0000 7f926dffb700 1 -- 172.21.15.49:0/1244400282 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92580035b0 con 0x7f9270107d10 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f926dffb700 1 -- 172.21.15.49:0/1244400282 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589270900 0 0) 0x7f92580035b0 con 0x7f9270107d10 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f926dffb700 1 -- 172.21.15.49:0/1244400282 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927010d2e0 con 0x7f9270107d10 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f926dffb700 1 -- 172.21.15.49:0/1244400282 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9260001580 con 0x7f9270107d10 2024-03-11T21:59:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f926dffb700 1 -- 172.21.15.49:0/1244400282 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f9260001d00 con 0x7f9270107d10 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f926dffb700 1 -- 172.21.15.49:0/1244400282 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9260005960 con 0x7f9270107d10 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- 172.21.15.49:0/1244400282 >> v1:172.21.15.49:6789/0 conn(0x7f9270107d10 legacy=0x7f9270108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- 172.21.15.49:0/1244400282 shutdown_connections 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- 172.21.15.49:0/1244400282 >> 172.21.15.49:0/1244400282 conn(0x7f927007b0e0 msgr2=0x7f9270105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- 172.21.15.49:0/1244400282 shutdown_connections 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- 172.21.15.49:0/1244400282 wait complete. 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 Processor -- start 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- start start 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f927019bd70 con 0x7f9270107d10 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f926effd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9270107d10 0x7f927019b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:32902/0 (socket says 172.21.15.49:32902) 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f926effd700 1 -- 172.21.15.49:0/948598710 learned_addr learned my addr 172.21.15.49:0/948598710 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961669559 0 0) 0x7f927019bd70 con 0x7f9270107d10 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92580054f0 con 0x7f9270107d10 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 437495599 0 0) 0x7f92580054f0 con 0x7f9270107d10 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f927019bd70 con 0x7f9270107d10 2024-03-11T21:59:12.363 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9260001080 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4069748648 0 0) 0x7f927019bd70 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927019bf00 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927019c1b0 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.118+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f927019fcb0 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.122+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9270195380 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.122+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f92600049f0 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.122+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f92600060c0 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.122+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 12) v1 ==== 45747+0+0 (unknown 538448952 0 0) 0x7f92600115c0 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.122+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7f9260047f20 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.126+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9260012d40 con 0x7f9270107d10 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.522+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f92700630c0 con 0x7f9258039fc0 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.794+0000 7f9274990700 1 -- 172.21.15.49:0/948598710 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (unknown 0 0 1363705794) 0x7f92700630c0 con 0x7f9258039fc0 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.798+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 >> v1:172.21.15.49:6800/4076252288 conn(0x7f9258039fc0 legacy=0x7f925803c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.798+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 >> v1:172.21.15.49:6789/0 conn(0x7f9270107d10 legacy=0x7f927019b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.798+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 shutdown_connections 2024-03-11T21:59:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.798+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 >> 172.21.15.49:0/948598710 conn(0x7f927007b0e0 msgr2=0x7f92701924c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:12.365 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.798+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 shutdown_connections 2024-03-11T21:59:12.365 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:11.798+0000 7f9275992700 1 -- 172.21.15.49:0/948598710 wait complete. 2024-03-11T21:59:12.365 INFO:teuthology.orchestra.run.smithi049.stdout:Fetching dashboard port number... 2024-03-11T21:59:13.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:12 smithi049 bash[21434]: audit 2024-03-11T21:59:11.529374+0000 mgr.y (mgr.14152) 8 : audit 0 from='client.14166 v1:172.21.15.49:0/948598710' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:59:13.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:12 smithi049 bash[21434]: audit 2024-03-11T21:59:11.797379+0000 mon.a (mon.0) 90 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:13.856 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:13 smithi049 bash[21434]: cluster 2024-03-11T21:59:12.804567+0000 mon.a (mon.0) 91 : cluster 0 mgrmap e13: y(active, since 6s) 2024-03-11T21:59:13.856 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:13 smithi049 bash[21434]: audit 2024-03-11T21:59:13.482176+0000 mon.a (mon.0) 92 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:13.857 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:13 smithi049 bash[21434]: audit 2024-03-11T21:59:13.585466+0000 mon.a (mon.0) 93 : audit 0 from='client.? v1:172.21.15.49:0/3634475723' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 8443 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.186+0000 7fea60b54700 1 Processor -- start 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.186+0000 7fea60b54700 1 -- start start 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fea5c07a330 con 0x7fea5c07b730 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fea5c07b730 0x7fea5c079b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:32904/0 (socket says 172.21.15.49:32904) 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5a59c700 1 -- 172.21.15.49:0/4020041576 learned_addr learned my addr 172.21.15.49:0/4020041576 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5959a700 1 -- 172.21.15.49:0/4020041576 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095838881 0 0) 0x7fea5c07a330 con 0x7fea5c07b730 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5959a700 1 -- 172.21.15.49:0/4020041576 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea440035b0 con 0x7fea5c07b730 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5959a700 1 -- 172.21.15.49:0/4020041576 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 236819566 0 0) 0x7fea440035b0 con 0x7fea5c07b730 2024-03-11T21:59:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5959a700 1 -- 172.21.15.49:0/4020041576 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c07a4c0 con 0x7fea5c07b730 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5959a700 1 -- 172.21.15.49:0/4020041576 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fea50001580 con 0x7fea5c07b730 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5959a700 1 -- 172.21.15.49:0/4020041576 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fea50001c30 con 0x7fea5c07b730 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5959a700 1 -- 172.21.15.49:0/4020041576 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fea500057e0 con 0x7fea5c07b730 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- 172.21.15.49:0/4020041576 >> v1:172.21.15.49:6789/0 conn(0x7fea5c07b730 legacy=0x7fea5c079b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- 172.21.15.49:0/4020041576 shutdown_connections 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- 172.21.15.49:0/4020041576 >> 172.21.15.49:0/4020041576 conn(0x7fea5c1010b0 msgr2=0x7fea5c1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- 172.21.15.49:0/4020041576 shutdown_connections 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- 172.21.15.49:0/4020041576 wait complete. 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 Processor -- start 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- start start 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fea5c19bd90 con 0x7fea5c07b730 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5a59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fea5c07b730 0x7fea5c19b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:32914/0 (socket says 172.21.15.49:32914) 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea5a59c700 1 -- 172.21.15.49:0/3634475723 learned_addr learned my addr 172.21.15.49:0/3634475723 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:14.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432979755 0 0) 0x7fea5c19bd90 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea44005540 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1674263978 0 0) 0x7fea44005540 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fea5c19bd90 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fea50000ed0 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1290725538 0 0) 0x7fea5c19bd90 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c19bf20 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.190+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c19c1d0 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.194+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c19fd20 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.194+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fea500049d0 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.194+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fea50006160 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.194+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7fea500115d0 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.194+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c005150 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.194+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7fea50047290 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.198+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fea50016c80 con 0x7fea5c07b730 2024-03-11T21:59:14.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fea3c005980 con 0x7fea5c07b730 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea4b7fe700 1 -- 172.21.15.49:0/3634475723 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (unknown 3713421687 0 83753974) 0x7fea50015050 con 0x7fea5c07b730 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 >> v1:172.21.15.49:6800/4076252288 conn(0x7fea4403a020 legacy=0x7fea4403c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 >> v1:172.21.15.49:6789/0 conn(0x7fea5c07b730 legacy=0x7fea5c19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 shutdown_connections 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 >> 172.21.15.49:0/3634475723 conn(0x7fea5c1010b0 msgr2=0x7fea5c109fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 shutdown_connections 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:13.582+0000 7fea60b54700 1 -- 172.21.15.49:0/3634475723 wait complete. 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld does not appear to be present 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph Dashboard is now available at: 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: URL: https://smithi049.front.sepia.ceph.com:8443/ 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: User: admin 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: Password: cnsq52gi12 2024-03-11T21:59:14.126 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:14.127 INFO:teuthology.orchestra.run.smithi049.stdout:Saving cluster configuration to /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config directory 2024-03-11T21:59:14.127 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling autotune for osd_memory_target 2024-03-11T21:59:15.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:15 smithi049 bash[21434]: audit 2024-03-11T21:59:14.573761+0000 mon.a (mon.0) 94 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:15.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.982+0000 7fd87e1f1700 1 Processor -- start 2024-03-11T21:59:15.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.982+0000 7fd87e1f1700 1 -- start start 2024-03-11T21:59:15.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.982+0000 7fd87e1f1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd878108e50 con 0x7fd878104f00 2024-03-11T21:59:15.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.982+0000 7fd8777fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd878104f00 0x7fd878105320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34594/0 (socket says 172.21.15.49:34594) 2024-03-11T21:59:15.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.982+0000 7fd8777fe700 1 -- 172.21.15.49:0/3858648929 learned_addr learned my addr 172.21.15.49:0/3858648929 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:15.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.982+0000 7fd8767fc700 1 -- 172.21.15.49:0/3858648929 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177940851 0 0) 0x7fd878108e50 con 0x7fd878104f00 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.982+0000 7fd8767fc700 1 -- 172.21.15.49:0/3858648929 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8600035b0 con 0x7fd878104f00 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd8767fc700 1 -- 172.21.15.49:0/3858648929 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787338684 0 0) 0x7fd8600035b0 con 0x7fd878104f00 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd8767fc700 1 -- 172.21.15.49:0/3858648929 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878109ff0 con 0x7fd878104f00 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd8767fc700 1 -- 172.21.15.49:0/3858648929 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fd868001580 con 0x7fd878104f00 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd8767fc700 1 -- 172.21.15.49:0/3858648929 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fd868001d00 con 0x7fd878104f00 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd8767fc700 1 -- 172.21.15.49:0/3858648929 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fd868005960 con 0x7fd878104f00 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- 172.21.15.49:0/3858648929 >> v1:172.21.15.49:6789/0 conn(0x7fd878104f00 legacy=0x7fd878105320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- 172.21.15.49:0/3858648929 shutdown_connections 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- 172.21.15.49:0/3858648929 >> 172.21.15.49:0/3858648929 conn(0x7fd8780ff700 msgr2=0x7fd878101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- 172.21.15.49:0/3858648929 shutdown_connections 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- 172.21.15.49:0/3858648929 wait complete. 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 Processor -- start 2024-03-11T21:59:15.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- start start 2024-03-11T21:59:15.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd878199b60 con 0x7fd878104f00 2024-03-11T21:59:15.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd8777fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd878104f00 0x7fd878199450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34610/0 (socket says 172.21.15.49:34610) 2024-03-11T21:59:15.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd8777fe700 1 -- 172.21.15.49:0/681578752 learned_addr learned my addr 172.21.15.49:0/681578752 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:15.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343071190 0 0) 0x7fd878199b60 con 0x7fd878104f00 2024-03-11T21:59:15.980 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8600054f0 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2935895538 0 0) 0x7fd8600054f0 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd878199b60 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fd868001080 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2342137039 0 0) 0x7fd878199b60 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878199cf0 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd878199fa0 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87819daf0 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fd868004a60 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.986+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fd8680061c0 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.990+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7fd868005680 con 0x7fd878104f00 2024-03-11T21:59:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.990+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864005150 con 0x7fd878104f00 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.990+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7fd868047240 con 0x7fd878104f00 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:14.994+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fd868005c30 con 0x7fd878104f00 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.362+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 --> v1:172.21.15.49:6789/0 -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fd864005980 con 0x7fd878104f00 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.362+0000 7fd874ff9700 1 -- 172.21.15.49:0/681578752 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (unknown 689008156 0 0) 0x7fd8680141a0 con 0x7fd878104f00 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.366+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 >> v1:172.21.15.49:6800/4076252288 conn(0x7fd860039fe0 legacy=0x7fd86003c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.366+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 >> v1:172.21.15.49:6789/0 conn(0x7fd878104f00 legacy=0x7fd878199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.366+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 shutdown_connections 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.366+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 >> 172.21.15.49:0/681578752 conn(0x7fd8780ff700 msgr2=0x7fd878103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.366+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 shutdown_connections 2024-03-11T21:59:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:15.366+0000 7fd87e1f1700 1 -- 172.21.15.49:0/681578752 wait complete. 2024-03-11T21:59:18.013 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 Processor -- start 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- start start 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9a8407a310 con 0x7f9a8407b710 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8a08c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9a8407b710 0x7f9a84079b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34614/0 (socket says 172.21.15.49:34614) 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8a08c700 1 -- 172.21.15.49:0/2908399642 learned_addr learned my addr 172.21.15.49:0/2908399642 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8908a700 1 -- 172.21.15.49:0/2908399642 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163105267 0 0) 0x7f9a8407a310 con 0x7f9a8407b710 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8908a700 1 -- 172.21.15.49:0/2908399642 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a700035b0 con 0x7f9a8407b710 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8908a700 1 -- 172.21.15.49:0/2908399642 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 185770558 0 0) 0x7f9a700035b0 con 0x7f9a8407b710 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8908a700 1 -- 172.21.15.49:0/2908399642 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8407a4a0 con 0x7f9a8407b710 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8908a700 1 -- 172.21.15.49:0/2908399642 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9a80001580 con 0x7f9a8407b710 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8908a700 1 -- 172.21.15.49:0/2908399642 <== mon.0 v1:172.21.15.49:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f9a80001d00 con 0x7f9a8407b710 2024-03-11T21:59:18.014 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8908a700 1 -- 172.21.15.49:0/2908399642 <== mon.0 v1:172.21.15.49:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9a80005960 con 0x7f9a8407b710 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/2908399642 >> v1:172.21.15.49:6789/0 conn(0x7f9a8407b710 legacy=0x7f9a84079b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/2908399642 shutdown_connections 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/2908399642 >> 172.21.15.49:0/2908399642 conn(0x7f9a841010b0 msgr2=0x7f9a841034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/2908399642 shutdown_connections 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/2908399642 wait complete. 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 Processor -- start 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.833+0000 7f9a8c2f0700 1 -- start start 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a8c2f0700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9a8419bd60 con 0x7f9a8407b710 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a8a08c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9a8407b710 0x7f9a8419b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34624/0 (socket says 172.21.15.49:34624) 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a8a08c700 1 -- 172.21.15.49:0/116218924 learned_addr learned my addr 172.21.15.49:0/116218924 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360819662 0 0) 0x7f9a8419bd60 con 0x7f9a8407b710 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a700054f0 con 0x7f9a8407b710 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4259980453 0 0) 0x7f9a700054f0 con 0x7f9a8407b710 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a8419bd60 con 0x7f9a8407b710 2024-03-11T21:59:18.015 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9a80001080 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2723682206 0 0) 0x7f9a8419bd60 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8419bef0 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8419c1a0 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8419fcf0 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f9a800059b0 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f9a80006260 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f9a800116b0 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7f9a80048180 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.837+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a68005150 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:16.841+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9a80016d10 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.429+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 --> v1:172.21.15.49:6789/0 -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f9a68005980 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.433+0000 7f9a7b7fe700 1 -- 172.21.15.49:0/116218924 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) v1 ==== 153+0+0 (unknown 1951093493 0 0) 0x7f9a800150e0 con 0x7f9a8407b710 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.437+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 >> v1:172.21.15.49:6800/4076252288 conn(0x7f9a70039fe0 legacy=0x7f9a7003c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.437+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 >> v1:172.21.15.49:6789/0 conn(0x7f9a8407b710 legacy=0x7f9a8419b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.437+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 shutdown_connections 2024-03-11T21:59:18.016 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.437+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 >> 172.21.15.49:0/116218924 conn(0x7f9a841010b0 msgr2=0x7f9a8410a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.437+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 shutdown_connections 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-03-11T21:59:17.437+0000 7f9a8c2f0700 1 -- 172.21.15.49:0/116218924 wait complete. 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /usr/sbin/cephadm shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:Or, if you are only running a single cluster on this host: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /usr/sbin/cephadm shell 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: ceph telemetry on 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.017 INFO:teuthology.orchestra.run.smithi049.stdout:For more information see: 2024-03-11T21:59:18.018 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.018 INFO:teuthology.orchestra.run.smithi049.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-11T21:59:18.018 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:18.018 INFO:teuthology.orchestra.run.smithi049.stdout:Bootstrap complete. 2024-03-11T21:59:18.048 INFO:tasks.cephadm:Fetching config... 2024-03-11T21:59:18.049 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:59:18.049 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-11T21:59:18.055 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-11T21:59:18.055 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:59:18.055 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-11T21:59:18.101 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-11T21:59:18.102 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:59:18.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-11T21:59:18.157 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-11T21:59:18.157 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T21:59:18.158 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-11T21:59:18.209 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-11T21:59:18.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD9TcYFEvDxdI58xu23nXi8eWrddnCZAVzXDWlMmdBTQ6TEmJ1k9djs9Kjfg2ixIVxegNia8S0Cf+DMJ2EmKWPcWoQ8+YjBHPRTBAbXS7Ysxf5EgeewiIm1xfESFjGDV8L2SXubVRsaYpeuh59semuTUqHcY3G2sfucZIXa8P5FUuTsqSeBwPO4rHa3gWbdOkg1aDM8hgk6ws9RNQ9RPfgVblEOo8LhmYRrU2JDM7LlW405xAN9fRZzy/aP0QPETyhKtK1rDRSsLZkofkZI0OcbBo7cDdXmBbtuESeMXODAWxLjJaO2FdDi5EqBuonSokeFunJ4VZMXhdb1C9LpDvnJHSBYZz9lQ4xdNZZ7/sB46hRJ9nkv7XTU8QLGzeeisXutpH0JJgZ2z7H1PD4rlsVyzJWE/Ol2cIbSEiJsckibwfRx9zlkabO+WsVHYxZOndQZ9RirnvDgzh7+iUIFOTO3tMfTxrYRjh+2s1z/T2PCpJDIc2DsxTeRbOXgQsYKC1s= ceph-377df5b0-dff2-11ee-95c8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-11T21:59:18.277 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD9TcYFEvDxdI58xu23nXi8eWrddnCZAVzXDWlMmdBTQ6TEmJ1k9djs9Kjfg2ixIVxegNia8S0Cf+DMJ2EmKWPcWoQ8+YjBHPRTBAbXS7Ysxf5EgeewiIm1xfESFjGDV8L2SXubVRsaYpeuh59semuTUqHcY3G2sfucZIXa8P5FUuTsqSeBwPO4rHa3gWbdOkg1aDM8hgk6ws9RNQ9RPfgVblEOo8LhmYRrU2JDM7LlW405xAN9fRZzy/aP0QPETyhKtK1rDRSsLZkofkZI0OcbBo7cDdXmBbtuESeMXODAWxLjJaO2FdDi5EqBuonSokeFunJ4VZMXhdb1C9LpDvnJHSBYZz9lQ4xdNZZ7/sB46hRJ9nkv7XTU8QLGzeeisXutpH0JJgZ2z7H1PD4rlsVyzJWE/Ol2cIbSEiJsckibwfRx9zlkabO+WsVHYxZOndQZ9RirnvDgzh7+iUIFOTO3tMfTxrYRjh+2s1z/T2PCpJDIc2DsxTeRbOXgQsYKC1s= ceph-377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:59:18.287 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD9TcYFEvDxdI58xu23nXi8eWrddnCZAVzXDWlMmdBTQ6TEmJ1k9djs9Kjfg2ixIVxegNia8S0Cf+DMJ2EmKWPcWoQ8+YjBHPRTBAbXS7Ysxf5EgeewiIm1xfESFjGDV8L2SXubVRsaYpeuh59semuTUqHcY3G2sfucZIXa8P5FUuTsqSeBwPO4rHa3gWbdOkg1aDM8hgk6ws9RNQ9RPfgVblEOo8LhmYRrU2JDM7LlW405xAN9fRZzy/aP0QPETyhKtK1rDRSsLZkofkZI0OcbBo7cDdXmBbtuESeMXODAWxLjJaO2FdDi5EqBuonSokeFunJ4VZMXhdb1C9LpDvnJHSBYZz9lQ4xdNZZ7/sB46hRJ9nkv7XTU8QLGzeeisXutpH0JJgZ2z7H1PD4rlsVyzJWE/Ol2cIbSEiJsckibwfRx9zlkabO+WsVHYxZOndQZ9RirnvDgzh7+iUIFOTO3tMfTxrYRjh+2s1z/T2PCpJDIc2DsxTeRbOXgQsYKC1s= ceph-377df5b0-dff2-11ee-95c8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-11T21:59:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD9TcYFEvDxdI58xu23nXi8eWrddnCZAVzXDWlMmdBTQ6TEmJ1k9djs9Kjfg2ixIVxegNia8S0Cf+DMJ2EmKWPcWoQ8+YjBHPRTBAbXS7Ysxf5EgeewiIm1xfESFjGDV8L2SXubVRsaYpeuh59semuTUqHcY3G2sfucZIXa8P5FUuTsqSeBwPO4rHa3gWbdOkg1aDM8hgk6ws9RNQ9RPfgVblEOo8LhmYRrU2JDM7LlW405xAN9fRZzy/aP0QPETyhKtK1rDRSsLZkofkZI0OcbBo7cDdXmBbtuESeMXODAWxLjJaO2FdDi5EqBuonSokeFunJ4VZMXhdb1C9LpDvnJHSBYZz9lQ4xdNZZ7/sB46hRJ9nkv7XTU8QLGzeeisXutpH0JJgZ2z7H1PD4rlsVyzJWE/Ol2cIbSEiJsckibwfRx9zlkabO+WsVHYxZOndQZ9RirnvDgzh7+iUIFOTO3tMfTxrYRjh+2s1z/T2PCpJDIc2DsxTeRbOXgQsYKC1s= ceph-377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T21:59:18.320 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-11T21:59:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:18 smithi049 bash[21434]: audit 2024-03-11T21:59:17.439399+0000 mon.a (mon.0) 95 : audit 1 from='client.? v1:172.21.15.49:0/116218924' entity='client.admin' 2024-03-11T21:59:23.016 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T21:59:25.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- 172.21.15.49:0/3806331441 >> v1:172.21.15.49:6789/0 conn(0x7f0f080ff8c0 legacy=0x7f0f080ffce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:25.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- 172.21.15.49:0/3806331441 shutdown_connections 2024-03-11T21:59:25.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- 172.21.15.49:0/3806331441 >> 172.21.15.49:0/3806331441 conn(0x7f0f080fb240 msgr2=0x7f0f080fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:25.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- 172.21.15.49:0/3806331441 shutdown_connections 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- 172.21.15.49:0/3806331441 wait complete. 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 Processor -- start 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- start start 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0f0819bf30 con 0x7f0f080ff8c0 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f06ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0f080ff8c0 0x7f0f081020d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58298/0 (socket says 172.21.15.49:58298) 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f06ffd700 1 -- 172.21.15.49:0/3272357651 learned_addr learned my addr 172.21.15.49:0/3272357651 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901201457 0 0) 0x7f0f0819bf30 con 0x7f0f080ff8c0 2024-03-11T21:59:25.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef40054f0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1402126884 0 0) 0x7f0ef40054f0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0f0819bf30 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0ef00044b0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2344097826 0 0) 0x7f0f0819bf30 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0819d0d0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0819c0c0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0819c5c0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f0ef0001190 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.793+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0ef0004de0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.797+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f0ef0005020 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.797+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee8005150 con 0x7f0f080ff8c0 2024-03-11T21:59:25.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.797+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7f0ef00470a0 con 0x7f0f080ff8c0 2024-03-11T21:59:25.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:25.801+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0ef00168d0 con 0x7f0f080ff8c0 2024-03-11T21:59:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.009+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 --> v1:172.21.15.49:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f0ee8005980 con 0x7f0f080ff8c0 2024-03-11T21:59:26.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.017+0000 7f0f0c817700 1 -- 172.21.15.49:0/3272357651 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (unknown 3028693289 0 0) 0x7f0ef0014ed0 con 0x7f0f080ff8c0 2024-03-11T21:59:26.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.017+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 >> v1:172.21.15.49:6800/4076252288 conn(0x7f0ef4039ff0 legacy=0x7f0ef403c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:26.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.017+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 >> v1:172.21.15.49:6789/0 conn(0x7f0f080ff8c0 legacy=0x7f0f081020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:26.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.017+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 shutdown_connections 2024-03-11T21:59:26.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.017+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 >> 172.21.15.49:0/3272357651 conn(0x7f0f080fb240 msgr2=0x7f0f080fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:26.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.017+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 shutdown_connections 2024-03-11T21:59:26.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:26.017+0000 7f0f0d819700 1 -- 172.21.15.49:0/3272357651 wait complete. 2024-03-11T21:59:26.680 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-11T21:59:26.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-11T21:59:27.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:25.720101+0000 mon.a (mon.0) 96 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:27.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:25.724863+0000 mon.a (mon.0) 97 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:27.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:25.725996+0000 mon.a (mon.0) 98 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-03-11T21:59:27.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:25.731827+0000 mon.a (mon.0) 99 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:27.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:25.765607+0000 mon.a (mon.0) 100 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:59:27.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:25.770483+0000 mon.a (mon.0) 101 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:27.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:26.021101+0000 mon.a (mon.0) 102 : audit 1 from='client.? v1:172.21.15.49:0/3272357651' entity='client.admin' 2024-03-11T21:59:27.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:26.051582+0000 mon.a (mon.0) 103 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:59:27.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:26 smithi049 bash[21434]: audit 2024-03-11T21:59:26.055637+0000 mon.a (mon.0) 104 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:28.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:28 smithi049 bash[21434]: cluster 2024-03-11T21:59:26.659183+0000 mgr.y (mgr.14152) 9 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:30.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:30 smithi049 bash[21434]: cluster 2024-03-11T21:59:28.659611+0000 mgr.y (mgr.14152) 10 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:31.393 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T21:59:32.322 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:32 smithi049 bash[21434]: cluster 2024-03-11T21:59:30.660119+0000 mgr.y (mgr.14152) 11 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:33.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.713+0000 7f8b792e4700 1 -- 172.21.15.49:0/786025529 >> v1:172.21.15.49:6789/0 conn(0x7f8b741037e0 legacy=0x7f8b74103c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:33.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.713+0000 7f8b792e4700 1 -- 172.21.15.49:0/786025529 shutdown_connections 2024-03-11T21:59:33.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.713+0000 7f8b792e4700 1 -- 172.21.15.49:0/786025529 >> 172.21.15.49:0/786025529 conn(0x7f8b740feda0 msgr2=0x7f8b741011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 -- 172.21.15.49:0/786025529 shutdown_connections 2024-03-11T21:59:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 -- 172.21.15.49:0/786025529 wait complete. 2024-03-11T21:59:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 Processor -- start 2024-03-11T21:59:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 -- start start 2024-03-11T21:59:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8b74198750 con 0x7f8b741037e0 2024-03-11T21:59:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b72ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8b741037e0 0x7f8b74198040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55914/0 (socket says 172.21.15.49:55914) 2024-03-11T21:59:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b72ffd700 1 -- 172.21.15.49:0/3398083196 learned_addr learned my addr 172.21.15.49:0/3398083196 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389435148 0 0) 0x7f8b74198750 con 0x7f8b741037e0 2024-03-11T21:59:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b5c005540 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1528237683 0 0) 0x7f8b5c005540 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b74198750 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8b64003790 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4184440611 0 0) 0x7f8b74198750 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b741988e0 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b74198b90 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7419c6e0 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f8b64003d60 con 0x7f8b741037e0 2024-03-11T21:59:33.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f8b64004df0 con 0x7f8b741037e0 2024-03-11T21:59:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f8b64004f70 con 0x7f8b741037e0 2024-03-11T21:59:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60005150 con 0x7f8b741037e0 2024-03-11T21:59:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.717+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7f8b64047000 con 0x7f8b741037e0 2024-03-11T21:59:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.725+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8b64005360 con 0x7f8b741037e0 2024-03-11T21:59:33.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.945+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b60000bc0 con 0x7f8b5c03a050 2024-03-11T21:59:33.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.953+0000 7f8b5bfff700 1 -- 172.21.15.49:0/3398083196 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f8b60000bc0 con 0x7f8b5c03a050 2024-03-11T21:59:33.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.953+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 >> v1:172.21.15.49:6800/4076252288 conn(0x7f8b5c03a050 legacy=0x7f8b5c03c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:33.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.953+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 >> v1:172.21.15.49:6789/0 conn(0x7f8b741037e0 legacy=0x7f8b74198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:33.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.953+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 shutdown_connections 2024-03-11T21:59:33.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.953+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 >> 172.21.15.49:0/3398083196 conn(0x7f8b740feda0 msgr2=0x7f8b74101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:33.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.953+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 shutdown_connections 2024-03-11T21:59:33.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:33.953+0000 7f8b792e4700 1 -- 172.21.15.49:0/3398083196 wait complete. 2024-03-11T21:59:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:34 smithi049 bash[21434]: cluster 2024-03-11T21:59:32.660505+0000 mgr.y (mgr.14152) 12 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:34 smithi049 bash[21434]: audit 2024-03-11T21:59:33.956848+0000 mon.a (mon.0) 105 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:34 smithi049 bash[21434]: audit 2024-03-11T21:59:34.005708+0000 mon.a (mon.0) 106 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:59:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:34 smithi049 bash[21434]: audit 2024-03-11T21:59:34.007322+0000 mon.a (mon.0) 107 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T21:59:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:34 smithi049 bash[21434]: audit 2024-03-11T21:59:34.008126+0000 mon.a (mon.0) 108 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T21:59:34.594 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi187 2024-03-11T21:59:34.594 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:59:34.594 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.conf 2024-03-11T21:59:34.600 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T21:59:34.600 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-11T21:59:34.647 INFO:tasks.cephadm:Adding host smithi187 to orchestrator... 2024-03-11T21:59:34.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch host add smithi187 2024-03-11T21:59:35.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:35 smithi049 bash[21434]: audit 2024-03-11T21:59:33.951953+0000 mgr.y (mgr.14152) 13 : audit 0 from='client.14176 v1:172.21.15.49:0/3398083196' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:59:35.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:35 smithi049 bash[21434]: cephadm 2024-03-11T21:59:34.009352+0000 mgr.y (mgr.14152) 14 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T21:59:35.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:35 smithi049 bash[21434]: cephadm 2024-03-11T21:59:34.123901+0000 mgr.y (mgr.14152) 15 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T21:59:35.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:35 smithi049 bash[21434]: audit 2024-03-11T21:59:34.672175+0000 mon.a (mon.0) 109 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:35.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:35 smithi049 bash[21434]: audit 2024-03-11T21:59:34.676280+0000 mon.a (mon.0) 110 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:35.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:35 smithi049 bash[21434]: audit 2024-03-11T21:59:34.680214+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:36.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:36 smithi049 bash[21434]: cephadm 2024-03-11T21:59:34.338619+0000 mgr.y (mgr.14152) 16 : cephadm 1 Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-03-11T21:59:36.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:36 smithi049 bash[21434]: cephadm 2024-03-11T21:59:34.503461+0000 mgr.y (mgr.14152) 17 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T21:59:36.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:36 smithi049 bash[21434]: cluster 2024-03-11T21:59:34.660976+0000 mgr.y (mgr.14152) 18 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:38.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:38 smithi049 bash[21434]: cluster 2024-03-11T21:59:36.661441+0000 mgr.y (mgr.14152) 19 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:39.363 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T21:59:40.318 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:40 smithi049 bash[21434]: cluster 2024-03-11T21:59:38.661952+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:41.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/2903153150 >> v1:172.21.15.49:6789/0 conn(0x7f028c1097a0 legacy=0x7f028c109b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:41.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/2903153150 shutdown_connections 2024-03-11T21:59:41.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/2903153150 >> 172.21.15.49:0/2903153150 conn(0x7f028c0ff290 msgr2=0x7f028c1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:41.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/2903153150 shutdown_connections 2024-03-11T21:59:41.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/2903153150 wait complete. 2024-03-11T21:59:41.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 Processor -- start 2024-03-11T21:59:41.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- start start 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f028c198a70 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0290c4e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f028c1097a0 0x7f028c198360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55936/0 (socket says 172.21.15.49:55936) 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0290c4e700 1 -- 172.21.15.49:0/3260800087 learned_addr learned my addr 172.21.15.49:0/3260800087 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000072168 0 0) 0x7f028c198a70 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f027c0054f0 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3325597236 0 0) 0x7f027c0054f0 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f028c198a70 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0280001980 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3607592413 0 0) 0x7f028c198a70 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c198c00 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c198eb0 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c1a1090 con 0x7f028c1097a0 2024-03-11T21:59:41.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f0280001620 con 0x7f028c1097a0 2024-03-11T21:59:41.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f0280004e50 con 0x7f028c1097a0 2024-03-11T21:59:41.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f0280005090 con 0x7f028c1097a0 2024-03-11T21:59:41.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.672+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0270005120 con 0x7f028c1097a0 2024-03-11T21:59:41.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.676+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7f0280047090 con 0x7f028c1097a0 2024-03-11T21:59:41.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.680+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0280016850 con 0x7f028c1097a0 2024-03-11T21:59:41.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:41.892+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}) v1 -- 0x7f0270000b90 con 0x7f027c03a010 2024-03-11T21:59:42.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:42 smithi049 bash[21434]: cluster 2024-03-11T21:59:40.662515+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:43.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:43 smithi049 bash[21434]: audit 2024-03-11T21:59:41.894258+0000 mgr.y (mgr.14152) 22 : audit 0 from='client.14178 v1:172.21.15.49:0/3260800087' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T21:59:44.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:44 smithi049 bash[21434]: cluster 2024-03-11T21:59:42.663016+0000 mgr.y (mgr.14152) 23 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:44.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:44 smithi049 bash[21434]: cephadm 2024-03-11T21:59:42.671540+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi187 2024-03-11T21:59:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:46 smithi049 bash[21434]: cluster 2024-03-11T21:59:44.663394+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:47.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:47.968+0000 7f0289ffb700 1 -- 172.21.15.49:0/3260800087 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (unknown 0 0 1727695749) 0x7f0270000b90 con 0x7f027c03a010 2024-03-11T21:59:47.964 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi187' with addr '172.21.15.187' 2024-03-11T21:59:47.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:47.972+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 >> v1:172.21.15.49:6800/4076252288 conn(0x7f027c03a010 legacy=0x7f027c03c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:47.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:47.972+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 >> v1:172.21.15.49:6789/0 conn(0x7f028c1097a0 legacy=0x7f028c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:47.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:47.972+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 shutdown_connections 2024-03-11T21:59:47.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:47.972+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 >> 172.21.15.49:0/3260800087 conn(0x7f028c0ff290 msgr2=0x7f028c0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:47.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:47.972+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 shutdown_connections 2024-03-11T21:59:47.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:47.972+0000 7f0292eb2700 1 -- 172.21.15.49:0/3260800087 wait complete. 2024-03-11T21:59:48.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:48 smithi049 bash[21434]: cluster 2024-03-11T21:59:46.663884+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:48.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:48 smithi049 bash[21434]: audit 2024-03-11T21:59:47.969909+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:48.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:48 smithi049 bash[21434]: audit 2024-03-11T21:59:47.989259+0000 mon.a (mon.0) 113 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T21:59:48.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch host ls --format=json 2024-03-11T21:59:49.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:49 smithi049 bash[21434]: cephadm 2024-03-11T21:59:47.970832+0000 mgr.y (mgr.14152) 27 : cephadm 1 Added host smithi187 2024-03-11T21:59:49.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:49 smithi049 bash[21434]: audit 2024-03-11T21:59:48.462567+0000 mon.a (mon.0) 114 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:50.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:50 smithi049 bash[21434]: cluster 2024-03-11T21:59:48.664266+0000 mgr.y (mgr.14152) 28 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:50.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:50 smithi049 bash[21434]: audit 2024-03-11T21:59:49.987971+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:52.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:52 smithi049 bash[21434]: cluster 2024-03-11T21:59:50.664664+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:52.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:52 smithi049 bash[21434]: audit 2024-03-11T21:59:51.133997+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:53.352 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T21:59:54.402 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:54 smithi049 bash[21434]: cluster 2024-03-11T21:59:52.665086+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:55.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.904+0000 7f66debf8700 1 -- 172.21.15.49:0/2947533213 >> v1:172.21.15.49:6789/0 conn(0x7f66d80740a0 legacy=0x7f66d8074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:55.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.904+0000 7f66debf8700 1 -- 172.21.15.49:0/2947533213 shutdown_connections 2024-03-11T21:59:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.904+0000 7f66debf8700 1 -- 172.21.15.49:0/2947533213 >> 172.21.15.49:0/2947533213 conn(0x7f66d80fd070 msgr2=0x7f66d80ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.904+0000 7f66debf8700 1 -- 172.21.15.49:0/2947533213 shutdown_connections 2024-03-11T21:59:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.904+0000 7f66debf8700 1 -- 172.21.15.49:0/2947533213 wait complete. 2024-03-11T21:59:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66debf8700 1 Processor -- start 2024-03-11T21:59:55.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66debf8700 1 -- start start 2024-03-11T21:59:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66debf8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f66d8198b00 con 0x7f66d80740a0 2024-03-11T21:59:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66dc994700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f66d80740a0 0x7f66d81983f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:38940/0 (socket says 172.21.15.49:38940) 2024-03-11T21:59:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66dc994700 1 -- 172.21.15.49:0/4294411849 learned_addr learned my addr 172.21.15.49:0/4294411849 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T21:59:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531309525 0 0) 0x7f66d8198b00 con 0x7f66d80740a0 2024-03-11T21:59:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c00054f0 con 0x7f66d80740a0 2024-03-11T21:59:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3631255983 0 0) 0x7f66c00054f0 con 0x7f66d80740a0 2024-03-11T21:59:55.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66d8198b00 con 0x7f66d80740a0 2024-03-11T21:59:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f66c80044b0 con 0x7f66d80740a0 2024-03-11T21:59:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2402973967 0 0) 0x7f66d8198b00 con 0x7f66d80740a0 2024-03-11T21:59:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8198c90 con 0x7f66d80740a0 2024-03-11T21:59:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d8198f40 con 0x7f66d80740a0 2024-03-11T21:59:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d81a1120 con 0x7f66d80740a0 2024-03-11T21:59:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f66c8001620 con 0x7f66d80740a0 2024-03-11T21:59:55.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f66c8004dc0 con 0x7f66d80740a0 2024-03-11T21:59:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f66c8004fa0 con 0x7f66d80740a0 2024-03-11T21:59:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c4005120 con 0x7f66d80740a0 2024-03-11T21:59:55.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.908+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7f66c8046fc0 con 0x7f66d80740a0 2024-03-11T21:59:55.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:55.916+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f66c8016830 con 0x7f66d80740a0 2024-03-11T21:59:56.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.128+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66c4000b90 con 0x7f66c003a060 2024-03-11T21:59:56.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.132+0000 7f66d5ffb700 1 -- 172.21.15.49:0/4294411849 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (unknown 0 0 34711007) 0x7f66c4000b90 con 0x7f66c003a060 2024-03-11T21:59:56.127 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T21:59:56.127 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.187", "hostname": "smithi187", "labels": [], "status": ""}] 2024-03-11T21:59:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.136+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 >> v1:172.21.15.49:6800/4076252288 conn(0x7f66c003a060 legacy=0x7f66c003c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.136+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 >> v1:172.21.15.49:6789/0 conn(0x7f66d80740a0 legacy=0x7f66d81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T21:59:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.136+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 shutdown_connections 2024-03-11T21:59:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.136+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 >> 172.21.15.49:0/4294411849 conn(0x7f66d80fd070 msgr2=0x7f66d80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T21:59:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.136+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 shutdown_connections 2024-03-11T21:59:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T21:59:56.136+0000 7f66debf8700 1 -- 172.21.15.49:0/4294411849 wait complete. 2024-03-11T21:59:56.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:56 smithi049 bash[21434]: cluster 2024-03-11T21:59:54.665528+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:56.792 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-11T21:59:56.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd crush tunables default 2024-03-11T21:59:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.133722+0000 mgr.y (mgr.14152) 32 : audit 0 from='client.14180 v1:172.21.15.49:0/4294411849' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T21:59:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.572572+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.577884+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.584090+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.589412+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:57.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.591203+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2024-03-11T21:59:57.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.593152+0000 mon.a (mon.0) 122 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T21:59:57.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:57 smithi049 bash[21434]: audit 2024-03-11T21:59:56.594526+0000 mon.a (mon.0) 123 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: cephadm 2024-03-11T21:59:56.596667+0000 mgr.y (mgr.14152) 33 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: cluster 2024-03-11T21:59:56.665970+0000 mgr.y (mgr.14152) 34 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: cephadm 2024-03-11T21:59:56.812632+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: cephadm 2024-03-11T21:59:56.977425+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: cephadm 2024-03-11T21:59:57.091661+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: audit 2024-03-11T21:59:57.211096+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: audit 2024-03-11T21:59:57.216343+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T21:59:58.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 21:59:58 smithi049 bash[21434]: audit 2024-03-11T21:59:57.221686+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:00.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:00 smithi049 bash[21434]: cluster 2024-03-11T21:59:58.666467+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:01.513 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:00:02.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:02 smithi049 bash[21434]: cluster 2024-03-11T22:00:00.666975+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- 172.21.15.49:0/1798777680 >> v1:172.21.15.49:6789/0 conn(0x7f5668107630 legacy=0x7f5668107a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- 172.21.15.49:0/1798777680 shutdown_connections 2024-03-11T22:00:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- 172.21.15.49:0/1798777680 >> 172.21.15.49:0/1798777680 conn(0x7f56680fd070 msgr2=0x7f56680ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- 172.21.15.49:0/1798777680 shutdown_connections 2024-03-11T22:00:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- 172.21.15.49:0/1798777680 wait complete. 2024-03-11T22:00:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 Processor -- start 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- start start 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5668075e60 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f566de4e700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5668107630 0x7f5668073f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51282/0 (socket says 172.21.15.49:51282) 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f566de4e700 1 -- 172.21.15.49:0/1354557939 learned_addr learned my addr 172.21.15.49:0/1354557939 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376365891 0 0) 0x7f5668075e60 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56540054f0 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2878368765 0 0) 0x7f56540054f0 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5668075e60 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5664001980 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2297205776 0 0) 0x7f5668075e60 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5668074680 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5668074930 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5668074db0 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f5664001200 con 0x7f5668107630 2024-03-11T22:00:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.968+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f5664004e90 con 0x7f5668107630 2024-03-11T22:00:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.972+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f5664005010 con 0x7f5668107630 2024-03-11T22:00:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.972+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c005120 con 0x7f5668107630 2024-03-11T22:00:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.972+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 3919474133 0 0) 0x7f5664047180 con 0x7f5668107630 2024-03-11T22:00:03.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:03.976+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f5664005400 con 0x7f5668107630 2024-03-11T22:00:04.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.188+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f564c0053d0 con 0x7f5668107630 2024-03-11T22:00:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.216+0000 7f565effd700 1 -- 172.21.15.49:0/1354557939 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (unknown 3126668360 0 0) 0x7f5664014e60 con 0x7f5668107630 2024-03-11T22:00:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.220+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 >> v1:172.21.15.49:6800/4076252288 conn(0x7f565403a010 legacy=0x7f565403c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.220+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 >> v1:172.21.15.49:6789/0 conn(0x7f5668107630 legacy=0x7f5668073f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:04.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.220+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 shutdown_connections 2024-03-11T22:00:04.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.220+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 >> 172.21.15.49:0/1354557939 conn(0x7f56680fd070 msgr2=0x7f5668108500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:04.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.220+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 shutdown_connections 2024-03-11T22:00:04.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:04.220+0000 7f56700b2700 1 -- 172.21.15.49:0/1354557939 wait complete. 2024-03-11T22:00:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-03-11T22:00:04.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:04 smithi049 bash[21434]: cluster 2024-03-11T22:00:02.667350+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:04.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:04 smithi049 bash[21434]: audit 2024-03-11T22:00:04.190834+0000 mon.a (mon.0) 127 : audit 1 from='client.? v1:172.21.15.49:0/1354557939' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-11T22:00:04.858 INFO:tasks.cephadm:Adding mon.a on smithi049 2024-03-11T22:00:04.859 INFO:tasks.cephadm:Adding mon.c on smithi049 2024-03-11T22:00:04.859 INFO:tasks.cephadm:Adding mon.b on smithi187 2024-03-11T22:00:04.859 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply mon '3;smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b' 2024-03-11T22:00:05.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:05 smithi049 bash[21434]: audit 2024-03-11T22:00:04.218556+0000 mon.a (mon.0) 128 : audit 1 from='client.? v1:172.21.15.49:0/1354557939' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-11T22:00:05.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:05 smithi049 bash[21434]: cluster 2024-03-11T22:00:04.221945+0000 mon.a (mon.0) 129 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:06.070 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:06.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:06 smithi049 bash[21434]: cluster 2024-03-11T22:00:04.667860+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:08.351 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- 172.21.15.187:0/1601189435 >> v1:172.21.15.49:6789/0 conn(0x7f3d28102780 legacy=0x7f3d28102b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:08.351 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- 172.21.15.187:0/1601189435 shutdown_connections 2024-03-11T22:00:08.351 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- 172.21.15.187:0/1601189435 >> 172.21.15.187:0/1601189435 conn(0x7f3d280fbf30 msgr2=0x7f3d280fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:08.351 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- 172.21.15.187:0/1601189435 shutdown_connections 2024-03-11T22:00:08.351 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- 172.21.15.187:0/1601189435 wait complete. 2024-03-11T22:00:08.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 Processor -- start 2024-03-11T22:00:08.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- start start 2024-03-11T22:00:08.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3d28196960 con 0x7f3d28102780 2024-03-11T22:00:08.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2d6b3700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3d28102780 0x7f3d28196250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.187:43922/0 (socket says 172.21.15.187:43922) 2024-03-11T22:00:08.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2d6b3700 1 -- 172.21.15.187:0/1276417862 learned_addr learned my addr 172.21.15.187:0/1276417862 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:00:08.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657813817 0 0) 0x7f3d28196960 con 0x7f3d28102780 2024-03-11T22:00:08.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d10005540 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2082970215 0 0) 0x7f3d10005540 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3d28196960 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f3d18001370 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2256703661 0 0) 0x7f3d28196960 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d28196af0 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d28196da0 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.356+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2819ef80 con 0x7f3d28102780 2024-03-11T22:00:08.354 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.360+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f3d18001190 con 0x7f3d28102780 2024-03-11T22:00:08.355 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.360+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7f3d18004df0 con 0x7f3d28102780 2024-03-11T22:00:08.355 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.360+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d14005120 con 0x7f3d28102780 2024-03-11T22:00:08.355 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.360+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f3d18001970 con 0x7f3d28102780 2024-03-11T22:00:08.355 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.360+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 4163023633 0 0) 0x7f3d18046e80 con 0x7f3d28102780 2024-03-11T22:00:08.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.372+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f3d18015840 con 0x7f3d28102780 2024-03-11T22:00:08.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:08 smithi049 bash[21434]: cluster 2024-03-11T22:00:06.668362+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:08.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.588+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d14000c60 con 0x7f3d10039fc0 2024-03-11T22:00:08.598 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.604+0000 7f3d267fc700 1 -- 172.21.15.187:0/1276417862 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 3265049985) 0x7f3d14000c60 con 0x7f3d10039fc0 2024-03-11T22:00:08.598 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mon update... 2024-03-11T22:00:08.601 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.604+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 >> v1:172.21.15.49:6800/4076252288 conn(0x7f3d10039fc0 legacy=0x7f3d1003c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:08.601 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.604+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 >> v1:172.21.15.49:6789/0 conn(0x7f3d28102780 legacy=0x7f3d28196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:08.601 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.604+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 shutdown_connections 2024-03-11T22:00:08.601 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.604+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 >> 172.21.15.187:0/1276417862 conn(0x7f3d280fbf30 msgr2=0x7f3d28107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:08.601 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.604+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 shutdown_connections 2024-03-11T22:00:08.601 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:08.604+0000 7f3d2f917700 1 -- 172.21.15.187:0/1276417862 wait complete. 2024-03-11T22:00:09.168 DEBUG:teuthology.orchestra.run.smithi049:mon.c> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.c.service 2024-03-11T22:00:09.171 DEBUG:teuthology.orchestra.run.smithi187:mon.b> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.b.service 2024-03-11T22:00:09.173 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-11T22:00:09.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.592428+0000 mgr.y (mgr.14152) 43 : audit 0 from='client.14184 v1:172.21.15.187:0/1276417862' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: cephadm 2024-03-11T22:00:08.598385+0000 mgr.y (mgr.14152) 44 : cephadm 1 Saving service mon spec with placement smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b;count:3 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.604003+0000 mon.a (mon.0) 130 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.630328+0000 mon.a (mon.0) 131 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.634332+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.636413+0000 mon.a (mon.0) 133 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.643727+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.647126+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: audit 2024-03-11T22:00:08.648917+0000 mon.a (mon.0) 136 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:10.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: cephadm 2024-03-11T22:00:08.650989+0000 mgr.y (mgr.14152) 45 : cephadm 1 Deploying daemon mon.b on smithi187 2024-03-11T22:00:10.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:09 smithi049 bash[21434]: cluster 2024-03-11T22:00:08.668868+0000 mgr.y (mgr.14152) 46 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:10.392 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:12.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:11 smithi049 bash[21434]: cluster 2024-03-11T22:00:10.669363+0000 mgr.y (mgr.14152) 47 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:13.461 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/2096628001 >> v1:172.21.15.49:6789/0 conn(0x7fc2b8107610 legacy=0x7fc2b81079f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:13.461 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/2096628001 shutdown_connections 2024-03-11T22:00:13.461 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/2096628001 >> 172.21.15.187:0/2096628001 conn(0x7fc2b8075f60 msgr2=0x7fc2b8076370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:13.461 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/2096628001 shutdown_connections 2024-03-11T22:00:13.461 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/2096628001 wait complete. 2024-03-11T22:00:13.461 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 Processor -- start 2024-03-11T22:00:13.461 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 -- start start 2024-03-11T22:00:13.462 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bf5ca700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc2b81967f0 con 0x7fc2b8107610 2024-03-11T22:00:13.462 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bd366700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc2b8107610 0x7fc2b81960e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.187:43942/0 (socket says 172.21.15.187:43942) 2024-03-11T22:00:13.462 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2bd366700 1 -- 172.21.15.187:0/1519393654 learned_addr learned my addr 172.21.15.187:0/1519393654 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:00:13.462 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260566794 0 0) 0x7fc2b81967f0 con 0x7fc2b8107610 2024-03-11T22:00:13.462 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.464+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a4005540 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1599901971 0 0) 0x7fc2a4005540 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc2b81967f0 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fc2b40014c0 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 791865575 0 0) 0x7fc2b81967f0 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8196980 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8196c30 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b819ee10 con 0x7fc2b8107610 2024-03-11T22:00:13.463 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fc2b4003b10 con 0x7fc2b8107610 2024-03-11T22:00:13.464 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 1979951150 0 0) 0x7fc2b4004d70 con 0x7fc2b8107610 2024-03-11T22:00:13.464 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c005120 con 0x7fc2b8107610 2024-03-11T22:00:13.464 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7fc2b4003680 con 0x7fc2b8107610 2024-03-11T22:00:13.464 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.468+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 4163023633 0 0) 0x7fc2b4047070 con 0x7fc2b8107610 2024-03-11T22:00:13.478 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.484+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fc2b4015750 con 0x7fc2b8107610 2024-03-11T22:00:13.795 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.800+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc29c0053d0 con 0x7fc2b8107610 2024-03-11T22:00:13.796 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.800+0000 7fc2ae7fc700 1 -- 172.21.15.187:0/1519393654 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+694 (unknown 2237029548 0 2708501762) 0x7fc2b4015750 con 0x7fc2b8107610 2024-03-11T22:00:13.796 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-11T22:00:13.796 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"377df5b0-dff2-11ee-95c8-87774f69a715","modified":"2024-03-11T21:57:55.591787Z","created":"2024-03-11T21:57:55.591787Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-11T22:00:13.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.804+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 >> v1:172.21.15.49:6800/4076252288 conn(0x7fc2a403a010 legacy=0x7fc2a403c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:13.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.804+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 >> v1:172.21.15.49:6789/0 conn(0x7fc2b8107610 legacy=0x7fc2b81960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:13.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.804+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 shutdown_connections 2024-03-11T22:00:13.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.804+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 >> 172.21.15.187:0/1519393654 conn(0x7fc2b8075f60 msgr2=0x7fc2b8108d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:13.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.804+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 shutdown_connections 2024-03-11T22:00:13.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:13.804+0000 7fc2bf5ca700 1 -- 172.21.15.187:0/1519393654 wait complete. 2024-03-11T22:00:13.799 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-03-11T22:00:14.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:13 smithi049 bash[21434]: cluster 2024-03-11T22:00:12.669792+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:14 smithi049 bash[21434]: audit 2024-03-11T22:00:13.802685+0000 mon.a (mon.0) 137 : audit 0 from='client.? v1:172.21.15.187:0/1519393654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-11T22:00:15.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:14 smithi049 bash[21434]: audit 2024-03-11T22:00:13.929740+0000 mon.a (mon.0) 138 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:14 smithi049 bash[21434]: audit 2024-03-11T22:00:13.935453+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:14 smithi049 bash[21434]: audit 2024-03-11T22:00:13.982806+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:14 smithi049 bash[21434]: audit 2024-03-11T22:00:13.984191+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:15.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:14 smithi049 bash[21434]: audit 2024-03-11T22:00:13.986029+0000 mon.a (mon.0) 142 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:15.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:14 smithi049 bash[21434]: cephadm 2024-03-11T22:00:13.988020+0000 mgr.y (mgr.14152) 49 : cephadm 1 Deploying daemon mon.c on smithi049 2024-03-11T22:00:15.054 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.048+0000 7fb59c544c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-11T22:00:15.054 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.048+0000 7fb59c544c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0ffd2fda-3767-4998-a7a0-18afd1616a17 2024-03-11T22:00:15.054 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.048+0000 7fb59c544c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194415052117, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-11T22:00:15.054 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.048+0000 7fb59c544c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-11T22:00:15.055 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.048+0000 7fb59c544c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194415052572, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1587, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 488, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 366, "raw_average_value_size": 73, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710194415, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0ffd2fda-3767-4998-a7a0-18afd1616a17", "db_session_id": "1PGLNDPI4AXVEAE6OPPZ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.048+0000 7fb59c544c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194415052671, "job": 1, "event": "recovery_finished"} 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.048+0000 7fb59c544c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb59c544c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb59c544c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5647095c8000 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb59c544c80 4 rocksdb: DB pointer 0x5647095b2000 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb59c544c80 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb58acb4700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb58acb4700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-11T22:00:15.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: ** DB Stats ** 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: ** Compaction Stats [default] ** 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: L0 1/0 1.55 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Sum 1/0 1.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: ** Compaction Stats [default] ** 2024-03-11T22:00:15.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T22:00:15.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: AddFile(Total Files): cumulative 0, interval 0 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: AddFile(Keys): cumulative 0, interval 0 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-11T22:00:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Block cache BinnedLRUCache@0x5647094d3090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: ** File Read Latency Histogram By Level [default] ** 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb59c544c80 0 using public_addrv v1:172.21.15.187:6789/0 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb59c544c80 0 starting mon.b rank -1 at public addrs v1:172.21.15.187:6789/0 at bind addrs v1:172.21.15.187:6789/0 mon_data /var/lib/ceph/mon/ceph-b fsid 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.052+0000 7fb59c544c80 1 mon.b@-1(???) e0 preinit fsid 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 0 mon.b@-1(synchronizing).mds e1 new map 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: e1 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: legacy client fscid: -1 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: No filesystems configured 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-11T22:00:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.072+0000 7fb58dcba700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.076+0000 7fb58dcba700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.076+0000 7fb58dcba700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.076+0000 7fb58dcba700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.076+0000 7fb58dcba700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:33.951953+0000 mgr.y (mgr.14152) 13 : audit 0 from='client.14176 v1:172.21.15.49:0/3398083196' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:34.009352+0000 mgr.y (mgr.14152) 14 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:34.123901+0000 mgr.y (mgr.14152) 15 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:34.672175+0000 mon.a (mon.0) 109 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:34.676280+0000 mon.a (mon.0) 110 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:34.680214+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:34.338619+0000 mgr.y (mgr.14152) 16 : cephadm 1 Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:34.503461+0000 mgr.y (mgr.14152) 17 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:34.660976+0000 mgr.y (mgr.14152) 18 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:36.661441+0000 mgr.y (mgr.14152) 19 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:38.661952+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:40.662515+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:41.894258+0000 mgr.y (mgr.14152) 22 : audit 0 from='client.14178 v1:172.21.15.49:0/3260800087' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:42.663016+0000 mgr.y (mgr.14152) 23 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:42.671540+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi187 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:44.663394+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:46.663884+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:47.969909+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:47.989259+0000 mon.a (mon.0) 113 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:47.970832+0000 mgr.y (mgr.14152) 27 : cephadm 1 Added host smithi187 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:48.462567+0000 mon.a (mon.0) 114 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:48.664266+0000 mgr.y (mgr.14152) 28 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:49.987971+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:50.664664+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:51.133997+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:52.665086+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:54.665528+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.133722+0000 mgr.y (mgr.14152) 32 : audit 0 from='client.14180 v1:172.21.15.49:0/4294411849' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.572572+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.577884+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.584090+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.589412+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.591203+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.593152+0000 mon.a (mon.0) 122 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:56.594526+0000 mon.a (mon.0) 123 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:56.596667+0000 mgr.y (mgr.14152) 33 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:56.665970+0000 mgr.y (mgr.14152) 34 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:56.812632+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:56.977425+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T21:59:57.091661+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:57.211096+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:57.216343+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T21:59:57.221686+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T21:59:58.666467+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:00.666975+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:02.667350+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:04.190834+0000 mon.a (mon.0) 127 : audit 1 from='client.? v1:172.21.15.49:0/1354557939' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:04.218556+0000 mon.a (mon.0) 128 : audit 1 from='client.? v1:172.21.15.49:0/1354557939' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:04.221945+0000 mon.a (mon.0) 129 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:04.667860+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:06.668362+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.592428+0000 mgr.y (mgr.14152) 43 : audit 0 from='client.14184 v1:172.21.15.187:0/1276417862' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T22:00:08.598385+0000 mgr.y (mgr.14152) 44 : cephadm 1 Saving service mon spec with placement smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b;count:3 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.604003+0000 mon.a (mon.0) 130 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.630328+0000 mon.a (mon.0) 131 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.634332+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.636413+0000 mon.a (mon.0) 133 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.643727+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.647126+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:08.648917+0000 mon.a (mon.0) 136 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T22:00:08.650989+0000 mgr.y (mgr.14152) 45 : cephadm 1 Deploying daemon mon.b on smithi187 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:08.668868+0000 mgr.y (mgr.14152) 46 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:10.669363+0000 mgr.y (mgr.14152) 47 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cluster 2024-03-11T22:00:12.669792+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:13.802685+0000 mon.a (mon.0) 137 : audit 0 from='client.? v1:172.21.15.187:0/1519393654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:13.929740+0000 mon.a (mon.0) 138 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:13.935453+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:13.982806+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:13.984191+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:15.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: audit 2024-03-11T22:00:13.986029+0000 mon.a (mon.0) 142 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:15.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: cephadm 2024-03-11T22:00:13.988020+0000 mgr.y (mgr.14152) 49 : cephadm 1 Deploying daemon mon.c on smithi049 2024-03-11T22:00:15.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:15 smithi187 bash[23415]: debug 2024-03-11T22:00:15.076+0000 7fb58dcba700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-11T22:00:15.806 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-11T22:00:15.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-11T22:00:17.730 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:17 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:17.730 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:00:17 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:18.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:17 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:18.024 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:00:17 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:18.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:17 smithi049 systemd[1]: Started Ceph mon.c for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.730+0000 7f374beffc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.730+0000 7f374beffc80 0 ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev), process ceph-mon, pid 7 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.730+0000 7f374beffc80 0 pidfile_write: ignore empty --pid-file 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 0 load: jerasure load: lrc 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: RocksDB version: 7.9.2 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Git sha 0 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Compile date 2024-03-08 02:48:09 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: DB SUMMARY 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: DB Session ID: 009IV4AI9HGNCTKP2NBK 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: CURRENT file: CURRENT 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: IDENTITY file: IDENTITY 2024-03-11T22:00:19.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 476 ; 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.error_if_exists: 0 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.create_if_missing: 0 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.paranoid_checks: 1 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.env: 0x56131148dae0 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.info_log: 0x56131229b960 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.statistics: (nil) 2024-03-11T22:00:19.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.use_fsync: 0 2024-03-11T22:00:19.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_log_file_size: 0 2024-03-11T22:00:19.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-11T22:00:19.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-11T22:00:19.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-11T22:00:19.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.allow_fallocate: 1 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.use_direct_reads: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.db_log_dir: 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.wal_dir: 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-11T22:00:19.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.write_buffer_manager: 0x56131226f400 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.unordered_write: 0 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-11T22:00:19.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.row_cache: None 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.wal_filter: None 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.two_write_queues: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.wal_compression: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.atomic_flush: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-11T22:00:19.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.log_readahead_size: 0 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_background_jobs: 2 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_background_compactions: -1 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_subcompactions: 1 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-11T22:00:19.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_open_files: -1 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_background_flushes: -1 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Compression algorithms supported: 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kZSTD supported: 0 2024-03-11T22:00:19.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kXpressCompression supported: 0 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kZlibCompression supported: 1 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kSnappyCompression supported: 1 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kLZ4Compression supported: 1 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: kBZip2Compression supported: 0 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-11T22:00:19.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-11T22:00:19.035 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-11T22:00:19.035 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.merge_operator: 2024-03-11T22:00:19.035 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_filter: None 2024-03-11T22:00:19.035 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-11T22:00:19.035 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-11T22:00:19.035 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56131229ba60) 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cache_index_and_filter_blocks: 1 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: pin_top_level_index_and_filter: 1 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: index_type: 0 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: data_block_index_type: 0 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: index_shortening: 1 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: data_block_hash_table_util_ratio: 0.750000 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: checksum: 4 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: no_block_cache: 0 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_cache: 0x56131229d090 2024-03-11T22:00:19.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_cache_name: BinnedLRUCache 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_cache_options: 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: capacity : 536870912 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: num_shard_bits : 4 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: strict_capacity_limit : 0 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: high_pri_pool_ratio: 0.000 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_cache_compressed: (nil) 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: persistent_cache: (nil) 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_size: 4096 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_size_deviation: 10 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_restart_interval: 16 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: index_block_restart_interval: 1 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: metadata_block_size: 4096 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: partition_filters: 0 2024-03-11T22:00:19.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: use_delta_encoding: 1 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: filter_policy: bloomfilter 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: whole_key_filtering: 1 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: verify_compression: 0 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: read_amp_bytes_per_bit: 0 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: format_version: 5 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: enable_index_compression: 1 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: block_align: 0 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: max_auto_readahead_size: 262144 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: prepopulate_block_cache: 0 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: initial_auto_readahead_size: 8192 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: num_file_reads_for_auto_readahead: 2 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression: NoCompression 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-11T22:00:19.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.num_levels: 7 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-11T22:00:19.039 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-11T22:00:19.040 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-11T22:00:19.041 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.table_properties_collectors: 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.inplace_update_support: 0 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.bloom_locality: 0 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.max_successive_merges: 0 2024-03-11T22:00:19.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.ttl: 2592000 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.enable_blob_files: false 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.min_blob_size: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-11T22:00:19.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f3869c53-f707-4faf-99f9-4fe14ea32962 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194418740440, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.734+0000 7f374beffc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194418740963, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1587, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 488, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 366, "raw_average_value_size": 73, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710194418, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f3869c53-f707-4faf-99f9-4fe14ea32962", "db_session_id": "009IV4AI9HGNCTKP2NBK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710194418741087, "job": 1, "event": "recovery_finished"} 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561312392000 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 4 rocksdb: DB pointer 0x56131237c000 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f373a66f700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f373a66f700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-11T22:00:19.044 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: ** DB Stats ** 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: ** Compaction Stats [default] ** 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: L0 1/0 1.55 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Sum 1/0 1.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: ** Compaction Stats [default] ** 2024-03-11T22:00:19.045 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: AddFile(Total Files): cumulative 0, interval 0 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: AddFile(Keys): cumulative 0, interval 0 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Block cache BinnedLRUCache@0x56131229d090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-03-11T22:00:19.046 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: ** File Read Latency Histogram By Level [default] ** 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 0 using public_addrv v1:172.21.15.49:6790/0 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 0 starting mon.c rank -1 at public addrs v1:172.21.15.49:6790/0 at bind addrs v1:172.21.15.49:6790/0 mon_data /var/lib/ceph/mon/ceph-c fsid 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.738+0000 7f374beffc80 1 mon.c@-1(???) e0 preinit fsid 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 0 mon.c@-1(synchronizing).mds e1 new map 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 0 mon.c@-1(synchronizing).mds e1 print_map 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: e1 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: legacy client fscid: -1 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: No filesystems configured 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-11T22:00:19.047 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:33.951953+0000 mgr.y (mgr.14152) 13 : audit 0 from='client.14176 v1:172.21.15.49:0/3398083196' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:34.009352+0000 mgr.y (mgr.14152) 14 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:34.123901+0000 mgr.y (mgr.14152) 15 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:34.672175+0000 mon.a (mon.0) 109 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:34.676280+0000 mon.a (mon.0) 110 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:34.680214+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:34.338619+0000 mgr.y (mgr.14152) 16 : cephadm 1 Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:00:19.048 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:34.503461+0000 mgr.y (mgr.14152) 17 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:34.660976+0000 mgr.y (mgr.14152) 18 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:36.661441+0000 mgr.y (mgr.14152) 19 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:38.661952+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:40.662515+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:41.894258+0000 mgr.y (mgr.14152) 22 : audit 0 from='client.14178 v1:172.21.15.49:0/3260800087' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:42.663016+0000 mgr.y (mgr.14152) 23 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:42.671540+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi187 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:44.663394+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:46.663884+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:47.969909+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:47.989259+0000 mon.a (mon.0) 113 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:47.970832+0000 mgr.y (mgr.14152) 27 : cephadm 1 Added host smithi187 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:48.462567+0000 mon.a (mon.0) 114 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.049 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:48.664266+0000 mgr.y (mgr.14152) 28 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:49.987971+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:50.664664+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:51.133997+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:52.665086+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:54.665528+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.133722+0000 mgr.y (mgr.14152) 32 : audit 0 from='client.14180 v1:172.21.15.49:0/4294411849' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.572572+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.577884+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.584090+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.589412+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.591203+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.593152+0000 mon.a (mon.0) 122 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:56.594526+0000 mon.a (mon.0) 123 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:19.050 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:56.596667+0000 mgr.y (mgr.14152) 33 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:56.665970+0000 mgr.y (mgr.14152) 34 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:56.812632+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:56.977425+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T21:59:57.091661+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:57.211096+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:57.216343+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T21:59:57.221686+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T21:59:58.666467+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:00.666975+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:02.667350+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:04.190834+0000 mon.a (mon.0) 127 : audit 1 from='client.? v1:172.21.15.49:0/1354557939' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:04.218556+0000 mon.a (mon.0) 128 : audit 1 from='client.? v1:172.21.15.49:0/1354557939' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:04.221945+0000 mon.a (mon.0) 129 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:04.667860+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.051 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:06.668362+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.592428+0000 mgr.y (mgr.14152) 43 : audit 0 from='client.14184 v1:172.21.15.187:0/1276417862' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T22:00:08.598385+0000 mgr.y (mgr.14152) 44 : cephadm 1 Saving service mon spec with placement smithi049:[v1:172.21.15.49:6789]=a;smithi049:[v1:172.21.15.49:6790]=c;smithi187:[v1:172.21.15.187:6789]=b;count:3 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.604003+0000 mon.a (mon.0) 130 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.630328+0000 mon.a (mon.0) 131 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.634332+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.636413+0000 mon.a (mon.0) 133 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.643727+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.647126+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:08.648917+0000 mon.a (mon.0) 136 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T22:00:08.650989+0000 mgr.y (mgr.14152) 45 : cephadm 1 Deploying daemon mon.b on smithi187 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:08.668868+0000 mgr.y (mgr.14152) 46 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:10.669363+0000 mgr.y (mgr.14152) 47 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cluster 2024-03-11T22:00:12.669792+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:19.052 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:13.802685+0000 mon.a (mon.0) 137 : audit 0 from='client.? v1:172.21.15.187:0/1519393654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-11T22:00:19.053 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:13.929740+0000 mon.a (mon.0) 138 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.053 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:13.935453+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.053 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:13.982806+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:19.053 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:13.984191+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:19.053 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: audit 2024-03-11T22:00:13.986029+0000 mon.a (mon.0) 142 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:19.053 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: cephadm 2024-03-11T22:00:13.988020+0000 mgr.y (mgr.14152) 49 : cephadm 1 Deploying daemon mon.c on smithi049 2024-03-11T22:00:19.053 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:18 smithi049 bash[28804]: debug 2024-03-11T22:00:18.754+0000 7f373d675700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-11T22:00:19.505 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:00:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:14.670264+0000 mgr.y (mgr.14152) 50 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:15.090252+0000 mon.a (mon.0) 144 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:00:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:15.090714+0000 mon.a (mon.0) 145 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:15.110187+0000 mon.a (mon.0) 146 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:16.084603+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:16.670605+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:17.084906+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:17.087097+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:18.085236+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:18.670950+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:18.763907+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:19.085024+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:19.764488+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:20.085167+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.130727+0000 mon.a (mon.0) 154 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.141203+0000 mon.a (mon.0) 155 : cluster 0 monmap e2: 2 mons at {a=v1:172.21.15.49:6789/0,b=v1:172.21.15.187:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.161882+0000 mon.a (mon.0) 156 : cluster 0 fsmap 2024-03-11T22:00:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.161961+0000 mon.a (mon.0) 157 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:20.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.162243+0000 mon.a (mon.0) 158 : cluster 0 mgrmap e13: y(active, since 73s) 2024-03-11T22:00:20.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.162497+0000 mon.a (mon.0) 159 : cluster 1 overall HEALTH_OK 2024-03-11T22:00:20.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:20.169664+0000 mon.a (mon.0) 160 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:20.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:20 smithi187 bash[23415]: audit 2024-03-11T22:00:20.176544+0000 mon.a (mon.0) 161 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:20.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:14.670264+0000 mgr.y (mgr.14152) 50 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:15.090252+0000 mon.a (mon.0) 144 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:15.090714+0000 mon.a (mon.0) 145 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:15.110187+0000 mon.a (mon.0) 146 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:16.084603+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:16.670605+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:17.084906+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:17.087097+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:18.085236+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:18.670950+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:18.763907+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:19.085024+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:19.764488+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:20.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:20.085167+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.130727+0000 mon.a (mon.0) 154 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.141203+0000 mon.a (mon.0) 155 : cluster 0 monmap e2: 2 mons at {a=v1:172.21.15.49:6789/0,b=v1:172.21.15.187:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.161882+0000 mon.a (mon.0) 156 : cluster 0 fsmap 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.161961+0000 mon.a (mon.0) 157 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.162243+0000 mon.a (mon.0) 158 : cluster 0 mgrmap e13: y(active, since 73s) 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.162497+0000 mon.a (mon.0) 159 : cluster 1 overall HEALTH_OK 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:20.169664+0000 mon.a (mon.0) 160 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:20 smithi049 bash[21434]: audit 2024-03-11T22:00:20.176544+0000 mon.a (mon.0) 161 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:21.524 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:00:21 smithi049 bash[21686]: debug 2024-03-11T22:00:21.082+0000 7f2b8511f700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-11T22:00:25.837 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.840+0000 7f23c5adc700 1 -- 172.21.15.187:0/621860410 >> v1:172.21.15.49:6789/0 conn(0x7f23ac0035f0 legacy=0x7f23ac005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:25.837 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.840+0000 7f23c5adc700 1 -- 172.21.15.187:0/621860410 shutdown_connections 2024-03-11T22:00:25.837 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.840+0000 7f23c5adc700 1 -- 172.21.15.187:0/621860410 >> 172.21.15.187:0/621860410 conn(0x7f23c00fc0e0 msgr2=0x7f23c00fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:25.837 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.840+0000 7f23c5adc700 1 -- 172.21.15.187:0/621860410 shutdown_connections 2024-03-11T22:00:25.838 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.840+0000 7f23c5adc700 1 -- 172.21.15.187:0/621860410 wait complete. 2024-03-11T22:00:25.838 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23c5adc700 1 Processor -- start 2024-03-11T22:00:25.839 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23c5adc700 1 -- start start 2024-03-11T22:00:25.839 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23c5adc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f23c01a6310 con 0x7f23c01a2640 2024-03-11T22:00:25.839 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23c5adc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f23c01a74f0 con 0x7f23ac0035f0 2024-03-11T22:00:25.839 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23bf7fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f23ac0035f0 0x7f23c01963b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:56870/0 (socket says 172.21.15.187:56870) 2024-03-11T22:00:25.840 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23bf7fe700 1 -- 172.21.15.187:0/4085227384 learned_addr learned my addr 172.21.15.187:0/4085227384 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:00:25.840 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23c5adc700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f23c01a86f0 con 0x7f23c0196ac0 2024-03-11T22:00:25.842 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688509019 0 0) 0x7f23c01a6310 con 0x7f23c01a2640 2024-03-11T22:00:25.842 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.844+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a8003bb0 con 0x7f23c01a2640 2024-03-11T22:00:25.842 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.848+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3780797179 0 0) 0x7f23a8003bb0 con 0x7f23c01a2640 2024-03-11T22:00:25.842 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.848+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f23c01a6310 con 0x7f23c01a2640 2024-03-11T22:00:25.842 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.848+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f23b8001b90 con 0x7f23c01a2640 2024-03-11T22:00:25.848 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.852+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2984508676 0 0) 0x7f23c01a6310 con 0x7f23c01a2640 2024-03-11T22:00:25.848 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.852+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 >> v1:172.21.15.49:6790/0 conn(0x7f23c0196ac0 legacy=0x7f23c01a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:25.848 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.852+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 >> v1:172.21.15.187:6789/0 conn(0x7f23ac0035f0 legacy=0x7f23c01963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:25.848 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.852+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c01a98f0 con 0x7f23c01a2640 2024-03-11T22:00:25.848 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.852+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c01a88e0 con 0x7f23c01a2640 2024-03-11T22:00:25.848 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.852+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c01a8da0 con 0x7f23c01a2640 2024-03-11T22:00:25.849 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.852+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c00632a0 con 0x7f23c01a2640 2024-03-11T22:00:25.856 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.860+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f23b8002180 con 0x7f23c01a2640 2024-03-11T22:00:25.856 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.860+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f23b8004c90 con 0x7f23c01a2640 2024-03-11T22:00:25.857 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.860+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f23b8010100 con 0x7f23c01a2640 2024-03-11T22:00:25.861 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.864+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 4163023633 0 0) 0x7f23b8011c70 con 0x7f23c01a2640 2024-03-11T22:00:25.876 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:25.880+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f23b80157b0 con 0x7f23c01a2640 2024-03-11T22:00:26.188 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.192+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f23c0197830 con 0x7f23c01a2640 2024-03-11T22:00:26.188 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.192+0000 7f23bcff9700 1 -- 172.21.15.187:0/4085227384 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1127 (unknown 409899127 0 3068667671) 0x7f23b8013b80 con 0x7f23c01a2640 2024-03-11T22:00:26.189 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-03-11T22:00:26.189 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":3,"fsid":"377df5b0-dff2-11ee-95c8-87774f69a715","modified":"2024-03-11T22:00:20.764977Z","created":"2024-03-11T21:57:55.591787Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6790","nonce":0}]},"addr":"172.21.15.49:6790/0","public_addr":"172.21.15.49:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-11T22:00:26.191 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.196+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 >> v1:172.21.15.49:6800/4076252288 conn(0x7f23a8039f40 legacy=0x7f23a803c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:26.191 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.196+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 >> v1:172.21.15.49:6789/0 conn(0x7f23c01a2640 legacy=0x7f23c01a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:26.191 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.196+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 shutdown_connections 2024-03-11T22:00:26.191 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.196+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 >> 172.21.15.187:0/4085227384 conn(0x7f23c00fc0e0 msgr2=0x7f23c01036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:26.191 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.196+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 shutdown_connections 2024-03-11T22:00:26.191 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:26.196+0000 7f23c5adc700 1 -- 172.21.15.187:0/4085227384 wait complete. 2024-03-11T22:00:26.192 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 3 2024-03-11T22:00:26.204 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.671349+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:20.768360+0000 mon.a (mon.0) 166 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.768539+0000 mon.a (mon.0) 167 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:20.770271+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:20.785726+0000 mon.a (mon.0) 168 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:20.785847+0000 mon.a (mon.0) 169 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:21.764737+0000 mon.a (mon.0) 170 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:22.671762+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:22.764918+0000 mon.a (mon.0) 171 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:22.767260+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:23.765114+0000 mon.a (mon.0) 172 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:24.672176+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:24.765156+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:25.765346+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.205 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:25.771714+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:25.810539+0000 mon.a (mon.0) 176 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:25.816313+0000 mon.a (mon.0) 177 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.49:6789/0,b=v1:172.21.15.187:6789/0,c=v1:172.21.15.49:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:25.833555+0000 mon.a (mon.0) 178 : cluster 0 fsmap 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:25.833587+0000 mon.a (mon.0) 179 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:25.833774+0000 mon.a (mon.0) 180 : cluster 0 mgrmap e13: y(active, since 79s) 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: cluster 2024-03-11T22:00:25.833932+0000 mon.a (mon.0) 181 : cluster 1 overall HEALTH_OK 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:25.839984+0000 mon.a (mon.0) 182 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:25.846129+0000 mon.a (mon.0) 183 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:25.852569+0000 mon.a (mon.0) 184 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.206 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:25 smithi187 bash[23415]: audit 2024-03-11T22:00:25.859612+0000 mon.a (mon.0) 185 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:14.670264+0000 mgr.y (mgr.14152) 50 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:15.090252+0000 mon.a (mon.0) 144 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:00:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:15.090714+0000 mon.a (mon.0) 145 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:15.110187+0000 mon.a (mon.0) 146 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:16.084603+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:16.670605+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:17.084906+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:17.087097+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:18.085236+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:18.670950+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:18.763907+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:19.085024+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:19.764488+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:20.085167+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.130727+0000 mon.a (mon.0) 154 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-11T22:00:26.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.141203+0000 mon.a (mon.0) 155 : cluster 0 monmap e2: 2 mons at {a=v1:172.21.15.49:6789/0,b=v1:172.21.15.187:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.161882+0000 mon.a (mon.0) 156 : cluster 0 fsmap 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.161961+0000 mon.a (mon.0) 157 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.162243+0000 mon.a (mon.0) 158 : cluster 0 mgrmap e13: y(active, since 73s) 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.162497+0000 mon.a (mon.0) 159 : cluster 1 overall HEALTH_OK 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:20.169664+0000 mon.a (mon.0) 160 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:20.176544+0000 mon.a (mon.0) 161 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.671349+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:20.768360+0000 mon.a (mon.0) 166 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.768539+0000 mon.a (mon.0) 167 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:20.770271+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:20.785726+0000 mon.a (mon.0) 168 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:20.785847+0000 mon.a (mon.0) 169 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:21.764737+0000 mon.a (mon.0) 170 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:22.671762+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:22.764918+0000 mon.a (mon.0) 171 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:22.767260+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:23.765114+0000 mon.a (mon.0) 172 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:24.672176+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:24.765156+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:25.765346+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:25.771714+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:25.810539+0000 mon.a (mon.0) 176 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:25.816313+0000 mon.a (mon.0) 177 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.49:6789/0,b=v1:172.21.15.187:6789/0,c=v1:172.21.15.49:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:25.833555+0000 mon.a (mon.0) 178 : cluster 0 fsmap 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:25.833587+0000 mon.a (mon.0) 179 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:25.833774+0000 mon.a (mon.0) 180 : cluster 0 mgrmap e13: y(active, since 79s) 2024-03-11T22:00:26.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: cluster 2024-03-11T22:00:25.833932+0000 mon.a (mon.0) 181 : cluster 1 overall HEALTH_OK 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:25.839984+0000 mon.a (mon.0) 182 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:25.846129+0000 mon.a (mon.0) 183 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:25.852569+0000 mon.a (mon.0) 184 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[21434]: audit 2024-03-11T22:00:25.859612+0000 mon.a (mon.0) 185 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.671349+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:20.768360+0000 mon.a (mon.0) 166 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.768539+0000 mon.a (mon.0) 167 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:20.770271+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:20.785726+0000 mon.a (mon.0) 168 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:20.785847+0000 mon.a (mon.0) 169 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:21.764737+0000 mon.a (mon.0) 170 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:22.671762+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:22.764918+0000 mon.a (mon.0) 171 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:22.767260+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:23.765114+0000 mon.a (mon.0) 172 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:24.672176+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:24.765156+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:25.765346+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:25.771714+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:25.810539+0000 mon.a (mon.0) 176 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:25.816313+0000 mon.a (mon.0) 177 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.49:6789/0,b=v1:172.21.15.187:6789/0,c=v1:172.21.15.49:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:25.833555+0000 mon.a (mon.0) 178 : cluster 0 fsmap 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:25.833587+0000 mon.a (mon.0) 179 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:25.833774+0000 mon.a (mon.0) 180 : cluster 0 mgrmap e13: y(active, since 79s) 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: cluster 2024-03-11T22:00:25.833932+0000 mon.a (mon.0) 181 : cluster 1 overall HEALTH_OK 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:25.839984+0000 mon.a (mon.0) 182 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:25.846129+0000 mon.a (mon.0) 183 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:25.852569+0000 mon.a (mon.0) 184 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:25 smithi049 bash[28804]: audit 2024-03-11T22:00:25.859612+0000 mon.a (mon.0) 185 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:26.842 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-11T22:00:26.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph config generate-minimal-conf 2024-03-11T22:00:27.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:25.885893+0000 mon.a (mon.0) 186 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.194770+0000 mon.a (mon.0) 187 : audit 0 from='client.? v1:172.21.15.187:0/4085227384' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.511057+0000 mon.a (mon.0) 188 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.512672+0000 mon.a (mon.0) 189 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.764863+0000 mon.a (mon.0) 190 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.849968+0000 mon.a (mon.0) 191 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.856156+0000 mon.a (mon.0) 192 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.862454+0000 mon.a (mon.0) 193 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.868263+0000 mon.a (mon.0) 194 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:26 smithi187 bash[23415]: audit 2024-03-11T22:00:26.874630+0000 mon.a (mon.0) 195 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:25.885893+0000 mon.a (mon.0) 186 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.194770+0000 mon.a (mon.0) 187 : audit 0 from='client.? v1:172.21.15.187:0/4085227384' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.511057+0000 mon.a (mon.0) 188 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.512672+0000 mon.a (mon.0) 189 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.764863+0000 mon.a (mon.0) 190 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.849968+0000 mon.a (mon.0) 191 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.856156+0000 mon.a (mon.0) 192 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.862454+0000 mon.a (mon.0) 193 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.868263+0000 mon.a (mon.0) 194 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[21434]: audit 2024-03-11T22:00:26.874630+0000 mon.a (mon.0) 195 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:25.885893+0000 mon.a (mon.0) 186 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.194770+0000 mon.a (mon.0) 187 : audit 0 from='client.? v1:172.21.15.187:0/4085227384' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.511057+0000 mon.a (mon.0) 188 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.512672+0000 mon.a (mon.0) 189 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.764863+0000 mon.a (mon.0) 190 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.849968+0000 mon.a (mon.0) 191 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.856156+0000 mon.a (mon.0) 192 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.862454+0000 mon.a (mon.0) 193 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.868263+0000 mon.a (mon.0) 194 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:27.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:26 smithi049 bash[28804]: audit 2024-03-11T22:00:26.874630+0000 mon.a (mon.0) 195 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: cephadm 2024-03-11T22:00:26.514724+0000 mgr.y (mgr.14152) 56 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: cephadm 2024-03-11T22:00:26.515137+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: cluster 2024-03-11T22:00:26.672440+0000 mgr.y (mgr.14152) 58 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: cephadm 2024-03-11T22:00:26.679298+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: cephadm 2024-03-11T22:00:26.680757+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: audit 2024-03-11T22:00:26.947855+0000 mon.a (mon.0) 196 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: audit 2024-03-11T22:00:26.954776+0000 mon.a (mon.0) 197 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: audit 2024-03-11T22:00:26.959782+0000 mon.a (mon.0) 198 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: audit 2024-03-11T22:00:26.966007+0000 mon.a (mon.0) 199 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: cephadm 2024-03-11T22:00:26.966744+0000 mgr.y (mgr.14152) 61 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: audit 2024-03-11T22:00:26.967283+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: audit 2024-03-11T22:00:26.968360+0000 mon.a (mon.0) 201 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: audit 2024-03-11T22:00:26.969326+0000 mon.a (mon.0) 202 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[21434]: cephadm 2024-03-11T22:00:26.970630+0000 mgr.y (mgr.14152) 62 : cephadm 1 Reconfiguring daemon mon.a on smithi049 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: cephadm 2024-03-11T22:00:26.514724+0000 mgr.y (mgr.14152) 56 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: cephadm 2024-03-11T22:00:26.515137+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: cluster 2024-03-11T22:00:26.672440+0000 mgr.y (mgr.14152) 58 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: cephadm 2024-03-11T22:00:26.679298+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: cephadm 2024-03-11T22:00:26.680757+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: audit 2024-03-11T22:00:26.947855+0000 mon.a (mon.0) 196 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: audit 2024-03-11T22:00:26.954776+0000 mon.a (mon.0) 197 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: audit 2024-03-11T22:00:26.959782+0000 mon.a (mon.0) 198 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: audit 2024-03-11T22:00:26.966007+0000 mon.a (mon.0) 199 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: cephadm 2024-03-11T22:00:26.966744+0000 mgr.y (mgr.14152) 61 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2024-03-11T22:00:28.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: audit 2024-03-11T22:00:26.967283+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:28.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: audit 2024-03-11T22:00:26.968360+0000 mon.a (mon.0) 201 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:28.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: audit 2024-03-11T22:00:26.969326+0000 mon.a (mon.0) 202 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:28.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:27 smithi049 bash[28804]: cephadm 2024-03-11T22:00:26.970630+0000 mgr.y (mgr.14152) 62 : cephadm 1 Reconfiguring daemon mon.a on smithi049 2024-03-11T22:00:28.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: cephadm 2024-03-11T22:00:26.514724+0000 mgr.y (mgr.14152) 56 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:00:28.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: cephadm 2024-03-11T22:00:26.515137+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: cluster 2024-03-11T22:00:26.672440+0000 mgr.y (mgr.14152) 58 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: cephadm 2024-03-11T22:00:26.679298+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: cephadm 2024-03-11T22:00:26.680757+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: audit 2024-03-11T22:00:26.947855+0000 mon.a (mon.0) 196 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: audit 2024-03-11T22:00:26.954776+0000 mon.a (mon.0) 197 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: audit 2024-03-11T22:00:26.959782+0000 mon.a (mon.0) 198 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: audit 2024-03-11T22:00:26.966007+0000 mon.a (mon.0) 199 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: cephadm 2024-03-11T22:00:26.966744+0000 mgr.y (mgr.14152) 61 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: audit 2024-03-11T22:00:26.967283+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: audit 2024-03-11T22:00:26.968360+0000 mon.a (mon.0) 201 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: audit 2024-03-11T22:00:26.969326+0000 mon.a (mon.0) 202 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:28.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:27 smithi187 bash[23415]: cephadm 2024-03-11T22:00:26.970630+0000 mgr.y (mgr.14152) 62 : cephadm 1 Reconfiguring daemon mon.a on smithi049 2024-03-11T22:00:30.183 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: cluster 2024-03-11T22:00:28.672849+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:30.183 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: audit 2024-03-11T22:00:28.939030+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:30.183 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: audit 2024-03-11T22:00:28.946728+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:30.183 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: cephadm 2024-03-11T22:00:28.989904+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: audit 2024-03-11T22:00:28.990504+0000 mon.a (mon.0) 205 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: audit 2024-03-11T22:00:28.992120+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: audit 2024-03-11T22:00:28.993604+0000 mon.a (mon.0) 207 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[28804]: cephadm 2024-03-11T22:00:28.995379+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi049 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: cluster 2024-03-11T22:00:28.672849+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: audit 2024-03-11T22:00:28.939030+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: audit 2024-03-11T22:00:28.946728+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: cephadm 2024-03-11T22:00:28.989904+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: audit 2024-03-11T22:00:28.990504+0000 mon.a (mon.0) 205 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: audit 2024-03-11T22:00:28.992120+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: audit 2024-03-11T22:00:28.993604+0000 mon.a (mon.0) 207 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:30.184 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:29 smithi049 bash[21434]: cephadm 2024-03-11T22:00:28.995379+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi049 2024-03-11T22:00:30.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: cluster 2024-03-11T22:00:28.672849+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:30.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: audit 2024-03-11T22:00:28.939030+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:30.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: audit 2024-03-11T22:00:28.946728+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:30.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: cephadm 2024-03-11T22:00:28.989904+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-03-11T22:00:30.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: audit 2024-03-11T22:00:28.990504+0000 mon.a (mon.0) 205 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:30.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: audit 2024-03-11T22:00:28.992120+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:30.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: audit 2024-03-11T22:00:28.993604+0000 mon.a (mon.0) 207 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:30.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:29 smithi187 bash[23415]: cephadm 2024-03-11T22:00:28.995379+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi049 2024-03-11T22:00:31.594 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:00:32.163 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: cluster 2024-03-11T22:00:30.673276+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:32.163 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: audit 2024-03-11T22:00:30.910325+0000 mon.a (mon.0) 208 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:32.163 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: audit 2024-03-11T22:00:30.915939+0000 mon.a (mon.0) 209 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:32.163 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: cephadm 2024-03-11T22:00:30.964244+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-03-11T22:00:32.163 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: audit 2024-03-11T22:00:30.964858+0000 mon.a (mon.0) 210 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:32.163 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: audit 2024-03-11T22:00:30.966580+0000 mon.a (mon.0) 211 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:32.164 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: audit 2024-03-11T22:00:30.968191+0000 mon.a (mon.0) 212 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:32.164 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:31 smithi187 bash[23415]: cephadm 2024-03-11T22:00:30.970206+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi187 2024-03-11T22:00:32.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: cluster 2024-03-11T22:00:30.673276+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: audit 2024-03-11T22:00:30.910325+0000 mon.a (mon.0) 208 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: audit 2024-03-11T22:00:30.915939+0000 mon.a (mon.0) 209 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: cephadm 2024-03-11T22:00:30.964244+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: audit 2024-03-11T22:00:30.964858+0000 mon.a (mon.0) 210 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: audit 2024-03-11T22:00:30.966580+0000 mon.a (mon.0) 211 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: audit 2024-03-11T22:00:30.968191+0000 mon.a (mon.0) 212 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[21434]: cephadm 2024-03-11T22:00:30.970206+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi187 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: cluster 2024-03-11T22:00:30.673276+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: audit 2024-03-11T22:00:30.910325+0000 mon.a (mon.0) 208 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: audit 2024-03-11T22:00:30.915939+0000 mon.a (mon.0) 209 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: cephadm 2024-03-11T22:00:30.964244+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: audit 2024-03-11T22:00:30.964858+0000 mon.a (mon.0) 210 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-11T22:00:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: audit 2024-03-11T22:00:30.966580+0000 mon.a (mon.0) 211 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-11T22:00:32.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: audit 2024-03-11T22:00:30.968191+0000 mon.a (mon.0) 212 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:32.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:31 smithi049 bash[28804]: cephadm 2024-03-11T22:00:30.970206+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi187 2024-03-11T22:00:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- 172.21.15.49:0/2201712185 >> v1:172.21.15.49:6790/0 conn(0x7f8f700ffdc0 legacy=0x7f8f701001a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- 172.21.15.49:0/2201712185 shutdown_connections 2024-03-11T22:00:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- 172.21.15.49:0/2201712185 >> 172.21.15.49:0/2201712185 conn(0x7f8f70076cf0 msgr2=0x7f8f70077100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- 172.21.15.49:0/2201712185 shutdown_connections 2024-03-11T22:00:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- 172.21.15.49:0/2201712185 wait complete. 2024-03-11T22:00:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 Processor -- start 2024-03-11T22:00:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- start start 2024-03-11T22:00:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8f701a89b0 con 0x7f8f700ffdc0 2024-03-11T22:00:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8f701a9b90 con 0x7f8f701106e0 2024-03-11T22:00:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8f701aad90 con 0x7f8f7010cbd0 2024-03-11T22:00:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8f700ffdc0 0x7f8f7010c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:52020/0 (socket says 172.21.15.49:52020) 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6ffff700 1 -- 172.21.15.49:0/3824365859 learned_addr learned my addr 172.21.15.49:0/3824365859 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6f7fe700 1 --1- 172.21.15.49:0/3824365859 >> v1:172.21.15.49:6790/0 conn(0x7f8f7010cbd0 0x7f8f701a3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:39044/0 (socket says 172.21.15.49:39044) 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062763087 0 0) 0x7f8f701a89b0 con 0x7f8f700ffdc0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f580031f0 con 0x7f8f700ffdc0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798560492 0 0) 0x7f8f701aad90 con 0x7f8f7010cbd0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f701a89b0 con 0x7f8f7010cbd0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2385718650 0 0) 0x7f8f580031f0 con 0x7f8f700ffdc0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8f701aad90 con 0x7f8f700ffdc0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8f64003780 con 0x7f8f700ffdc0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2519908539 0 0) 0x7f8f701a89b0 con 0x7f8f7010cbd0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8f580031f0 con 0x7f8f7010cbd0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180267390 0 0) 0x7f8f701a9b90 con 0x7f8f701106e0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f701a89b0 con 0x7f8f701106e0 2024-03-11T22:00:33.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8f60001830 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1855904534 0 0) 0x7f8f580031f0 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 >> v1:172.21.15.187:6789/0 conn(0x7f8f701106e0 legacy=0x7f8f701a7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 >> v1:172.21.15.49:6789/0 conn(0x7f8f700ffdc0 legacy=0x7f8f7010c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f701abf90 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.870+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f701aaf80 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.874+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f701ab480 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.874+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f8f60003b30 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.874+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8f60005ae0 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.874+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f8f60005c40 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.874+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c005150 con 0x7f8f7010cbd0 2024-03-11T22:00:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.874+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 4163023633 0 0) 0x7f8f60046cb0 con 0x7f8f7010cbd0 2024-03-11T22:00:33.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:33.878+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8f600065a0 con 0x7f8f7010cbd0 2024-03-11T22:00:34.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[21434]: cluster 2024-03-11T22:00:32.673641+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:34.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[21434]: audit 2024-03-11T22:00:32.902704+0000 mon.a (mon.0) 213 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[21434]: audit 2024-03-11T22:00:32.910381+0000 mon.a (mon.0) 214 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[21434]: audit 2024-03-11T22:00:32.940998+0000 mon.a (mon.0) 215 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[21434]: audit 2024-03-11T22:00:32.944466+0000 mon.a (mon.0) 216 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[21434]: audit 2024-03-11T22:00:32.946089+0000 mon.a (mon.0) 217 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[21434]: audit 2024-03-11T22:00:32.955020+0000 mon.a (mon.0) 218 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[28804]: cluster 2024-03-11T22:00:32.673641+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[28804]: audit 2024-03-11T22:00:32.902704+0000 mon.a (mon.0) 213 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[28804]: audit 2024-03-11T22:00:32.910381+0000 mon.a (mon.0) 214 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[28804]: audit 2024-03-11T22:00:32.940998+0000 mon.a (mon.0) 215 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[28804]: audit 2024-03-11T22:00:32.944466+0000 mon.a (mon.0) 216 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[28804]: audit 2024-03-11T22:00:32.946089+0000 mon.a (mon.0) 217 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:33 smithi049 bash[28804]: audit 2024-03-11T22:00:32.955020+0000 mon.a (mon.0) 218 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.086+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f8f5c005400 con 0x7f8f7010cbd0 2024-03-11T22:00:34.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.086+0000 7f8f6d7fa700 1 -- 172.21.15.49:0/3824365859 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+191 (unknown 2189217731 0 2993368592) 0x7f8f60016180 con 0x7f8f7010cbd0 2024-03-11T22:00:34.086 INFO:teuthology.orchestra.run.smithi049.stdout:# minimal ceph.conf for 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:00:34.086 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-03-11T22:00:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:00:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: mon_host = 172.21.15.49:6789/0 172.21.15.187:6789/0 v1:172.21.15.49:6790/0 2024-03-11T22:00:34.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.090+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 >> v1:172.21.15.49:6800/4076252288 conn(0x7f8f5803a080 legacy=0x7f8f5803c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:34.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.090+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 >> v1:172.21.15.49:6790/0 conn(0x7f8f7010cbd0 legacy=0x7f8f701a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:34.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.090+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 shutdown_connections 2024-03-11T22:00:34.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.090+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 >> 172.21.15.49:0/3824365859 conn(0x7f8f70076cf0 msgr2=0x7f8f701013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:34.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.090+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 shutdown_connections 2024-03-11T22:00:34.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:34.090+0000 7f8f765f2700 1 -- 172.21.15.49:0/3824365859 wait complete. 2024-03-11T22:00:34.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:33 smithi187 bash[23415]: cluster 2024-03-11T22:00:32.673641+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:34.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:33 smithi187 bash[23415]: audit 2024-03-11T22:00:32.902704+0000 mon.a (mon.0) 213 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:33 smithi187 bash[23415]: audit 2024-03-11T22:00:32.910381+0000 mon.a (mon.0) 214 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:33 smithi187 bash[23415]: audit 2024-03-11T22:00:32.940998+0000 mon.a (mon.0) 215 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:34.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:33 smithi187 bash[23415]: audit 2024-03-11T22:00:32.944466+0000 mon.a (mon.0) 216 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:34.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:33 smithi187 bash[23415]: audit 2024-03-11T22:00:32.946089+0000 mon.a (mon.0) 217 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:34.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:33 smithi187 bash[23415]: audit 2024-03-11T22:00:32.955020+0000 mon.a (mon.0) 218 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:34.659 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-11T22:00:34.659 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T22:00:34.659 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2024-03-11T22:00:34.673 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T22:00:34.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:00:34.727 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T22:00:34.727 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.conf 2024-03-11T22:00:34.741 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T22:00:34.741 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:00:34.794 INFO:tasks.cephadm:Adding mgr.y on smithi049 2024-03-11T22:00:34.794 INFO:tasks.cephadm:Adding mgr.x on smithi187 2024-03-11T22:00:34.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply mgr '2;smithi049=y;smithi187=x' 2024-03-11T22:00:34.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:34 smithi187 bash[23415]: audit 2024-03-11T22:00:34.092029+0000 mon.c (mon.2) 2 : audit 0 from='client.? v1:172.21.15.49:0/3824365859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:35.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:34 smithi049 bash[21434]: audit 2024-03-11T22:00:34.092029+0000 mon.c (mon.2) 2 : audit 0 from='client.? v1:172.21.15.49:0/3824365859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:35.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:34 smithi049 bash[28804]: audit 2024-03-11T22:00:34.092029+0000 mon.c (mon.2) 2 : audit 0 from='client.? v1:172.21.15.49:0/3824365859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:36.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:35 smithi187 bash[23415]: cluster 2024-03-11T22:00:34.674004+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:36.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:35 smithi049 bash[21434]: cluster 2024-03-11T22:00:34.674004+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:36.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:35 smithi049 bash[28804]: cluster 2024-03-11T22:00:34.674004+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:38.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:37 smithi187 bash[23415]: cluster 2024-03-11T22:00:36.674341+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:38.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:37 smithi049 bash[21434]: cluster 2024-03-11T22:00:36.674341+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:38.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:37 smithi049 bash[28804]: cluster 2024-03-11T22:00:36.674341+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:38.536 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:00:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:39 smithi187 bash[23415]: cluster 2024-03-11T22:00:38.674772+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:40.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:39 smithi049 bash[21434]: cluster 2024-03-11T22:00:38.674772+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:40.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:39 smithi049 bash[28804]: cluster 2024-03-11T22:00:38.674772+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:40.774 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.776+0000 7f76d5c79700 1 -- 172.21.15.187:0/2458734076 >> v1:172.21.15.187:6789/0 conn(0x7f76d0100320 legacy=0x7f76d0100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:40.774 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.776+0000 7f76d5c79700 1 -- 172.21.15.187:0/2458734076 shutdown_connections 2024-03-11T22:00:40.774 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.776+0000 7f76d5c79700 1 -- 172.21.15.187:0/2458734076 >> 172.21.15.187:0/2458734076 conn(0x7f76d00fbf60 msgr2=0x7f76d00fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:40.774 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.776+0000 7f76d5c79700 1 -- 172.21.15.187:0/2458734076 shutdown_connections 2024-03-11T22:00:40.775 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.776+0000 7f76d5c79700 1 -- 172.21.15.187:0/2458734076 wait complete. 2024-03-11T22:00:40.775 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 Processor -- start 2024-03-11T22:00:40.775 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 -- start start 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f76d0199b40 con 0x7f76d010c080 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f76d01a5330 con 0x7f76d0101e60 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f76d01a64d0 con 0x7f76d0100320 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ceffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f76d0101e60 0x7f76d019f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45370/0 (socket says 172.21.15.187:45370) 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ceffd700 1 -- 172.21.15.187:0/2439859354 learned_addr learned my addr 172.21.15.187:0/2439859354 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288182570 0 0) 0x7f76d01a5330 con 0x7f76d0101e60 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76bc0035b0 con 0x7f76d0101e60 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1589677239 0 0) 0x7f76bc0035b0 con 0x7f76d0101e60 2024-03-11T22:00:40.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f76d01a5330 con 0x7f76d0101e60 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f76b8001930 con 0x7f76d0101e60 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704183101 0 0) 0x7f76d0199b40 con 0x7f76d010c080 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76bc0035b0 con 0x7f76d010c080 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874687934 0 0) 0x7f76d01a64d0 con 0x7f76d0100320 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d0199b40 con 0x7f76d0100320 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1037138740 0 0) 0x7f76d01a5330 con 0x7f76d0101e60 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 >> v1:172.21.15.49:6790/0 conn(0x7f76d0100320 legacy=0x7f76d0198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 >> v1:172.21.15.49:6789/0 conn(0x7f76d010c080 legacy=0x7f76d01a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d01a7670 con 0x7f76d0101e60 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d01a4380 con 0x7f76d0101e60 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d01a4880 con 0x7f76d0101e60 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f76b8003bb0 con 0x7f76d0101e60 2024-03-11T22:00:40.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f76b8005d10 con 0x7f76d0101e60 2024-03-11T22:00:40.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 13) v1 ==== 45790+0+0 (unknown 2581831193 0 0) 0x7f76b8011160 con 0x7f76d0101e60 2024-03-11T22:00:40.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b0005150 con 0x7f76d0101e60 2024-03-11T22:00:40.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.780+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 4163023633 0 0) 0x7f76b8046e60 con 0x7f76d0101e60 2024-03-11T22:00:40.782 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:40.788+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f76b8012ad0 con 0x7f76d0101e60 2024-03-11T22:00:41.000 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.004+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi049=y;smithi187=x", "target": ["mon-mgr", ""]}) v1 -- 0x7f76b0000bc0 con 0x7f76bc03a040 2024-03-11T22:00:41.013 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.016+0000 7f76ccff9700 1 -- 172.21.15.187:0/2439859354 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 325935098) 0x7f76b0000bc0 con 0x7f76bc03a040 2024-03-11T22:00:41.013 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mgr update... 2024-03-11T22:00:41.016 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.020+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 >> v1:172.21.15.49:6800/4076252288 conn(0x7f76bc03a040 legacy=0x7f76bc03c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:41.016 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.020+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 >> v1:172.21.15.187:6789/0 conn(0x7f76d0101e60 legacy=0x7f76d019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:41.016 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.020+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 shutdown_connections 2024-03-11T22:00:41.016 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.020+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 >> 172.21.15.187:0/2439859354 conn(0x7f76d00fbf60 msgr2=0x7f76d00fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:41.016 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.020+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 shutdown_connections 2024-03-11T22:00:41.016 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:00:41.020+0000 7f76d5c79700 1 -- 172.21.15.187:0/2439859354 wait complete. 2024-03-11T22:00:41.537 DEBUG:teuthology.orchestra.run.smithi187:mgr.x> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.x.service 2024-03-11T22:00:41.538 INFO:tasks.cephadm:Deploying OSDs... 2024-03-11T22:00:41.539 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T22:00:41.539 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-03-11T22:00:41.545 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-11T22:00:41.545 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-03-11T22:00:41.591 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-11T22:00:41.591 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:41.592 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-03-11T22:00:41.592 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:41.592 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-11 21:51:03.757062737 +0000 2024-03-11T22:00:41.592 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-11 21:51:03.489065127 +0000 2024-03-11T22:00:41.592 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-11 21:51:03.489065127 +0000 2024-03-11T22:00:41.592 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-03-11T22:00:41.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-11T22:00:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-11T22:00:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-11T22:00:41.646 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000269778 s, 1.9 MB/s 2024-03-11T22:00:41.648 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-11T22:00:41.697 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-03-11T22:00:41.743 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-11T22:00:41.743 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:41.743 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-03-11T22:00:41.743 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:41.743 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-11 21:51:03.977060775 +0000 2024-03-11T22:00:41.743 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-11 21:51:03.973060811 +0000 2024-03-11T22:00:41.743 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-11 21:51:03.973060811 +0000 2024-03-11T22:00:41.744 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-03-11T22:00:41.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-11T22:00:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-11T22:00:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-11T22:00:41.798 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000348338 s, 1.5 MB/s 2024-03-11T22:00:41.799 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-11T22:00:41.849 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-11 21:51:04.745053926 +0000 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-11 21:51:04.449056565 +0000 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-11 21:51:04.449056565 +0000 2024-03-11T22:00:41.899 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-03-11T22:00:41.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-11T22:00:41.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-11T22:00:41.958 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-11T22:00:41.958 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.00028205 s, 1.8 MB/s 2024-03-11T22:00:41.959 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-11T22:00:42.008 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-11 21:51:05.261049323 +0000 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-11 21:51:04.977051857 +0000 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-11 21:51:04.977051857 +0000 2024-03-11T22:00:42.056 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-03-11T22:00:42.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-11T22:00:42.110 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-11T22:00:42.110 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-11T22:00:42.110 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000322714 s, 1.6 MB/s 2024-03-11T22:00:42.111 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-11T22:00:42.167 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T22:00:42.167 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-03-11T22:00:42.173 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-11T22:00:42.173 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-11 21:51:01.645201630 +0000 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-11 21:51:01.377204025 +0000 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-11 21:51:01.377204025 +0000 2024-03-11T22:00:42.219 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-03-11T22:00:42.220 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-11T22:00:42.271 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: cluster 2024-03-11T22:00:40.675215+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.008620+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24109 v1:172.21.15.187:0/2439859354' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi049=y;smithi187=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: cephadm 2024-03-11T22:00:41.012160+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi049=y;smithi187=x;count:2 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.018309+0000 mon.a (mon.0) 219 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.063197+0000 mon.a (mon.0) 220 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.067033+0000 mon.a (mon.0) 221 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.068932+0000 mon.a (mon.0) 222 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.077939+0000 mon.a (mon.0) 223 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.081228+0000 mon.a (mon.0) 224 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.083598+0000 mon.a (mon.0) 225 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.090245+0000 mon.a (mon.0) 226 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: audit 2024-03-11T22:00:41.092100+0000 mon.a (mon.0) 227 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:42.272 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:42 smithi187 bash[23415]: cephadm 2024-03-11T22:00:41.094164+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi187 2024-03-11T22:00:42.273 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-11T22:00:42.273 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-11T22:00:42.273 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000378576 s, 1.4 MB/s 2024-03-11T22:00:42.275 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-11T22:00:42.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: cluster 2024-03-11T22:00:40.675215+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:42.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.008620+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24109 v1:172.21.15.187:0/2439859354' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi049=y;smithi187=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:42.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: cephadm 2024-03-11T22:00:41.012160+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi049=y;smithi187=x;count:2 2024-03-11T22:00:42.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.018309+0000 mon.a (mon.0) 219 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.063197+0000 mon.a (mon.0) 220 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.067033+0000 mon.a (mon.0) 221 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.068932+0000 mon.a (mon.0) 222 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.077939+0000 mon.a (mon.0) 223 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.081228+0000 mon.a (mon.0) 224 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.083598+0000 mon.a (mon.0) 225 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.090245+0000 mon.a (mon.0) 226 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: audit 2024-03-11T22:00:41.092100+0000 mon.a (mon.0) 227 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[21434]: cephadm 2024-03-11T22:00:41.094164+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi187 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: cluster 2024-03-11T22:00:40.675215+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:42.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.008620+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24109 v1:172.21.15.187:0/2439859354' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi049=y;smithi187=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: cephadm 2024-03-11T22:00:41.012160+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi049=y;smithi187=x;count:2 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.018309+0000 mon.a (mon.0) 219 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.063197+0000 mon.a (mon.0) 220 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.067033+0000 mon.a (mon.0) 221 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.068932+0000 mon.a (mon.0) 222 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.077939+0000 mon.a (mon.0) 223 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.081228+0000 mon.a (mon.0) 224 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.083598+0000 mon.a (mon.0) 225 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.090245+0000 mon.a (mon.0) 226 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: audit 2024-03-11T22:00:41.092100+0000 mon.a (mon.0) 227 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:42.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:42 smithi049 bash[28804]: cephadm 2024-03-11T22:00:41.094164+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi187 2024-03-11T22:00:42.324 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-11 21:51:02.153197093 +0000 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-11 21:51:01.865199665 +0000 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-11 21:51:01.865199665 +0000 2024-03-11T22:00:42.371 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-03-11T22:00:42.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-11T22:00:42.426 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-11T22:00:42.426 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-11T22:00:42.426 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000344837 s, 1.5 MB/s 2024-03-11T22:00:42.427 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-11T22:00:42.475 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-11 21:51:02.641192735 +0000 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-11 21:51:02.385195021 +0000 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-11 21:51:02.385195021 +0000 2024-03-11T22:00:42.522 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-03-11T22:00:42.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-11T22:00:42.574 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-11T22:00:42.575 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-11T22:00:42.575 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000386334 s, 1.3 MB/s 2024-03-11T22:00:42.575 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-11T22:00:42.623 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-03-11 21:51:03.113188518 +0000 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-03-11 21:51:02.861190770 +0000 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-03-11 21:51:02.861190770 +0000 2024-03-11T22:00:42.670 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-03-11T22:00:42.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-11T22:00:42.723 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-03-11T22:00:42.723 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-03-11T22:00:42.723 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000372739 s, 1.4 MB/s 2024-03-11T22:00:42.724 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-11T22:00:42.776 INFO:tasks.cephadm:Deploying osd.0 on smithi049 with /dev/vg_nvme/lv_4... 2024-03-11T22:00:42.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-11T22:00:43.633 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:43.633 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:43.633 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:43.633 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:43.990 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:43.990 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:43 smithi187 systemd[1]: Started Ceph mgr.x for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:00:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:00:44.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[21434]: cluster 2024-03-11T22:00:42.675641+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:44.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[21434]: audit 2024-03-11T22:00:43.794771+0000 mon.a (mon.0) 228 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[21434]: audit 2024-03-11T22:00:43.803580+0000 mon.a (mon.0) 229 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[21434]: audit 2024-03-11T22:00:43.820918+0000 mon.a (mon.0) 230 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[21434]: audit 2024-03-11T22:00:43.829125+0000 mon.a (mon.0) 231 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[21434]: audit 2024-03-11T22:00:43.897962+0000 mon.a (mon.0) 232 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:44.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[28804]: cluster 2024-03-11T22:00:42.675641+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:44.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[28804]: audit 2024-03-11T22:00:43.794771+0000 mon.a (mon.0) 228 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[28804]: audit 2024-03-11T22:00:43.803580+0000 mon.a (mon.0) 229 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[28804]: audit 2024-03-11T22:00:43.820918+0000 mon.a (mon.0) 230 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[28804]: audit 2024-03-11T22:00:43.829125+0000 mon.a (mon.0) 231 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:44 smithi049 bash[28804]: audit 2024-03-11T22:00:43.897962+0000 mon.a (mon.0) 232 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:44.481 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[23415]: cluster 2024-03-11T22:00:42.675641+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:44.482 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[23415]: audit 2024-03-11T22:00:43.794771+0000 mon.a (mon.0) 228 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.482 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[23415]: audit 2024-03-11T22:00:43.803580+0000 mon.a (mon.0) 229 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.482 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[23415]: audit 2024-03-11T22:00:43.820918+0000 mon.a (mon.0) 230 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.482 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[23415]: audit 2024-03-11T22:00:43.829125+0000 mon.a (mon.0) 231 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:44.482 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[23415]: audit 2024-03-11T22:00:43.897962+0000 mon.a (mon.0) 232 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:44.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[24316]: debug 2024-03-11T22:00:44.580+0000 7f1a91b07700 1 -- 172.21.15.187:0/52048028 <== mon.1 v1:172.21.15.187:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 2817254352 0 0) 0x5623d9ca84e0 con 0x5623daa2a800 2024-03-11T22:00:44.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:44 smithi187 bash[24316]: debug 2024-03-11T22:00:44.724+0000 7f1a9bd01200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-11T22:00:46.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:46 smithi049 bash[21434]: cluster 2024-03-11T22:00:44.676045+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:46.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:46 smithi049 bash[21434]: audit 2024-03-11T22:00:45.847638+0000 mon.a (mon.0) 233 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:46.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:46 smithi049 bash[28804]: cluster 2024-03-11T22:00:44.676045+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:46.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:46 smithi049 bash[28804]: audit 2024-03-11T22:00:45.847638+0000 mon.a (mon.0) 233 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:46.296 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:46 smithi187 bash[23415]: cluster 2024-03-11T22:00:44.676045+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:46.296 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:46 smithi187 bash[23415]: audit 2024-03-11T22:00:45.847638+0000 mon.a (mon.0) 233 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:46.641 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:46 smithi187 bash[24316]: debug 2024-03-11T22:00:46.300+0000 7f1a9bd01200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-11T22:00:46.642 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:46 smithi187 bash[24316]: debug 2024-03-11T22:00:46.396+0000 7f1a9bd01200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-11T22:00:46.642 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:46 smithi187 bash[24316]: debug 2024-03-11T22:00:46.644+0000 7f1a9bd01200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-11T22:00:47.503 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:00:47.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:47 smithi187 bash[24316]: debug 2024-03-11T22:00:47.436+0000 7f1a9bd01200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-11T22:00:47.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:47 smithi187 bash[24316]: debug 2024-03-11T22:00:47.548+0000 7f1a9bd01200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-11T22:00:47.741 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:47 smithi187 bash[24316]: debug 2024-03-11T22:00:47.648+0000 7f1a9bd01200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-11T22:00:48.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:48 smithi049 bash[28804]: cluster 2024-03-11T22:00:46.676437+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:48.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:48 smithi049 bash[21434]: cluster 2024-03-11T22:00:46.676437+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:48 smithi187 bash[23415]: cluster 2024-03-11T22:00:46.676437+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:48.490 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:48 smithi187 bash[24316]: debug 2024-03-11T22:00:48.000+0000 7f1a9bd01200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-11T22:00:48.490 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:48 smithi187 bash[24316]: debug 2024-03-11T22:00:48.112+0000 7f1a9bd01200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-11T22:00:48.490 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:48 smithi187 bash[24316]: debug 2024-03-11T22:00:48.216+0000 7f1a9bd01200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-11T22:00:48.990 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:48 smithi187 bash[24316]: debug 2024-03-11T22:00:48.564+0000 7f1a9bd01200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-11T22:00:48.990 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:48 smithi187 bash[24316]: debug 2024-03-11T22:00:48.804+0000 7f1a9bd01200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-11T22:00:49.467 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:49 smithi187 bash[24316]: debug 2024-03-11T22:00:49.088+0000 7f1a9bd01200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-11T22:00:49.467 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:49 smithi187 bash[24316]: debug 2024-03-11T22:00:49.200+0000 7f1a9bd01200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-11T22:00:49.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:49 smithi187 bash[24316]: debug 2024-03-11T22:00:49.472+0000 7f1a9bd01200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-11T22:00:49.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:49 smithi187 bash[24316]: debug 2024-03-11T22:00:49.708+0000 7f1a9bd01200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-11T22:00:50.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: cluster 2024-03-11T22:00:48.676827+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.084494+0000 mon.a (mon.0) 234 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.088861+0000 mon.a (mon.0) 235 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.090081+0000 mon.a (mon.0) 236 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.091317+0000 mon.a (mon.0) 237 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.098597+0000 mon.a (mon.0) 238 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: cephadm 2024-03-11T22:00:49.167553+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.168001+0000 mon.a (mon.0) 239 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.169148+0000 mon.a (mon.0) 240 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: audit 2024-03-11T22:00:49.170305+0000 mon.a (mon.0) 241 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[28804]: cephadm 2024-03-11T22:00:49.171874+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi049 2024-03-11T22:00:50.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: cluster 2024-03-11T22:00:48.676827+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.084494+0000 mon.a (mon.0) 234 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.088861+0000 mon.a (mon.0) 235 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.090081+0000 mon.a (mon.0) 236 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.091317+0000 mon.a (mon.0) 237 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.098597+0000 mon.a (mon.0) 238 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: cephadm 2024-03-11T22:00:49.167553+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.168001+0000 mon.a (mon.0) 239 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.169148+0000 mon.a (mon.0) 240 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: audit 2024-03-11T22:00:49.170305+0000 mon.a (mon.0) 241 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:50 smithi049 bash[21434]: cephadm 2024-03-11T22:00:49.171874+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi049 2024-03-11T22:00:50.475 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[24316]: debug 2024-03-11T22:00:50.120+0000 7f1a9bd01200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-11T22:00:50.475 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[24316]: debug 2024-03-11T22:00:50.236+0000 7f1a9bd01200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-11T22:00:50.475 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: cluster 2024-03-11T22:00:48.676827+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.084494+0000 mon.a (mon.0) 234 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.088861+0000 mon.a (mon.0) 235 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.090081+0000 mon.a (mon.0) 236 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.091317+0000 mon.a (mon.0) 237 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.098597+0000 mon.a (mon.0) 238 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: cephadm 2024-03-11T22:00:49.167553+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.168001+0000 mon.a (mon.0) 239 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.169148+0000 mon.a (mon.0) 240 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: audit 2024-03-11T22:00:49.170305+0000 mon.a (mon.0) 241 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:50.476 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[23415]: cephadm 2024-03-11T22:00:49.171874+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi049 2024-03-11T22:00:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-11T22:00:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-11T22:00:50.608 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-03-11T22:00:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-03-11T22:00:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.008979 s, 1.2 GB/s 2024-03-11T22:00:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-03-11T22:00:50.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:50 smithi187 bash[24316]: debug 2024-03-11T22:00:50.480+0000 7f1a9bd01200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-11T22:00:51.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2024-03-11T22:00:51.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:51 smithi187 bash[24316]: debug 2024-03-11T22:00:51.480+0000 7f1a9bd01200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-11T22:00:51.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:51 smithi187 bash[24316]: debug 2024-03-11T22:00:51.600+0000 7f1a9bd01200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-11T22:00:52.240 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:51 smithi187 bash[24316]: debug 2024-03-11T22:00:51.896+0000 7f1a9bd01200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-11T22:00:52.240 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:52 smithi187 bash[24316]: debug 2024-03-11T22:00:52.012+0000 7f1a9bd01200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-11T22:00:52.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:52 smithi187 bash[23415]: cluster 2024-03-11T22:00:50.677122+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:52.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:52 smithi187 bash[23415]: audit 2024-03-11T22:00:51.461175+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:52.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:52 smithi187 bash[23415]: audit 2024-03-11T22:00:51.466551+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:52.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:52 smithi187 bash[23415]: audit 2024-03-11T22:00:51.492842+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:52.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[21434]: cluster 2024-03-11T22:00:50.677122+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:52.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[21434]: audit 2024-03-11T22:00:51.461175+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:52.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[21434]: audit 2024-03-11T22:00:51.466551+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:52.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[21434]: audit 2024-03-11T22:00:51.492842+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:52.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[28804]: cluster 2024-03-11T22:00:50.677122+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:52.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[28804]: audit 2024-03-11T22:00:51.461175+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:52.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[28804]: audit 2024-03-11T22:00:51.466551+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:52.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:52 smithi049 bash[28804]: audit 2024-03-11T22:00:51.492842+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:00:52.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:52 smithi187 bash[24316]: debug 2024-03-11T22:00:52.456+0000 7f1a9bd01200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-11T22:00:52.740 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:00:52 smithi187 bash[24316]: debug 2024-03-11T22:00:52.576+0000 7f1a9bd01200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-11T22:00:53.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: audit 2024-03-11T22:00:52.176592+0000 mon.a (mon.0) 245 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:53.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: audit 2024-03-11T22:00:52.178450+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:53.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: audit 2024-03-11T22:00:52.188013+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:53.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: cluster 2024-03-11T22:00:52.599721+0000 mon.a (mon.0) 248 : cluster 0 Standby manager daemon x started 2024-03-11T22:00:53.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: audit 2024-03-11T22:00:52.602351+0000 mon.b (mon.1) 3 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-11T22:00:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: audit 2024-03-11T22:00:52.603368+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-11T22:00:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: audit 2024-03-11T22:00:52.604682+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-11T22:00:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:53 smithi187 bash[23415]: audit 2024-03-11T22:00:52.605209+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: audit 2024-03-11T22:00:52.176592+0000 mon.a (mon.0) 245 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: audit 2024-03-11T22:00:52.178450+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: audit 2024-03-11T22:00:52.188013+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: cluster 2024-03-11T22:00:52.599721+0000 mon.a (mon.0) 248 : cluster 0 Standby manager daemon x started 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: audit 2024-03-11T22:00:52.602351+0000 mon.b (mon.1) 3 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: audit 2024-03-11T22:00:52.603368+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: audit 2024-03-11T22:00:52.604682+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[21434]: audit 2024-03-11T22:00:52.605209+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-11T22:00:53.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: audit 2024-03-11T22:00:52.176592+0000 mon.a (mon.0) 245 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:53.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: audit 2024-03-11T22:00:52.178450+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:00:53.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: audit 2024-03-11T22:00:52.188013+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:00:53.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: cluster 2024-03-11T22:00:52.599721+0000 mon.a (mon.0) 248 : cluster 0 Standby manager daemon x started 2024-03-11T22:00:53.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: audit 2024-03-11T22:00:52.602351+0000 mon.b (mon.1) 3 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-11T22:00:53.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: audit 2024-03-11T22:00:52.603368+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-11T22:00:53.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: audit 2024-03-11T22:00:52.604682+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-11T22:00:53.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:53 smithi049 bash[28804]: audit 2024-03-11T22:00:52.605209+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.187:0/3077181255' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-11T22:00:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:54 smithi187 bash[23415]: cluster 2024-03-11T22:00:52.677500+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:54 smithi187 bash[23415]: cluster 2024-03-11T22:00:53.203558+0000 mon.a (mon.0) 249 : cluster 0 mgrmap e14: y(active, since 106s), standbys: x 2024-03-11T22:00:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:54 smithi187 bash[23415]: audit 2024-03-11T22:00:53.203813+0000 mon.a (mon.0) 250 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-11T22:00:54.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:54 smithi049 bash[28804]: cluster 2024-03-11T22:00:52.677500+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:54.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:54 smithi049 bash[28804]: cluster 2024-03-11T22:00:53.203558+0000 mon.a (mon.0) 249 : cluster 0 mgrmap e14: y(active, since 106s), standbys: x 2024-03-11T22:00:54.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:54 smithi049 bash[28804]: audit 2024-03-11T22:00:53.203813+0000 mon.a (mon.0) 250 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-11T22:00:54.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:54 smithi049 bash[21434]: cluster 2024-03-11T22:00:52.677500+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:54.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:54 smithi049 bash[21434]: cluster 2024-03-11T22:00:53.203558+0000 mon.a (mon.0) 249 : cluster 0 mgrmap e14: y(active, since 106s), standbys: x 2024-03-11T22:00:54.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:54 smithi049 bash[21434]: audit 2024-03-11T22:00:53.203813+0000 mon.a (mon.0) 250 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-11T22:00:56.225 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:00:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:56 smithi187 bash[23415]: cluster 2024-03-11T22:00:54.677979+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:56.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:56 smithi049 bash[21434]: cluster 2024-03-11T22:00:54.677979+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:56.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:56 smithi049 bash[28804]: cluster 2024-03-11T22:00:54.677979+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:58.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:58 smithi049 bash[21434]: cluster 2024-03-11T22:00:56.678399+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:58.452 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:58 smithi049 bash[28804]: cluster 2024-03-11T22:00:56.678399+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:58.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:58 smithi187 bash[23415]: cluster 2024-03-11T22:00:56.678399+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:00:58.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- 172.21.15.49:0/3932421857 >> v1:172.21.15.49:6789/0 conn(0x7ffacc101a60 legacy=0x7ffacc101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:58.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- 172.21.15.49:0/3932421857 shutdown_connections 2024-03-11T22:00:58.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- 172.21.15.49:0/3932421857 >> 172.21.15.49:0/3932421857 conn(0x7ffacc0fd020 msgr2=0x7ffacc0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:00:58.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- 172.21.15.49:0/3932421857 shutdown_connections 2024-03-11T22:00:58.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- 172.21.15.49:0/3932421857 wait complete. 2024-03-11T22:00:58.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 Processor -- start 2024-03-11T22:00:58.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- start start 2024-03-11T22:00:58.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffacc1977d0 con 0x7ffacc105e90 2024-03-11T22:00:58.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffacc1a2fc0 con 0x7ffacc101a60 2024-03-11T22:00:58.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad1985700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffacc1a4160 con 0x7ffacc109bd0 2024-03-11T22:00:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffaca7fc700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffacc105e90 0x7ffacc19d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36476/0 (socket says 172.21.15.49:36476) 2024-03-11T22:00:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffaca7fc700 1 -- 172.21.15.49:0/1999728289 learned_addr learned my addr 172.21.15.49:0/1999728289 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:00:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffacb7fe700 1 --1- 172.21.15.49:0/1999728289 >> v1:172.21.15.49:6790/0 conn(0x7ffacc109bd0 0x7ffacc1a0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:42512/0 (socket says 172.21.15.49:42512) 2024-03-11T22:00:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071480084 0 0) 0x7ffacc1a4160 con 0x7ffacc109bd0 2024-03-11T22:00:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab80049e0 con 0x7ffacc109bd0 2024-03-11T22:00:58.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804781023 0 0) 0x7ffacc1977d0 con 0x7ffacc105e90 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffacc1a4160 con 0x7ffacc105e90 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3546256423 0 0) 0x7ffab80049e0 con 0x7ffacc109bd0 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffacc1977d0 con 0x7ffacc109bd0 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ffac40018b0 con 0x7ffacc109bd0 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1962847689 0 0) 0x7ffacc1a4160 con 0x7ffacc105e90 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffab80049e0 con 0x7ffacc105e90 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ffab4001800 con 0x7ffacc105e90 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982815245 0 0) 0x7ffacc1a2fc0 con 0x7ffacc101a60 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffacc1a4160 con 0x7ffacc101a60 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1779338048 0 0) 0x7ffacc1977d0 con 0x7ffacc109bd0 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 >> v1:172.21.15.187:6789/0 conn(0x7ffacc101a60 legacy=0x7ffacc196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 >> v1:172.21.15.49:6789/0 conn(0x7ffacc105e90 legacy=0x7ffacc19d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.617+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc1a5300 con 0x7ffacc109bd0 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.621+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc1a2010 con 0x7ffacc109bd0 2024-03-11T22:00:58.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.621+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc1a2510 con 0x7ffacc109bd0 2024-03-11T22:00:58.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.621+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7ffac4003b70 con 0x7ffacc109bd0 2024-03-11T22:00:58.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.621+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ffac4005ca0 con 0x7ffacc109bd0 2024-03-11T22:00:58.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.621+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac005150 con 0x7ffacc109bd0 2024-03-11T22:00:58.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.621+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 14) v1 ==== 90989+0+0 (unknown 1005286256 0 0) 0x7ffac40036e0 con 0x7ffacc109bd0 2024-03-11T22:00:58.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.621+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 4163023633 0 0) 0x7ffac4086b90 con 0x7ffacc109bd0 2024-03-11T22:00:58.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.625+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ffac4051b20 con 0x7ffacc109bd0 2024-03-11T22:00:58.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:00:58.849+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaac000bc0 con 0x7ffab806e490 2024-03-11T22:00:59.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:59 smithi187 bash[23415]: audit 2024-03-11T22:00:58.863693+0000 mon.a (mon.0) 251 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:00:59.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:59 smithi187 bash[23415]: audit 2024-03-11T22:00:58.866902+0000 mon.a (mon.0) 252 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:00:59.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:00:59 smithi187 bash[23415]: audit 2024-03-11T22:00:58.867750+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:59.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:59 smithi049 bash[21434]: audit 2024-03-11T22:00:58.863693+0000 mon.a (mon.0) 251 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:00:59.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:59 smithi049 bash[21434]: audit 2024-03-11T22:00:58.866902+0000 mon.a (mon.0) 252 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:00:59.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:00:59 smithi049 bash[21434]: audit 2024-03-11T22:00:58.867750+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:00:59.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:59 smithi049 bash[28804]: audit 2024-03-11T22:00:58.863693+0000 mon.a (mon.0) 251 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:00:59.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:59 smithi049 bash[28804]: audit 2024-03-11T22:00:58.866902+0000 mon.a (mon.0) 252 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:00:59.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:00:59 smithi049 bash[28804]: audit 2024-03-11T22:00:58.867750+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:00.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:00 smithi187 bash[23415]: cluster 2024-03-11T22:00:58.678676+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:00.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:00 smithi187 bash[23415]: audit 2024-03-11T22:00:58.856536+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.24116 v1:172.21.15.49:0/1999728289' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:01:00.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:00 smithi049 bash[21434]: cluster 2024-03-11T22:00:58.678676+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:00.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:00 smithi049 bash[21434]: audit 2024-03-11T22:00:58.856536+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.24116 v1:172.21.15.49:0/1999728289' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:01:00.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:00 smithi049 bash[28804]: cluster 2024-03-11T22:00:58.678676+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:00.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:00 smithi049 bash[28804]: audit 2024-03-11T22:00:58.856536+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.24116 v1:172.21.15.49:0/1999728289' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:01:02.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:02 smithi187 bash[23415]: cluster 2024-03-11T22:01:00.679072+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:02.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:02 smithi049 bash[21434]: cluster 2024-03-11T22:01:00.679072+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:02.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:02 smithi049 bash[28804]: cluster 2024-03-11T22:01:00.679072+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:04.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:04 smithi187 bash[23415]: cluster 2024-03-11T22:01:02.679499+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:04.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:04 smithi049 bash[21434]: cluster 2024-03-11T22:01:02.679499+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:04.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:04 smithi049 bash[28804]: cluster 2024-03-11T22:01:02.679499+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:06.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:06 smithi049 bash[21434]: cluster 2024-03-11T22:01:04.679826+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:06.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:06 smithi049 bash[28804]: cluster 2024-03-11T22:01:04.679826+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:06.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:06 smithi187 bash[23415]: cluster 2024-03-11T22:01:04.679826+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:07 smithi187 bash[23415]: audit 2024-03-11T22:01:06.929437+0000 mon.a (mon.0) 254 : audit 1 from='client.? v1:172.21.15.49:0/2488203333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5539a6f5-8ee5-43a7-b42c-83eaad23ebda"}]: dispatch 2024-03-11T22:01:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:07 smithi187 bash[23415]: audit 2024-03-11T22:01:06.932178+0000 mon.a (mon.0) 255 : audit 1 from='client.? v1:172.21.15.49:0/2488203333' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5539a6f5-8ee5-43a7-b42c-83eaad23ebda"}]': finished 2024-03-11T22:01:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:07 smithi187 bash[23415]: cluster 2024-03-11T22:01:06.935358+0000 mon.a (mon.0) 256 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-03-11T22:01:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:07 smithi187 bash[23415]: audit 2024-03-11T22:01:06.935632+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:07.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[28804]: audit 2024-03-11T22:01:06.929437+0000 mon.a (mon.0) 254 : audit 1 from='client.? v1:172.21.15.49:0/2488203333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5539a6f5-8ee5-43a7-b42c-83eaad23ebda"}]: dispatch 2024-03-11T22:01:07.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[28804]: audit 2024-03-11T22:01:06.932178+0000 mon.a (mon.0) 255 : audit 1 from='client.? v1:172.21.15.49:0/2488203333' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5539a6f5-8ee5-43a7-b42c-83eaad23ebda"}]': finished 2024-03-11T22:01:07.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[28804]: cluster 2024-03-11T22:01:06.935358+0000 mon.a (mon.0) 256 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-03-11T22:01:07.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[28804]: audit 2024-03-11T22:01:06.935632+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:07.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[21434]: audit 2024-03-11T22:01:06.929437+0000 mon.a (mon.0) 254 : audit 1 from='client.? v1:172.21.15.49:0/2488203333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5539a6f5-8ee5-43a7-b42c-83eaad23ebda"}]: dispatch 2024-03-11T22:01:07.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[21434]: audit 2024-03-11T22:01:06.932178+0000 mon.a (mon.0) 255 : audit 1 from='client.? v1:172.21.15.49:0/2488203333' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5539a6f5-8ee5-43a7-b42c-83eaad23ebda"}]': finished 2024-03-11T22:01:07.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[21434]: cluster 2024-03-11T22:01:06.935358+0000 mon.a (mon.0) 256 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-03-11T22:01:07.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:07 smithi049 bash[21434]: audit 2024-03-11T22:01:06.935632+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:08 smithi187 bash[23415]: cluster 2024-03-11T22:01:06.680062+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:08 smithi187 bash[23415]: audit 2024-03-11T22:01:07.629378+0000 mon.c (mon.2) 3 : audit 0 from='client.? v1:172.21.15.49:0/539561353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:01:08.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:08 smithi049 bash[21434]: cluster 2024-03-11T22:01:06.680062+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:08.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:08 smithi049 bash[21434]: audit 2024-03-11T22:01:07.629378+0000 mon.c (mon.2) 3 : audit 0 from='client.? v1:172.21.15.49:0/539561353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:01:08.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:08 smithi049 bash[28804]: cluster 2024-03-11T22:01:06.680062+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:08.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:08 smithi049 bash[28804]: audit 2024-03-11T22:01:07.629378+0000 mon.c (mon.2) 3 : audit 0 from='client.? v1:172.21.15.49:0/539561353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:01:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:10 smithi187 bash[23415]: cluster 2024-03-11T22:01:08.680508+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:10.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:10 smithi049 bash[21434]: cluster 2024-03-11T22:01:08.680508+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:10.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:10 smithi049 bash[28804]: cluster 2024-03-11T22:01:08.680508+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:12 smithi187 bash[23415]: cluster 2024-03-11T22:01:10.680967+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:12.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:12 smithi049 bash[21434]: cluster 2024-03-11T22:01:10.680967+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:12.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:12 smithi049 bash[28804]: cluster 2024-03-11T22:01:10.680967+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:14 smithi187 bash[23415]: cluster 2024-03-11T22:01:12.681401+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:14.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:14 smithi049 bash[21434]: cluster 2024-03-11T22:01:12.681401+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:14.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:14 smithi049 bash[28804]: cluster 2024-03-11T22:01:12.681401+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:16.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:16 smithi049 bash[28804]: cluster 2024-03-11T22:01:14.681814+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:16.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:16 smithi049 bash[21434]: cluster 2024-03-11T22:01:14.681814+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:16.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:16 smithi187 bash[23415]: cluster 2024-03-11T22:01:14.681814+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:18.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:18 smithi049 bash[28804]: cluster 2024-03-11T22:01:16.682197+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:18.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:18 smithi049 bash[21434]: cluster 2024-03-11T22:01:16.682197+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:18.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:18 smithi187 bash[23415]: cluster 2024-03-11T22:01:16.682197+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:19.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:19 smithi049 bash[21434]: audit 2024-03-11T22:01:18.973529+0000 mon.a (mon.0) 258 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-11T22:01:19.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:19 smithi049 bash[21434]: audit 2024-03-11T22:01:18.975229+0000 mon.a (mon.0) 259 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:19.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:19 smithi049 bash[28804]: audit 2024-03-11T22:01:18.973529+0000 mon.a (mon.0) 258 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-11T22:01:19.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:19 smithi049 bash[28804]: audit 2024-03-11T22:01:18.975229+0000 mon.a (mon.0) 259 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:19.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:19 smithi187 bash[23415]: audit 2024-03-11T22:01:18.973529+0000 mon.a (mon.0) 258 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-11T22:01:19.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:19 smithi187 bash[23415]: audit 2024-03-11T22:01:18.975229+0000 mon.a (mon.0) 259 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:20.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:20 smithi049 bash[21434]: cluster 2024-03-11T22:01:18.682591+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:20.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:20 smithi049 bash[21434]: cephadm 2024-03-11T22:01:18.976806+0000 mgr.y (mgr.14152) 99 : cephadm 1 Deploying daemon osd.0 on smithi049 2024-03-11T22:01:20.450 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:20 smithi049 bash[28804]: cluster 2024-03-11T22:01:18.682591+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:20.450 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:20 smithi049 bash[28804]: cephadm 2024-03-11T22:01:18.976806+0000 mgr.y (mgr.14152) 99 : cephadm 1 Deploying daemon osd.0 on smithi049 2024-03-11T22:01:20.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:20 smithi187 bash[23415]: cluster 2024-03-11T22:01:18.682591+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:20.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:20 smithi187 bash[23415]: cephadm 2024-03-11T22:01:18.976806+0000 mgr.y (mgr.14152) 99 : cephadm 1 Deploying daemon osd.0 on smithi049 2024-03-11T22:01:22.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:22 smithi049 bash[21434]: cluster 2024-03-11T22:01:20.683081+0000 mgr.y (mgr.14152) 100 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:22.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:22 smithi049 bash[28804]: cluster 2024-03-11T22:01:20.683081+0000 mgr.y (mgr.14152) 100 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:22 smithi187 bash[23415]: cluster 2024-03-11T22:01:20.683081+0000 mgr.y (mgr.14152) 100 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:22.896 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:01:22 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:01:22.897 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:01:22 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:01:22.897 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:22 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:01:22.897 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:22 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:01:22.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:22 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:01:22.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:22 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:01:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:23 smithi187 bash[23415]: cluster 2024-03-11T22:01:22.683475+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:23 smithi187 bash[23415]: audit 2024-03-11T22:01:22.946071+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:23 smithi187 bash[23415]: audit 2024-03-11T22:01:22.947565+0000 mon.a (mon.0) 261 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:01:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:23 smithi187 bash[23415]: audit 2024-03-11T22:01:22.951866+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:24.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[28804]: cluster 2024-03-11T22:01:22.683475+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[28804]: audit 2024-03-11T22:01:22.946071+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[28804]: audit 2024-03-11T22:01:22.947565+0000 mon.a (mon.0) 261 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:01:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[28804]: audit 2024-03-11T22:01:22.951866+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:24.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[21434]: cluster 2024-03-11T22:01:22.683475+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:24.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[21434]: audit 2024-03-11T22:01:22.946071+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:24.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[21434]: audit 2024-03-11T22:01:22.947565+0000 mon.a (mon.0) 261 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:01:24.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:23 smithi049 bash[21434]: audit 2024-03-11T22:01:22.951866+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:26.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:25 smithi187 bash[23415]: cluster 2024-03-11T22:01:24.683932+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:26.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:25 smithi049 bash[21434]: cluster 2024-03-11T22:01:24.683932+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:25 smithi049 bash[28804]: cluster 2024-03-11T22:01:24.683932+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:28.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:27 smithi187 bash[23415]: cluster 2024-03-11T22:01:26.684473+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:28.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:27 smithi049 bash[28804]: cluster 2024-03-11T22:01:26.684473+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:28.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:27 smithi049 bash[21434]: cluster 2024-03-11T22:01:26.684473+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[21434]: audit 2024-03-11T22:01:28.230614+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[21434]: audit 2024-03-11T22:01:28.236098+0000 mon.a (mon.0) 264 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[21434]: audit 2024-03-11T22:01:28.805487+0000 mon.a (mon.0) 265 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[21434]: audit 2024-03-11T22:01:28.806257+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[21434]: audit 2024-03-11T22:01:28.811029+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[28804]: audit 2024-03-11T22:01:28.230614+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[28804]: audit 2024-03-11T22:01:28.236098+0000 mon.a (mon.0) 264 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[28804]: audit 2024-03-11T22:01:28.805487+0000 mon.a (mon.0) 265 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:29.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[28804]: audit 2024-03-11T22:01:28.806257+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:01:29.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:29 smithi049 bash[28804]: audit 2024-03-11T22:01:28.811029+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:29 smithi187 bash[23415]: audit 2024-03-11T22:01:28.230614+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:29 smithi187 bash[23415]: audit 2024-03-11T22:01:28.236098+0000 mon.a (mon.0) 264 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:29 smithi187 bash[23415]: audit 2024-03-11T22:01:28.805487+0000 mon.a (mon.0) 265 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:29 smithi187 bash[23415]: audit 2024-03-11T22:01:28.806257+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:01:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:29 smithi187 bash[23415]: audit 2024-03-11T22:01:28.811029+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:30.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:30 smithi049 bash[28804]: cluster 2024-03-11T22:01:28.684805+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:30.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:30 smithi049 bash[28804]: audit 2024-03-11T22:01:29.587815+0000 mon.a (mon.0) 268 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-11T22:01:30.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:30 smithi049 bash[21434]: cluster 2024-03-11T22:01:28.684805+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:30.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:30 smithi049 bash[21434]: audit 2024-03-11T22:01:29.587815+0000 mon.a (mon.0) 268 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-11T22:01:30.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:30 smithi187 bash[23415]: cluster 2024-03-11T22:01:28.684805+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:30.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:30 smithi187 bash[23415]: audit 2024-03-11T22:01:29.587815+0000 mon.a (mon.0) 268 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-11T22:01:31.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[21434]: audit 2024-03-11T22:01:30.238604+0000 mon.a (mon.0) 269 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-11T22:01:31.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[21434]: cluster 2024-03-11T22:01:30.243675+0000 mon.a (mon.0) 270 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-03-11T22:01:31.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[21434]: audit 2024-03-11T22:01:30.244531+0000 mon.a (mon.0) 271 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:01:31.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[21434]: audit 2024-03-11T22:01:30.245033+0000 mon.a (mon.0) 272 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:31.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[21434]: audit 2024-03-11T22:01:31.240554+0000 mon.a (mon.0) 273 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:01:31.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[28804]: audit 2024-03-11T22:01:30.238604+0000 mon.a (mon.0) 269 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-11T22:01:31.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[28804]: cluster 2024-03-11T22:01:30.243675+0000 mon.a (mon.0) 270 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-03-11T22:01:31.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[28804]: audit 2024-03-11T22:01:30.244531+0000 mon.a (mon.0) 271 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:01:31.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[28804]: audit 2024-03-11T22:01:30.245033+0000 mon.a (mon.0) 272 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:31.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:31 smithi049 bash[28804]: audit 2024-03-11T22:01:31.240554+0000 mon.a (mon.0) 273 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:01:31.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:31.560+0000 7ffad0983700 1 -- 172.21.15.49:0/1999728289 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 4205017657) 0x7ffaac000bc0 con 0x7ffab806e490 2024-03-11T22:01:31.556 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 0 on host 'smithi049' 2024-03-11T22:01:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:31.564+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 >> v1:172.21.15.49:6800/4076252288 conn(0x7ffab806e490 legacy=0x7ffab8070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:01:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:31.564+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 >> v1:172.21.15.49:6790/0 conn(0x7ffacc109bd0 legacy=0x7ffacc1a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:01:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:31.564+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 shutdown_connections 2024-03-11T22:01:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:31.564+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 >> 172.21.15.49:0/1999728289 conn(0x7ffacc0fd020 msgr2=0x7ffacc1082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:01:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:31.564+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 shutdown_connections 2024-03-11T22:01:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:31.564+0000 7ffad1985700 1 -- 172.21.15.49:0/1999728289 wait complete. 2024-03-11T22:01:31.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:31 smithi187 bash[23415]: audit 2024-03-11T22:01:30.238604+0000 mon.a (mon.0) 269 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-11T22:01:31.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:31 smithi187 bash[23415]: cluster 2024-03-11T22:01:30.243675+0000 mon.a (mon.0) 270 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-03-11T22:01:31.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:31 smithi187 bash[23415]: audit 2024-03-11T22:01:30.244531+0000 mon.a (mon.0) 271 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:01:31.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:31 smithi187 bash[23415]: audit 2024-03-11T22:01:30.245033+0000 mon.a (mon.0) 272 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:31.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:31 smithi187 bash[23415]: audit 2024-03-11T22:01:31.240554+0000 mon.a (mon.0) 273 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:01:32.187 DEBUG:teuthology.orchestra.run.smithi049:osd.0> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.0.service 2024-03-11T22:01:32.189 INFO:tasks.cephadm:Deploying osd.1 on smithi049 with /dev/vg_nvme/lv_3... 2024-03-11T22:01:32.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-11T22:01:32.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: cluster 2024-03-11T22:01:30.685118+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:32.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: cluster 2024-03-11T22:01:31.247761+0000 mon.a (mon.0) 274 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-03-11T22:01:32.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: audit 2024-03-11T22:01:31.250360+0000 mon.a (mon.0) 275 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: audit 2024-03-11T22:01:31.259053+0000 mon.a (mon.0) 276 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: audit 2024-03-11T22:01:31.514808+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: audit 2024-03-11T22:01:31.519942+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: audit 2024-03-11T22:01:31.530446+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: audit 2024-03-11T22:01:31.570610+0000 mon.a (mon.0) 280 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[21434]: audit 2024-03-11T22:01:32.256011+0000 mon.a (mon.0) 281 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: cluster 2024-03-11T22:01:30.685118+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: cluster 2024-03-11T22:01:31.247761+0000 mon.a (mon.0) 274 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: audit 2024-03-11T22:01:31.250360+0000 mon.a (mon.0) 275 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: audit 2024-03-11T22:01:31.259053+0000 mon.a (mon.0) 276 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: audit 2024-03-11T22:01:31.514808+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: audit 2024-03-11T22:01:31.519942+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: audit 2024-03-11T22:01:31.530446+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:01:32.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: audit 2024-03-11T22:01:31.570610+0000 mon.a (mon.0) 280 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' 2024-03-11T22:01:32.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:32 smithi049 bash[28804]: audit 2024-03-11T22:01:32.256011+0000 mon.a (mon.0) 281 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: cluster 2024-03-11T22:01:30.685118+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:32.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: cluster 2024-03-11T22:01:31.247761+0000 mon.a (mon.0) 274 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-03-11T22:01:32.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: audit 2024-03-11T22:01:31.250360+0000 mon.a (mon.0) 275 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: audit 2024-03-11T22:01:31.259053+0000 mon.a (mon.0) 276 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:32.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: audit 2024-03-11T22:01:31.514808+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:32.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: audit 2024-03-11T22:01:31.519942+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:32.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: audit 2024-03-11T22:01:31.530446+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:01:32.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: audit 2024-03-11T22:01:31.570610+0000 mon.a (mon.0) 280 : audit 1 from='osd.0 v1:172.21.15.49:6801/1383006495' entity='osd.0' 2024-03-11T22:01:32.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:32 smithi187 bash[23415]: audit 2024-03-11T22:01:32.256011+0000 mon.a (mon.0) 281 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:33 smithi187 bash[23415]: cluster 2024-03-11T22:01:30.591340+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:01:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:33 smithi187 bash[23415]: cluster 2024-03-11T22:01:30.591414+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:01:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:33 smithi187 bash[23415]: cluster 2024-03-11T22:01:32.574478+0000 mon.a (mon.0) 282 : cluster 1 osd.0 v1:172.21.15.49:6801/1383006495 boot 2024-03-11T22:01:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:33 smithi187 bash[23415]: cluster 2024-03-11T22:01:32.574511+0000 mon.a (mon.0) 283 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-03-11T22:01:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:33 smithi187 bash[23415]: audit 2024-03-11T22:01:32.575283+0000 mon.a (mon.0) 284 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:33 smithi187 bash[23415]: cluster 2024-03-11T22:01:32.685459+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[21434]: cluster 2024-03-11T22:01:30.591340+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[21434]: cluster 2024-03-11T22:01:30.591414+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[21434]: cluster 2024-03-11T22:01:32.574478+0000 mon.a (mon.0) 282 : cluster 1 osd.0 v1:172.21.15.49:6801/1383006495 boot 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[21434]: cluster 2024-03-11T22:01:32.574511+0000 mon.a (mon.0) 283 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[21434]: audit 2024-03-11T22:01:32.575283+0000 mon.a (mon.0) 284 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[21434]: cluster 2024-03-11T22:01:32.685459+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[28804]: cluster 2024-03-11T22:01:30.591340+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:01:34.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[28804]: cluster 2024-03-11T22:01:30.591414+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:01:34.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[28804]: cluster 2024-03-11T22:01:32.574478+0000 mon.a (mon.0) 282 : cluster 1 osd.0 v1:172.21.15.49:6801/1383006495 boot 2024-03-11T22:01:34.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[28804]: cluster 2024-03-11T22:01:32.574511+0000 mon.a (mon.0) 283 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-03-11T22:01:34.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[28804]: audit 2024-03-11T22:01:32.575283+0000 mon.a (mon.0) 284 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:01:34.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:33 smithi049 bash[28804]: cluster 2024-03-11T22:01:32.685459+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-11T22:01:35.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:35 smithi187 bash[23415]: cluster 2024-03-11T22:01:34.583032+0000 mon.a (mon.0) 285 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-03-11T22:01:35.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:35 smithi187 bash[23415]: cluster 2024-03-11T22:01:34.685947+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:36.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:35 smithi049 bash[21434]: cluster 2024-03-11T22:01:34.583032+0000 mon.a (mon.0) 285 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-03-11T22:01:36.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:35 smithi049 bash[21434]: cluster 2024-03-11T22:01:34.685947+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:36.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:35 smithi049 bash[28804]: cluster 2024-03-11T22:01:34.583032+0000 mon.a (mon.0) 285 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-03-11T22:01:36.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:35 smithi049 bash[28804]: cluster 2024-03-11T22:01:34.685947+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:36.495 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:01:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:37 smithi187 bash[23415]: cluster 2024-03-11T22:01:36.686462+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:38.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:37 smithi049 bash[21434]: cluster 2024-03-11T22:01:36.686462+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:38.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:37 smithi049 bash[28804]: cluster 2024-03-11T22:01:36.686462+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:40.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:39 smithi049 bash[21434]: cluster 2024-03-11T22:01:38.686926+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:40.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:39 smithi049 bash[28804]: cluster 2024-03-11T22:01:38.686926+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:40.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:39 smithi187 bash[23415]: cluster 2024-03-11T22:01:38.686926+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:40.582 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-11T22:01:40.582 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-11T22:01:40.582 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-03-11T22:01:40.582 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-03-11T22:01:40.582 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116316 s, 901 MB/s 2024-03-11T22:01:40.582 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-03-11T22:01:41.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_3 2024-03-11T22:01:42.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:41 smithi049 bash[21434]: cluster 2024-03-11T22:01:40.687243+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:42.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:41 smithi049 bash[28804]: cluster 2024-03-11T22:01:40.687243+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:42.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:41 smithi187 bash[23415]: cluster 2024-03-11T22:01:40.687243+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: cephadm 2024-03-11T22:01:41.769793+0000 mgr.y (mgr.14152) 111 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: audit 2024-03-11T22:01:41.777439+0000 mon.a (mon.0) 286 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: audit 2024-03-11T22:01:41.785584+0000 mon.a (mon.0) 287 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: audit 2024-03-11T22:01:41.787615+0000 mon.a (mon.0) 288 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: cephadm 2024-03-11T22:01:41.788950+0000 mgr.y (mgr.14152) 112 : cephadm 1 Adjusting osd_memory_target on smithi049 to 16241M 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: audit 2024-03-11T22:01:41.795260+0000 mon.a (mon.0) 289 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: audit 2024-03-11T22:01:41.799643+0000 mon.a (mon.0) 290 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: audit 2024-03-11T22:01:41.801189+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[21434]: audit 2024-03-11T22:01:41.810489+0000 mon.a (mon.0) 292 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: cephadm 2024-03-11T22:01:41.769793+0000 mgr.y (mgr.14152) 111 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: audit 2024-03-11T22:01:41.777439+0000 mon.a (mon.0) 286 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: audit 2024-03-11T22:01:41.785584+0000 mon.a (mon.0) 287 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: audit 2024-03-11T22:01:41.787615+0000 mon.a (mon.0) 288 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: cephadm 2024-03-11T22:01:41.788950+0000 mgr.y (mgr.14152) 112 : cephadm 1 Adjusting osd_memory_target on smithi049 to 16241M 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: audit 2024-03-11T22:01:41.795260+0000 mon.a (mon.0) 289 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: audit 2024-03-11T22:01:41.799643+0000 mon.a (mon.0) 290 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: audit 2024-03-11T22:01:41.801189+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:01:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:42 smithi049 bash[28804]: audit 2024-03-11T22:01:41.810489+0000 mon.a (mon.0) 292 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: cephadm 2024-03-11T22:01:41.769793+0000 mgr.y (mgr.14152) 111 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: audit 2024-03-11T22:01:41.777439+0000 mon.a (mon.0) 286 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: audit 2024-03-11T22:01:41.785584+0000 mon.a (mon.0) 287 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: audit 2024-03-11T22:01:41.787615+0000 mon.a (mon.0) 288 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: cephadm 2024-03-11T22:01:41.788950+0000 mgr.y (mgr.14152) 112 : cephadm 1 Adjusting osd_memory_target on smithi049 to 16241M 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: audit 2024-03-11T22:01:41.795260+0000 mon.a (mon.0) 289 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: audit 2024-03-11T22:01:41.799643+0000 mon.a (mon.0) 290 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: audit 2024-03-11T22:01:41.801189+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:01:43.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:42 smithi187 bash[23415]: audit 2024-03-11T22:01:41.810489+0000 mon.a (mon.0) 292 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:01:44.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:43 smithi187 bash[23415]: cluster 2024-03-11T22:01:42.687661+0000 mgr.y (mgr.14152) 113 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:44.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:43 smithi049 bash[21434]: cluster 2024-03-11T22:01:42.687661+0000 mgr.y (mgr.14152) 113 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:44.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:43 smithi049 bash[28804]: cluster 2024-03-11T22:01:42.687661+0000 mgr.y (mgr.14152) 113 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:46.100 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:01:46.122 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:45 smithi049 bash[21434]: cluster 2024-03-11T22:01:44.688161+0000 mgr.y (mgr.14152) 114 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:46.122 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:45 smithi049 bash[28804]: cluster 2024-03-11T22:01:44.688161+0000 mgr.y (mgr.14152) 114 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:46.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:45 smithi187 bash[23415]: cluster 2024-03-11T22:01:44.688161+0000 mgr.y (mgr.14152) 114 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:48.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:47 smithi049 bash[21434]: cluster 2024-03-11T22:01:46.688660+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:48.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:47 smithi049 bash[28804]: cluster 2024-03-11T22:01:46.688660+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:48.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:47 smithi187 bash[23415]: cluster 2024-03-11T22:01:46.688660+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:48.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- 172.21.15.49:0/2486907882 >> v1:172.21.15.49:6789/0 conn(0x7f7f74103cb0 legacy=0x7f7f741040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:01:48.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- 172.21.15.49:0/2486907882 shutdown_connections 2024-03-11T22:01:48.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- 172.21.15.49:0/2486907882 >> 172.21.15.49:0/2486907882 conn(0x7f7f740ff270 msgr2=0x7f7f74101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:01:48.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- 172.21.15.49:0/2486907882 shutdown_connections 2024-03-11T22:01:48.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- 172.21.15.49:0/2486907882 wait complete. 2024-03-11T22:01:48.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 Processor -- start 2024-03-11T22:01:48.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- start start 2024-03-11T22:01:48.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7f74199a30 con 0x7f7f7410be20 2024-03-11T22:01:48.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7f741a5220 con 0x7f7f74103cb0 2024-03-11T22:01:48.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f7acb3700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7f741a63c0 con 0x7f7f741080e0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f79250700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7f7410be20 0x7f7f741a2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49218/0 (socket says 172.21.15.49:49218) 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f79250700 1 -- 172.21.15.49:0/244593765 learned_addr learned my addr 172.21.15.49:0/244593765 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144220404 0 0) 0x7f7f74199a30 con 0x7f7f7410be20 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f64005070 con 0x7f7f7410be20 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599519185 0 0) 0x7f7f741a63c0 con 0x7f7f741080e0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.479+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f74199a30 con 0x7f7f741080e0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321992207 0 0) 0x7f7f741a5220 con 0x7f7f74103cb0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f741a63c0 con 0x7f7f74103cb0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1694018377 0 0) 0x7f7f74199a30 con 0x7f7f741080e0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f741a5220 con 0x7f7f741080e0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 90517501 0 0) 0x7f7f64005070 con 0x7f7f7410be20 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f74199a30 con 0x7f7f7410be20 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f7f60001830 con 0x7f7f741080e0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f7f6c001c50 con 0x7f7f7410be20 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1920955705 0 0) 0x7f7f741a5220 con 0x7f7f741080e0 2024-03-11T22:01:48.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 >> v1:172.21.15.187:6789/0 conn(0x7f7f74103cb0 legacy=0x7f7f74198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 >> v1:172.21.15.49:6789/0 conn(0x7f7f7410be20 legacy=0x7f7f741a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f741a7560 con 0x7f7f741080e0 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f741a65b0 con 0x7f7f741080e0 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f741a6ab0 con 0x7f7f741080e0 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f7f60003b30 con 0x7f7f741080e0 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f7f60004a40 con 0x7f7f741080e0 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f58005150 con 0x7f7f741080e0 2024-03-11T22:01:48.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 14) v1 ==== 90989+0+0 (unknown 1005286256 0 0) 0x7f7f600036a0 con 0x7f7f741080e0 2024-03-11T22:01:48.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.483+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1541+0+0 (unknown 1974695523 0 0) 0x7f7f60085c00 con 0x7f7f741080e0 2024-03-11T22:01:48.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.487+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f7f60050930 con 0x7f7f741080e0 2024-03-11T22:01:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:01:48.711+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f58000bc0 con 0x7f7f6406e3d0 2024-03-11T22:01:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:48 smithi187 bash[23415]: audit 2024-03-11T22:01:48.718791+0000 mon.a (mon.0) 293 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:01:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:48 smithi187 bash[23415]: audit 2024-03-11T22:01:48.722602+0000 mon.a (mon.0) 294 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:01:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:48 smithi187 bash[23415]: audit 2024-03-11T22:01:48.723437+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:49.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:48 smithi049 bash[21434]: audit 2024-03-11T22:01:48.718791+0000 mon.a (mon.0) 293 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:01:49.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:48 smithi049 bash[21434]: audit 2024-03-11T22:01:48.722602+0000 mon.a (mon.0) 294 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:01:49.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:48 smithi049 bash[21434]: audit 2024-03-11T22:01:48.723437+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:49.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:48 smithi049 bash[28804]: audit 2024-03-11T22:01:48.718791+0000 mon.a (mon.0) 293 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:01:49.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:48 smithi049 bash[28804]: audit 2024-03-11T22:01:48.722602+0000 mon.a (mon.0) 294 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:01:49.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:48 smithi049 bash[28804]: audit 2024-03-11T22:01:48.723437+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:01:50.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:49 smithi187 bash[23415]: cluster 2024-03-11T22:01:48.689123+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:50.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:49 smithi187 bash[23415]: audit 2024-03-11T22:01:48.715028+0000 mgr.y (mgr.14152) 117 : audit 0 from='client.24143 v1:172.21.15.49:0/244593765' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:01:50.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:49 smithi049 bash[21434]: cluster 2024-03-11T22:01:48.689123+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:50.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:49 smithi049 bash[21434]: audit 2024-03-11T22:01:48.715028+0000 mgr.y (mgr.14152) 117 : audit 0 from='client.24143 v1:172.21.15.49:0/244593765' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:01:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:49 smithi049 bash[28804]: cluster 2024-03-11T22:01:48.689123+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:49 smithi049 bash[28804]: audit 2024-03-11T22:01:48.715028+0000 mgr.y (mgr.14152) 117 : audit 0 from='client.24143 v1:172.21.15.49:0/244593765' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:01:52.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:51 smithi187 bash[23415]: cluster 2024-03-11T22:01:50.689624+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:52.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:51 smithi049 bash[21434]: cluster 2024-03-11T22:01:50.689624+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:52.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:51 smithi049 bash[28804]: cluster 2024-03-11T22:01:50.689624+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:54.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:53 smithi049 bash[21434]: cluster 2024-03-11T22:01:52.690118+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:54.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:53 smithi049 bash[28804]: cluster 2024-03-11T22:01:52.690118+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:54.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:53 smithi187 bash[23415]: cluster 2024-03-11T22:01:52.690118+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:56.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:55 smithi187 bash[23415]: cluster 2024-03-11T22:01:54.690643+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:56.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:55 smithi049 bash[28804]: cluster 2024-03-11T22:01:54.690643+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:56.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:55 smithi049 bash[21434]: cluster 2024-03-11T22:01:54.690643+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:57.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:56 smithi187 bash[23415]: audit 2024-03-11T22:01:56.775795+0000 mon.c (mon.2) 4 : audit 1 from='client.? v1:172.21.15.49:0/533259462' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]: dispatch 2024-03-11T22:01:57.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:56 smithi187 bash[23415]: audit 2024-03-11T22:01:56.776309+0000 mon.a (mon.0) 296 : audit 1 from='client.24149 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]: dispatch 2024-03-11T22:01:57.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:56 smithi187 bash[23415]: audit 2024-03-11T22:01:56.778491+0000 mon.a (mon.0) 297 : audit 1 from='client.24149 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]': finished 2024-03-11T22:01:57.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:56 smithi187 bash[23415]: cluster 2024-03-11T22:01:56.783492+0000 mon.a (mon.0) 298 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-03-11T22:01:57.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:56 smithi187 bash[23415]: audit 2024-03-11T22:01:56.783871+0000 mon.a (mon.0) 299 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:01:57.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[21434]: audit 2024-03-11T22:01:56.775795+0000 mon.c (mon.2) 4 : audit 1 from='client.? v1:172.21.15.49:0/533259462' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]: dispatch 2024-03-11T22:01:57.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[21434]: audit 2024-03-11T22:01:56.776309+0000 mon.a (mon.0) 296 : audit 1 from='client.24149 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]: dispatch 2024-03-11T22:01:57.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[21434]: audit 2024-03-11T22:01:56.778491+0000 mon.a (mon.0) 297 : audit 1 from='client.24149 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]': finished 2024-03-11T22:01:57.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[21434]: cluster 2024-03-11T22:01:56.783492+0000 mon.a (mon.0) 298 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-03-11T22:01:57.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[21434]: audit 2024-03-11T22:01:56.783871+0000 mon.a (mon.0) 299 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:01:57.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[28804]: audit 2024-03-11T22:01:56.775795+0000 mon.c (mon.2) 4 : audit 1 from='client.? v1:172.21.15.49:0/533259462' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]: dispatch 2024-03-11T22:01:57.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[28804]: audit 2024-03-11T22:01:56.776309+0000 mon.a (mon.0) 296 : audit 1 from='client.24149 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]: dispatch 2024-03-11T22:01:57.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[28804]: audit 2024-03-11T22:01:56.778491+0000 mon.a (mon.0) 297 : audit 1 from='client.24149 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e57e1dff-7e3e-4924-ae2d-6b921cb9d99b"}]': finished 2024-03-11T22:01:57.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[28804]: cluster 2024-03-11T22:01:56.783492+0000 mon.a (mon.0) 298 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-03-11T22:01:57.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:56 smithi049 bash[28804]: audit 2024-03-11T22:01:56.783871+0000 mon.a (mon.0) 299 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:01:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:57 smithi187 bash[23415]: cluster 2024-03-11T22:01:56.691065+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:57 smithi187 bash[23415]: audit 2024-03-11T22:01:57.489469+0000 mon.c (mon.2) 5 : audit 0 from='client.? v1:172.21.15.49:0/2037456411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:01:58.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:57 smithi049 bash[21434]: cluster 2024-03-11T22:01:56.691065+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:58.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:57 smithi049 bash[21434]: audit 2024-03-11T22:01:57.489469+0000 mon.c (mon.2) 5 : audit 0 from='client.? v1:172.21.15.49:0/2037456411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:01:58.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:57 smithi049 bash[28804]: cluster 2024-03-11T22:01:56.691065+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:01:58.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:57 smithi049 bash[28804]: audit 2024-03-11T22:01:57.489469+0000 mon.c (mon.2) 5 : audit 0 from='client.? v1:172.21.15.49:0/2037456411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:02:00.177 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:01:59 smithi049 bash[21434]: cluster 2024-03-11T22:01:58.691515+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:00.178 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:01:59 smithi049 bash[28804]: cluster 2024-03-11T22:01:58.691515+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:00.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:01:59 smithi187 bash[23415]: cluster 2024-03-11T22:01:58.691515+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:02.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:01 smithi187 bash[23415]: cluster 2024-03-11T22:02:00.691966+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:02.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:01 smithi049 bash[21434]: cluster 2024-03-11T22:02:00.691966+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:02.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:01 smithi049 bash[28804]: cluster 2024-03-11T22:02:00.691966+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:04.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:03 smithi187 bash[23415]: cluster 2024-03-11T22:02:02.692427+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:04.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:03 smithi049 bash[21434]: cluster 2024-03-11T22:02:02.692427+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:04.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:03 smithi049 bash[28804]: cluster 2024-03-11T22:02:02.692427+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:06.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:05 smithi049 bash[21434]: cluster 2024-03-11T22:02:04.692891+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:06.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:05 smithi049 bash[28804]: cluster 2024-03-11T22:02:04.692891+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:06.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:05 smithi187 bash[23415]: cluster 2024-03-11T22:02:04.692891+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:08.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:07 smithi187 bash[23415]: cluster 2024-03-11T22:02:06.693284+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:08.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:07 smithi049 bash[21434]: cluster 2024-03-11T22:02:06.693284+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:08.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:07 smithi049 bash[28804]: cluster 2024-03-11T22:02:06.693284+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:10.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:09 smithi187 bash[23415]: cluster 2024-03-11T22:02:08.693744+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:10.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:09 smithi187 bash[23415]: audit 2024-03-11T22:02:09.165112+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-11T22:02:10.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:09 smithi187 bash[23415]: audit 2024-03-11T22:02:09.166728+0000 mon.a (mon.0) 301 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:10.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:09 smithi187 bash[23415]: cephadm 2024-03-11T22:02:09.168213+0000 mgr.y (mgr.14152) 128 : cephadm 1 Deploying daemon osd.1 on smithi049 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[21434]: cluster 2024-03-11T22:02:08.693744+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[21434]: audit 2024-03-11T22:02:09.165112+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[21434]: audit 2024-03-11T22:02:09.166728+0000 mon.a (mon.0) 301 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[21434]: cephadm 2024-03-11T22:02:09.168213+0000 mgr.y (mgr.14152) 128 : cephadm 1 Deploying daemon osd.1 on smithi049 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[28804]: cluster 2024-03-11T22:02:08.693744+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[28804]: audit 2024-03-11T22:02:09.165112+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[28804]: audit 2024-03-11T22:02:09.166728+0000 mon.a (mon.0) 301 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:09 smithi049 bash[28804]: cephadm 2024-03-11T22:02:09.168213+0000 mgr.y (mgr.14152) 128 : cephadm 1 Deploying daemon osd.1 on smithi049 2024-03-11T22:02:12.158 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:11 smithi049 bash[28804]: cluster 2024-03-11T22:02:10.694198+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:12.158 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:11 smithi049 bash[21434]: cluster 2024-03-11T22:02:10.694198+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:12.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:11 smithi187 bash[23415]: cluster 2024-03-11T22:02:10.694198+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:13.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:13.248 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:13.249 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:13.249 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:13.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:13.524 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:13.525 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:13.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:02:14.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:13 smithi187 bash[23415]: cluster 2024-03-11T22:02:12.694667+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:14.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:13 smithi187 bash[23415]: audit 2024-03-11T22:02:13.530967+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:14.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:13 smithi187 bash[23415]: audit 2024-03-11T22:02:13.536232+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:14.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:13 smithi187 bash[23415]: audit 2024-03-11T22:02:13.575242+0000 mon.a (mon.0) 304 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:02:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[21434]: cluster 2024-03-11T22:02:12.694667+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[21434]: audit 2024-03-11T22:02:13.530967+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[21434]: audit 2024-03-11T22:02:13.536232+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[21434]: audit 2024-03-11T22:02:13.575242+0000 mon.a (mon.0) 304 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:02:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[28804]: cluster 2024-03-11T22:02:12.694667+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[28804]: audit 2024-03-11T22:02:13.530967+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[28804]: audit 2024-03-11T22:02:13.536232+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:13 smithi049 bash[28804]: audit 2024-03-11T22:02:13.575242+0000 mon.a (mon.0) 304 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:02:16.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:15 smithi049 bash[21434]: cluster 2024-03-11T22:02:14.695103+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:16.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:15 smithi049 bash[28804]: cluster 2024-03-11T22:02:14.695103+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:16.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:15 smithi187 bash[23415]: cluster 2024-03-11T22:02:14.695103+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:18.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:17 smithi187 bash[23415]: cluster 2024-03-11T22:02:16.695541+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:18.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:17 smithi049 bash[21434]: cluster 2024-03-11T22:02:16.695541+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:18.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:17 smithi049 bash[28804]: cluster 2024-03-11T22:02:16.695541+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:20.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[21434]: cluster 2024-03-11T22:02:18.695901+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[21434]: audit 2024-03-11T22:02:18.823200+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[21434]: audit 2024-03-11T22:02:18.827545+0000 mon.a (mon.0) 306 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[21434]: audit 2024-03-11T22:02:18.828368+0000 mon.a (mon.0) 307 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[21434]: audit 2024-03-11T22:02:18.829063+0000 mon.a (mon.0) 308 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[21434]: audit 2024-03-11T22:02:18.833509+0000 mon.a (mon.0) 309 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[28804]: cluster 2024-03-11T22:02:18.695901+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[28804]: audit 2024-03-11T22:02:18.823200+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[28804]: audit 2024-03-11T22:02:18.827545+0000 mon.a (mon.0) 306 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[28804]: audit 2024-03-11T22:02:18.828368+0000 mon.a (mon.0) 307 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:20.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[28804]: audit 2024-03-11T22:02:18.829063+0000 mon.a (mon.0) 308 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:02:20.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:19 smithi049 bash[28804]: audit 2024-03-11T22:02:18.833509+0000 mon.a (mon.0) 309 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:19 smithi187 bash[23415]: cluster 2024-03-11T22:02:18.695901+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:20.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:19 smithi187 bash[23415]: audit 2024-03-11T22:02:18.823200+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:19 smithi187 bash[23415]: audit 2024-03-11T22:02:18.827545+0000 mon.a (mon.0) 306 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:20.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:19 smithi187 bash[23415]: audit 2024-03-11T22:02:18.828368+0000 mon.a (mon.0) 307 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:20.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:19 smithi187 bash[23415]: audit 2024-03-11T22:02:18.829063+0000 mon.a (mon.0) 308 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:02:20.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:19 smithi187 bash[23415]: audit 2024-03-11T22:02:18.833509+0000 mon.a (mon.0) 309 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:21.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:20 smithi187 bash[23415]: audit 2024-03-11T22:02:19.903624+0000 mon.a (mon.0) 310 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-11T22:02:21.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:20 smithi049 bash[21434]: audit 2024-03-11T22:02:19.903624+0000 mon.a (mon.0) 310 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-11T22:02:21.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:20 smithi049 bash[28804]: audit 2024-03-11T22:02:19.903624+0000 mon.a (mon.0) 310 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-11T22:02:22.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:21 smithi187 bash[23415]: cluster 2024-03-11T22:02:20.696343+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:22.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:21 smithi187 bash[23415]: audit 2024-03-11T22:02:20.830830+0000 mon.a (mon.0) 311 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-11T22:02:22.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:21 smithi187 bash[23415]: cluster 2024-03-11T22:02:20.836210+0000 mon.a (mon.0) 312 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-03-11T22:02:22.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:21 smithi187 bash[23415]: audit 2024-03-11T22:02:20.836670+0000 mon.a (mon.0) 313 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:02:22.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:21 smithi187 bash[23415]: audit 2024-03-11T22:02:20.837181+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:22.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[28804]: cluster 2024-03-11T22:02:20.696343+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:22.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[28804]: audit 2024-03-11T22:02:20.830830+0000 mon.a (mon.0) 311 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-11T22:02:22.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[28804]: cluster 2024-03-11T22:02:20.836210+0000 mon.a (mon.0) 312 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-03-11T22:02:22.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[28804]: audit 2024-03-11T22:02:20.836670+0000 mon.a (mon.0) 313 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:02:22.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[28804]: audit 2024-03-11T22:02:20.837181+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[21434]: cluster 2024-03-11T22:02:20.696343+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[21434]: audit 2024-03-11T22:02:20.830830+0000 mon.a (mon.0) 311 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-11T22:02:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[21434]: cluster 2024-03-11T22:02:20.836210+0000 mon.a (mon.0) 312 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-03-11T22:02:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[21434]: audit 2024-03-11T22:02:20.836670+0000 mon.a (mon.0) 313 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:02:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:21 smithi049 bash[21434]: audit 2024-03-11T22:02:20.837181+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:22.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:22.319+0000 7f7f71ffb700 1 -- 172.21.15.49:0/244593765 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 2796983437) 0x7f7f58000bc0 con 0x7f7f6406e3d0 2024-03-11T22:02:22.315 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 1 on host 'smithi049' 2024-03-11T22:02:22.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:22.319+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 >> v1:172.21.15.49:6800/4076252288 conn(0x7f7f6406e3d0 legacy=0x7f7f64070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:02:22.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:22.319+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 >> v1:172.21.15.49:6790/0 conn(0x7f7f741080e0 legacy=0x7f7f7419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:02:22.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:22.319+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 shutdown_connections 2024-03-11T22:02:22.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:22.319+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 >> 172.21.15.49:0/244593765 conn(0x7f7f740ff270 msgr2=0x7f7f7410ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:02:22.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:22.323+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 shutdown_connections 2024-03-11T22:02:22.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:22.323+0000 7f7f7acb3700 1 -- 172.21.15.49:0/244593765 wait complete. 2024-03-11T22:02:22.900 DEBUG:teuthology.orchestra.run.smithi049:osd.1> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.1.service 2024-03-11T22:02:22.903 INFO:tasks.cephadm:Deploying osd.2 on smithi049 with /dev/vg_nvme/lv_2... 2024-03-11T22:02:22.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-11T22:02:23.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:22 smithi187 bash[23415]: audit 2024-03-11T22:02:21.833153+0000 mon.a (mon.0) 315 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:02:23.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:22 smithi187 bash[23415]: cluster 2024-03-11T22:02:21.837217+0000 mon.a (mon.0) 316 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-03-11T22:02:23.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:22 smithi187 bash[23415]: audit 2024-03-11T22:02:21.838460+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:23.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:22 smithi187 bash[23415]: audit 2024-03-11T22:02:21.845873+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:23.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:22 smithi187 bash[23415]: audit 2024-03-11T22:02:22.255723+0000 mon.a (mon.0) 319 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:02:23.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:22 smithi187 bash[23415]: audit 2024-03-11T22:02:22.262443+0000 mon.a (mon.0) 320 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:23.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:22 smithi187 bash[23415]: audit 2024-03-11T22:02:22.269935+0000 mon.a (mon.0) 321 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:23.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[21434]: audit 2024-03-11T22:02:21.833153+0000 mon.a (mon.0) 315 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:02:23.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[21434]: cluster 2024-03-11T22:02:21.837217+0000 mon.a (mon.0) 316 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-03-11T22:02:23.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[21434]: audit 2024-03-11T22:02:21.838460+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[21434]: audit 2024-03-11T22:02:21.845873+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[21434]: audit 2024-03-11T22:02:22.255723+0000 mon.a (mon.0) 319 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[21434]: audit 2024-03-11T22:02:22.262443+0000 mon.a (mon.0) 320 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[21434]: audit 2024-03-11T22:02:22.269935+0000 mon.a (mon.0) 321 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[28804]: audit 2024-03-11T22:02:21.833153+0000 mon.a (mon.0) 315 : audit 1 from='osd.1 v1:172.21.15.49:6805/3491699509' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[28804]: cluster 2024-03-11T22:02:21.837217+0000 mon.a (mon.0) 316 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[28804]: audit 2024-03-11T22:02:21.838460+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[28804]: audit 2024-03-11T22:02:21.845873+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[28804]: audit 2024-03-11T22:02:22.255723+0000 mon.a (mon.0) 319 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[28804]: audit 2024-03-11T22:02:22.262443+0000 mon.a (mon.0) 320 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:22 smithi049 bash[28804]: audit 2024-03-11T22:02:22.269935+0000 mon.a (mon.0) 321 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:23 smithi187 bash[23415]: cluster 2024-03-11T22:02:20.916223+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:02:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:23 smithi187 bash[23415]: cluster 2024-03-11T22:02:20.916339+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:02:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:23 smithi187 bash[23415]: cluster 2024-03-11T22:02:22.696681+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:23 smithi187 bash[23415]: cluster 2024-03-11T22:02:22.847731+0000 mon.a (mon.0) 322 : cluster 1 osd.1 v1:172.21.15.49:6805/3491699509 boot 2024-03-11T22:02:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:23 smithi187 bash[23415]: cluster 2024-03-11T22:02:22.847831+0000 mon.a (mon.0) 323 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-03-11T22:02:24.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:23 smithi187 bash[23415]: audit 2024-03-11T22:02:22.848933+0000 mon.a (mon.0) 324 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:24.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[21434]: cluster 2024-03-11T22:02:20.916223+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:02:24.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[21434]: cluster 2024-03-11T22:02:20.916339+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:02:24.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[21434]: cluster 2024-03-11T22:02:22.696681+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:24.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[21434]: cluster 2024-03-11T22:02:22.847731+0000 mon.a (mon.0) 322 : cluster 1 osd.1 v1:172.21.15.49:6805/3491699509 boot 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[21434]: cluster 2024-03-11T22:02:22.847831+0000 mon.a (mon.0) 323 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[21434]: audit 2024-03-11T22:02:22.848933+0000 mon.a (mon.0) 324 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[28804]: cluster 2024-03-11T22:02:20.916223+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[28804]: cluster 2024-03-11T22:02:20.916339+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[28804]: cluster 2024-03-11T22:02:22.696681+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[28804]: cluster 2024-03-11T22:02:22.847731+0000 mon.a (mon.0) 322 : cluster 1 osd.1 v1:172.21.15.49:6805/3491699509 boot 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[28804]: cluster 2024-03-11T22:02:22.847831+0000 mon.a (mon.0) 323 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-03-11T22:02:24.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:23 smithi049 bash[28804]: audit 2024-03-11T22:02:22.848933+0000 mon.a (mon.0) 324 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:02:25.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:24 smithi187 bash[23415]: cluster 2024-03-11T22:02:23.865088+0000 mon.a (mon.0) 325 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-03-11T22:02:25.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:24 smithi049 bash[21434]: cluster 2024-03-11T22:02:23.865088+0000 mon.a (mon.0) 325 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-03-11T22:02:25.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:24 smithi049 bash[28804]: cluster 2024-03-11T22:02:23.865088+0000 mon.a (mon.0) 325 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-03-11T22:02:26.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:25 smithi187 bash[23415]: cluster 2024-03-11T22:02:24.697144+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:26.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:25 smithi049 bash[21434]: cluster 2024-03-11T22:02:24.697144+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:26.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:25 smithi049 bash[28804]: cluster 2024-03-11T22:02:24.697144+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:27.255 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:02:28.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:27 smithi187 bash[23415]: cluster 2024-03-11T22:02:26.697549+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:28.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:27 smithi049 bash[28804]: cluster 2024-03-11T22:02:26.697549+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:28.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:27 smithi049 bash[21434]: cluster 2024-03-11T22:02:26.697549+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:30.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:29 smithi187 bash[23415]: cluster 2024-03-11T22:02:28.698047+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:30.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:29 smithi049 bash[21434]: cluster 2024-03-11T22:02:28.698047+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:30.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:29 smithi049 bash[28804]: cluster 2024-03-11T22:02:28.698047+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:31.084 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-11T22:02:31.084 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-11T22:02:31.084 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-03-11T22:02:31.084 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-03-11T22:02:31.084 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108271 s, 968 MB/s 2024-03-11T22:02:31.084 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-03-11T22:02:31.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_2 2024-03-11T22:02:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:31 smithi187 bash[23415]: cluster 2024-03-11T22:02:30.698424+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:32.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:31 smithi049 bash[21434]: cluster 2024-03-11T22:02:30.698424+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:32.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:31 smithi049 bash[28804]: cluster 2024-03-11T22:02:30.698424+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: cephadm 2024-03-11T22:02:32.496837+0000 mgr.y (mgr.14152) 140 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.508011+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.519387+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.521970+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.523729+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: cephadm 2024-03-11T22:02:32.525015+0000 mgr.y (mgr.14152) 141 : cephadm 1 Adjusting osd_memory_target on smithi049 to 8120M 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.531510+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.536016+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.537488+0000 mon.a (mon.0) 332 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: audit 2024-03-11T22:02:32.546400+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[21434]: cluster 2024-03-11T22:02:32.698850+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: cephadm 2024-03-11T22:02:32.496837+0000 mgr.y (mgr.14152) 140 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.508011+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.519387+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.521970+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.523729+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: cephadm 2024-03-11T22:02:32.525015+0000 mgr.y (mgr.14152) 141 : cephadm 1 Adjusting osd_memory_target on smithi049 to 8120M 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.531510+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.536016+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.537488+0000 mon.a (mon.0) 332 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: audit 2024-03-11T22:02:32.546400+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:33 smithi049 bash[28804]: cluster 2024-03-11T22:02:32.698850+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: cephadm 2024-03-11T22:02:32.496837+0000 mgr.y (mgr.14152) 140 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.508011+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.519387+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.521970+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.523729+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: cephadm 2024-03-11T22:02:32.525015+0000 mgr.y (mgr.14152) 141 : cephadm 1 Adjusting osd_memory_target on smithi049 to 8120M 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.531510+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.536016+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:33.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.537488+0000 mon.a (mon.0) 332 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:02:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: audit 2024-03-11T22:02:32.546400+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:02:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:33 smithi187 bash[23415]: cluster 2024-03-11T22:02:32.698850+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:36.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:35 smithi049 bash[21434]: cluster 2024-03-11T22:02:34.699375+0000 mgr.y (mgr.14152) 143 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:36.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:35 smithi049 bash[28804]: cluster 2024-03-11T22:02:34.699375+0000 mgr.y (mgr.14152) 143 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:36.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:35 smithi187 bash[23415]: cluster 2024-03-11T22:02:34.699375+0000 mgr.y (mgr.14152) 143 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:36.689 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:02:38.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:37 smithi049 bash[28804]: cluster 2024-03-11T22:02:36.699875+0000 mgr.y (mgr.14152) 144 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:38.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:37 smithi049 bash[21434]: cluster 2024-03-11T22:02:36.699875+0000 mgr.y (mgr.14152) 144 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:38.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:37 smithi187 bash[23415]: cluster 2024-03-11T22:02:36.699875+0000 mgr.y (mgr.14152) 144 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:39.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- 172.21.15.49:0/829272947 >> v1:172.21.15.49:6789/0 conn(0x7fb9c8102550 legacy=0x7fb9c8104940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:02:39.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- 172.21.15.49:0/829272947 shutdown_connections 2024-03-11T22:02:39.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- 172.21.15.49:0/829272947 >> 172.21.15.49:0/829272947 conn(0x7fb9c80fbf40 msgr2=0x7fb9c80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:02:39.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- 172.21.15.49:0/829272947 shutdown_connections 2024-03-11T22:02:39.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- 172.21.15.49:0/829272947 wait complete. 2024-03-11T22:02:39.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 Processor -- start 2024-03-11T22:02:39.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- start start 2024-03-11T22:02:39.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb9c81a40d0 con 0x7fb9c8109c00 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb9c81a52d0 con 0x7fb9c8102550 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9cf181700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb9c81a64d0 con 0x7fb9c8106060 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9c7fff700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fb9c8106060 0x7fb9c819eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:46314/0 (socket says 172.21.15.49:46314) 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9c7fff700 1 -- 172.21.15.49:0/1036570022 learned_addr learned my addr 172.21.15.49:0/1036570022 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659511017 0 0) 0x7fb9c81a64d0 con 0x7fb9c8106060 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b00037f0 con 0x7fb9c8106060 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558735850 0 0) 0x7fb9c81a40d0 con 0x7fb9c8109c00 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c81a64d0 con 0x7fb9c8109c00 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.079+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172948051 0 0) 0x7fb9c81a52d0 con 0x7fb9c8102550 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c81a40d0 con 0x7fb9c8102550 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1479186918 0 0) 0x7fb9c81a64d0 con 0x7fb9c8109c00 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb9c81a52d0 con 0x7fb9c8109c00 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb9c00017e0 con 0x7fb9c8109c00 2024-03-11T22:02:39.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1911532791 0 0) 0x7fb9b00037f0 con 0x7fb9c8106060 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb9c81a64d0 con 0x7fb9c8106060 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb9bc001830 con 0x7fb9c8106060 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 981993219 0 0) 0x7fb9c81a52d0 con 0x7fb9c8109c00 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 >> v1:172.21.15.49:6790/0 conn(0x7fb9c8106060 legacy=0x7fb9c819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 >> v1:172.21.15.187:6789/0 conn(0x7fb9c8102550 legacy=0x7fb9c8101dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c81a76d0 con 0x7fb9c8109c00 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c81a42c0 con 0x7fb9c8109c00 2024-03-11T22:02:39.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c81a47c0 con 0x7fb9c8109c00 2024-03-11T22:02:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fb9c0001d10 con 0x7fb9c8109c00 2024-03-11T22:02:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb9c0004930 con 0x7fb9c8109c00 2024-03-11T22:02:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b4005150 con 0x7fb9c8109c00 2024-03-11T22:02:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 14) v1 ==== 90989+0+0 (unknown 1005286256 0 0) 0x7fb9c00036a0 con 0x7fb9c8109c00 2024-03-11T22:02:39.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.083+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 1833+0+0 (unknown 998010163 0 0) 0x7fb9c0085d80 con 0x7fb9c8109c00 2024-03-11T22:02:39.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.087+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb9c0050930 con 0x7fb9c8109c00 2024-03-11T22:02:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:02:39.307+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b4000bc0 con 0x7fb9b006e540 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[21434]: cluster 2024-03-11T22:02:38.700345+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[21434]: audit 2024-03-11T22:02:39.315657+0000 mon.a (mon.0) 334 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[21434]: audit 2024-03-11T22:02:39.321246+0000 mon.a (mon.0) 335 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[21434]: audit 2024-03-11T22:02:39.322227+0000 mon.a (mon.0) 336 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[28804]: cluster 2024-03-11T22:02:38.700345+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[28804]: audit 2024-03-11T22:02:39.315657+0000 mon.a (mon.0) 334 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[28804]: audit 2024-03-11T22:02:39.321246+0000 mon.a (mon.0) 335 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:02:40.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:39 smithi049 bash[28804]: audit 2024-03-11T22:02:39.322227+0000 mon.a (mon.0) 336 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:40.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:39 smithi187 bash[23415]: cluster 2024-03-11T22:02:38.700345+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:40.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:39 smithi187 bash[23415]: audit 2024-03-11T22:02:39.315657+0000 mon.a (mon.0) 334 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:02:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:39 smithi187 bash[23415]: audit 2024-03-11T22:02:39.321246+0000 mon.a (mon.0) 335 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:02:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:39 smithi187 bash[23415]: audit 2024-03-11T22:02:39.322227+0000 mon.a (mon.0) 336 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:02:41.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:40 smithi049 bash[21434]: audit 2024-03-11T22:02:39.311888+0000 mgr.y (mgr.14152) 146 : audit 0 from='client.14265 v1:172.21.15.49:0/1036570022' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:02:41.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:40 smithi049 bash[28804]: audit 2024-03-11T22:02:39.311888+0000 mgr.y (mgr.14152) 146 : audit 0 from='client.14265 v1:172.21.15.49:0/1036570022' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:02:41.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:40 smithi187 bash[23415]: audit 2024-03-11T22:02:39.311888+0000 mgr.y (mgr.14152) 146 : audit 0 from='client.14265 v1:172.21.15.49:0/1036570022' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:02:42.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:41 smithi049 bash[21434]: cluster 2024-03-11T22:02:40.700805+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:42.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:41 smithi049 bash[28804]: cluster 2024-03-11T22:02:40.700805+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:42.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:41 smithi187 bash[23415]: cluster 2024-03-11T22:02:40.700805+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:44.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:43 smithi049 bash[21434]: cluster 2024-03-11T22:02:42.701223+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:44.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:43 smithi049 bash[28804]: cluster 2024-03-11T22:02:42.701223+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:44.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:43 smithi187 bash[23415]: cluster 2024-03-11T22:02:42.701223+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:46.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:45 smithi049 bash[21434]: cluster 2024-03-11T22:02:44.701722+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:46.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:45 smithi049 bash[28804]: cluster 2024-03-11T22:02:44.701722+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:46.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:45 smithi187 bash[23415]: cluster 2024-03-11T22:02:44.701722+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:47 smithi187 bash[23415]: cluster 2024-03-11T22:02:46.702213+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:47 smithi187 bash[23415]: audit 2024-03-11T22:02:47.654016+0000 mon.a (mon.0) 337 : audit 1 from='client.? v1:172.21.15.49:0/1179489713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8230702-b6f3-4390-8902-24cec89cb476"}]: dispatch 2024-03-11T22:02:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:47 smithi187 bash[23415]: audit 2024-03-11T22:02:47.656248+0000 mon.a (mon.0) 338 : audit 1 from='client.? v1:172.21.15.49:0/1179489713' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8230702-b6f3-4390-8902-24cec89cb476"}]': finished 2024-03-11T22:02:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:47 smithi187 bash[23415]: cluster 2024-03-11T22:02:47.662620+0000 mon.a (mon.0) 339 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-03-11T22:02:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:47 smithi187 bash[23415]: audit 2024-03-11T22:02:47.663009+0000 mon.a (mon.0) 340 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:02:48.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[28804]: cluster 2024-03-11T22:02:46.702213+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:48.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[28804]: audit 2024-03-11T22:02:47.654016+0000 mon.a (mon.0) 337 : audit 1 from='client.? v1:172.21.15.49:0/1179489713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8230702-b6f3-4390-8902-24cec89cb476"}]: dispatch 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[28804]: audit 2024-03-11T22:02:47.656248+0000 mon.a (mon.0) 338 : audit 1 from='client.? v1:172.21.15.49:0/1179489713' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8230702-b6f3-4390-8902-24cec89cb476"}]': finished 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[28804]: cluster 2024-03-11T22:02:47.662620+0000 mon.a (mon.0) 339 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[28804]: audit 2024-03-11T22:02:47.663009+0000 mon.a (mon.0) 340 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[21434]: cluster 2024-03-11T22:02:46.702213+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[21434]: audit 2024-03-11T22:02:47.654016+0000 mon.a (mon.0) 337 : audit 1 from='client.? v1:172.21.15.49:0/1179489713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8230702-b6f3-4390-8902-24cec89cb476"}]: dispatch 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[21434]: audit 2024-03-11T22:02:47.656248+0000 mon.a (mon.0) 338 : audit 1 from='client.? v1:172.21.15.49:0/1179489713' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8230702-b6f3-4390-8902-24cec89cb476"}]': finished 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[21434]: cluster 2024-03-11T22:02:47.662620+0000 mon.a (mon.0) 339 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-03-11T22:02:48.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:47 smithi049 bash[21434]: audit 2024-03-11T22:02:47.663009+0000 mon.a (mon.0) 340 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:02:49.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:48 smithi187 bash[23415]: audit 2024-03-11T22:02:48.400570+0000 mon.c (mon.2) 6 : audit 0 from='client.? v1:172.21.15.49:0/380535298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:02:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:48 smithi049 bash[21434]: audit 2024-03-11T22:02:48.400570+0000 mon.c (mon.2) 6 : audit 0 from='client.? v1:172.21.15.49:0/380535298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:02:49.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:48 smithi049 bash[28804]: audit 2024-03-11T22:02:48.400570+0000 mon.c (mon.2) 6 : audit 0 from='client.? v1:172.21.15.49:0/380535298' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:02:50.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:49 smithi187 bash[23415]: cluster 2024-03-11T22:02:48.702717+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:50.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:49 smithi049 bash[21434]: cluster 2024-03-11T22:02:48.702717+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:50.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:49 smithi049 bash[28804]: cluster 2024-03-11T22:02:48.702717+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:52.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:51 smithi187 bash[23415]: cluster 2024-03-11T22:02:50.703231+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:52.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:51 smithi049 bash[21434]: cluster 2024-03-11T22:02:50.703231+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:52.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:51 smithi049 bash[28804]: cluster 2024-03-11T22:02:50.703231+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:54.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:53 smithi187 bash[23415]: cluster 2024-03-11T22:02:52.703779+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:54.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:53 smithi049 bash[28804]: cluster 2024-03-11T22:02:52.703779+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:54.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:53 smithi049 bash[21434]: cluster 2024-03-11T22:02:52.703779+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:56.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:55 smithi187 bash[23415]: cluster 2024-03-11T22:02:54.704363+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:56.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:55 smithi049 bash[28804]: cluster 2024-03-11T22:02:54.704363+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:56.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:55 smithi049 bash[21434]: cluster 2024-03-11T22:02:54.704363+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:58.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:57 smithi187 bash[23415]: cluster 2024-03-11T22:02:56.704687+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:58.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:57 smithi049 bash[21434]: cluster 2024-03-11T22:02:56.704687+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:02:58.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:57 smithi049 bash[28804]: cluster 2024-03-11T22:02:56.704687+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:00.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:02:59 smithi187 bash[23415]: cluster 2024-03-11T22:02:58.705157+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:00.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:02:59 smithi049 bash[21434]: cluster 2024-03-11T22:02:58.705157+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:00.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:02:59 smithi049 bash[28804]: cluster 2024-03-11T22:02:58.705157+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:01.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:00 smithi049 bash[21434]: audit 2024-03-11T22:03:00.177020+0000 mon.a (mon.0) 341 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-11T22:03:01.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:00 smithi049 bash[21434]: audit 2024-03-11T22:03:00.178204+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:01.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:00 smithi049 bash[21434]: cephadm 2024-03-11T22:03:00.179288+0000 mgr.y (mgr.14152) 157 : cephadm 1 Deploying daemon osd.2 on smithi049 2024-03-11T22:03:01.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:00 smithi049 bash[28804]: audit 2024-03-11T22:03:00.177020+0000 mon.a (mon.0) 341 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-11T22:03:01.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:00 smithi049 bash[28804]: audit 2024-03-11T22:03:00.178204+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:01.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:00 smithi049 bash[28804]: cephadm 2024-03-11T22:03:00.179288+0000 mgr.y (mgr.14152) 157 : cephadm 1 Deploying daemon osd.2 on smithi049 2024-03-11T22:03:01.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:00 smithi187 bash[23415]: audit 2024-03-11T22:03:00.177020+0000 mon.a (mon.0) 341 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-11T22:03:01.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:00 smithi187 bash[23415]: audit 2024-03-11T22:03:00.178204+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:01.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:00 smithi187 bash[23415]: cephadm 2024-03-11T22:03:00.179288+0000 mgr.y (mgr.14152) 157 : cephadm 1 Deploying daemon osd.2 on smithi049 2024-03-11T22:03:02.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:01 smithi187 bash[23415]: cluster 2024-03-11T22:03:00.705686+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:02.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:01 smithi049 bash[28804]: cluster 2024-03-11T22:03:00.705686+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:02.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:01 smithi049 bash[21434]: cluster 2024-03-11T22:03:00.705686+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:04.189 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:03 smithi049 bash[21434]: cluster 2024-03-11T22:03:02.706172+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:04.189 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:03 smithi049 bash[28804]: cluster 2024-03-11T22:03:02.706172+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:04.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:03 smithi187 bash[23415]: cluster 2024-03-11T22:03:02.706172+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:04.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.441 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.441 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.441 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.442 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.725 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.726 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.726 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:04.726 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:03:04 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[21434]: cluster 2024-03-11T22:03:04.706481+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[21434]: audit 2024-03-11T22:03:04.724091+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[21434]: audit 2024-03-11T22:03:04.728908+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[21434]: audit 2024-03-11T22:03:04.762338+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:05.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[28804]: cluster 2024-03-11T22:03:04.706481+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:05.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[28804]: audit 2024-03-11T22:03:04.724091+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:05.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[28804]: audit 2024-03-11T22:03:04.728908+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:05.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:05 smithi049 bash[28804]: audit 2024-03-11T22:03:04.762338+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:05.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:05 smithi187 bash[23415]: cluster 2024-03-11T22:03:04.706481+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:05.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:05 smithi187 bash[23415]: audit 2024-03-11T22:03:04.724091+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:05.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:05 smithi187 bash[23415]: audit 2024-03-11T22:03:04.728908+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:05.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:05 smithi187 bash[23415]: audit 2024-03-11T22:03:04.762338+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:07 smithi187 bash[23415]: cluster 2024-03-11T22:03:06.706875+0000 mgr.y (mgr.14152) 161 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:07 smithi049 bash[21434]: cluster 2024-03-11T22:03:06.706875+0000 mgr.y (mgr.14152) 161 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:07 smithi049 bash[28804]: cluster 2024-03-11T22:03:06.706875+0000 mgr.y (mgr.14152) 161 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:09.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:09 smithi187 bash[23415]: cluster 2024-03-11T22:03:08.707349+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:10.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:09 smithi049 bash[21434]: cluster 2024-03-11T22:03:08.707349+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:10.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:09 smithi049 bash[28804]: cluster 2024-03-11T22:03:08.707349+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:11.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[21434]: audit 2024-03-11T22:03:10.044315+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[21434]: audit 2024-03-11T22:03:10.050519+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[21434]: audit 2024-03-11T22:03:10.621584+0000 mon.a (mon.0) 348 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:11.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[21434]: audit 2024-03-11T22:03:10.622303+0000 mon.a (mon.0) 349 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:03:11.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[21434]: audit 2024-03-11T22:03:10.626763+0000 mon.a (mon.0) 350 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[28804]: audit 2024-03-11T22:03:10.044315+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[28804]: audit 2024-03-11T22:03:10.050519+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[28804]: audit 2024-03-11T22:03:10.621584+0000 mon.a (mon.0) 348 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:11.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[28804]: audit 2024-03-11T22:03:10.622303+0000 mon.a (mon.0) 349 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:03:11.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:11 smithi049 bash[28804]: audit 2024-03-11T22:03:10.626763+0000 mon.a (mon.0) 350 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:11 smithi187 bash[23415]: audit 2024-03-11T22:03:10.044315+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:11 smithi187 bash[23415]: audit 2024-03-11T22:03:10.050519+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:11 smithi187 bash[23415]: audit 2024-03-11T22:03:10.621584+0000 mon.a (mon.0) 348 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:11 smithi187 bash[23415]: audit 2024-03-11T22:03:10.622303+0000 mon.a (mon.0) 349 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:03:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:11 smithi187 bash[23415]: audit 2024-03-11T22:03:10.626763+0000 mon.a (mon.0) 350 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:12 smithi187 bash[23415]: cluster 2024-03-11T22:03:10.707655+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:12 smithi187 bash[23415]: audit 2024-03-11T22:03:11.056387+0000 mon.a (mon.0) 351 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-11T22:03:12.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:12 smithi049 bash[21434]: cluster 2024-03-11T22:03:10.707655+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:12.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:12 smithi049 bash[21434]: audit 2024-03-11T22:03:11.056387+0000 mon.a (mon.0) 351 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-11T22:03:12.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:12 smithi049 bash[28804]: cluster 2024-03-11T22:03:10.707655+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:12.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:12 smithi049 bash[28804]: audit 2024-03-11T22:03:11.056387+0000 mon.a (mon.0) 351 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-11T22:03:13.315 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 2 on host 'smithi049' 2024-03-11T22:03:13.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:13.315+0000 7fb9c5ffb700 1 -- 172.21.15.49:0/1036570022 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 1116251985) 0x7fb9b4000bc0 con 0x7fb9b006e540 2024-03-11T22:03:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:13.319+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 >> v1:172.21.15.49:6800/4076252288 conn(0x7fb9b006e540 legacy=0x7fb9b0070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:03:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:13.319+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 >> v1:172.21.15.49:6789/0 conn(0x7fb9c8109c00 legacy=0x7fb9c81a27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:03:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:13.319+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 shutdown_connections 2024-03-11T22:03:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:13.319+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 >> 172.21.15.49:0/1036570022 conn(0x7fb9c80fbf40 msgr2=0x7fb9c810c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:03:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:13.319+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 shutdown_connections 2024-03-11T22:03:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:13.319+0000 7fb9cf181700 1 -- 172.21.15.49:0/1036570022 wait complete. 2024-03-11T22:03:13.335 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[28804]: audit 2024-03-11T22:03:12.054982+0000 mon.a (mon.0) 352 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-11T22:03:13.336 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[28804]: cluster 2024-03-11T22:03:12.060469+0000 mon.a (mon.0) 353 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-03-11T22:03:13.336 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[28804]: audit 2024-03-11T22:03:12.061375+0000 mon.a (mon.0) 354 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:03:13.336 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[28804]: audit 2024-03-11T22:03:12.062055+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:13.336 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[21434]: audit 2024-03-11T22:03:12.054982+0000 mon.a (mon.0) 352 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-11T22:03:13.336 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[21434]: cluster 2024-03-11T22:03:12.060469+0000 mon.a (mon.0) 353 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-03-11T22:03:13.336 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[21434]: audit 2024-03-11T22:03:12.061375+0000 mon.a (mon.0) 354 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:03:13.336 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:13 smithi049 bash[21434]: audit 2024-03-11T22:03:12.062055+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:13.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:13 smithi187 bash[23415]: audit 2024-03-11T22:03:12.054982+0000 mon.a (mon.0) 352 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-11T22:03:13.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:13 smithi187 bash[23415]: cluster 2024-03-11T22:03:12.060469+0000 mon.a (mon.0) 353 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-03-11T22:03:13.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:13 smithi187 bash[23415]: audit 2024-03-11T22:03:12.061375+0000 mon.a (mon.0) 354 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:03:13.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:13 smithi187 bash[23415]: audit 2024-03-11T22:03:12.062055+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:14.020 DEBUG:teuthology.orchestra.run.smithi049:osd.2> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.2.service 2024-03-11T22:03:14.023 INFO:tasks.cephadm:Deploying osd.3 on smithi049 with /dev/vg_nvme/lv_1... 2024-03-11T22:03:14.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-11T22:03:14.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: cluster 2024-03-11T22:03:12.089275+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:03:14.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: cluster 2024-03-11T22:03:12.089403+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:03:14.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: cluster 2024-03-11T22:03:12.708027+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: audit 2024-03-11T22:03:13.063256+0000 mon.a (mon.0) 356 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: cluster 2024-03-11T22:03:13.069820+0000 mon.a (mon.0) 357 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: audit 2024-03-11T22:03:13.070759+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: audit 2024-03-11T22:03:13.078214+0000 mon.a (mon.0) 359 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: audit 2024-03-11T22:03:13.251677+0000 mon.a (mon.0) 360 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: audit 2024-03-11T22:03:13.260973+0000 mon.a (mon.0) 361 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: audit 2024-03-11T22:03:13.269149+0000 mon.a (mon.0) 362 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:14.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[21434]: audit 2024-03-11T22:03:13.384682+0000 mon.a (mon.0) 363 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: cluster 2024-03-11T22:03:12.089275+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: cluster 2024-03-11T22:03:12.089403+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: cluster 2024-03-11T22:03:12.708027+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: audit 2024-03-11T22:03:13.063256+0000 mon.a (mon.0) 356 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: cluster 2024-03-11T22:03:13.069820+0000 mon.a (mon.0) 357 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: audit 2024-03-11T22:03:13.070759+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: audit 2024-03-11T22:03:13.078214+0000 mon.a (mon.0) 359 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: audit 2024-03-11T22:03:13.251677+0000 mon.a (mon.0) 360 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: audit 2024-03-11T22:03:13.260973+0000 mon.a (mon.0) 361 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: audit 2024-03-11T22:03:13.269149+0000 mon.a (mon.0) 362 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:14.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:14 smithi049 bash[28804]: audit 2024-03-11T22:03:13.384682+0000 mon.a (mon.0) 363 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' 2024-03-11T22:03:14.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: cluster 2024-03-11T22:03:12.089275+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: cluster 2024-03-11T22:03:12.089403+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: cluster 2024-03-11T22:03:12.708027+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: audit 2024-03-11T22:03:13.063256+0000 mon.a (mon.0) 356 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: cluster 2024-03-11T22:03:13.069820+0000 mon.a (mon.0) 357 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: audit 2024-03-11T22:03:13.070759+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: audit 2024-03-11T22:03:13.078214+0000 mon.a (mon.0) 359 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: audit 2024-03-11T22:03:13.251677+0000 mon.a (mon.0) 360 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: audit 2024-03-11T22:03:13.260973+0000 mon.a (mon.0) 361 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: audit 2024-03-11T22:03:13.269149+0000 mon.a (mon.0) 362 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:14 smithi187 bash[23415]: audit 2024-03-11T22:03:13.384682+0000 mon.a (mon.0) 363 : audit 1 from='osd.2 v1:172.21.15.49:6809/535303154' entity='osd.2' 2024-03-11T22:03:15.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:15 smithi187 bash[23415]: audit 2024-03-11T22:03:14.076037+0000 mon.a (mon.0) 364 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:15.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:15 smithi187 bash[23415]: cluster 2024-03-11T22:03:14.391369+0000 mon.a (mon.0) 365 : cluster 1 osd.2 v1:172.21.15.49:6809/535303154 boot 2024-03-11T22:03:15.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:15 smithi187 bash[23415]: cluster 2024-03-11T22:03:14.391464+0000 mon.a (mon.0) 366 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-03-11T22:03:15.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:15 smithi187 bash[23415]: audit 2024-03-11T22:03:14.391996+0000 mon.a (mon.0) 367 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:15.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[21434]: audit 2024-03-11T22:03:14.076037+0000 mon.a (mon.0) 364 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:15.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[21434]: cluster 2024-03-11T22:03:14.391369+0000 mon.a (mon.0) 365 : cluster 1 osd.2 v1:172.21.15.49:6809/535303154 boot 2024-03-11T22:03:15.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[21434]: cluster 2024-03-11T22:03:14.391464+0000 mon.a (mon.0) 366 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-03-11T22:03:15.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[21434]: audit 2024-03-11T22:03:14.391996+0000 mon.a (mon.0) 367 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:15.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[28804]: audit 2024-03-11T22:03:14.076037+0000 mon.a (mon.0) 364 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:15.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[28804]: cluster 2024-03-11T22:03:14.391369+0000 mon.a (mon.0) 365 : cluster 1 osd.2 v1:172.21.15.49:6809/535303154 boot 2024-03-11T22:03:15.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[28804]: cluster 2024-03-11T22:03:14.391464+0000 mon.a (mon.0) 366 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-03-11T22:03:15.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:15 smithi049 bash[28804]: audit 2024-03-11T22:03:14.391996+0000 mon.a (mon.0) 367 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:03:16.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:16 smithi187 bash[23415]: cluster 2024-03-11T22:03:14.708472+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:16.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:16 smithi187 bash[23415]: audit 2024-03-11T22:03:14.848286+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:03:16.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:16 smithi187 bash[23415]: audit 2024-03-11T22:03:15.392409+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-11T22:03:16.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:16 smithi187 bash[23415]: cluster 2024-03-11T22:03:15.398967+0000 mon.a (mon.0) 370 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-03-11T22:03:16.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:16 smithi187 bash[23415]: audit 2024-03-11T22:03:15.401335+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[21434]: cluster 2024-03-11T22:03:14.708472+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[21434]: audit 2024-03-11T22:03:14.848286+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[21434]: audit 2024-03-11T22:03:15.392409+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[21434]: cluster 2024-03-11T22:03:15.398967+0000 mon.a (mon.0) 370 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[21434]: audit 2024-03-11T22:03:15.401335+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[28804]: cluster 2024-03-11T22:03:14.708472+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[28804]: audit 2024-03-11T22:03:14.848286+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:03:16.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[28804]: audit 2024-03-11T22:03:15.392409+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-11T22:03:16.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[28804]: cluster 2024-03-11T22:03:15.398967+0000 mon.a (mon.0) 370 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-03-11T22:03:16.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:16 smithi049 bash[28804]: audit 2024-03-11T22:03:15.401335+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:03:17.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:17 smithi187 bash[23415]: audit 2024-03-11T22:03:16.394464+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-11T22:03:17.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:17 smithi187 bash[23415]: cluster 2024-03-11T22:03:16.399680+0000 mon.a (mon.0) 373 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-03-11T22:03:17.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:17 smithi187 bash[23415]: cluster 2024-03-11T22:03:16.708848+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v135: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:17 smithi049 bash[21434]: audit 2024-03-11T22:03:16.394464+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-11T22:03:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:17 smithi049 bash[21434]: cluster 2024-03-11T22:03:16.399680+0000 mon.a (mon.0) 373 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-03-11T22:03:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:17 smithi049 bash[21434]: cluster 2024-03-11T22:03:16.708848+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v135: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:17 smithi049 bash[28804]: audit 2024-03-11T22:03:16.394464+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-11T22:03:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:17 smithi049 bash[28804]: cluster 2024-03-11T22:03:16.399680+0000 mon.a (mon.0) 373 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-03-11T22:03:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:17 smithi049 bash[28804]: cluster 2024-03-11T22:03:16.708848+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v135: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:03:18.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:18 smithi187 bash[23415]: cluster 2024-03-11T22:03:17.410114+0000 mon.a (mon.0) 374 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-03-11T22:03:18.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:18 smithi187 bash[23415]: audit 2024-03-11T22:03:17.726164+0000 mon.a (mon.0) 375 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:18 smithi049 bash[28804]: cluster 2024-03-11T22:03:17.410114+0000 mon.a (mon.0) 374 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-03-11T22:03:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:18 smithi049 bash[28804]: audit 2024-03-11T22:03:17.726164+0000 mon.a (mon.0) 375 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:18 smithi049 bash[21434]: cluster 2024-03-11T22:03:17.410114+0000 mon.a (mon.0) 374 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-03-11T22:03:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:18 smithi049 bash[21434]: audit 2024-03-11T22:03:17.726164+0000 mon.a (mon.0) 375 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:19.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:19 smithi049 bash[21434]: cluster 2024-03-11T22:03:18.709272+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:19.665 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:19 smithi049 bash[28804]: cluster 2024-03-11T22:03:18.709272+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:19.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:19 smithi187 bash[23415]: cluster 2024-03-11T22:03:18.709272+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[21434]: cluster 2024-03-11T22:03:19.425010+0000 mon.a (mon.0) 376 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-03-11T22:03:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[21434]: audit 2024-03-11T22:03:19.590585+0000 mon.a (mon.0) 377 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[21434]: audit 2024-03-11T22:03:19.590740+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[21434]: audit 2024-03-11T22:03:19.590918+0000 mon.a (mon.0) 379 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[21434]: audit 2024-03-11T22:03:19.590992+0000 mon.a (mon.0) 380 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:20.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[28804]: cluster 2024-03-11T22:03:19.425010+0000 mon.a (mon.0) 376 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-03-11T22:03:20.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[28804]: audit 2024-03-11T22:03:19.590585+0000 mon.a (mon.0) 377 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:20.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[28804]: audit 2024-03-11T22:03:19.590740+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:20.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[28804]: audit 2024-03-11T22:03:19.590918+0000 mon.a (mon.0) 379 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:20.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:20 smithi049 bash[28804]: audit 2024-03-11T22:03:19.590992+0000 mon.a (mon.0) 380 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:20.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:20 smithi187 bash[23415]: cluster 2024-03-11T22:03:19.425010+0000 mon.a (mon.0) 376 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-03-11T22:03:20.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:20 smithi187 bash[23415]: audit 2024-03-11T22:03:19.590585+0000 mon.a (mon.0) 377 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:20.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:20 smithi187 bash[23415]: audit 2024-03-11T22:03:19.590740+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:20.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:20 smithi187 bash[23415]: audit 2024-03-11T22:03:19.590918+0000 mon.a (mon.0) 379 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:20.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:20 smithi187 bash[23415]: audit 2024-03-11T22:03:19.590992+0000 mon.a (mon.0) 380 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:20.529824+0000 mon.a (mon.0) 381 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:20.538416+0000 mon.a (mon.0) 382 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:20.538954+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:20.539298+0000 mon.b (mon.1) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:20.539492+0000 mon.a (mon.0) 384 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: cluster 2024-03-11T22:03:20.709919+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:21.451113+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:21.505574+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:21.508640+0000 mon.a (mon.0) 386 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:21.509080+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:22.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[21434]: audit 2024-03-11T22:03:21.509499+0000 mon.a (mon.0) 388 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:20.529824+0000 mon.a (mon.0) 381 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:20.538416+0000 mon.a (mon.0) 382 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:20.538954+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:20.539298+0000 mon.b (mon.1) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:20.539492+0000 mon.a (mon.0) 384 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: cluster 2024-03-11T22:03:20.709919+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:21.451113+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:21.505574+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:21.508640+0000 mon.a (mon.0) 386 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:21.509080+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:22.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:22 smithi049 bash[28804]: audit 2024-03-11T22:03:21.509499+0000 mon.a (mon.0) 388 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:22.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:20.529824+0000 mon.a (mon.0) 381 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:22.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:20.538416+0000 mon.a (mon.0) 382 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:22.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:20.538954+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:20.539298+0000 mon.b (mon.1) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:20.539492+0000 mon.a (mon.0) 384 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: cluster 2024-03-11T22:03:20.709919+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:21.451113+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:21.505574+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:21.508640+0000 mon.a (mon.0) 386 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:21.509080+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:03:22.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:22 smithi187 bash[23415]: audit 2024-03-11T22:03:21.509499+0000 mon.a (mon.0) 388 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:03:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-11T22:03:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-11T22:03:22.923 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-03-11T22:03:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-03-11T22:03:22.923 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00974336 s, 1.1 GB/s 2024-03-11T22:03:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-03-11T22:03:23.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:23 smithi187 bash[23415]: audit 2024-03-11T22:03:21.509126+0000 mon.c (mon.2) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:23.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:23 smithi187 bash[23415]: audit 2024-03-11T22:03:22.456527+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:23.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:23 smithi187 bash[23415]: cluster 2024-03-11T22:03:22.710423+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:23.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:23 smithi049 bash[28804]: audit 2024-03-11T22:03:21.509126+0000 mon.c (mon.2) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:23.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:23 smithi049 bash[28804]: audit 2024-03-11T22:03:22.456527+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:23.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:23 smithi049 bash[28804]: cluster 2024-03-11T22:03:22.710423+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:23 smithi049 bash[21434]: audit 2024-03-11T22:03:21.509126+0000 mon.c (mon.2) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-11T22:03:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:23 smithi049 bash[21434]: audit 2024-03-11T22:03:22.456527+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-11T22:03:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:23 smithi049 bash[21434]: cluster 2024-03-11T22:03:22.710423+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:24.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_1 2024-03-11T22:03:25.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: cephadm 2024-03-11T22:03:24.291672+0000 mgr.y (mgr.14152) 170 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:03:25.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.300729+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.310202+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.312361+0000 mon.a (mon.0) 391 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.313668+0000 mon.a (mon.0) 392 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.314877+0000 mon.a (mon.0) 393 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.322024+0000 mon.a (mon.0) 394 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.326447+0000 mon.a (mon.0) 395 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.327900+0000 mon.a (mon.0) 396 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:03:25.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:25 smithi187 bash[23415]: audit 2024-03-11T22:03:24.338702+0000 mon.a (mon.0) 397 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: cephadm 2024-03-11T22:03:24.291672+0000 mgr.y (mgr.14152) 170 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:03:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.300729+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.310202+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.312361+0000 mon.a (mon.0) 391 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.313668+0000 mon.a (mon.0) 392 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.314877+0000 mon.a (mon.0) 393 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.322024+0000 mon.a (mon.0) 394 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.326447+0000 mon.a (mon.0) 395 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.327900+0000 mon.a (mon.0) 396 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[21434]: audit 2024-03-11T22:03:24.338702+0000 mon.a (mon.0) 397 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: cephadm 2024-03-11T22:03:24.291672+0000 mgr.y (mgr.14152) 170 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.300729+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.310202+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.312361+0000 mon.a (mon.0) 391 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.313668+0000 mon.a (mon.0) 392 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.314877+0000 mon.a (mon.0) 393 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:03:25.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.322024+0000 mon.a (mon.0) 394 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:25.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.326447+0000 mon.a (mon.0) 395 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:25.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.327900+0000 mon.a (mon.0) 396 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:03:25.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:25 smithi049 bash[28804]: audit 2024-03-11T22:03:24.338702+0000 mon.a (mon.0) 397 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:26.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:26 smithi187 bash[23415]: cephadm 2024-03-11T22:03:24.315881+0000 mgr.y (mgr.14152) 171 : cephadm 1 Adjusting osd_memory_target on smithi049 to 5413M 2024-03-11T22:03:26.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:26 smithi187 bash[23415]: cluster 2024-03-11T22:03:24.711016+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-03-11T22:03:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:26 smithi049 bash[21434]: cephadm 2024-03-11T22:03:24.315881+0000 mgr.y (mgr.14152) 171 : cephadm 1 Adjusting osd_memory_target on smithi049 to 5413M 2024-03-11T22:03:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:26 smithi049 bash[21434]: cluster 2024-03-11T22:03:24.711016+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-03-11T22:03:26.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:26 smithi049 bash[28804]: cephadm 2024-03-11T22:03:24.315881+0000 mgr.y (mgr.14152) 171 : cephadm 1 Adjusting osd_memory_target on smithi049 to 5413M 2024-03-11T22:03:26.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:26 smithi049 bash[28804]: cluster 2024-03-11T22:03:24.711016+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-03-11T22:03:28.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:28 smithi187 bash[23415]: cluster 2024-03-11T22:03:26.711594+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-11T22:03:28.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:28 smithi049 bash[21434]: cluster 2024-03-11T22:03:26.711594+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-11T22:03:28.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:28 smithi049 bash[28804]: cluster 2024-03-11T22:03:26.711594+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-11T22:03:28.927 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:03:29.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:29 smithi187 bash[23415]: cluster 2024-03-11T22:03:28.712155+0000 mgr.y (mgr.14152) 174 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-11T22:03:29.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:29 smithi049 bash[21434]: cluster 2024-03-11T22:03:28.712155+0000 mgr.y (mgr.14152) 174 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-11T22:03:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:29 smithi049 bash[28804]: cluster 2024-03-11T22:03:28.712155+0000 mgr.y (mgr.14152) 174 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-11T22:03:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.515+0000 7f5e1f48a700 1 -- 172.21.15.49:0/3294958698 >> v1:172.21.15.49:6789/0 conn(0x7f5e18104d90 legacy=0x7f5e181071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:03:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.515+0000 7f5e1f48a700 1 -- 172.21.15.49:0/3294958698 shutdown_connections 2024-03-11T22:03:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.515+0000 7f5e1f48a700 1 -- 172.21.15.49:0/3294958698 >> 172.21.15.49:0/3294958698 conn(0x7f5e180fbf00 msgr2=0x7f5e180fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:03:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.515+0000 7f5e1f48a700 1 -- 172.21.15.49:0/3294958698 shutdown_connections 2024-03-11T22:03:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.515+0000 7f5e1f48a700 1 -- 172.21.15.49:0/3294958698 wait complete. 2024-03-11T22:03:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.515+0000 7f5e1f48a700 1 Processor -- start 2024-03-11T22:03:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.515+0000 7f5e1f48a700 1 -- start start 2024-03-11T22:03:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1f48a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5e1806a4b0 con 0x7f5e18104d90 2024-03-11T22:03:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1f48a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5e181a2f10 con 0x7f5e18108ad0 2024-03-11T22:03:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1f48a700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5e181a40b0 con 0x7f5e18100960 2024-03-11T22:03:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1d226700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f5e18100960 0x7f5e18199980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:33076/0 (socket says 172.21.15.49:33076) 2024-03-11T22:03:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1d226700 1 -- 172.21.15.49:0/761929823 learned_addr learned my addr 172.21.15.49:0/761929823 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:03:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1ca25700 1 --1- 172.21.15.49:0/761929823 >> v1:172.21.15.49:6789/0 conn(0x7f5e18104d90 0x7f5e1819d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33482/0 (socket says 172.21.15.49:33482) 2024-03-11T22:03:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199389477 0 0) 0x7f5e181a40b0 con 0x7f5e18100960 2024-03-11T22:03:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e00005070 con 0x7f5e18100960 2024-03-11T22:03:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783927783 0 0) 0x7f5e1806a4b0 con 0x7f5e18104d90 2024-03-11T22:03:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e181a40b0 con 0x7f5e18104d90 2024-03-11T22:03:31.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1610097006 0 0) 0x7f5e00005070 con 0x7f5e18100960 2024-03-11T22:03:31.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e1806a4b0 con 0x7f5e18100960 2024-03-11T22:03:31.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f5e10001ca0 con 0x7f5e18100960 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 978773799 0 0) 0x7f5e181a40b0 con 0x7f5e18104d90 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e00005070 con 0x7f5e18104d90 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363780998 0 0) 0x7f5e181a2f10 con 0x7f5e18108ad0 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e181a40b0 con 0x7f5e18108ad0 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f5e0c004510 con 0x7f5e18104d90 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2298180895 0 0) 0x7f5e1806a4b0 con 0x7f5e18100960 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 >> v1:172.21.15.187:6789/0 conn(0x7f5e18108ad0 legacy=0x7f5e181a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 >> v1:172.21.15.49:6789/0 conn(0x7f5e18104d90 legacy=0x7f5e1819d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e181a52b0 con 0x7f5e18100960 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1f48a700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e181a4240 con 0x7f5e18100960 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e1f48a700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e181a4740 con 0x7f5e18100960 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f5e10003e90 con 0x7f5e18100960 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f5e10005f40 con 0x7f5e18100960 2024-03-11T22:03:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df8005120 con 0x7f5e18100960 2024-03-11T22:03:31.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f5e10003a00 con 0x7f5e18100960 2024-03-11T22:03:31.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.519+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(21..21 src has 1..21) v4 ==== 2511+0+0 (unknown 569980158 0 0) 0x7f5e10087890 con 0x7f5e18100960 2024-03-11T22:03:31.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.527+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f5e100520c0 con 0x7f5e18100960 2024-03-11T22:03:31.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:03:31.751+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5df8000b90 con 0x7f5e0006e4c0 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[21434]: cluster 2024-03-11T22:03:30.712846+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[21434]: audit 2024-03-11T22:03:31.759563+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[21434]: audit 2024-03-11T22:03:31.762649+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[21434]: audit 2024-03-11T22:03:31.764037+0000 mon.a (mon.0) 400 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[28804]: cluster 2024-03-11T22:03:30.712846+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[28804]: audit 2024-03-11T22:03:31.759563+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[28804]: audit 2024-03-11T22:03:31.762649+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:03:32.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:31 smithi049 bash[28804]: audit 2024-03-11T22:03:31.764037+0000 mon.a (mon.0) 400 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:31 smithi187 bash[23415]: cluster 2024-03-11T22:03:30.712846+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-11T22:03:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:31 smithi187 bash[23415]: audit 2024-03-11T22:03:31.759563+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:03:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:31 smithi187 bash[23415]: audit 2024-03-11T22:03:31.762649+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:03:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:31 smithi187 bash[23415]: audit 2024-03-11T22:03:31.764037+0000 mon.a (mon.0) 400 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:33.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:32 smithi049 bash[21434]: audit 2024-03-11T22:03:31.756754+0000 mgr.y (mgr.14152) 176 : audit 0 from='client.24206 v1:172.21.15.49:0/761929823' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:03:33.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:32 smithi049 bash[28804]: audit 2024-03-11T22:03:31.756754+0000 mgr.y (mgr.14152) 176 : audit 0 from='client.24206 v1:172.21.15.49:0/761929823' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:03:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:32 smithi187 bash[23415]: audit 2024-03-11T22:03:31.756754+0000 mgr.y (mgr.14152) 176 : audit 0 from='client.24206 v1:172.21.15.49:0/761929823' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:03:34.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:33 smithi049 bash[21434]: cluster 2024-03-11T22:03:32.713454+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-11T22:03:34.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:33 smithi049 bash[28804]: cluster 2024-03-11T22:03:32.713454+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-11T22:03:34.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:33 smithi187 bash[23415]: cluster 2024-03-11T22:03:32.713454+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-11T22:03:36.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:35 smithi187 bash[23415]: cluster 2024-03-11T22:03:34.713872+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-11T22:03:36.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:35 smithi049 bash[21434]: cluster 2024-03-11T22:03:34.713872+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-11T22:03:36.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:35 smithi049 bash[28804]: cluster 2024-03-11T22:03:34.713872+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-11T22:03:37.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:37 smithi049 bash[21434]: cluster 2024-03-11T22:03:36.714392+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:37.962 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:37 smithi049 bash[28804]: cluster 2024-03-11T22:03:36.714392+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:38.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:37 smithi187 bash[23415]: cluster 2024-03-11T22:03:36.714392+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:40.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:39 smithi187 bash[23415]: cluster 2024-03-11T22:03:38.714967+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:40.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:39 smithi049 bash[28804]: cluster 2024-03-11T22:03:38.714967+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:40.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:39 smithi049 bash[21434]: cluster 2024-03-11T22:03:38.714967+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:41.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:40 smithi187 bash[23415]: audit 2024-03-11T22:03:40.176347+0000 mon.c (mon.2) 9 : audit 1 from='client.? v1:172.21.15.49:0/391739140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]: dispatch 2024-03-11T22:03:41.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:40 smithi187 bash[23415]: audit 2024-03-11T22:03:40.176888+0000 mon.a (mon.0) 401 : audit 1 from='client.24212 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]: dispatch 2024-03-11T22:03:41.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:40 smithi187 bash[23415]: audit 2024-03-11T22:03:40.180002+0000 mon.a (mon.0) 402 : audit 1 from='client.24212 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]': finished 2024-03-11T22:03:41.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:40 smithi187 bash[23415]: cluster 2024-03-11T22:03:40.183279+0000 mon.a (mon.0) 403 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-03-11T22:03:41.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:40 smithi187 bash[23415]: audit 2024-03-11T22:03:40.183560+0000 mon.a (mon.0) 404 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:03:41.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[21434]: audit 2024-03-11T22:03:40.176347+0000 mon.c (mon.2) 9 : audit 1 from='client.? v1:172.21.15.49:0/391739140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]: dispatch 2024-03-11T22:03:41.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[21434]: audit 2024-03-11T22:03:40.176888+0000 mon.a (mon.0) 401 : audit 1 from='client.24212 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]: dispatch 2024-03-11T22:03:41.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[21434]: audit 2024-03-11T22:03:40.180002+0000 mon.a (mon.0) 402 : audit 1 from='client.24212 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]': finished 2024-03-11T22:03:41.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[21434]: cluster 2024-03-11T22:03:40.183279+0000 mon.a (mon.0) 403 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-03-11T22:03:41.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[21434]: audit 2024-03-11T22:03:40.183560+0000 mon.a (mon.0) 404 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:03:41.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[28804]: audit 2024-03-11T22:03:40.176347+0000 mon.c (mon.2) 9 : audit 1 from='client.? v1:172.21.15.49:0/391739140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]: dispatch 2024-03-11T22:03:41.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[28804]: audit 2024-03-11T22:03:40.176888+0000 mon.a (mon.0) 401 : audit 1 from='client.24212 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]: dispatch 2024-03-11T22:03:41.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[28804]: audit 2024-03-11T22:03:40.180002+0000 mon.a (mon.0) 402 : audit 1 from='client.24212 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "046c12b6-90f4-4c80-9d33-b644551e6649"}]': finished 2024-03-11T22:03:41.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[28804]: cluster 2024-03-11T22:03:40.183279+0000 mon.a (mon.0) 403 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-03-11T22:03:41.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:40 smithi049 bash[28804]: audit 2024-03-11T22:03:40.183560+0000 mon.a (mon.0) 404 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:03:42.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:41 smithi187 bash[23415]: cluster 2024-03-11T22:03:40.715347+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:42.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:41 smithi187 bash[23415]: audit 2024-03-11T22:03:40.924352+0000 mon.c (mon.2) 10 : audit 0 from='client.? v1:172.21.15.49:0/249496054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:03:42.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:41 smithi049 bash[21434]: cluster 2024-03-11T22:03:40.715347+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:42.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:41 smithi049 bash[21434]: audit 2024-03-11T22:03:40.924352+0000 mon.c (mon.2) 10 : audit 0 from='client.? v1:172.21.15.49:0/249496054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:03:42.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:41 smithi049 bash[28804]: cluster 2024-03-11T22:03:40.715347+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:42.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:41 smithi049 bash[28804]: audit 2024-03-11T22:03:40.924352+0000 mon.c (mon.2) 10 : audit 0 from='client.? v1:172.21.15.49:0/249496054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:03:44.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:43 smithi187 bash[23415]: cluster 2024-03-11T22:03:42.715846+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:44.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:43 smithi049 bash[21434]: cluster 2024-03-11T22:03:42.715846+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:44.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:43 smithi049 bash[28804]: cluster 2024-03-11T22:03:42.715846+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:46.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:45 smithi187 bash[23415]: cluster 2024-03-11T22:03:44.716443+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:46.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:45 smithi049 bash[21434]: cluster 2024-03-11T22:03:44.716443+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:46.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:45 smithi049 bash[28804]: cluster 2024-03-11T22:03:44.716443+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:47 smithi187 bash[23415]: cluster 2024-03-11T22:03:46.716961+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:48.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:47 smithi049 bash[21434]: cluster 2024-03-11T22:03:46.716961+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:48.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:47 smithi049 bash[28804]: cluster 2024-03-11T22:03:46.716961+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:50.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:49 smithi049 bash[21434]: cluster 2024-03-11T22:03:48.717404+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:50.066 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:49 smithi049 bash[28804]: cluster 2024-03-11T22:03:48.717404+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:50.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:49 smithi187 bash[23415]: cluster 2024-03-11T22:03:48.717404+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:52.193 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:51 smithi049 bash[21434]: cluster 2024-03-11T22:03:50.717896+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:52.193 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:51 smithi049 bash[28804]: cluster 2024-03-11T22:03:50.717896+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:52.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:51 smithi187 bash[23415]: cluster 2024-03-11T22:03:50.717896+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:53.123 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:52 smithi049 bash[21434]: audit 2024-03-11T22:03:52.689997+0000 mon.a (mon.0) 405 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-11T22:03:53.123 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:52 smithi049 bash[21434]: audit 2024-03-11T22:03:52.691604+0000 mon.a (mon.0) 406 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:53.124 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:52 smithi049 bash[28804]: audit 2024-03-11T22:03:52.689997+0000 mon.a (mon.0) 405 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-11T22:03:53.124 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:52 smithi049 bash[28804]: audit 2024-03-11T22:03:52.691604+0000 mon.a (mon.0) 406 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:53.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:52 smithi187 bash[23415]: audit 2024-03-11T22:03:52.689997+0000 mon.a (mon.0) 405 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-11T22:03:53.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:52 smithi187 bash[23415]: audit 2024-03-11T22:03:52.691604+0000 mon.a (mon.0) 406 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:03:54.105 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:53 smithi049 bash[21434]: cephadm 2024-03-11T22:03:52.692980+0000 mgr.y (mgr.14152) 187 : cephadm 1 Deploying daemon osd.3 on smithi049 2024-03-11T22:03:54.105 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:53 smithi049 bash[21434]: cluster 2024-03-11T22:03:52.718294+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:54.106 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:53 smithi049 bash[28804]: cephadm 2024-03-11T22:03:52.692980+0000 mgr.y (mgr.14152) 187 : cephadm 1 Deploying daemon osd.3 on smithi049 2024-03-11T22:03:54.106 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:53 smithi049 bash[28804]: cluster 2024-03-11T22:03:52.718294+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:54.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:53 smithi187 bash[23415]: cephadm 2024-03-11T22:03:52.692980+0000 mgr.y (mgr.14152) 187 : cephadm 1 Deploying daemon osd.3 on smithi049 2024-03-11T22:03:54.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:53 smithi187 bash[23415]: cluster 2024-03-11T22:03:52.718294+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:56.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:55 smithi049 bash[21434]: cluster 2024-03-11T22:03:54.718770+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:56.076 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:55 smithi049 bash[28804]: cluster 2024-03-11T22:03:54.718770+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:56.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:55 smithi187 bash[23415]: cluster 2024-03-11T22:03:54.718770+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:56.990 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:03:56 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:56.990 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:56 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:56.991 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:03:56 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:56.991 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:56 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:56.991 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:03:56 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:56.991 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:03:56 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:57.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:57 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:57.273 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:03:57 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:57.274 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:03:57 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:57.274 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:03:57 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:57.274 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:03:57 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:57.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:57 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:03:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[21434]: cluster 2024-03-11T22:03:56.719376+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[21434]: audit 2024-03-11T22:03:57.271579+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[21434]: audit 2024-03-11T22:03:57.277268+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[21434]: audit 2024-03-11T22:03:57.309057+0000 mon.a (mon.0) 409 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:58.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[28804]: cluster 2024-03-11T22:03:56.719376+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:58.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[28804]: audit 2024-03-11T22:03:57.271579+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:58.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[28804]: audit 2024-03-11T22:03:57.277268+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:58.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:03:58 smithi049 bash[28804]: audit 2024-03-11T22:03:57.309057+0000 mon.a (mon.0) 409 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:03:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:58 smithi187 bash[23415]: cluster 2024-03-11T22:03:56.719376+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:03:58.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:58 smithi187 bash[23415]: audit 2024-03-11T22:03:57.271579+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:58.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:58 smithi187 bash[23415]: audit 2024-03-11T22:03:57.277268+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:03:58.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:03:58 smithi187 bash[23415]: audit 2024-03-11T22:03:57.309057+0000 mon.a (mon.0) 409 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:00.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:00 smithi049 bash[28804]: cluster 2024-03-11T22:03:58.719780+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:00.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:00 smithi049 bash[21434]: cluster 2024-03-11T22:03:58.719780+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:00.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:00 smithi187 bash[23415]: cluster 2024-03-11T22:03:58.719780+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:02.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:02 smithi049 bash[21434]: cluster 2024-03-11T22:04:00.720141+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:02.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:02 smithi049 bash[28804]: cluster 2024-03-11T22:04:00.720141+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:02.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:02 smithi187 bash[23415]: cluster 2024-03-11T22:04:00.720141+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:03.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[21434]: audit 2024-03-11T22:04:02.653986+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[21434]: audit 2024-03-11T22:04:02.659919+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[21434]: audit 2024-03-11T22:04:02.661171+0000 mon.a (mon.0) 412 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[21434]: audit 2024-03-11T22:04:02.662158+0000 mon.a (mon.0) 413 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[21434]: audit 2024-03-11T22:04:02.668054+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[21434]: cluster 2024-03-11T22:04:02.720434+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[28804]: audit 2024-03-11T22:04:02.653986+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[28804]: audit 2024-03-11T22:04:02.659919+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[28804]: audit 2024-03-11T22:04:02.661171+0000 mon.a (mon.0) 412 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[28804]: audit 2024-03-11T22:04:02.662158+0000 mon.a (mon.0) 413 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[28804]: audit 2024-03-11T22:04:02.668054+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:03 smithi049 bash[28804]: cluster 2024-03-11T22:04:02.720434+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:03.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:03 smithi187 bash[23415]: audit 2024-03-11T22:04:02.653986+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:03 smithi187 bash[23415]: audit 2024-03-11T22:04:02.659919+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:03 smithi187 bash[23415]: audit 2024-03-11T22:04:02.661171+0000 mon.a (mon.0) 412 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:03.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:03 smithi187 bash[23415]: audit 2024-03-11T22:04:02.662158+0000 mon.a (mon.0) 413 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:03.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:03 smithi187 bash[23415]: audit 2024-03-11T22:04:02.668054+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:03.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:03 smithi187 bash[23415]: cluster 2024-03-11T22:04:02.720434+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:04.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:04 smithi187 bash[23415]: audit 2024-03-11T22:04:03.757658+0000 mon.a (mon.0) 415 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-11T22:04:05.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:04 smithi049 bash[21434]: audit 2024-03-11T22:04:03.757658+0000 mon.a (mon.0) 415 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-11T22:04:05.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:04 smithi049 bash[28804]: audit 2024-03-11T22:04:03.757658+0000 mon.a (mon.0) 415 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-11T22:04:05.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:05 smithi187 bash[23415]: audit 2024-03-11T22:04:04.677187+0000 mon.a (mon.0) 416 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-11T22:04:05.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:05 smithi187 bash[23415]: cluster 2024-03-11T22:04:04.682777+0000 mon.a (mon.0) 417 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-03-11T22:04:05.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:05 smithi187 bash[23415]: audit 2024-03-11T22:04:04.683317+0000 mon.a (mon.0) 418 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:04:05.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:05 smithi187 bash[23415]: audit 2024-03-11T22:04:04.684183+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:05.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:05 smithi187 bash[23415]: cluster 2024-03-11T22:04:04.720755+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[21434]: audit 2024-03-11T22:04:04.677187+0000 mon.a (mon.0) 416 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[21434]: cluster 2024-03-11T22:04:04.682777+0000 mon.a (mon.0) 417 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[21434]: audit 2024-03-11T22:04:04.683317+0000 mon.a (mon.0) 418 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[21434]: audit 2024-03-11T22:04:04.684183+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[21434]: cluster 2024-03-11T22:04:04.720755+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[28804]: audit 2024-03-11T22:04:04.677187+0000 mon.a (mon.0) 416 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[28804]: cluster 2024-03-11T22:04:04.682777+0000 mon.a (mon.0) 417 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[28804]: audit 2024-03-11T22:04:04.683317+0000 mon.a (mon.0) 418 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[28804]: audit 2024-03-11T22:04:04.684183+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.007 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:05 smithi049 bash[28804]: cluster 2024-03-11T22:04:04.720755+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:04:06.266+0000 7f5e167fc700 1 -- 172.21.15.49:0/761929823 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 513624549) 0x7f5df8000b90 con 0x7f5e0006e4c0 2024-03-11T22:04:06.264 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 3 on host 'smithi049' 2024-03-11T22:04:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:04:06.270+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 >> v1:172.21.15.49:6800/4076252288 conn(0x7f5e0006e4c0 legacy=0x7f5e00070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:04:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:04:06.270+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 >> v1:172.21.15.49:6790/0 conn(0x7f5e18100960 legacy=0x7f5e18199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:04:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:04:06.270+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 shutdown_connections 2024-03-11T22:04:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:04:06.270+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 >> 172.21.15.49:0/761929823 conn(0x7f5e180fbf00 msgr2=0x7f5e181071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:04:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:04:06.270+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 shutdown_connections 2024-03-11T22:04:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:04:06.270+0000 7f5dfffff700 1 -- 172.21.15.49:0/761929823 wait complete. 2024-03-11T22:04:06.911 DEBUG:teuthology.orchestra.run.smithi049:osd.3> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.3.service 2024-03-11T22:04:06.914 INFO:tasks.cephadm:Deploying osd.4 on smithi187 with /dev/vg_nvme/lv_4... 2024-03-11T22:04:06.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-11T22:04:06.950 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: audit 2024-03-11T22:04:05.685236+0000 mon.a (mon.0) 420 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: cluster 2024-03-11T22:04:05.693832+0000 mon.a (mon.0) 421 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: audit 2024-03-11T22:04:05.695835+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: audit 2024-03-11T22:04:05.702486+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: audit 2024-03-11T22:04:06.019186+0000 mon.a (mon.0) 424 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: audit 2024-03-11T22:04:06.246565+0000 mon.a (mon.0) 425 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: audit 2024-03-11T22:04:06.256899+0000 mon.a (mon.0) 426 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[21434]: audit 2024-03-11T22:04:06.260023+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: audit 2024-03-11T22:04:05.685236+0000 mon.a (mon.0) 420 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: cluster 2024-03-11T22:04:05.693832+0000 mon.a (mon.0) 421 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-03-11T22:04:06.951 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: audit 2024-03-11T22:04:05.695835+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.952 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: audit 2024-03-11T22:04:05.702486+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.952 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: audit 2024-03-11T22:04:06.019186+0000 mon.a (mon.0) 424 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' 2024-03-11T22:04:06.952 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: audit 2024-03-11T22:04:06.246565+0000 mon.a (mon.0) 425 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:06.952 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: audit 2024-03-11T22:04:06.256899+0000 mon.a (mon.0) 426 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:06.952 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:06 smithi049 bash[28804]: audit 2024-03-11T22:04:06.260023+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: audit 2024-03-11T22:04:05.685236+0000 mon.a (mon.0) 420 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: cluster 2024-03-11T22:04:05.693832+0000 mon.a (mon.0) 421 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: audit 2024-03-11T22:04:05.695835+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: audit 2024-03-11T22:04:05.702486+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: audit 2024-03-11T22:04:06.019186+0000 mon.a (mon.0) 424 : audit 1 from='osd.3 v1:172.21.15.49:6813/4161800259' entity='osd.3' 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: audit 2024-03-11T22:04:06.246565+0000 mon.a (mon.0) 425 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: audit 2024-03-11T22:04:06.256899+0000 mon.a (mon.0) 426 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:06.964 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:06 smithi187 bash[23415]: audit 2024-03-11T22:04:06.260023+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:07 smithi187 bash[23415]: cluster 2024-03-11T22:04:04.714255+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:04:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:07 smithi187 bash[23415]: cluster 2024-03-11T22:04:04.714419+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:04:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:07 smithi187 bash[23415]: audit 2024-03-11T22:04:06.700060+0000 mon.a (mon.0) 428 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:07 smithi187 bash[23415]: cluster 2024-03-11T22:04:06.721211+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:07 smithi187 bash[23415]: cluster 2024-03-11T22:04:07.024866+0000 mon.a (mon.0) 429 : cluster 1 osd.3 v1:172.21.15.49:6813/4161800259 boot 2024-03-11T22:04:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:07 smithi187 bash[23415]: cluster 2024-03-11T22:04:07.024967+0000 mon.a (mon.0) 430 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-03-11T22:04:07.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:07 smithi187 bash[23415]: audit 2024-03-11T22:04:07.025297+0000 mon.a (mon.0) 431 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:08.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[21434]: cluster 2024-03-11T22:04:04.714255+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:04:08.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[21434]: cluster 2024-03-11T22:04:04.714419+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[21434]: audit 2024-03-11T22:04:06.700060+0000 mon.a (mon.0) 428 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[21434]: cluster 2024-03-11T22:04:06.721211+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[21434]: cluster 2024-03-11T22:04:07.024866+0000 mon.a (mon.0) 429 : cluster 1 osd.3 v1:172.21.15.49:6813/4161800259 boot 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[21434]: cluster 2024-03-11T22:04:07.024967+0000 mon.a (mon.0) 430 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[21434]: audit 2024-03-11T22:04:07.025297+0000 mon.a (mon.0) 431 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[28804]: cluster 2024-03-11T22:04:04.714255+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[28804]: cluster 2024-03-11T22:04:04.714419+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[28804]: audit 2024-03-11T22:04:06.700060+0000 mon.a (mon.0) 428 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[28804]: cluster 2024-03-11T22:04:06.721211+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[28804]: cluster 2024-03-11T22:04:07.024866+0000 mon.a (mon.0) 429 : cluster 1 osd.3 v1:172.21.15.49:6813/4161800259 boot 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[28804]: cluster 2024-03-11T22:04:07.024967+0000 mon.a (mon.0) 430 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-03-11T22:04:08.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:07 smithi049 bash[28804]: audit 2024-03-11T22:04:07.025297+0000 mon.a (mon.0) 431 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:04:09.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:09 smithi187 bash[23415]: cluster 2024-03-11T22:04:08.703528+0000 mon.a (mon.0) 432 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-03-11T22:04:09.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:09 smithi187 bash[23415]: cluster 2024-03-11T22:04:08.721701+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:10.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:09 smithi049 bash[21434]: cluster 2024-03-11T22:04:08.703528+0000 mon.a (mon.0) 432 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-03-11T22:04:10.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:09 smithi049 bash[21434]: cluster 2024-03-11T22:04:08.721701+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:10.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:09 smithi049 bash[28804]: cluster 2024-03-11T22:04:08.703528+0000 mon.a (mon.0) 432 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-03-11T22:04:10.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:09 smithi049 bash[28804]: cluster 2024-03-11T22:04:08.721701+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:11.623 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:04:11.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:11 smithi187 bash[23415]: cluster 2024-03-11T22:04:10.722262+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:12.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:11 smithi049 bash[21434]: cluster 2024-03-11T22:04:10.722262+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:12.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:11 smithi049 bash[28804]: cluster 2024-03-11T22:04:10.722262+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:14.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:13 smithi049 bash[21434]: cluster 2024-03-11T22:04:12.722785+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:14.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:13 smithi049 bash[28804]: cluster 2024-03-11T22:04:12.722785+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:14.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:13 smithi187 bash[23415]: cluster 2024-03-11T22:04:12.722785+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:14.469 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-11T22:04:14.469 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-11T22:04:14.469 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2024-03-11T22:04:14.469 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2024-03-11T22:04:14.469 INFO:teuthology.orchestra.run.smithi187.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0135776 s, 772 MB/s 2024-03-11T22:04:14.469 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2024-03-11T22:04:15.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi187:vg_nvme/lv_4 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: cluster 2024-03-11T22:04:14.723323+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.659623+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.671455+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.674058+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.675710+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.677260+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.678742+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.686482+0000 mon.a (mon.0) 439 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.692031+0000 mon.a (mon.0) 440 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.693929+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:16.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:15 smithi187 bash[23415]: audit 2024-03-11T22:04:15.703623+0000 mon.a (mon.0) 442 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: cluster 2024-03-11T22:04:14.723323+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.659623+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.671455+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.674058+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.675710+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.677260+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.678742+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.686482+0000 mon.a (mon.0) 439 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.692031+0000 mon.a (mon.0) 440 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.693929+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[28804]: audit 2024-03-11T22:04:15.703623+0000 mon.a (mon.0) 442 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: cluster 2024-03-11T22:04:14.723323+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.659623+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.671455+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.674058+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.675710+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.677260+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.678742+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:04:16.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.686482+0000 mon.a (mon.0) 439 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:16.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.692031+0000 mon.a (mon.0) 440 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:16.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.693929+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:16.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:15 smithi049 bash[21434]: audit 2024-03-11T22:04:15.703623+0000 mon.a (mon.0) 442 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:17.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:16 smithi187 bash[23415]: cephadm 2024-03-11T22:04:15.650100+0000 mgr.y (mgr.14152) 200 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:04:17.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:16 smithi187 bash[23415]: cephadm 2024-03-11T22:04:15.679987+0000 mgr.y (mgr.14152) 201 : cephadm 1 Adjusting osd_memory_target on smithi049 to 4060M 2024-03-11T22:04:17.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:16 smithi049 bash[28804]: cephadm 2024-03-11T22:04:15.650100+0000 mgr.y (mgr.14152) 200 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:04:17.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:16 smithi049 bash[28804]: cephadm 2024-03-11T22:04:15.679987+0000 mgr.y (mgr.14152) 201 : cephadm 1 Adjusting osd_memory_target on smithi049 to 4060M 2024-03-11T22:04:17.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:16 smithi049 bash[21434]: cephadm 2024-03-11T22:04:15.650100+0000 mgr.y (mgr.14152) 200 : cephadm 1 Detected new or changed devices on smithi049 2024-03-11T22:04:17.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:16 smithi049 bash[21434]: cephadm 2024-03-11T22:04:15.679987+0000 mgr.y (mgr.14152) 201 : cephadm 1 Adjusting osd_memory_target on smithi049 to 4060M 2024-03-11T22:04:18.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:17 smithi187 bash[23415]: cluster 2024-03-11T22:04:16.723902+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:17 smithi049 bash[21434]: cluster 2024-03-11T22:04:16.723902+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:17 smithi049 bash[28804]: cluster 2024-03-11T22:04:16.723902+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:19.790 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:04:20.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:19 smithi187 bash[23415]: cluster 2024-03-11T22:04:18.724435+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:20.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:19 smithi049 bash[21434]: cluster 2024-03-11T22:04:18.724435+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:20.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:19 smithi049 bash[28804]: cluster 2024-03-11T22:04:18.724435+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:21.990 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- 172.21.15.187:0/596484695 >> v1:172.21.15.187:6789/0 conn(0x7fc0d8101a80 legacy=0x7fc0d8101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:04:21.991 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- 172.21.15.187:0/596484695 shutdown_connections 2024-03-11T22:04:21.991 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- 172.21.15.187:0/596484695 >> 172.21.15.187:0/596484695 conn(0x7fc0d80fd020 msgr2=0x7fc0d80ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:04:21.991 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- 172.21.15.187:0/596484695 shutdown_connections 2024-03-11T22:04:21.991 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- 172.21.15.187:0/596484695 wait complete. 2024-03-11T22:04:21.991 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 Processor -- start 2024-03-11T22:04:21.991 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- start start 2024-03-11T22:04:21.992 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc0d810e920 con 0x7fc0d8109bf0 2024-03-11T22:04:21.992 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc0d81a5110 con 0x7fc0d8105eb0 2024-03-11T22:04:21.992 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc0d81a6310 con 0x7fc0d8101a80 2024-03-11T22:04:21.992 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0dcce1700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc0d8105eb0 0x7fc0d819ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:50422/0 (socket says 172.21.15.187:50422) 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0dcce1700 1 -- 172.21.15.187:0/3519018068 learned_addr learned my addr 172.21.15.187:0/3519018068 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199877860 0 0) 0x7fc0d81a5110 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c40035b0 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3874403142 0 0) 0x7fc0c40035b0 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc0d81a5110 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fc0c8004090 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620516330 0 0) 0x7fc0d81a6310 con 0x7fc0d8101a80 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c40035b0 con 0x7fc0d8101a80 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3513888338 0 0) 0x7fc0d81a5110 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 >> v1:172.21.15.49:6790/0 conn(0x7fc0d8101a80 legacy=0x7fc0d8075930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 >> v1:172.21.15.49:6789/0 conn(0x7fc0d8109bf0 legacy=0x7fc0d81a27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d81a7510 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.995+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d81a6500 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.999+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d81a6a00 con 0x7fc0d8105eb0 2024-03-11T22:04:21.993 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.999+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fc0c8004480 con 0x7fc0d8105eb0 2024-03-11T22:04:21.994 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.999+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fc0c8005d80 con 0x7fc0d8105eb0 2024-03-11T22:04:21.994 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.999+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc005150 con 0x7fc0d8105eb0 2024-03-11T22:04:21.994 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.999+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7fc0c8001200 con 0x7fc0d8105eb0 2024-03-11T22:04:21.994 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:21.999+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 2803+0+0 (unknown 1897065700 0 0) 0x7fc0c8087450 con 0x7fc0d8105eb0 2024-03-11T22:04:21.999 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:22.003+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fc0c8051c30 con 0x7fc0d8105eb0 2024-03-11T22:04:22.202 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:22.207+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0bc000bc0 con 0x7fc0c406e2f0 2024-03-11T22:04:22.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:21 smithi187 bash[23415]: cluster 2024-03-11T22:04:20.724998+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:22.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:21 smithi049 bash[21434]: cluster 2024-03-11T22:04:20.724998+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:21 smithi049 bash[28804]: cluster 2024-03-11T22:04:20.724998+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:23.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:22 smithi187 bash[23415]: audit 2024-03-11T22:04:22.212638+0000 mgr.y (mgr.14152) 205 : audit 0 from='client.24238 v1:172.21.15.187:0/3519018068' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:04:23.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:22 smithi187 bash[23415]: audit 2024-03-11T22:04:22.220943+0000 mon.a (mon.0) 443 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:04:23.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:22 smithi187 bash[23415]: audit 2024-03-11T22:04:22.227730+0000 mon.a (mon.0) 444 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:04:23.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:22 smithi187 bash[23415]: audit 2024-03-11T22:04:22.229748+0000 mon.a (mon.0) 445 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[21434]: audit 2024-03-11T22:04:22.212638+0000 mgr.y (mgr.14152) 205 : audit 0 from='client.24238 v1:172.21.15.187:0/3519018068' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:04:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[21434]: audit 2024-03-11T22:04:22.220943+0000 mon.a (mon.0) 443 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:04:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[21434]: audit 2024-03-11T22:04:22.227730+0000 mon.a (mon.0) 444 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:04:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[21434]: audit 2024-03-11T22:04:22.229748+0000 mon.a (mon.0) 445 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[28804]: audit 2024-03-11T22:04:22.212638+0000 mgr.y (mgr.14152) 205 : audit 0 from='client.24238 v1:172.21.15.187:0/3519018068' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:04:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[28804]: audit 2024-03-11T22:04:22.220943+0000 mon.a (mon.0) 443 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:04:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[28804]: audit 2024-03-11T22:04:22.227730+0000 mon.a (mon.0) 444 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:04:23.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:22 smithi049 bash[28804]: audit 2024-03-11T22:04:22.229748+0000 mon.a (mon.0) 445 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:24.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:23 smithi187 bash[23415]: cluster 2024-03-11T22:04:22.725521+0000 mgr.y (mgr.14152) 206 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:24.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:23 smithi049 bash[21434]: cluster 2024-03-11T22:04:22.725521+0000 mgr.y (mgr.14152) 206 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:23 smithi049 bash[28804]: cluster 2024-03-11T22:04:22.725521+0000 mgr.y (mgr.14152) 206 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:26.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:25 smithi187 bash[23415]: cluster 2024-03-11T22:04:24.726082+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:26.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:25 smithi049 bash[21434]: cluster 2024-03-11T22:04:24.726082+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:26.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:25 smithi049 bash[28804]: cluster 2024-03-11T22:04:24.726082+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:28.077 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:27 smithi187 bash[23415]: cluster 2024-03-11T22:04:26.726618+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:28.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:27 smithi049 bash[21434]: cluster 2024-03-11T22:04:26.726618+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:28.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:27 smithi049 bash[28804]: cluster 2024-03-11T22:04:26.726618+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:30.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:29 smithi187 bash[23415]: cluster 2024-03-11T22:04:28.727133+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:29 smithi049 bash[21434]: cluster 2024-03-11T22:04:28.727133+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:30.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:29 smithi049 bash[28804]: cluster 2024-03-11T22:04:28.727133+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:31.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:30 smithi187 bash[23415]: audit 2024-03-11T22:04:30.458874+0000 mon.b (mon.1) 9 : audit 1 from='client.? v1:172.21.15.187:0/918203969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]: dispatch 2024-03-11T22:04:31.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:30 smithi187 bash[23415]: audit 2024-03-11T22:04:30.459205+0000 mon.a (mon.0) 446 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]: dispatch 2024-03-11T22:04:31.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:30 smithi187 bash[23415]: audit 2024-03-11T22:04:30.462529+0000 mon.a (mon.0) 447 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]': finished 2024-03-11T22:04:31.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:30 smithi187 bash[23415]: cluster 2024-03-11T22:04:30.467773+0000 mon.a (mon.0) 448 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-03-11T22:04:31.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:30 smithi187 bash[23415]: audit 2024-03-11T22:04:30.468185+0000 mon.a (mon.0) 449 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[21434]: audit 2024-03-11T22:04:30.458874+0000 mon.b (mon.1) 9 : audit 1 from='client.? v1:172.21.15.187:0/918203969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]: dispatch 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[21434]: audit 2024-03-11T22:04:30.459205+0000 mon.a (mon.0) 446 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]: dispatch 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[21434]: audit 2024-03-11T22:04:30.462529+0000 mon.a (mon.0) 447 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]': finished 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[21434]: cluster 2024-03-11T22:04:30.467773+0000 mon.a (mon.0) 448 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[21434]: audit 2024-03-11T22:04:30.468185+0000 mon.a (mon.0) 449 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[28804]: audit 2024-03-11T22:04:30.458874+0000 mon.b (mon.1) 9 : audit 1 from='client.? v1:172.21.15.187:0/918203969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]: dispatch 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[28804]: audit 2024-03-11T22:04:30.459205+0000 mon.a (mon.0) 446 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]: dispatch 2024-03-11T22:04:31.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[28804]: audit 2024-03-11T22:04:30.462529+0000 mon.a (mon.0) 447 : audit 1 from='client.24244 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7"}]': finished 2024-03-11T22:04:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[28804]: cluster 2024-03-11T22:04:30.467773+0000 mon.a (mon.0) 448 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-03-11T22:04:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:30 smithi049 bash[28804]: audit 2024-03-11T22:04:30.468185+0000 mon.a (mon.0) 449 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:32.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:31 smithi187 bash[23415]: cluster 2024-03-11T22:04:30.727629+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:32.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:31 smithi187 bash[23415]: audit 2024-03-11T22:04:31.203084+0000 mon.b (mon.1) 10 : audit 0 from='client.? v1:172.21.15.187:0/752233289' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:04:32.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:31 smithi049 bash[21434]: cluster 2024-03-11T22:04:30.727629+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:32.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:31 smithi049 bash[21434]: audit 2024-03-11T22:04:31.203084+0000 mon.b (mon.1) 10 : audit 0 from='client.? v1:172.21.15.187:0/752233289' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:04:32.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:31 smithi049 bash[28804]: cluster 2024-03-11T22:04:30.727629+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:32.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:31 smithi049 bash[28804]: audit 2024-03-11T22:04:31.203084+0000 mon.b (mon.1) 10 : audit 0 from='client.? v1:172.21.15.187:0/752233289' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:04:33.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:33 smithi187 bash[23415]: cluster 2024-03-11T22:04:32.728178+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:34.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:33 smithi049 bash[21434]: cluster 2024-03-11T22:04:32.728178+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:34.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:33 smithi049 bash[28804]: cluster 2024-03-11T22:04:32.728178+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:36.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:35 smithi187 bash[23415]: cluster 2024-03-11T22:04:34.728739+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:36.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:35 smithi049 bash[21434]: cluster 2024-03-11T22:04:34.728739+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:35 smithi049 bash[28804]: cluster 2024-03-11T22:04:34.728739+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:38.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:37 smithi187 bash[23415]: cluster 2024-03-11T22:04:36.729283+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:38.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:37 smithi049 bash[21434]: cluster 2024-03-11T22:04:36.729283+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:38.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:37 smithi049 bash[28804]: cluster 2024-03-11T22:04:36.729283+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:40.164 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:39 smithi187 bash[23415]: cluster 2024-03-11T22:04:38.729804+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:40.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:39 smithi049 bash[21434]: cluster 2024-03-11T22:04:38.729804+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:40.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:39 smithi049 bash[28804]: cluster 2024-03-11T22:04:38.729804+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:42.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:41 smithi187 bash[23415]: cluster 2024-03-11T22:04:40.730345+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:42.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:41 smithi049 bash[21434]: cluster 2024-03-11T22:04:40.730345+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:42.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:41 smithi049 bash[28804]: cluster 2024-03-11T22:04:40.730345+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:43.106 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:42 smithi187 bash[23415]: audit 2024-03-11T22:04:42.681270+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-11T22:04:43.106 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:42 smithi187 bash[23415]: audit 2024-03-11T22:04:42.682981+0000 mon.a (mon.0) 451 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:43.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:42 smithi049 bash[21434]: audit 2024-03-11T22:04:42.681270+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-11T22:04:43.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:42 smithi049 bash[21434]: audit 2024-03-11T22:04:42.682981+0000 mon.a (mon.0) 451 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:43.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:42 smithi049 bash[28804]: audit 2024-03-11T22:04:42.681270+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-11T22:04:43.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:42 smithi049 bash[28804]: audit 2024-03-11T22:04:42.682981+0000 mon.a (mon.0) 451 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:44.161 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:43 smithi187 bash[23415]: cephadm 2024-03-11T22:04:42.684676+0000 mgr.y (mgr.14152) 216 : cephadm 1 Deploying daemon osd.4 on smithi187 2024-03-11T22:04:44.161 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:43 smithi187 bash[23415]: cluster 2024-03-11T22:04:42.730820+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:44.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:43 smithi049 bash[21434]: cephadm 2024-03-11T22:04:42.684676+0000 mgr.y (mgr.14152) 216 : cephadm 1 Deploying daemon osd.4 on smithi187 2024-03-11T22:04:44.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:43 smithi049 bash[21434]: cluster 2024-03-11T22:04:42.730820+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:44.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:43 smithi049 bash[28804]: cephadm 2024-03-11T22:04:42.684676+0000 mgr.y (mgr.14152) 216 : cephadm 1 Deploying daemon osd.4 on smithi187 2024-03-11T22:04:44.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:43 smithi049 bash[28804]: cluster 2024-03-11T22:04:42.730820+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:45.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:45 smithi187 bash[23415]: cluster 2024-03-11T22:04:44.731351+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:46.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:45 smithi049 bash[21434]: cluster 2024-03-11T22:04:44.731351+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:46.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:45 smithi049 bash[28804]: cluster 2024-03-11T22:04:44.731351+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:46.719 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:04:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:04:46.719 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:04:46.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:04:46.990 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:04:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:04:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:47 smithi187 bash[23415]: cluster 2024-03-11T22:04:46.731871+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:47 smithi187 bash[23415]: audit 2024-03-11T22:04:46.992738+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:47 smithi187 bash[23415]: audit 2024-03-11T22:04:47.001530+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:47 smithi187 bash[23415]: audit 2024-03-11T22:04:47.020310+0000 mon.a (mon.0) 454 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:48.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[21434]: cluster 2024-03-11T22:04:46.731871+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:48.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[21434]: audit 2024-03-11T22:04:46.992738+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:48.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[21434]: audit 2024-03-11T22:04:47.001530+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:48.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[21434]: audit 2024-03-11T22:04:47.020310+0000 mon.a (mon.0) 454 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:48.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[28804]: cluster 2024-03-11T22:04:46.731871+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:48.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[28804]: audit 2024-03-11T22:04:46.992738+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:48.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[28804]: audit 2024-03-11T22:04:47.001530+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:48.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:47 smithi049 bash[28804]: audit 2024-03-11T22:04:47.020310+0000 mon.a (mon.0) 454 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:50.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:49 smithi187 bash[23415]: cluster 2024-03-11T22:04:48.732411+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:50.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:49 smithi049 bash[21434]: cluster 2024-03-11T22:04:48.732411+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:50.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:49 smithi049 bash[28804]: cluster 2024-03-11T22:04:48.732411+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:52.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:51 smithi049 bash[21434]: cluster 2024-03-11T22:04:50.732956+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:52.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:51 smithi049 bash[28804]: cluster 2024-03-11T22:04:50.732956+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:52.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:51 smithi187 bash[23415]: cluster 2024-03-11T22:04:50.732956+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: cluster 2024-03-11T22:04:52.733474+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: audit 2024-03-11T22:04:53.217809+0000 mon.b (mon.1) 11 : audit 1 from='osd.4 v1:172.21.15.187:6800/4268742344' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: audit 2024-03-11T22:04:53.218226+0000 mon.a (mon.0) 455 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: audit 2024-03-11T22:04:53.832861+0000 mon.a (mon.0) 456 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: audit 2024-03-11T22:04:53.843270+0000 mon.a (mon.0) 457 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: audit 2024-03-11T22:04:53.845285+0000 mon.a (mon.0) 458 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: audit 2024-03-11T22:04:53.847058+0000 mon.a (mon.0) 459 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[28804]: audit 2024-03-11T22:04:53.858587+0000 mon.a (mon.0) 460 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: cluster 2024-03-11T22:04:52.733474+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:54.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: audit 2024-03-11T22:04:53.217809+0000 mon.b (mon.1) 11 : audit 1 from='osd.4 v1:172.21.15.187:6800/4268742344' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-11T22:04:54.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: audit 2024-03-11T22:04:53.218226+0000 mon.a (mon.0) 455 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-11T22:04:54.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: audit 2024-03-11T22:04:53.832861+0000 mon.a (mon.0) 456 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: audit 2024-03-11T22:04:53.843270+0000 mon.a (mon.0) 457 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: audit 2024-03-11T22:04:53.845285+0000 mon.a (mon.0) 458 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:54.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: audit 2024-03-11T22:04:53.847058+0000 mon.a (mon.0) 459 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:54.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:54 smithi049 bash[21434]: audit 2024-03-11T22:04:53.858587+0000 mon.a (mon.0) 460 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.362 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: cluster 2024-03-11T22:04:52.733474+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:54.362 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: audit 2024-03-11T22:04:53.217809+0000 mon.b (mon.1) 11 : audit 1 from='osd.4 v1:172.21.15.187:6800/4268742344' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-11T22:04:54.362 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: audit 2024-03-11T22:04:53.218226+0000 mon.a (mon.0) 455 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-11T22:04:54.362 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: audit 2024-03-11T22:04:53.832861+0000 mon.a (mon.0) 456 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.363 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: audit 2024-03-11T22:04:53.843270+0000 mon.a (mon.0) 457 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:54.363 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: audit 2024-03-11T22:04:53.845285+0000 mon.a (mon.0) 458 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:04:54.363 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: audit 2024-03-11T22:04:53.847058+0000 mon.a (mon.0) 459 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:04:54.363 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:54 smithi187 bash[23415]: audit 2024-03-11T22:04:53.858587+0000 mon.a (mon.0) 460 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:55.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[28804]: audit 2024-03-11T22:04:54.010594+0000 mon.a (mon.0) 461 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-11T22:04:55.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[28804]: cluster 2024-03-11T22:04:54.015834+0000 mon.a (mon.0) 462 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-03-11T22:04:55.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[28804]: audit 2024-03-11T22:04:54.016332+0000 mon.a (mon.0) 463 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:55.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[28804]: audit 2024-03-11T22:04:54.020057+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.187:6800/4268742344' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:04:55.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[28804]: audit 2024-03-11T22:04:54.020438+0000 mon.a (mon.0) 464 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:04:55.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[21434]: audit 2024-03-11T22:04:54.010594+0000 mon.a (mon.0) 461 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-11T22:04:55.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[21434]: cluster 2024-03-11T22:04:54.015834+0000 mon.a (mon.0) 462 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-03-11T22:04:55.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[21434]: audit 2024-03-11T22:04:54.016332+0000 mon.a (mon.0) 463 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:55.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[21434]: audit 2024-03-11T22:04:54.020057+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.187:6800/4268742344' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:04:55.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:55 smithi049 bash[21434]: audit 2024-03-11T22:04:54.020438+0000 mon.a (mon.0) 464 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:04:55.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:55 smithi187 bash[23415]: audit 2024-03-11T22:04:54.010594+0000 mon.a (mon.0) 461 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-11T22:04:55.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:55 smithi187 bash[23415]: cluster 2024-03-11T22:04:54.015834+0000 mon.a (mon.0) 462 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-03-11T22:04:55.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:55 smithi187 bash[23415]: audit 2024-03-11T22:04:54.016332+0000 mon.a (mon.0) 463 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:55.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:55 smithi187 bash[23415]: audit 2024-03-11T22:04:54.020057+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.187:6800/4268742344' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:04:55.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:55 smithi187 bash[23415]: audit 2024-03-11T22:04:54.020438+0000 mon.a (mon.0) 464 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:04:56.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: cluster 2024-03-11T22:04:54.734035+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: audit 2024-03-11T22:04:55.012938+0000 mon.a (mon.0) 465 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: cluster 2024-03-11T22:04:55.018949+0000 mon.a (mon.0) 466 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: audit 2024-03-11T22:04:55.020132+0000 mon.a (mon.0) 467 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: audit 2024-03-11T22:04:55.029808+0000 mon.a (mon.0) 468 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: cluster 2024-03-11T22:04:55.636060+0000 mon.a (mon.0) 469 : cluster 1 osd.4 v1:172.21.15.187:6800/4268742344 boot 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: cluster 2024-03-11T22:04:55.636173+0000 mon.a (mon.0) 470 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[21434]: audit 2024-03-11T22:04:55.636442+0000 mon.a (mon.0) 471 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: cluster 2024-03-11T22:04:54.734035+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: audit 2024-03-11T22:04:55.012938+0000 mon.a (mon.0) 465 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: cluster 2024-03-11T22:04:55.018949+0000 mon.a (mon.0) 466 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-03-11T22:04:56.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: audit 2024-03-11T22:04:55.020132+0000 mon.a (mon.0) 467 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: audit 2024-03-11T22:04:55.029808+0000 mon.a (mon.0) 468 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: cluster 2024-03-11T22:04:55.636060+0000 mon.a (mon.0) 469 : cluster 1 osd.4 v1:172.21.15.187:6800/4268742344 boot 2024-03-11T22:04:56.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: cluster 2024-03-11T22:04:55.636173+0000 mon.a (mon.0) 470 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-03-11T22:04:56.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:56 smithi049 bash[28804]: audit 2024-03-11T22:04:55.636442+0000 mon.a (mon.0) 471 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: cluster 2024-03-11T22:04:54.734035+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: audit 2024-03-11T22:04:55.012938+0000 mon.a (mon.0) 465 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: cluster 2024-03-11T22:04:55.018949+0000 mon.a (mon.0) 466 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: audit 2024-03-11T22:04:55.020132+0000 mon.a (mon.0) 467 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: audit 2024-03-11T22:04:55.029808+0000 mon.a (mon.0) 468 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: cluster 2024-03-11T22:04:55.636060+0000 mon.a (mon.0) 469 : cluster 1 osd.4 v1:172.21.15.187:6800/4268742344 boot 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: cluster 2024-03-11T22:04:55.636173+0000 mon.a (mon.0) 470 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-03-11T22:04:56.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:56 smithi187 bash[23415]: audit 2024-03-11T22:04:55.636442+0000 mon.a (mon.0) 471 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:04:57.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:57 smithi049 bash[21434]: cluster 2024-03-11T22:04:54.167591+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:04:57.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:57 smithi049 bash[21434]: cluster 2024-03-11T22:04:54.167702+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:04:57.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:57 smithi049 bash[21434]: cluster 2024-03-11T22:04:56.638282+0000 mon.a (mon.0) 472 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-03-11T22:04:57.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:57 smithi049 bash[28804]: cluster 2024-03-11T22:04:54.167591+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:04:57.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:57 smithi049 bash[28804]: cluster 2024-03-11T22:04:54.167702+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:04:57.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:57 smithi049 bash[28804]: cluster 2024-03-11T22:04:56.638282+0000 mon.a (mon.0) 472 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-03-11T22:04:57.292 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:57.298+0000 7fc0ce7fc700 1 -- 172.21.15.187:0/3519018068 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 3549381491) 0x7fc0bc000bc0 con 0x7fc0c406e2f0 2024-03-11T22:04:57.292 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 4 on host 'smithi187' 2024-03-11T22:04:57.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:57.302+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 >> v1:172.21.15.49:6800/4076252288 conn(0x7fc0c406e2f0 legacy=0x7fc0c40707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:04:57.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:57.302+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 >> v1:172.21.15.187:6789/0 conn(0x7fc0d8105eb0 legacy=0x7fc0d819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:04:57.297 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:57.302+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 shutdown_connections 2024-03-11T22:04:57.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:57.302+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 >> 172.21.15.187:0/3519018068 conn(0x7fc0d80fd020 msgr2=0x7fc0d8108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:04:57.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:57.302+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 shutdown_connections 2024-03-11T22:04:57.298 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:04:57.302+0000 7fc0df746700 1 -- 172.21.15.187:0/3519018068 wait complete. 2024-03-11T22:04:57.313 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:57 smithi187 bash[23415]: cluster 2024-03-11T22:04:54.167591+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:04:57.313 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:57 smithi187 bash[23415]: cluster 2024-03-11T22:04:54.167702+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:04:57.313 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:57 smithi187 bash[23415]: cluster 2024-03-11T22:04:56.638282+0000 mon.a (mon.0) 472 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-03-11T22:04:57.950 DEBUG:teuthology.orchestra.run.smithi187:osd.4> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.4.service 2024-03-11T22:04:57.953 INFO:tasks.cephadm:Deploying osd.5 on smithi187 with /dev/vg_nvme/lv_3... 2024-03-11T22:04:57.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-11T22:04:58.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[28804]: cluster 2024-03-11T22:04:56.734624+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[28804]: audit 2024-03-11T22:04:57.271949+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[28804]: audit 2024-03-11T22:04:57.281016+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[28804]: audit 2024-03-11T22:04:57.304045+0000 mon.a (mon.0) 475 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[28804]: cluster 2024-03-11T22:04:57.645353+0000 mon.a (mon.0) 476 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[21434]: cluster 2024-03-11T22:04:56.734624+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[21434]: audit 2024-03-11T22:04:57.271949+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[21434]: audit 2024-03-11T22:04:57.281016+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[21434]: audit 2024-03-11T22:04:57.304045+0000 mon.a (mon.0) 475 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:58 smithi049 bash[21434]: cluster 2024-03-11T22:04:57.645353+0000 mon.a (mon.0) 476 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-03-11T22:04:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:58 smithi187 bash[23415]: cluster 2024-03-11T22:04:56.734624+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:04:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:58 smithi187 bash[23415]: audit 2024-03-11T22:04:57.271949+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:58 smithi187 bash[23415]: audit 2024-03-11T22:04:57.281016+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:04:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:58 smithi187 bash[23415]: audit 2024-03-11T22:04:57.304045+0000 mon.a (mon.0) 475 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:04:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:58 smithi187 bash[23415]: cluster 2024-03-11T22:04:57.645353+0000 mon.a (mon.0) 476 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-03-11T22:04:59.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:59 smithi187 bash[23415]: cluster 2024-03-11T22:04:58.647966+0000 mon.a (mon.0) 477 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-03-11T22:04:59.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:04:59 smithi187 bash[23415]: cluster 2024-03-11T22:04:58.735168+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:00.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:59 smithi049 bash[21434]: cluster 2024-03-11T22:04:58.647966+0000 mon.a (mon.0) 477 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-03-11T22:05:00.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:04:59 smithi049 bash[21434]: cluster 2024-03-11T22:04:58.735168+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:00.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:59 smithi049 bash[28804]: cluster 2024-03-11T22:04:58.647966+0000 mon.a (mon.0) 477 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-03-11T22:05:00.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:04:59 smithi049 bash[28804]: cluster 2024-03-11T22:04:58.735168+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:00.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:00 smithi187 bash[23415]: cluster 2024-03-11T22:04:59.656597+0000 mon.a (mon.0) 478 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-03-11T22:05:01.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:00 smithi049 bash[21434]: cluster 2024-03-11T22:04:59.656597+0000 mon.a (mon.0) 478 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-03-11T22:05:01.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:00 smithi049 bash[28804]: cluster 2024-03-11T22:04:59.656597+0000 mon.a (mon.0) 478 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-03-11T22:05:01.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:01 smithi187 bash[23415]: cluster 2024-03-11T22:05:00.735680+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v201: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-03-11T22:05:02.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:01 smithi049 bash[21434]: cluster 2024-03-11T22:05:00.735680+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v201: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-03-11T22:05:02.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:01 smithi049 bash[28804]: cluster 2024-03-11T22:05:00.735680+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v201: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-03-11T22:05:02.257 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:05:03.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:03 smithi187 bash[23415]: cluster 2024-03-11T22:05:02.736273+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v202: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-11T22:05:04.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:03 smithi049 bash[21434]: cluster 2024-03-11T22:05:02.736273+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v202: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-11T22:05:04.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:03 smithi049 bash[28804]: cluster 2024-03-11T22:05:02.736273+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v202: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-11T22:05:06.186 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-11T22:05:06.186 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-11T22:05:06.186 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2024-03-11T22:05:06.186 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2024-03-11T22:05:06.186 INFO:teuthology.orchestra.run.smithi187.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0144154 s, 727 MB/s 2024-03-11T22:05:06.187 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2024-03-11T22:05:06.222 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:05 smithi187 bash[23415]: cluster 2024-03-11T22:05:04.736974+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-11T22:05:06.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:05 smithi049 bash[21434]: cluster 2024-03-11T22:05:04.736974+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-11T22:05:06.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:05 smithi049 bash[28804]: cluster 2024-03-11T22:05:04.736974+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-11T22:05:07.001 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi187:vg_nvme/lv_3 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: cluster 2024-03-11T22:05:06.737529+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: audit 2024-03-11T22:05:07.466526+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: audit 2024-03-11T22:05:07.475730+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: audit 2024-03-11T22:05:07.478068+0000 mon.a (mon.0) 481 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: audit 2024-03-11T22:05:07.487347+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: audit 2024-03-11T22:05:07.492835+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: audit 2024-03-11T22:05:07.494665+0000 mon.a (mon.0) 484 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:05:08.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:07 smithi187 bash[23415]: audit 2024-03-11T22:05:07.504449+0000 mon.a (mon.0) 485 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: cluster 2024-03-11T22:05:06.737529+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-03-11T22:05:08.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: audit 2024-03-11T22:05:07.466526+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: audit 2024-03-11T22:05:07.475730+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: audit 2024-03-11T22:05:07.478068+0000 mon.a (mon.0) 481 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: audit 2024-03-11T22:05:07.487347+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: audit 2024-03-11T22:05:07.492835+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: audit 2024-03-11T22:05:07.494665+0000 mon.a (mon.0) 484 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[21434]: audit 2024-03-11T22:05:07.504449+0000 mon.a (mon.0) 485 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: cluster 2024-03-11T22:05:06.737529+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: audit 2024-03-11T22:05:07.466526+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: audit 2024-03-11T22:05:07.475730+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: audit 2024-03-11T22:05:07.478068+0000 mon.a (mon.0) 481 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: audit 2024-03-11T22:05:07.487347+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:08.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: audit 2024-03-11T22:05:07.492835+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:08.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: audit 2024-03-11T22:05:07.494665+0000 mon.a (mon.0) 484 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:05:08.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:07 smithi049 bash[28804]: audit 2024-03-11T22:05:07.504449+0000 mon.a (mon.0) 485 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:09.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:08 smithi187 bash[23415]: cephadm 2024-03-11T22:05:07.457389+0000 mgr.y (mgr.14152) 230 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:05:09.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:08 smithi187 bash[23415]: cephadm 2024-03-11T22:05:07.479461+0000 mgr.y (mgr.14152) 231 : cephadm 1 Adjusting osd_memory_target on smithi187 to 17265M 2024-03-11T22:05:09.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:08 smithi049 bash[21434]: cephadm 2024-03-11T22:05:07.457389+0000 mgr.y (mgr.14152) 230 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:05:09.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:08 smithi049 bash[21434]: cephadm 2024-03-11T22:05:07.479461+0000 mgr.y (mgr.14152) 231 : cephadm 1 Adjusting osd_memory_target on smithi187 to 17265M 2024-03-11T22:05:09.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:08 smithi049 bash[28804]: cephadm 2024-03-11T22:05:07.457389+0000 mgr.y (mgr.14152) 230 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:05:09.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:08 smithi049 bash[28804]: cephadm 2024-03-11T22:05:07.479461+0000 mgr.y (mgr.14152) 231 : cephadm 1 Adjusting osd_memory_target on smithi187 to 17265M 2024-03-11T22:05:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:09 smithi187 bash[23415]: cluster 2024-03-11T22:05:08.738055+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-11T22:05:10.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:09 smithi049 bash[21434]: cluster 2024-03-11T22:05:08.738055+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-11T22:05:10.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:09 smithi049 bash[28804]: cluster 2024-03-11T22:05:08.738055+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-11T22:05:11.724 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:05:12.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:11 smithi187 bash[23415]: cluster 2024-03-11T22:05:10.738707+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:12.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:11 smithi049 bash[21434]: cluster 2024-03-11T22:05:10.738707+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:12.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:11 smithi049 bash[28804]: cluster 2024-03-11T22:05:10.738707+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:14.068 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:13 smithi187 bash[23415]: cluster 2024-03-11T22:05:12.739280+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:14.230 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- 172.21.15.187:0/258724301 >> v1:172.21.15.187:6789/0 conn(0x7f087c109bb0 legacy=0x7f087c10c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:05:14.230 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- 172.21.15.187:0/258724301 shutdown_connections 2024-03-11T22:05:14.230 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- 172.21.15.187:0/258724301 >> 172.21.15.187:0/258724301 conn(0x7f087c0fbf30 msgr2=0x7f087c0fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:05:14.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- 172.21.15.187:0/258724301 shutdown_connections 2024-03-11T22:05:14.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- 172.21.15.187:0/258724301 wait complete. 2024-03-11T22:05:14.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 Processor -- start 2024-03-11T22:05:14.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- start start 2024-03-11T22:05:14.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f087c109560 con 0x7f087c109bb0 2024-03-11T22:05:14.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f087c1a5390 con 0x7f087c102500 2024-03-11T22:05:14.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0881731700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f087c1a6530 con 0x7f087c106010 2024-03-11T22:05:14.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f087affd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f087c102500 0x7f087c108a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:46062/0 (socket says 172.21.15.187:46062) 2024-03-11T22:05:14.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f087affd700 1 -- 172.21.15.187:0/559927455 learned_addr learned my addr 172.21.15.187:0/559927455 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:05:14.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024858384 0 0) 0x7f087c1a5390 con 0x7f087c102500 2024-03-11T22:05:14.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08640035b0 con 0x7f087c102500 2024-03-11T22:05:14.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 240868295 0 0) 0x7f08640035b0 con 0x7f087c102500 2024-03-11T22:05:14.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f087c1a5390 con 0x7f087c102500 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.234+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f086c001930 con 0x7f087c102500 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100325773 0 0) 0x7f087c1a6530 con 0x7f087c106010 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08640035b0 con 0x7f087c106010 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472263616 0 0) 0x7f087c109560 con 0x7f087c109bb0 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f087c1a6530 con 0x7f087c109bb0 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 293493244 0 0) 0x7f087c1a5390 con 0x7f087c102500 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 >> v1:172.21.15.49:6790/0 conn(0x7f087c106010 legacy=0x7f087c19f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 >> v1:172.21.15.49:6789/0 conn(0x7f087c109bb0 legacy=0x7f087c1a2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c1a76d0 con 0x7f087c102500 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c1a6720 con 0x7f087c102500 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c1a6c20 con 0x7f087c102500 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f086c001d00 con 0x7f087c102500 2024-03-11T22:05:14.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f086c005d00 con 0x7f087c102500 2024-03-11T22:05:14.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0868005150 con 0x7f087c102500 2024-03-11T22:05:14.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f086c0039b0 con 0x7f087c102500 2024-03-11T22:05:14.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.238+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3205+0+0 (unknown 886319873 0 0) 0x7f086c087770 con 0x7f087c102500 2024-03-11T22:05:14.238 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.242+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f086c051c80 con 0x7f087c102500 2024-03-11T22:05:14.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:13 smithi049 bash[21434]: cluster 2024-03-11T22:05:12.739280+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:14.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:13 smithi049 bash[28804]: cluster 2024-03-11T22:05:12.739280+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:14.456 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:14.458+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0868000bc0 con 0x7f086406e450 2024-03-11T22:05:15.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:14 smithi187 bash[23415]: audit 2024-03-11T22:05:14.474083+0000 mon.a (mon.0) 486 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:05:15.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:14 smithi187 bash[23415]: audit 2024-03-11T22:05:14.481081+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:05:15.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:14 smithi187 bash[23415]: audit 2024-03-11T22:05:14.482573+0000 mon.a (mon.0) 488 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:14 smithi049 bash[21434]: audit 2024-03-11T22:05:14.474083+0000 mon.a (mon.0) 486 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:05:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:14 smithi049 bash[21434]: audit 2024-03-11T22:05:14.481081+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:05:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:14 smithi049 bash[21434]: audit 2024-03-11T22:05:14.482573+0000 mon.a (mon.0) 488 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:15.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:14 smithi049 bash[28804]: audit 2024-03-11T22:05:14.474083+0000 mon.a (mon.0) 486 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:05:15.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:14 smithi049 bash[28804]: audit 2024-03-11T22:05:14.481081+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:05:15.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:14 smithi049 bash[28804]: audit 2024-03-11T22:05:14.482573+0000 mon.a (mon.0) 488 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:16.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:15 smithi187 bash[23415]: audit 2024-03-11T22:05:14.467090+0000 mgr.y (mgr.14152) 235 : audit 0 from='client.24265 v1:172.21.15.187:0/559927455' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:05:16.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:15 smithi187 bash[23415]: cluster 2024-03-11T22:05:14.739813+0000 mgr.y (mgr.14152) 236 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:15 smithi049 bash[21434]: audit 2024-03-11T22:05:14.467090+0000 mgr.y (mgr.14152) 235 : audit 0 from='client.24265 v1:172.21.15.187:0/559927455' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:05:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:15 smithi049 bash[21434]: cluster 2024-03-11T22:05:14.739813+0000 mgr.y (mgr.14152) 236 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:15 smithi049 bash[28804]: audit 2024-03-11T22:05:14.467090+0000 mgr.y (mgr.14152) 235 : audit 0 from='client.24265 v1:172.21.15.187:0/559927455' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:05:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:15 smithi049 bash[28804]: cluster 2024-03-11T22:05:14.739813+0000 mgr.y (mgr.14152) 236 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:18.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:17 smithi187 bash[23415]: cluster 2024-03-11T22:05:16.740430+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:17 smithi049 bash[21434]: cluster 2024-03-11T22:05:16.740430+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:18.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:17 smithi049 bash[28804]: cluster 2024-03-11T22:05:16.740430+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:20.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:19 smithi187 bash[23415]: cluster 2024-03-11T22:05:18.741031+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:20.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:19 smithi049 bash[21434]: cluster 2024-03-11T22:05:18.741031+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:20.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:19 smithi049 bash[28804]: cluster 2024-03-11T22:05:18.741031+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:22.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:21 smithi187 bash[23415]: cluster 2024-03-11T22:05:20.741586+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:21 smithi049 bash[21434]: cluster 2024-03-11T22:05:20.741586+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:22.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:21 smithi049 bash[28804]: cluster 2024-03-11T22:05:20.741586+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:23.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:22 smithi187 bash[23415]: audit 2024-03-11T22:05:22.740566+0000 mon.b (mon.1) 13 : audit 1 from='client.? v1:172.21.15.187:0/42420230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]: dispatch 2024-03-11T22:05:23.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:22 smithi187 bash[23415]: audit 2024-03-11T22:05:22.741448+0000 mon.a (mon.0) 489 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]: dispatch 2024-03-11T22:05:23.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:22 smithi187 bash[23415]: audit 2024-03-11T22:05:22.744871+0000 mon.a (mon.0) 490 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]': finished 2024-03-11T22:05:23.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:22 smithi187 bash[23415]: cluster 2024-03-11T22:05:22.750027+0000 mon.a (mon.0) 491 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-03-11T22:05:23.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:22 smithi187 bash[23415]: audit 2024-03-11T22:05:22.750796+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[21434]: audit 2024-03-11T22:05:22.740566+0000 mon.b (mon.1) 13 : audit 1 from='client.? v1:172.21.15.187:0/42420230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]: dispatch 2024-03-11T22:05:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[21434]: audit 2024-03-11T22:05:22.741448+0000 mon.a (mon.0) 489 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]: dispatch 2024-03-11T22:05:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[21434]: audit 2024-03-11T22:05:22.744871+0000 mon.a (mon.0) 490 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]': finished 2024-03-11T22:05:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[21434]: cluster 2024-03-11T22:05:22.750027+0000 mon.a (mon.0) 491 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-03-11T22:05:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[21434]: audit 2024-03-11T22:05:22.750796+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[28804]: audit 2024-03-11T22:05:22.740566+0000 mon.b (mon.1) 13 : audit 1 from='client.? v1:172.21.15.187:0/42420230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]: dispatch 2024-03-11T22:05:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[28804]: audit 2024-03-11T22:05:22.741448+0000 mon.a (mon.0) 489 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]: dispatch 2024-03-11T22:05:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[28804]: audit 2024-03-11T22:05:22.744871+0000 mon.a (mon.0) 490 : audit 1 from='client.24271 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1cd359e-0186-4ad1-bccb-e71dc10206a7"}]': finished 2024-03-11T22:05:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[28804]: cluster 2024-03-11T22:05:22.750027+0000 mon.a (mon.0) 491 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-03-11T22:05:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:22 smithi049 bash[28804]: audit 2024-03-11T22:05:22.750796+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:24.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:23 smithi187 bash[23415]: cluster 2024-03-11T22:05:22.742076+0000 mgr.y (mgr.14152) 240 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:24.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:23 smithi187 bash[23415]: audit 2024-03-11T22:05:23.448611+0000 mon.b (mon.1) 14 : audit 0 from='client.? v1:172.21.15.187:0/4231754291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:05:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:23 smithi049 bash[21434]: cluster 2024-03-11T22:05:22.742076+0000 mgr.y (mgr.14152) 240 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:23 smithi049 bash[21434]: audit 2024-03-11T22:05:23.448611+0000 mon.b (mon.1) 14 : audit 0 from='client.? v1:172.21.15.187:0/4231754291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:05:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:23 smithi049 bash[28804]: cluster 2024-03-11T22:05:22.742076+0000 mgr.y (mgr.14152) 240 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:23 smithi049 bash[28804]: audit 2024-03-11T22:05:23.448611+0000 mon.b (mon.1) 14 : audit 0 from='client.? v1:172.21.15.187:0/4231754291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:05:26.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:25 smithi187 bash[23415]: cluster 2024-03-11T22:05:24.742649+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:26.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:25 smithi049 bash[21434]: cluster 2024-03-11T22:05:24.742649+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:26.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:25 smithi049 bash[28804]: cluster 2024-03-11T22:05:24.742649+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:28.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:27 smithi187 bash[23415]: cluster 2024-03-11T22:05:26.743180+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:28.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:27 smithi049 bash[21434]: cluster 2024-03-11T22:05:26.743180+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:28.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:27 smithi049 bash[28804]: cluster 2024-03-11T22:05:26.743180+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:30.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:29 smithi187 bash[23415]: cluster 2024-03-11T22:05:28.743722+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:30.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:29 smithi049 bash[21434]: cluster 2024-03-11T22:05:28.743722+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:30.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:29 smithi049 bash[28804]: cluster 2024-03-11T22:05:28.743722+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:31.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:31 smithi187 bash[23415]: cluster 2024-03-11T22:05:30.744286+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:32.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:31 smithi049 bash[21434]: cluster 2024-03-11T22:05:30.744286+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:32.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:31 smithi049 bash[28804]: cluster 2024-03-11T22:05:30.744286+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:34.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:33 smithi187 bash[23415]: cluster 2024-03-11T22:05:32.744846+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:34.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:33 smithi049 bash[28804]: cluster 2024-03-11T22:05:32.744846+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:34.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:33 smithi049 bash[21434]: cluster 2024-03-11T22:05:32.744846+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:35.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:35 smithi187 bash[23415]: cluster 2024-03-11T22:05:34.745431+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:35.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:35 smithi187 bash[23415]: audit 2024-03-11T22:05:35.198129+0000 mon.a (mon.0) 493 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-11T22:05:35.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:35 smithi187 bash[23415]: audit 2024-03-11T22:05:35.199762+0000 mon.a (mon.0) 494 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:35.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:35 smithi187 bash[23415]: cephadm 2024-03-11T22:05:35.201314+0000 mgr.y (mgr.14152) 247 : cephadm 1 Deploying daemon osd.5 on smithi187 2024-03-11T22:05:36.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[21434]: cluster 2024-03-11T22:05:34.745431+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:36.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[21434]: audit 2024-03-11T22:05:35.198129+0000 mon.a (mon.0) 493 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-11T22:05:36.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[21434]: audit 2024-03-11T22:05:35.199762+0000 mon.a (mon.0) 494 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:36.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[21434]: cephadm 2024-03-11T22:05:35.201314+0000 mgr.y (mgr.14152) 247 : cephadm 1 Deploying daemon osd.5 on smithi187 2024-03-11T22:05:36.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[28804]: cluster 2024-03-11T22:05:34.745431+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[28804]: audit 2024-03-11T22:05:35.198129+0000 mon.a (mon.0) 493 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-11T22:05:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[28804]: audit 2024-03-11T22:05:35.199762+0000 mon.a (mon.0) 494 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:35 smithi049 bash[28804]: cephadm 2024-03-11T22:05:35.201314+0000 mgr.y (mgr.14152) 247 : cephadm 1 Deploying daemon osd.5 on smithi187 2024-03-11T22:05:38.157 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:37 smithi187 bash[23415]: cluster 2024-03-11T22:05:36.745966+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:38.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:37 smithi049 bash[28804]: cluster 2024-03-11T22:05:36.745966+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:38.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:37 smithi049 bash[21434]: cluster 2024-03-11T22:05:36.745966+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:39.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:39 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:05:39.631 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:05:39 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:05:39.631 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:05:39 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:05:39.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:39 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:05:39.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:39 smithi187 bash[23415]: cluster 2024-03-11T22:05:38.746532+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:39.883 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:05:39 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:05:39.883 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:05:39 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:05:40.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:39 smithi049 bash[21434]: cluster 2024-03-11T22:05:38.746532+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:40.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:39 smithi049 bash[28804]: cluster 2024-03-11T22:05:38.746532+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:41.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:40 smithi187 bash[23415]: audit 2024-03-11T22:05:39.942518+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:41.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:40 smithi187 bash[23415]: audit 2024-03-11T22:05:39.951400+0000 mon.a (mon.0) 496 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:41.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:40 smithi187 bash[23415]: audit 2024-03-11T22:05:39.978461+0000 mon.a (mon.0) 497 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:05:41.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:40 smithi049 bash[21434]: audit 2024-03-11T22:05:39.942518+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:41.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:40 smithi049 bash[21434]: audit 2024-03-11T22:05:39.951400+0000 mon.a (mon.0) 496 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:41.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:40 smithi049 bash[21434]: audit 2024-03-11T22:05:39.978461+0000 mon.a (mon.0) 497 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:05:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:40 smithi049 bash[28804]: audit 2024-03-11T22:05:39.942518+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:40 smithi049 bash[28804]: audit 2024-03-11T22:05:39.951400+0000 mon.a (mon.0) 496 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:40 smithi049 bash[28804]: audit 2024-03-11T22:05:39.978461+0000 mon.a (mon.0) 497 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:05:42.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:41 smithi187 bash[23415]: cluster 2024-03-11T22:05:40.747138+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:42.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:41 smithi049 bash[21434]: cluster 2024-03-11T22:05:40.747138+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:42.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:41 smithi049 bash[28804]: cluster 2024-03-11T22:05:40.747138+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:44.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:43 smithi187 bash[23415]: cluster 2024-03-11T22:05:42.747662+0000 mgr.y (mgr.14152) 251 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:44.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:43 smithi049 bash[21434]: cluster 2024-03-11T22:05:42.747662+0000 mgr.y (mgr.14152) 251 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:44.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:43 smithi049 bash[28804]: cluster 2024-03-11T22:05:42.747662+0000 mgr.y (mgr.14152) 251 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:46.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:46 smithi187 bash[23415]: cluster 2024-03-11T22:05:44.748250+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:46.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:46 smithi187 bash[23415]: audit 2024-03-11T22:05:45.274639+0000 mon.a (mon.0) 498 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:46 smithi187 bash[23415]: audit 2024-03-11T22:05:45.284216+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:46 smithi187 bash[23415]: audit 2024-03-11T22:05:45.968412+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:46.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:46 smithi187 bash[23415]: audit 2024-03-11T22:05:45.970314+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:05:46.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:46 smithi187 bash[23415]: audit 2024-03-11T22:05:45.980518+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[21434]: cluster 2024-03-11T22:05:44.748250+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[21434]: audit 2024-03-11T22:05:45.274639+0000 mon.a (mon.0) 498 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[21434]: audit 2024-03-11T22:05:45.284216+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[21434]: audit 2024-03-11T22:05:45.968412+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[21434]: audit 2024-03-11T22:05:45.970314+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[21434]: audit 2024-03-11T22:05:45.980518+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[28804]: cluster 2024-03-11T22:05:44.748250+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[28804]: audit 2024-03-11T22:05:45.274639+0000 mon.a (mon.0) 498 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[28804]: audit 2024-03-11T22:05:45.284216+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[28804]: audit 2024-03-11T22:05:45.968412+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[28804]: audit 2024-03-11T22:05:45.970314+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:05:46.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:46 smithi049 bash[28804]: audit 2024-03-11T22:05:45.980518+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:47.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:47 smithi049 bash[21434]: audit 2024-03-11T22:05:46.511547+0000 mon.b (mon.1) 15 : audit 1 from='osd.5 v1:172.21.15.187:6804/2249702314' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-11T22:05:47.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:47 smithi049 bash[21434]: audit 2024-03-11T22:05:46.512226+0000 mon.a (mon.0) 503 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-11T22:05:47.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:47 smithi049 bash[28804]: audit 2024-03-11T22:05:46.511547+0000 mon.b (mon.1) 15 : audit 1 from='osd.5 v1:172.21.15.187:6804/2249702314' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-11T22:05:47.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:47 smithi049 bash[28804]: audit 2024-03-11T22:05:46.512226+0000 mon.a (mon.0) 503 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-11T22:05:47.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:47 smithi187 bash[23415]: audit 2024-03-11T22:05:46.511547+0000 mon.b (mon.1) 15 : audit 1 from='osd.5 v1:172.21.15.187:6804/2249702314' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-11T22:05:47.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:47 smithi187 bash[23415]: audit 2024-03-11T22:05:46.512226+0000 mon.a (mon.0) 503 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-11T22:05:48.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:48 smithi187 bash[23415]: cluster 2024-03-11T22:05:46.748821+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:48.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:48 smithi187 bash[23415]: audit 2024-03-11T22:05:47.281459+0000 mon.a (mon.0) 504 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-11T22:05:48.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:48 smithi187 bash[23415]: cluster 2024-03-11T22:05:47.286862+0000 mon.a (mon.0) 505 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-03-11T22:05:48.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:48 smithi187 bash[23415]: audit 2024-03-11T22:05:47.287485+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:48.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:48 smithi187 bash[23415]: audit 2024-03-11T22:05:47.287579+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.187:6804/2249702314' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:05:48.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:48 smithi187 bash[23415]: audit 2024-03-11T22:05:47.288381+0000 mon.a (mon.0) 507 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[21434]: cluster 2024-03-11T22:05:46.748821+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[21434]: audit 2024-03-11T22:05:47.281459+0000 mon.a (mon.0) 504 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[21434]: cluster 2024-03-11T22:05:47.286862+0000 mon.a (mon.0) 505 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[21434]: audit 2024-03-11T22:05:47.287485+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[21434]: audit 2024-03-11T22:05:47.287579+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.187:6804/2249702314' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[21434]: audit 2024-03-11T22:05:47.288381+0000 mon.a (mon.0) 507 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[28804]: cluster 2024-03-11T22:05:46.748821+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[28804]: audit 2024-03-11T22:05:47.281459+0000 mon.a (mon.0) 504 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[28804]: cluster 2024-03-11T22:05:47.286862+0000 mon.a (mon.0) 505 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[28804]: audit 2024-03-11T22:05:47.287485+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:48.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[28804]: audit 2024-03-11T22:05:47.287579+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.187:6804/2249702314' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:05:48.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:48 smithi049 bash[28804]: audit 2024-03-11T22:05:47.288381+0000 mon.a (mon.0) 507 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:05:48.841 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:48.846+0000 7f0863fff700 1 -- 172.21.15.187:0/559927455 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 2409278919) 0x7f0868000bc0 con 0x7f086406e450 2024-03-11T22:05:48.841 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 5 on host 'smithi187' 2024-03-11T22:05:48.844 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:48.850+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 >> v1:172.21.15.49:6800/4076252288 conn(0x7f086406e450 legacy=0x7f0864070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:05:48.844 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:48.850+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 >> v1:172.21.15.187:6789/0 conn(0x7f087c102500 legacy=0x7f087c108a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:05:48.844 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:48.850+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 shutdown_connections 2024-03-11T22:05:48.845 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:48.850+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 >> 172.21.15.187:0/559927455 conn(0x7f087c0fbf30 msgr2=0x7f087c10a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:05:48.845 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:48.850+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 shutdown_connections 2024-03-11T22:05:48.845 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:05:48.850+0000 7f0881731700 1 -- 172.21.15.187:0/559927455 wait complete. 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: audit 2024-03-11T22:05:48.284075+0000 mon.a (mon.0) 508 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: cluster 2024-03-11T22:05:48.289672+0000 mon.a (mon.0) 509 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: audit 2024-03-11T22:05:48.290723+0000 mon.a (mon.0) 510 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: audit 2024-03-11T22:05:48.300681+0000 mon.a (mon.0) 511 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: audit 2024-03-11T22:05:48.805175+0000 mon.a (mon.0) 512 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: audit 2024-03-11T22:05:48.814923+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: audit 2024-03-11T22:05:48.824948+0000 mon.a (mon.0) 514 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: cluster 2024-03-11T22:05:49.288680+0000 mon.a (mon.0) 515 : cluster 1 osd.5 v1:172.21.15.187:6804/2249702314 boot 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: cluster 2024-03-11T22:05:49.288749+0000 mon.a (mon.0) 516 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-03-11T22:05:49.588 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:49 smithi187 bash[23415]: audit 2024-03-11T22:05:49.288890+0000 mon.a (mon.0) 517 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.589 DEBUG:teuthology.orchestra.run.smithi187:osd.5> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.5.service 2024-03-11T22:05:49.592 INFO:tasks.cephadm:Deploying osd.6 on smithi187 with /dev/vg_nvme/lv_2... 2024-03-11T22:05:49.592 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-11T22:05:49.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: audit 2024-03-11T22:05:48.284075+0000 mon.a (mon.0) 508 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: cluster 2024-03-11T22:05:48.289672+0000 mon.a (mon.0) 509 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: audit 2024-03-11T22:05:48.290723+0000 mon.a (mon.0) 510 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: audit 2024-03-11T22:05:48.300681+0000 mon.a (mon.0) 511 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: audit 2024-03-11T22:05:48.805175+0000 mon.a (mon.0) 512 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: audit 2024-03-11T22:05:48.814923+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: audit 2024-03-11T22:05:48.824948+0000 mon.a (mon.0) 514 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: cluster 2024-03-11T22:05:49.288680+0000 mon.a (mon.0) 515 : cluster 1 osd.5 v1:172.21.15.187:6804/2249702314 boot 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: cluster 2024-03-11T22:05:49.288749+0000 mon.a (mon.0) 516 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[21434]: audit 2024-03-11T22:05:49.288890+0000 mon.a (mon.0) 517 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: audit 2024-03-11T22:05:48.284075+0000 mon.a (mon.0) 508 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: cluster 2024-03-11T22:05:48.289672+0000 mon.a (mon.0) 509 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: audit 2024-03-11T22:05:48.290723+0000 mon.a (mon.0) 510 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: audit 2024-03-11T22:05:48.300681+0000 mon.a (mon.0) 511 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: audit 2024-03-11T22:05:48.805175+0000 mon.a (mon.0) 512 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: audit 2024-03-11T22:05:48.814923+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: audit 2024-03-11T22:05:48.824948+0000 mon.a (mon.0) 514 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: cluster 2024-03-11T22:05:49.288680+0000 mon.a (mon.0) 515 : cluster 1 osd.5 v1:172.21.15.187:6804/2249702314 boot 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: cluster 2024-03-11T22:05:49.288749+0000 mon.a (mon.0) 516 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-03-11T22:05:49.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:49 smithi049 bash[28804]: audit 2024-03-11T22:05:49.288890+0000 mon.a (mon.0) 517 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:05:50.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:50 smithi187 bash[23415]: cluster 2024-03-11T22:05:47.502502+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:05:50.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:50 smithi187 bash[23415]: cluster 2024-03-11T22:05:47.502586+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:05:50.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:50 smithi187 bash[23415]: cluster 2024-03-11T22:05:48.749384+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:50.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:50 smithi187 bash[23415]: cluster 2024-03-11T22:05:50.293297+0000 mon.a (mon.0) 518 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[21434]: cluster 2024-03-11T22:05:47.502502+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[21434]: cluster 2024-03-11T22:05:47.502586+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[21434]: cluster 2024-03-11T22:05:48.749384+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[21434]: cluster 2024-03-11T22:05:50.293297+0000 mon.a (mon.0) 518 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[28804]: cluster 2024-03-11T22:05:47.502502+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[28804]: cluster 2024-03-11T22:05:47.502586+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[28804]: cluster 2024-03-11T22:05:48.749384+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-03-11T22:05:50.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:50 smithi049 bash[28804]: cluster 2024-03-11T22:05:50.293297+0000 mon.a (mon.0) 518 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-03-11T22:05:52.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:52 smithi187 bash[23415]: cluster 2024-03-11T22:05:50.749888+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:52.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:52 smithi187 bash[23415]: cluster 2024-03-11T22:05:51.296344+0000 mon.a (mon.0) 519 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-03-11T22:05:52.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:52 smithi049 bash[21434]: cluster 2024-03-11T22:05:50.749888+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:52.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:52 smithi049 bash[21434]: cluster 2024-03-11T22:05:51.296344+0000 mon.a (mon.0) 519 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-03-11T22:05:52.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:52 smithi049 bash[28804]: cluster 2024-03-11T22:05:50.749888+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:52.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:52 smithi049 bash[28804]: cluster 2024-03-11T22:05:51.296344+0000 mon.a (mon.0) 519 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-03-11T22:05:53.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:53 smithi187 bash[23415]: cluster 2024-03-11T22:05:52.307440+0000 mon.a (mon.0) 520 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-03-11T22:05:53.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:53 smithi049 bash[28804]: cluster 2024-03-11T22:05:52.307440+0000 mon.a (mon.0) 520 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-03-11T22:05:53.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:53 smithi049 bash[21434]: cluster 2024-03-11T22:05:52.307440+0000 mon.a (mon.0) 520 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-03-11T22:05:53.806 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:05:54.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:54 smithi187 bash[23415]: cluster 2024-03-11T22:05:52.750440+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:54.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:54 smithi187 bash[23415]: cluster 2024-03-11T22:05:53.316901+0000 mon.a (mon.0) 521 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-03-11T22:05:54.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:54 smithi049 bash[28804]: cluster 2024-03-11T22:05:52.750440+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:54.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:54 smithi049 bash[28804]: cluster 2024-03-11T22:05:53.316901+0000 mon.a (mon.0) 521 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-03-11T22:05:54.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:54 smithi049 bash[21434]: cluster 2024-03-11T22:05:52.750440+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:54.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:54 smithi049 bash[21434]: cluster 2024-03-11T22:05:53.316901+0000 mon.a (mon.0) 521 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-03-11T22:05:56.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:56 smithi187 bash[23415]: cluster 2024-03-11T22:05:54.751018+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:56 smithi049 bash[28804]: cluster 2024-03-11T22:05:54.751018+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:56.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:56 smithi049 bash[21434]: cluster 2024-03-11T22:05:54.751018+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:58.201 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-11T22:05:58.201 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-11T22:05:58.201 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2024-03-11T22:05:58.201 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2024-03-11T22:05:58.202 INFO:teuthology.orchestra.run.smithi187.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0151624 s, 692 MB/s 2024-03-11T22:05:58.202 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2024-03-11T22:05:58.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:05:58 smithi187 bash[23415]: cluster 2024-03-11T22:05:56.751609+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:58.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:05:58 smithi049 bash[28804]: cluster 2024-03-11T22:05:56.751609+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:58.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:05:58 smithi049 bash[21434]: cluster 2024-03-11T22:05:56.751609+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:05:58.977 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi187:vg_nvme/lv_2 2024-03-11T22:06:00.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: cluster 2024-03-11T22:05:58.752168+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:00.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.438438+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.447658+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.450013+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:00.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.451807+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:00.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.459209+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.463517+0000 mon.a (mon.0) 527 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:00.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.465650+0000 mon.a (mon.0) 528 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:00.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:00 smithi187 bash[23415]: audit 2024-03-11T22:05:59.475301+0000 mon.a (mon.0) 529 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: cluster 2024-03-11T22:05:58.752168+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:00.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.438438+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.447658+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.450013+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.451807+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.459209+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.463517+0000 mon.a (mon.0) 527 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.465650+0000 mon.a (mon.0) 528 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[21434]: audit 2024-03-11T22:05:59.475301+0000 mon.a (mon.0) 529 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: cluster 2024-03-11T22:05:58.752168+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.438438+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.447658+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.450013+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:00.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.451807+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:00.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.459209+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:00.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.463517+0000 mon.a (mon.0) 527 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:00.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.465650+0000 mon.a (mon.0) 528 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:00.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:00 smithi049 bash[28804]: audit 2024-03-11T22:05:59.475301+0000 mon.a (mon.0) 529 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:01.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:01 smithi187 bash[23415]: cephadm 2024-03-11T22:05:59.429492+0000 mgr.y (mgr.14152) 260 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:06:01.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:01 smithi187 bash[23415]: cephadm 2024-03-11T22:05:59.453094+0000 mgr.y (mgr.14152) 261 : cephadm 1 Adjusting osd_memory_target on smithi187 to 8632M 2024-03-11T22:06:01.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:01 smithi049 bash[21434]: cephadm 2024-03-11T22:05:59.429492+0000 mgr.y (mgr.14152) 260 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:06:01.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:01 smithi049 bash[21434]: cephadm 2024-03-11T22:05:59.453094+0000 mgr.y (mgr.14152) 261 : cephadm 1 Adjusting osd_memory_target on smithi187 to 8632M 2024-03-11T22:06:01.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:01 smithi049 bash[28804]: cephadm 2024-03-11T22:05:59.429492+0000 mgr.y (mgr.14152) 260 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:06:01.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:01 smithi049 bash[28804]: cephadm 2024-03-11T22:05:59.453094+0000 mgr.y (mgr.14152) 261 : cephadm 1 Adjusting osd_memory_target on smithi187 to 8632M 2024-03-11T22:06:02.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:02 smithi187 bash[23415]: cluster 2024-03-11T22:06:00.752752+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:02 smithi049 bash[21434]: cluster 2024-03-11T22:06:00.752752+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:02.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:02 smithi049 bash[28804]: cluster 2024-03-11T22:06:00.752752+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:03.711 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:06:04.574 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:04 smithi187 bash[23415]: cluster 2024-03-11T22:06:02.753347+0000 mgr.y (mgr.14152) 263 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:04.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:04 smithi049 bash[21434]: cluster 2024-03-11T22:06:02.753347+0000 mgr.y (mgr.14152) 263 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:04.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:04 smithi049 bash[28804]: cluster 2024-03-11T22:06:02.753347+0000 mgr.y (mgr.14152) 263 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- 172.21.15.187:0/3414742653 >> v1:172.21.15.187:6789/0 conn(0x7f66a41080e0 legacy=0x7f66a410a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- 172.21.15.187:0/3414742653 shutdown_connections 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- 172.21.15.187:0/3414742653 >> 172.21.15.187:0/3414742653 conn(0x7f66a40ff250 msgr2=0x7f66a4101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- 172.21.15.187:0/3414742653 shutdown_connections 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- 172.21.15.187:0/3414742653 wait complete. 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 Processor -- start 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- start start 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f66a4199b90 con 0x7f66a4103cb0 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f66a41a5380 con 0x7f66a410be20 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a9cde700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f66a41a6520 con 0x7f66a41080e0 2024-03-11T22:06:06.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a3fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f66a410be20 0x7f66a41a2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:47350/0 (socket says 172.21.15.187:47350) 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a3fff700 1 -- 172.21.15.187:0/1000563493 learned_addr learned my addr 172.21.15.187:0/1000563493 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024328079 0 0) 0x7f66a41a5380 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f668c0035b0 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1848777079 0 0) 0x7f668c0035b0 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66a41a5380 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.358+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f669c001c10 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619201566 0 0) 0x7f66a4199b90 con 0x7f66a4103cb0 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f668c0035b0 con 0x7f66a4103cb0 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1667883557 0 0) 0x7f66a41a5380 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 >> v1:172.21.15.49:6790/0 conn(0x7f66a41080e0 legacy=0x7f66a419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 >> v1:172.21.15.49:6789/0 conn(0x7f66a4103cb0 legacy=0x7f66a4199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a41a76c0 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a41a43d0 con 0x7f66a410be20 2024-03-11T22:06:06.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a41a48d0 con 0x7f66a410be20 2024-03-11T22:06:06.358 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f669c003eb0 con 0x7f66a410be20 2024-03-11T22:06:06.358 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f669c005fb0 con 0x7f66a410be20 2024-03-11T22:06:06.358 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6690005150 con 0x7f66a410be20 2024-03-11T22:06:06.358 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f669c003a20 con 0x7f66a410be20 2024-03-11T22:06:06.358 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.362+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(42..42 src has 1..42) v4 ==== 3497+0+0 (unknown 2944238641 0 0) 0x7f669c087c30 con 0x7f66a410be20 2024-03-11T22:06:06.362 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.366+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f669c051eb0 con 0x7f66a410be20 2024-03-11T22:06:06.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:06 smithi187 bash[23415]: cluster 2024-03-11T22:06:04.753889+0000 mgr.y (mgr.14152) 264 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:06.569 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:06.574+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6690000bc0 con 0x7f668c06e280 2024-03-11T22:06:06.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:06 smithi049 bash[21434]: cluster 2024-03-11T22:06:04.753889+0000 mgr.y (mgr.14152) 264 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:06.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:06 smithi049 bash[28804]: cluster 2024-03-11T22:06:04.753889+0000 mgr.y (mgr.14152) 264 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:07.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:07 smithi187 bash[23415]: audit 2024-03-11T22:06:06.581847+0000 mgr.y (mgr.14152) 265 : audit 0 from='client.24292 v1:172.21.15.187:0/1000563493' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:06:07.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:07 smithi187 bash[23415]: audit 2024-03-11T22:06:06.588879+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:06:07.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:07 smithi187 bash[23415]: audit 2024-03-11T22:06:06.595120+0000 mon.a (mon.0) 531 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:06:07.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:07 smithi187 bash[23415]: audit 2024-03-11T22:06:06.596664+0000 mon.a (mon.0) 532 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:07.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:07 smithi187 bash[23415]: cluster 2024-03-11T22:06:06.754412+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[21434]: audit 2024-03-11T22:06:06.581847+0000 mgr.y (mgr.14152) 265 : audit 0 from='client.24292 v1:172.21.15.187:0/1000563493' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:06:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[21434]: audit 2024-03-11T22:06:06.588879+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:06:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[21434]: audit 2024-03-11T22:06:06.595120+0000 mon.a (mon.0) 531 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:06:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[21434]: audit 2024-03-11T22:06:06.596664+0000 mon.a (mon.0) 532 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[21434]: cluster 2024-03-11T22:06:06.754412+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[28804]: audit 2024-03-11T22:06:06.581847+0000 mgr.y (mgr.14152) 265 : audit 0 from='client.24292 v1:172.21.15.187:0/1000563493' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:06:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[28804]: audit 2024-03-11T22:06:06.588879+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:06:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[28804]: audit 2024-03-11T22:06:06.595120+0000 mon.a (mon.0) 531 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:06:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[28804]: audit 2024-03-11T22:06:06.596664+0000 mon.a (mon.0) 532 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:07 smithi049 bash[28804]: cluster 2024-03-11T22:06:06.754412+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:09 smithi187 bash[23415]: cluster 2024-03-11T22:06:08.754954+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:10.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:09 smithi049 bash[21434]: cluster 2024-03-11T22:06:08.754954+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:10.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:09 smithi049 bash[28804]: cluster 2024-03-11T22:06:08.754954+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:11.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:11 smithi187 bash[23415]: cluster 2024-03-11T22:06:10.755526+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:12.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:11 smithi049 bash[21434]: cluster 2024-03-11T22:06:10.755526+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:12.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:11 smithi049 bash[28804]: cluster 2024-03-11T22:06:10.755526+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:14.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:13 smithi187 bash[23415]: cluster 2024-03-11T22:06:12.756017+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:14.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:13 smithi049 bash[21434]: cluster 2024-03-11T22:06:12.756017+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:14.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:13 smithi049 bash[28804]: cluster 2024-03-11T22:06:12.756017+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:16.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:15 smithi187 bash[23415]: cluster 2024-03-11T22:06:14.756578+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:16.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:15 smithi187 bash[23415]: audit 2024-03-11T22:06:14.848661+0000 mon.b (mon.1) 17 : audit 1 from='client.? v1:172.21.15.187:0/3118711332' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]: dispatch 2024-03-11T22:06:16.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:15 smithi187 bash[23415]: audit 2024-03-11T22:06:14.849610+0000 mon.a (mon.0) 533 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]: dispatch 2024-03-11T22:06:16.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:15 smithi187 bash[23415]: audit 2024-03-11T22:06:14.853407+0000 mon.a (mon.0) 534 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]': finished 2024-03-11T22:06:16.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:15 smithi187 bash[23415]: cluster 2024-03-11T22:06:14.858640+0000 mon.a (mon.0) 535 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-03-11T22:06:16.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:15 smithi187 bash[23415]: audit 2024-03-11T22:06:14.859144+0000 mon.a (mon.0) 536 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:16.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:15 smithi187 bash[23415]: audit 2024-03-11T22:06:15.520557+0000 mon.b (mon.1) 18 : audit 0 from='client.? v1:172.21.15.187:0/1204157407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:06:16.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[21434]: cluster 2024-03-11T22:06:14.756578+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:16.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[21434]: audit 2024-03-11T22:06:14.848661+0000 mon.b (mon.1) 17 : audit 1 from='client.? v1:172.21.15.187:0/3118711332' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]: dispatch 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[21434]: audit 2024-03-11T22:06:14.849610+0000 mon.a (mon.0) 533 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]: dispatch 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[21434]: audit 2024-03-11T22:06:14.853407+0000 mon.a (mon.0) 534 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]': finished 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[21434]: cluster 2024-03-11T22:06:14.858640+0000 mon.a (mon.0) 535 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[21434]: audit 2024-03-11T22:06:14.859144+0000 mon.a (mon.0) 536 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[21434]: audit 2024-03-11T22:06:15.520557+0000 mon.b (mon.1) 18 : audit 0 from='client.? v1:172.21.15.187:0/1204157407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[28804]: cluster 2024-03-11T22:06:14.756578+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[28804]: audit 2024-03-11T22:06:14.848661+0000 mon.b (mon.1) 17 : audit 1 from='client.? v1:172.21.15.187:0/3118711332' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]: dispatch 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[28804]: audit 2024-03-11T22:06:14.849610+0000 mon.a (mon.0) 533 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]: dispatch 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[28804]: audit 2024-03-11T22:06:14.853407+0000 mon.a (mon.0) 534 : audit 1 from='client.24298 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "742c8fbe-3d0b-4586-aa9a-4bb91082fba7"}]': finished 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[28804]: cluster 2024-03-11T22:06:14.858640+0000 mon.a (mon.0) 535 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[28804]: audit 2024-03-11T22:06:14.859144+0000 mon.a (mon.0) 536 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:15 smithi049 bash[28804]: audit 2024-03-11T22:06:15.520557+0000 mon.b (mon.1) 18 : audit 0 from='client.? v1:172.21.15.187:0/1204157407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:06:18.169 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:17 smithi187 bash[23415]: cluster 2024-03-11T22:06:16.757199+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:18.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:17 smithi049 bash[21434]: cluster 2024-03-11T22:06:16.757199+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:18.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:17 smithi049 bash[28804]: cluster 2024-03-11T22:06:16.757199+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:20.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:19 smithi187 bash[23415]: cluster 2024-03-11T22:06:18.757766+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:20.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:19 smithi049 bash[21434]: cluster 2024-03-11T22:06:18.757766+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:20.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:19 smithi049 bash[28804]: cluster 2024-03-11T22:06:18.757766+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:22.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:21 smithi187 bash[23415]: cluster 2024-03-11T22:06:20.758448+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:22.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:21 smithi049 bash[21434]: cluster 2024-03-11T22:06:20.758448+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:22.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:21 smithi049 bash[28804]: cluster 2024-03-11T22:06:20.758448+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:23.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:23 smithi187 bash[23415]: cluster 2024-03-11T22:06:22.759131+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:24.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:23 smithi049 bash[21434]: cluster 2024-03-11T22:06:22.759131+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:24.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:23 smithi049 bash[28804]: cluster 2024-03-11T22:06:22.759131+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:26.088 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:25 smithi187 bash[23415]: cluster 2024-03-11T22:06:24.759837+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:26.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:25 smithi049 bash[21434]: cluster 2024-03-11T22:06:24.759837+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:26.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:25 smithi049 bash[28804]: cluster 2024-03-11T22:06:24.759837+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:27.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:27 smithi187 bash[23415]: cluster 2024-03-11T22:06:26.760460+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:27.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:27 smithi187 bash[23415]: audit 2024-03-11T22:06:27.244217+0000 mon.a (mon.0) 537 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-11T22:06:27.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:27 smithi187 bash[23415]: audit 2024-03-11T22:06:27.245909+0000 mon.a (mon.0) 538 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:27.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:27 smithi187 bash[23415]: cephadm 2024-03-11T22:06:27.247556+0000 mgr.y (mgr.14152) 277 : cephadm 1 Deploying daemon osd.6 on smithi187 2024-03-11T22:06:28.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[21434]: cluster 2024-03-11T22:06:26.760460+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:28.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[21434]: audit 2024-03-11T22:06:27.244217+0000 mon.a (mon.0) 537 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-11T22:06:28.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[21434]: audit 2024-03-11T22:06:27.245909+0000 mon.a (mon.0) 538 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:28.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[21434]: cephadm 2024-03-11T22:06:27.247556+0000 mgr.y (mgr.14152) 277 : cephadm 1 Deploying daemon osd.6 on smithi187 2024-03-11T22:06:28.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[28804]: cluster 2024-03-11T22:06:26.760460+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:28.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[28804]: audit 2024-03-11T22:06:27.244217+0000 mon.a (mon.0) 537 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-11T22:06:28.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[28804]: audit 2024-03-11T22:06:27.245909+0000 mon.a (mon.0) 538 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:28.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:27 smithi049 bash[28804]: cephadm 2024-03-11T22:06:27.247556+0000 mgr.y (mgr.14152) 277 : cephadm 1 Deploying daemon osd.6 on smithi187 2024-03-11T22:06:30.179 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:29 smithi187 bash[23415]: cluster 2024-03-11T22:06:28.761069+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:30.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:29 smithi049 bash[21434]: cluster 2024-03-11T22:06:28.761069+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:30.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:29 smithi049 bash[28804]: cluster 2024-03-11T22:06:28.761069+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:31.710 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.710 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.710 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.710 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.962 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.962 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.963 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.963 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:31 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:06:31.963 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:31 smithi187 bash[23415]: cluster 2024-03-11T22:06:30.761599+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:32.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:31 smithi049 bash[21434]: cluster 2024-03-11T22:06:30.761599+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:32.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:31 smithi049 bash[28804]: cluster 2024-03-11T22:06:30.761599+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:33.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:32 smithi187 bash[23415]: audit 2024-03-11T22:06:31.977737+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:33.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:32 smithi187 bash[23415]: audit 2024-03-11T22:06:31.986934+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:33.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:32 smithi187 bash[23415]: audit 2024-03-11T22:06:31.998956+0000 mon.a (mon.0) 541 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:06:33.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:32 smithi049 bash[21434]: audit 2024-03-11T22:06:31.977737+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:33.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:32 smithi049 bash[21434]: audit 2024-03-11T22:06:31.986934+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:33.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:32 smithi049 bash[21434]: audit 2024-03-11T22:06:31.998956+0000 mon.a (mon.0) 541 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:06:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:32 smithi049 bash[28804]: audit 2024-03-11T22:06:31.977737+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:32 smithi049 bash[28804]: audit 2024-03-11T22:06:31.986934+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:32 smithi049 bash[28804]: audit 2024-03-11T22:06:31.998956+0000 mon.a (mon.0) 541 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:06:34.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:33 smithi187 bash[23415]: cluster 2024-03-11T22:06:32.762245+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:34.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:33 smithi049 bash[21434]: cluster 2024-03-11T22:06:32.762245+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:34.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:33 smithi049 bash[28804]: cluster 2024-03-11T22:06:32.762245+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:36.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:35 smithi187 bash[23415]: cluster 2024-03-11T22:06:34.762821+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:36.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:35 smithi049 bash[21434]: cluster 2024-03-11T22:06:34.762821+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:36.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:35 smithi049 bash[28804]: cluster 2024-03-11T22:06:34.762821+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:38.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:37 smithi187 bash[23415]: cluster 2024-03-11T22:06:36.763374+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:38.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:37 smithi049 bash[21434]: cluster 2024-03-11T22:06:36.763374+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:38.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:37 smithi049 bash[28804]: cluster 2024-03-11T22:06:36.763374+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[21434]: audit 2024-03-11T22:06:38.483834+0000 mon.b (mon.1) 19 : audit 1 from='osd.6 v1:172.21.15.187:6808/2887830694' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[21434]: audit 2024-03-11T22:06:38.484795+0000 mon.a (mon.0) 542 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[21434]: audit 2024-03-11T22:06:38.951318+0000 mon.a (mon.0) 543 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[21434]: audit 2024-03-11T22:06:38.962958+0000 mon.a (mon.0) 544 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[21434]: audit 2024-03-11T22:06:38.965204+0000 mon.a (mon.0) 545 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[21434]: audit 2024-03-11T22:06:38.967005+0000 mon.a (mon.0) 546 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[21434]: audit 2024-03-11T22:06:38.976779+0000 mon.a (mon.0) 547 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[28804]: audit 2024-03-11T22:06:38.483834+0000 mon.b (mon.1) 19 : audit 1 from='osd.6 v1:172.21.15.187:6808/2887830694' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-11T22:06:39.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[28804]: audit 2024-03-11T22:06:38.484795+0000 mon.a (mon.0) 542 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-11T22:06:39.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[28804]: audit 2024-03-11T22:06:38.951318+0000 mon.a (mon.0) 543 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[28804]: audit 2024-03-11T22:06:38.962958+0000 mon.a (mon.0) 544 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[28804]: audit 2024-03-11T22:06:38.965204+0000 mon.a (mon.0) 545 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:39.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[28804]: audit 2024-03-11T22:06:38.967005+0000 mon.a (mon.0) 546 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:39.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:38 smithi049 bash[28804]: audit 2024-03-11T22:06:38.976779+0000 mon.a (mon.0) 547 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:38 smithi187 bash[23415]: audit 2024-03-11T22:06:38.483834+0000 mon.b (mon.1) 19 : audit 1 from='osd.6 v1:172.21.15.187:6808/2887830694' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-11T22:06:39.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:38 smithi187 bash[23415]: audit 2024-03-11T22:06:38.484795+0000 mon.a (mon.0) 542 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-11T22:06:39.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:38 smithi187 bash[23415]: audit 2024-03-11T22:06:38.951318+0000 mon.a (mon.0) 543 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:38 smithi187 bash[23415]: audit 2024-03-11T22:06:38.962958+0000 mon.a (mon.0) 544 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:39.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:38 smithi187 bash[23415]: audit 2024-03-11T22:06:38.965204+0000 mon.a (mon.0) 545 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:39.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:38 smithi187 bash[23415]: audit 2024-03-11T22:06:38.967005+0000 mon.a (mon.0) 546 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:39.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:38 smithi187 bash[23415]: audit 2024-03-11T22:06:38.976779+0000 mon.a (mon.0) 547 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:40.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:40 smithi187 bash[23415]: cluster 2024-03-11T22:06:38.763887+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:40.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:40 smithi187 bash[23415]: audit 2024-03-11T22:06:39.006111+0000 mon.a (mon.0) 548 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-11T22:06:40.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:40 smithi187 bash[23415]: cluster 2024-03-11T22:06:39.010133+0000 mon.a (mon.0) 549 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-03-11T22:06:40.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:40 smithi187 bash[23415]: audit 2024-03-11T22:06:39.010493+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:40.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:40 smithi187 bash[23415]: audit 2024-03-11T22:06:39.014406+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.187:6808/2887830694' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:06:40.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:40 smithi187 bash[23415]: audit 2024-03-11T22:06:39.015449+0000 mon.a (mon.0) 551 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:06:40.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[21434]: cluster 2024-03-11T22:06:38.763887+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[21434]: audit 2024-03-11T22:06:39.006111+0000 mon.a (mon.0) 548 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[21434]: cluster 2024-03-11T22:06:39.010133+0000 mon.a (mon.0) 549 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[21434]: audit 2024-03-11T22:06:39.010493+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[21434]: audit 2024-03-11T22:06:39.014406+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.187:6808/2887830694' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[21434]: audit 2024-03-11T22:06:39.015449+0000 mon.a (mon.0) 551 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[28804]: cluster 2024-03-11T22:06:38.763887+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[28804]: audit 2024-03-11T22:06:39.006111+0000 mon.a (mon.0) 548 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[28804]: cluster 2024-03-11T22:06:39.010133+0000 mon.a (mon.0) 549 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[28804]: audit 2024-03-11T22:06:39.010493+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:40.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[28804]: audit 2024-03-11T22:06:39.014406+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.187:6808/2887830694' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:06:40.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:40 smithi049 bash[28804]: audit 2024-03-11T22:06:39.015449+0000 mon.a (mon.0) 551 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:06:41.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[21434]: audit 2024-03-11T22:06:40.016752+0000 mon.a (mon.0) 552 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:06:41.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[21434]: cluster 2024-03-11T22:06:40.022257+0000 mon.a (mon.0) 553 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-03-11T22:06:41.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[21434]: audit 2024-03-11T22:06:40.022912+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[21434]: audit 2024-03-11T22:06:40.031609+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[21434]: cluster 2024-03-11T22:06:40.659768+0000 mon.a (mon.0) 556 : cluster 1 osd.6 v1:172.21.15.187:6808/2887830694 boot 2024-03-11T22:06:41.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[21434]: cluster 2024-03-11T22:06:40.659865+0000 mon.a (mon.0) 557 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-03-11T22:06:41.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[21434]: audit 2024-03-11T22:06:40.660238+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[28804]: audit 2024-03-11T22:06:40.016752+0000 mon.a (mon.0) 552 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:06:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[28804]: cluster 2024-03-11T22:06:40.022257+0000 mon.a (mon.0) 553 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-03-11T22:06:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[28804]: audit 2024-03-11T22:06:40.022912+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[28804]: audit 2024-03-11T22:06:40.031609+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[28804]: cluster 2024-03-11T22:06:40.659768+0000 mon.a (mon.0) 556 : cluster 1 osd.6 v1:172.21.15.187:6808/2887830694 boot 2024-03-11T22:06:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[28804]: cluster 2024-03-11T22:06:40.659865+0000 mon.a (mon.0) 557 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-03-11T22:06:41.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:41 smithi049 bash[28804]: audit 2024-03-11T22:06:40.660238+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:41 smithi187 bash[23415]: audit 2024-03-11T22:06:40.016752+0000 mon.a (mon.0) 552 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:06:41.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:41 smithi187 bash[23415]: cluster 2024-03-11T22:06:40.022257+0000 mon.a (mon.0) 553 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-03-11T22:06:41.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:41 smithi187 bash[23415]: audit 2024-03-11T22:06:40.022912+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:41 smithi187 bash[23415]: audit 2024-03-11T22:06:40.031609+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:41.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:41 smithi187 bash[23415]: cluster 2024-03-11T22:06:40.659768+0000 mon.a (mon.0) 556 : cluster 1 osd.6 v1:172.21.15.187:6808/2887830694 boot 2024-03-11T22:06:41.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:41 smithi187 bash[23415]: cluster 2024-03-11T22:06:40.659865+0000 mon.a (mon.0) 557 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-03-11T22:06:41.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:41 smithi187 bash[23415]: audit 2024-03-11T22:06:40.660238+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:06:42.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[21434]: cluster 2024-03-11T22:06:39.482283+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:06:42.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[21434]: cluster 2024-03-11T22:06:39.482359+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:06:42.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[21434]: cluster 2024-03-11T22:06:40.764542+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:42.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[21434]: cluster 2024-03-11T22:06:41.671420+0000 mon.a (mon.0) 559 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-03-11T22:06:42.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[28804]: cluster 2024-03-11T22:06:39.482283+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:06:42.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[28804]: cluster 2024-03-11T22:06:39.482359+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:06:42.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[28804]: cluster 2024-03-11T22:06:40.764542+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:42.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:42 smithi049 bash[28804]: cluster 2024-03-11T22:06:41.671420+0000 mon.a (mon.0) 559 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-03-11T22:06:42.323 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:42 smithi187 bash[23415]: cluster 2024-03-11T22:06:39.482283+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:06:42.323 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:42 smithi187 bash[23415]: cluster 2024-03-11T22:06:39.482359+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:06:42.323 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:42 smithi187 bash[23415]: cluster 2024-03-11T22:06:40.764542+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-11T22:06:42.324 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:42 smithi187 bash[23415]: cluster 2024-03-11T22:06:41.671420+0000 mon.a (mon.0) 559 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-03-11T22:06:42.903 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:42.910+0000 7f66a0ff9700 1 -- 172.21.15.187:0/1000563493 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 1805950491) 0x7f6690000bc0 con 0x7f668c06e280 2024-03-11T22:06:42.904 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 6 on host 'smithi187' 2024-03-11T22:06:42.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:42.914+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 >> v1:172.21.15.49:6800/4076252288 conn(0x7f668c06e280 legacy=0x7f668c070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:06:42.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:42.914+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 >> v1:172.21.15.187:6789/0 conn(0x7f66a410be20 legacy=0x7f66a41a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:06:42.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:42.914+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 shutdown_connections 2024-03-11T22:06:42.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:42.914+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 >> 172.21.15.187:0/1000563493 conn(0x7f66a40ff250 msgr2=0x7f66a410a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:06:42.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:42.914+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 shutdown_connections 2024-03-11T22:06:42.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:06:42.914+0000 7f66a9cde700 1 -- 172.21.15.187:0/1000563493 wait complete. 2024-03-11T22:06:43.702 DEBUG:teuthology.orchestra.run.smithi187:osd.6> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.6.service 2024-03-11T22:06:43.704 INFO:tasks.cephadm:Deploying osd.7 on smithi187 with /dev/vg_nvme/lv_1... 2024-03-11T22:06:43.705 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-11T22:06:43.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:43 smithi187 bash[23415]: cluster 2024-03-11T22:06:42.671795+0000 mon.a (mon.0) 560 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-03-11T22:06:43.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:43 smithi187 bash[23415]: cluster 2024-03-11T22:06:42.765262+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:43.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:43 smithi187 bash[23415]: audit 2024-03-11T22:06:42.883273+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:43.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:43 smithi187 bash[23415]: audit 2024-03-11T22:06:42.892786+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:43.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:43 smithi187 bash[23415]: audit 2024-03-11T22:06:42.922163+0000 mon.a (mon.0) 563 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[21434]: cluster 2024-03-11T22:06:42.671795+0000 mon.a (mon.0) 560 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[21434]: cluster 2024-03-11T22:06:42.765262+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[21434]: audit 2024-03-11T22:06:42.883273+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[21434]: audit 2024-03-11T22:06:42.892786+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[21434]: audit 2024-03-11T22:06:42.922163+0000 mon.a (mon.0) 563 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[28804]: cluster 2024-03-11T22:06:42.671795+0000 mon.a (mon.0) 560 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[28804]: cluster 2024-03-11T22:06:42.765262+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[28804]: audit 2024-03-11T22:06:42.883273+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[28804]: audit 2024-03-11T22:06:42.892786+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:44.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:43 smithi049 bash[28804]: audit 2024-03-11T22:06:42.922163+0000 mon.a (mon.0) 563 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:06:45.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:44 smithi187 bash[23415]: cluster 2024-03-11T22:06:43.896361+0000 mon.a (mon.0) 564 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-03-11T22:06:45.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:44 smithi049 bash[21434]: cluster 2024-03-11T22:06:43.896361+0000 mon.a (mon.0) 564 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-03-11T22:06:45.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:44 smithi049 bash[28804]: cluster 2024-03-11T22:06:43.896361+0000 mon.a (mon.0) 564 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-03-11T22:06:46.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:45 smithi187 bash[23415]: cluster 2024-03-11T22:06:44.765951+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-11T22:06:46.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:45 smithi187 bash[23415]: cluster 2024-03-11T22:06:44.905726+0000 mon.a (mon.0) 565 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-03-11T22:06:46.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:45 smithi049 bash[21434]: cluster 2024-03-11T22:06:44.765951+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-11T22:06:46.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:45 smithi049 bash[21434]: cluster 2024-03-11T22:06:44.905726+0000 mon.a (mon.0) 565 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-03-11T22:06:46.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:45 smithi049 bash[28804]: cluster 2024-03-11T22:06:44.765951+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-11T22:06:46.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:45 smithi049 bash[28804]: cluster 2024-03-11T22:06:44.905726+0000 mon.a (mon.0) 565 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-03-11T22:06:47.893 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:06:48.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:47 smithi187 bash[23415]: cluster 2024-03-11T22:06:46.766685+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-11T22:06:48.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:47 smithi049 bash[21434]: cluster 2024-03-11T22:06:46.766685+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-11T22:06:48.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:47 smithi049 bash[28804]: cluster 2024-03-11T22:06:46.766685+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-11T22:06:50.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:49 smithi187 bash[23415]: cluster 2024-03-11T22:06:48.767376+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-11T22:06:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:49 smithi049 bash[21434]: cluster 2024-03-11T22:06:48.767376+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-11T22:06:50.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:49 smithi049 bash[28804]: cluster 2024-03-11T22:06:48.767376+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-11T22:06:52.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:51 smithi187 bash[23415]: cluster 2024-03-11T22:06:50.767996+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-11T22:06:52.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:51 smithi049 bash[21434]: cluster 2024-03-11T22:06:50.767996+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-11T22:06:52.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:51 smithi049 bash[28804]: cluster 2024-03-11T22:06:50.767996+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-11T22:06:52.275 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-11T22:06:52.276 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-11T22:06:52.276 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2024-03-11T22:06:52.276 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2024-03-11T22:06:52.276 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0178092 s, 589 MB/s 2024-03-11T22:06:52.276 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2024-03-11T22:06:53.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi187:vg_nvme/lv_1 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: cluster 2024-03-11T22:06:52.768587+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.526632+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.536497+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.539043+0000 mon.a (mon.0) 568 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.540691+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.542341+0000 mon.a (mon.0) 570 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.549927+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.554749+0000 mon.a (mon.0) 572 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.556511+0000 mon.a (mon.0) 573 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:53 smithi187 bash[23415]: audit 2024-03-11T22:06:53.566458+0000 mon.a (mon.0) 574 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: cluster 2024-03-11T22:06:52.768587+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:54.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.526632+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.536497+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.539043+0000 mon.a (mon.0) 568 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.540691+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.542341+0000 mon.a (mon.0) 570 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.549927+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.554749+0000 mon.a (mon.0) 572 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.556511+0000 mon.a (mon.0) 573 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[21434]: audit 2024-03-11T22:06:53.566458+0000 mon.a (mon.0) 574 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: cluster 2024-03-11T22:06:52.768587+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.526632+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.536497+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.539043+0000 mon.a (mon.0) 568 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.540691+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.542341+0000 mon.a (mon.0) 570 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:06:54.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.549927+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:54.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.554749+0000 mon.a (mon.0) 572 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:06:54.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.556511+0000 mon.a (mon.0) 573 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:06:54.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:53 smithi049 bash[28804]: audit 2024-03-11T22:06:53.566458+0000 mon.a (mon.0) 574 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:06:55.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:54 smithi187 bash[23415]: cephadm 2024-03-11T22:06:53.517432+0000 mgr.y (mgr.14152) 291 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:06:55.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:54 smithi187 bash[23415]: cephadm 2024-03-11T22:06:53.543567+0000 mgr.y (mgr.14152) 292 : cephadm 1 Adjusting osd_memory_target on smithi187 to 5755M 2024-03-11T22:06:55.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:54 smithi049 bash[21434]: cephadm 2024-03-11T22:06:53.517432+0000 mgr.y (mgr.14152) 291 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:06:55.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:54 smithi049 bash[21434]: cephadm 2024-03-11T22:06:53.543567+0000 mgr.y (mgr.14152) 292 : cephadm 1 Adjusting osd_memory_target on smithi187 to 5755M 2024-03-11T22:06:55.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:54 smithi049 bash[28804]: cephadm 2024-03-11T22:06:53.517432+0000 mgr.y (mgr.14152) 291 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:06:55.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:54 smithi049 bash[28804]: cephadm 2024-03-11T22:06:53.543567+0000 mgr.y (mgr.14152) 292 : cephadm 1 Adjusting osd_memory_target on smithi187 to 5755M 2024-03-11T22:06:56.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:55 smithi187 bash[23415]: cluster 2024-03-11T22:06:54.769154+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:56.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:55 smithi049 bash[21434]: cluster 2024-03-11T22:06:54.769154+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:56.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:55 smithi049 bash[28804]: cluster 2024-03-11T22:06:54.769154+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:58.170 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:06:58.194 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:57 smithi187 bash[23415]: cluster 2024-03-11T22:06:56.769706+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:58.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:57 smithi049 bash[21434]: cluster 2024-03-11T22:06:56.769706+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:06:58.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:57 smithi049 bash[28804]: cluster 2024-03-11T22:06:56.769706+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:00.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:06:59 smithi187 bash[23415]: cluster 2024-03-11T22:06:58.770274+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:00.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:06:59 smithi049 bash[21434]: cluster 2024-03-11T22:06:58.770274+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:00.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:06:59 smithi049 bash[28804]: cluster 2024-03-11T22:06:58.770274+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:00.825 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- 172.21.15.187:0/3435900178 >> v1:172.21.15.187:6789/0 conn(0x7ff45c105e90 legacy=0x7ff45c1082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:00.825 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- 172.21.15.187:0/3435900178 shutdown_connections 2024-03-11T22:07:00.825 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- 172.21.15.187:0/3435900178 >> 172.21.15.187:0/3435900178 conn(0x7ff45c0fcfe0 msgr2=0x7ff45c0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:07:00.826 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- 172.21.15.187:0/3435900178 shutdown_connections 2024-03-11T22:07:00.826 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- 172.21.15.187:0/3435900178 wait complete. 2024-03-11T22:07:00.826 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 Processor -- start 2024-03-11T22:07:00.826 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- start start 2024-03-11T22:07:00.827 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff45c10d2f0 con 0x7ff45c101a60 2024-03-11T22:07:00.827 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff45c1a5450 con 0x7ff45c109bd0 2024-03-11T22:07:00.827 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff461b3f700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff45c1a65f0 con 0x7ff45c105e90 2024-03-11T22:07:00.827 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff45bfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff45c109bd0 0x7ff45c1a2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:59908/0 (socket says 172.21.15.187:59908) 2024-03-11T22:07:00.827 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff45bfff700 1 -- 172.21.15.187:0/4258072326 learned_addr learned my addr 172.21.15.187:0/4258072326 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:07:00.827 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.830+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108575779 0 0) 0x7ff45c1a5450 con 0x7ff45c109bd0 2024-03-11T22:07:00.827 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4480035b0 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2806942778 0 0) 0x7ff4480035b0 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff45c1a5450 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ff454001c30 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297986346 0 0) 0x7ff45c10d2f0 con 0x7ff45c101a60 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4480035b0 con 0x7ff45c101a60 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729706849 0 0) 0x7ff45c1a65f0 con 0x7ff45c105e90 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff45c10d2f0 con 0x7ff45c105e90 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1961872295 0 0) 0x7ff45c1a5450 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 >> v1:172.21.15.49:6790/0 conn(0x7ff45c105e90 legacy=0x7ff45c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 >> v1:172.21.15.49:6789/0 conn(0x7ff45c101a60 legacy=0x7ff45c10c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c1a7790 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c1a44a0 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c1a49a0 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7ff454002000 con 0x7ff45c109bd0 2024-03-11T22:07:00.828 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ff454006090 con 0x7ff45c109bd0 2024-03-11T22:07:00.829 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c005120 con 0x7ff45c109bd0 2024-03-11T22:07:00.829 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7ff45401c5a0 con 0x7ff45c109bd0 2024-03-11T22:07:00.829 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.834+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(50..50 src has 1..50) v4 ==== 3789+0+0 (unknown 1705531712 0 0) 0x7ff454087c90 con 0x7ff45c109bd0 2024-03-11T22:07:00.834 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:00.838+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ff454052080 con 0x7ff45c109bd0 2024-03-11T22:07:01.052 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:01.058+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff43c000b90 con 0x7ff44806e480 2024-03-11T22:07:02.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:01 smithi187 bash[23415]: cluster 2024-03-11T22:07:00.770858+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:02.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:01 smithi187 bash[23415]: audit 2024-03-11T22:07:01.066055+0000 mgr.y (mgr.14152) 297 : audit 0 from='client.24319 v1:172.21.15.187:0/4258072326' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:07:02.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:01 smithi187 bash[23415]: audit 2024-03-11T22:07:01.073174+0000 mon.a (mon.0) 575 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:07:02.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:01 smithi187 bash[23415]: audit 2024-03-11T22:07:01.079539+0000 mon.a (mon.0) 576 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:07:02.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:01 smithi187 bash[23415]: audit 2024-03-11T22:07:01.081189+0000 mon.a (mon.0) 577 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[28804]: cluster 2024-03-11T22:07:00.770858+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[28804]: audit 2024-03-11T22:07:01.066055+0000 mgr.y (mgr.14152) 297 : audit 0 from='client.24319 v1:172.21.15.187:0/4258072326' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[28804]: audit 2024-03-11T22:07:01.073174+0000 mon.a (mon.0) 575 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[28804]: audit 2024-03-11T22:07:01.079539+0000 mon.a (mon.0) 576 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[28804]: audit 2024-03-11T22:07:01.081189+0000 mon.a (mon.0) 577 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[21434]: cluster 2024-03-11T22:07:00.770858+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[21434]: audit 2024-03-11T22:07:01.066055+0000 mgr.y (mgr.14152) 297 : audit 0 from='client.24319 v1:172.21.15.187:0/4258072326' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[21434]: audit 2024-03-11T22:07:01.073174+0000 mon.a (mon.0) 575 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[21434]: audit 2024-03-11T22:07:01.079539+0000 mon.a (mon.0) 576 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-11T22:07:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:01 smithi049 bash[21434]: audit 2024-03-11T22:07:01.081189+0000 mon.a (mon.0) 577 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:04.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:03 smithi187 bash[23415]: cluster 2024-03-11T22:07:02.771480+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:04.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:03 smithi049 bash[21434]: cluster 2024-03-11T22:07:02.771480+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:04.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:03 smithi049 bash[28804]: cluster 2024-03-11T22:07:02.771480+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:06.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:05 smithi187 bash[23415]: cluster 2024-03-11T22:07:04.772078+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:06.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:05 smithi049 bash[21434]: cluster 2024-03-11T22:07:04.772078+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:06.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:05 smithi049 bash[28804]: cluster 2024-03-11T22:07:04.772078+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:08.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:07 smithi187 bash[23415]: cluster 2024-03-11T22:07:06.772643+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:08.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:07 smithi049 bash[28804]: cluster 2024-03-11T22:07:06.772643+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:08.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:07 smithi049 bash[21434]: cluster 2024-03-11T22:07:06.772643+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:10.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:09 smithi187 bash[23415]: cluster 2024-03-11T22:07:08.773254+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:10.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:09 smithi187 bash[23415]: audit 2024-03-11T22:07:09.387962+0000 mon.b (mon.1) 21 : audit 1 from='client.? v1:172.21.15.187:0/3980163005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]: dispatch 2024-03-11T22:07:10.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:09 smithi187 bash[23415]: audit 2024-03-11T22:07:09.389333+0000 mon.a (mon.0) 578 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]: dispatch 2024-03-11T22:07:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:09 smithi187 bash[23415]: audit 2024-03-11T22:07:09.392854+0000 mon.a (mon.0) 579 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]': finished 2024-03-11T22:07:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:09 smithi187 bash[23415]: cluster 2024-03-11T22:07:09.398699+0000 mon.a (mon.0) 580 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-03-11T22:07:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:09 smithi187 bash[23415]: audit 2024-03-11T22:07:09.399264+0000 mon.a (mon.0) 581 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:10.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[21434]: cluster 2024-03-11T22:07:08.773254+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:10.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[21434]: audit 2024-03-11T22:07:09.387962+0000 mon.b (mon.1) 21 : audit 1 from='client.? v1:172.21.15.187:0/3980163005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]: dispatch 2024-03-11T22:07:10.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[21434]: audit 2024-03-11T22:07:09.389333+0000 mon.a (mon.0) 578 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]: dispatch 2024-03-11T22:07:10.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[21434]: audit 2024-03-11T22:07:09.392854+0000 mon.a (mon.0) 579 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]': finished 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[21434]: cluster 2024-03-11T22:07:09.398699+0000 mon.a (mon.0) 580 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[21434]: audit 2024-03-11T22:07:09.399264+0000 mon.a (mon.0) 581 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[28804]: cluster 2024-03-11T22:07:08.773254+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[28804]: audit 2024-03-11T22:07:09.387962+0000 mon.b (mon.1) 21 : audit 1 from='client.? v1:172.21.15.187:0/3980163005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]: dispatch 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[28804]: audit 2024-03-11T22:07:09.389333+0000 mon.a (mon.0) 578 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]: dispatch 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[28804]: audit 2024-03-11T22:07:09.392854+0000 mon.a (mon.0) 579 : audit 1 from='client.24325 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0434ed1b-889d-4e07-bce8-98641881ec0c"}]': finished 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[28804]: cluster 2024-03-11T22:07:09.398699+0000 mon.a (mon.0) 580 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-03-11T22:07:10.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:09 smithi049 bash[28804]: audit 2024-03-11T22:07:09.399264+0000 mon.a (mon.0) 581 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:11.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:10 smithi187 bash[23415]: audit 2024-03-11T22:07:10.184084+0000 mon.b (mon.1) 22 : audit 0 from='client.? v1:172.21.15.187:0/209250683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:07:11.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:10 smithi049 bash[21434]: audit 2024-03-11T22:07:10.184084+0000 mon.b (mon.1) 22 : audit 0 from='client.? v1:172.21.15.187:0/209250683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:07:11.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:10 smithi049 bash[28804]: audit 2024-03-11T22:07:10.184084+0000 mon.b (mon.1) 22 : audit 0 from='client.? v1:172.21.15.187:0/209250683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-11T22:07:12.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:11 smithi187 bash[23415]: cluster 2024-03-11T22:07:10.773811+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:12.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:11 smithi049 bash[28804]: cluster 2024-03-11T22:07:10.773811+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:12.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:11 smithi049 bash[21434]: cluster 2024-03-11T22:07:10.773811+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:14.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:13 smithi187 bash[23415]: cluster 2024-03-11T22:07:12.774410+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:14.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:13 smithi049 bash[21434]: cluster 2024-03-11T22:07:12.774410+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:14.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:13 smithi049 bash[28804]: cluster 2024-03-11T22:07:12.774410+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:16.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:15 smithi187 bash[23415]: cluster 2024-03-11T22:07:14.774985+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:16.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:15 smithi049 bash[21434]: cluster 2024-03-11T22:07:14.774985+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:16.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:15 smithi049 bash[28804]: cluster 2024-03-11T22:07:14.774985+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:18.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:17 smithi187 bash[23415]: cluster 2024-03-11T22:07:16.775612+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:18.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:17 smithi049 bash[21434]: cluster 2024-03-11T22:07:16.775612+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:18.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:17 smithi049 bash[28804]: cluster 2024-03-11T22:07:16.775612+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:20.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:19 smithi187 bash[23415]: cluster 2024-03-11T22:07:18.776102+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:20.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:19 smithi049 bash[21434]: cluster 2024-03-11T22:07:18.776102+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:20.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:19 smithi049 bash[28804]: cluster 2024-03-11T22:07:18.776102+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:22.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:21 smithi187 bash[23415]: cluster 2024-03-11T22:07:20.776669+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:22.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:21 smithi049 bash[21434]: cluster 2024-03-11T22:07:20.776669+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:22.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:21 smithi049 bash[28804]: cluster 2024-03-11T22:07:20.776669+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:23.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:22 smithi187 bash[23415]: audit 2024-03-11T22:07:22.369201+0000 mon.a (mon.0) 582 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-11T22:07:23.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:22 smithi187 bash[23415]: audit 2024-03-11T22:07:22.371002+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:23.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:22 smithi049 bash[21434]: audit 2024-03-11T22:07:22.369201+0000 mon.a (mon.0) 582 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-11T22:07:23.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:22 smithi049 bash[21434]: audit 2024-03-11T22:07:22.371002+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:23.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:22 smithi049 bash[28804]: audit 2024-03-11T22:07:22.369201+0000 mon.a (mon.0) 582 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-11T22:07:23.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:22 smithi049 bash[28804]: audit 2024-03-11T22:07:22.371002+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:24.183 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:23 smithi187 bash[23415]: cephadm 2024-03-11T22:07:22.372640+0000 mgr.y (mgr.14152) 308 : cephadm 1 Deploying daemon osd.7 on smithi187 2024-03-11T22:07:24.183 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:23 smithi187 bash[23415]: cluster 2024-03-11T22:07:22.777269+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:24.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:23 smithi049 bash[21434]: cephadm 2024-03-11T22:07:22.372640+0000 mgr.y (mgr.14152) 308 : cephadm 1 Deploying daemon osd.7 on smithi187 2024-03-11T22:07:24.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:23 smithi049 bash[21434]: cluster 2024-03-11T22:07:22.777269+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:24.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:23 smithi049 bash[28804]: cephadm 2024-03-11T22:07:22.372640+0000 mgr.y (mgr.14152) 308 : cephadm 1 Deploying daemon osd.7 on smithi187 2024-03-11T22:07:24.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:23 smithi049 bash[28804]: cluster 2024-03-11T22:07:22.777269+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:26.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:25 smithi187 bash[23415]: cluster 2024-03-11T22:07:24.777879+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:26.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:25 smithi049 bash[21434]: cluster 2024-03-11T22:07:24.777879+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:26.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:25 smithi049 bash[28804]: cluster 2024-03-11T22:07:24.777879+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:27.048 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:26 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.048 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:07:26 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.048 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:07:26 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.049 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:07:26 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.049 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:07:26 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.300 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.301 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:07:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.301 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:07:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.301 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:07:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:27.301 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:07:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:07:28.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:28 smithi187 bash[23415]: cluster 2024-03-11T22:07:26.778607+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:28.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:28 smithi187 bash[23415]: audit 2024-03-11T22:07:27.319169+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:28.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:28 smithi187 bash[23415]: audit 2024-03-11T22:07:27.328776+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:28.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:28 smithi187 bash[23415]: audit 2024-03-11T22:07:27.349555+0000 mon.a (mon.0) 586 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:07:28.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[21434]: cluster 2024-03-11T22:07:26.778607+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:28.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[21434]: audit 2024-03-11T22:07:27.319169+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:28.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[21434]: audit 2024-03-11T22:07:27.328776+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:28.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[21434]: audit 2024-03-11T22:07:27.349555+0000 mon.a (mon.0) 586 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:07:28.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[28804]: cluster 2024-03-11T22:07:26.778607+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:28.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[28804]: audit 2024-03-11T22:07:27.319169+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:28.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[28804]: audit 2024-03-11T22:07:27.328776+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:28.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:28 smithi049 bash[28804]: audit 2024-03-11T22:07:27.349555+0000 mon.a (mon.0) 586 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:07:30.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:30 smithi187 bash[23415]: cluster 2024-03-11T22:07:28.779190+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:30 smithi049 bash[21434]: cluster 2024-03-11T22:07:28.779190+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:30.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:30 smithi049 bash[28804]: cluster 2024-03-11T22:07:28.779190+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:32.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:32 smithi187 bash[23415]: cluster 2024-03-11T22:07:30.779854+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:32.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:32 smithi049 bash[21434]: cluster 2024-03-11T22:07:30.779854+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:32.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:32 smithi049 bash[28804]: cluster 2024-03-11T22:07:30.779854+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:33.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:33 smithi187 bash[23415]: audit 2024-03-11T22:07:32.700608+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:33.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:33 smithi187 bash[23415]: audit 2024-03-11T22:07:32.710638+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:33.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:33 smithi187 bash[23415]: cluster 2024-03-11T22:07:32.780461+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:33.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:33 smithi187 bash[23415]: audit 2024-03-11T22:07:33.392445+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:33.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:33 smithi187 bash[23415]: audit 2024-03-11T22:07:33.394401+0000 mon.a (mon.0) 590 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:07:33.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:33 smithi187 bash[23415]: audit 2024-03-11T22:07:33.404733+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:34.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[21434]: audit 2024-03-11T22:07:32.700608+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:34.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[21434]: audit 2024-03-11T22:07:32.710638+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:34.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[21434]: cluster 2024-03-11T22:07:32.780461+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:34.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[21434]: audit 2024-03-11T22:07:33.392445+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:34.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[21434]: audit 2024-03-11T22:07:33.394401+0000 mon.a (mon.0) 590 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:07:34.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[21434]: audit 2024-03-11T22:07:33.404733+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:34.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[28804]: audit 2024-03-11T22:07:32.700608+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:34.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[28804]: audit 2024-03-11T22:07:32.710638+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:34.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[28804]: cluster 2024-03-11T22:07:32.780461+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:34.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[28804]: audit 2024-03-11T22:07:33.392445+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:34.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[28804]: audit 2024-03-11T22:07:33.394401+0000 mon.a (mon.0) 590 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:07:34.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:33 smithi049 bash[28804]: audit 2024-03-11T22:07:33.404733+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:34.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:34 smithi187 bash[23415]: audit 2024-03-11T22:07:34.197810+0000 mon.b (mon.1) 23 : audit 1 from='osd.7 v1:172.21.15.187:6812/3018671607' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-11T22:07:34.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:34 smithi187 bash[23415]: audit 2024-03-11T22:07:34.199203+0000 mon.a (mon.0) 592 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-11T22:07:35.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:34 smithi049 bash[21434]: audit 2024-03-11T22:07:34.197810+0000 mon.b (mon.1) 23 : audit 1 from='osd.7 v1:172.21.15.187:6812/3018671607' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-11T22:07:35.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:34 smithi049 bash[21434]: audit 2024-03-11T22:07:34.199203+0000 mon.a (mon.0) 592 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-11T22:07:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:34 smithi049 bash[28804]: audit 2024-03-11T22:07:34.197810+0000 mon.b (mon.1) 23 : audit 1 from='osd.7 v1:172.21.15.187:6812/3018671607' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-11T22:07:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:34 smithi049 bash[28804]: audit 2024-03-11T22:07:34.199203+0000 mon.a (mon.0) 592 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-11T22:07:35.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:35 smithi187 bash[23415]: audit 2024-03-11T22:07:34.717610+0000 mon.a (mon.0) 593 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-11T22:07:35.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:35 smithi187 bash[23415]: cluster 2024-03-11T22:07:34.722517+0000 mon.a (mon.0) 594 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-03-11T22:07:35.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:35 smithi187 bash[23415]: audit 2024-03-11T22:07:34.722547+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.187:6812/3018671607' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:07:35.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:35 smithi187 bash[23415]: audit 2024-03-11T22:07:34.722983+0000 mon.a (mon.0) 595 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:35.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:35 smithi187 bash[23415]: audit 2024-03-11T22:07:34.723961+0000 mon.a (mon.0) 596 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:07:35.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:35 smithi187 bash[23415]: cluster 2024-03-11T22:07:34.781000+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[21434]: audit 2024-03-11T22:07:34.717610+0000 mon.a (mon.0) 593 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[21434]: cluster 2024-03-11T22:07:34.722517+0000 mon.a (mon.0) 594 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[21434]: audit 2024-03-11T22:07:34.722547+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.187:6812/3018671607' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[21434]: audit 2024-03-11T22:07:34.722983+0000 mon.a (mon.0) 595 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[21434]: audit 2024-03-11T22:07:34.723961+0000 mon.a (mon.0) 596 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[21434]: cluster 2024-03-11T22:07:34.781000+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[28804]: audit 2024-03-11T22:07:34.717610+0000 mon.a (mon.0) 593 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[28804]: cluster 2024-03-11T22:07:34.722517+0000 mon.a (mon.0) 594 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[28804]: audit 2024-03-11T22:07:34.722547+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.187:6812/3018671607' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:07:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[28804]: audit 2024-03-11T22:07:34.722983+0000 mon.a (mon.0) 595 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[28804]: audit 2024-03-11T22:07:34.723961+0000 mon.a (mon.0) 596 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-03-11T22:07:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:35 smithi049 bash[28804]: cluster 2024-03-11T22:07:34.781000+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-03-11T22:07:36.640 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:36.646+0000 7ff458ff9700 1 -- 172.21.15.187:0/4258072326 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 934375599) 0x7ff43c000b90 con 0x7ff44806e480 2024-03-11T22:07:36.641 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 7 on host 'smithi187' 2024-03-11T22:07:36.643 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:36.650+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 >> v1:172.21.15.49:6800/4076252288 conn(0x7ff44806e480 legacy=0x7ff448070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:36.643 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:36.650+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 >> v1:172.21.15.187:6789/0 conn(0x7ff45c109bd0 legacy=0x7ff45c1a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:36.644 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:36.650+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 shutdown_connections 2024-03-11T22:07:36.644 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:36.650+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 >> 172.21.15.187:0/4258072326 conn(0x7ff45c0fcfe0 msgr2=0x7ff45c108da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:07:36.644 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:36.650+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 shutdown_connections 2024-03-11T22:07:36.644 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:07:36.650+0000 7ff461b3f700 1 -- 172.21.15.187:0/4258072326 wait complete. 2024-03-11T22:07:36.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: audit 2024-03-11T22:07:35.719812+0000 mon.a (mon.0) 597 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:07:36.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: cluster 2024-03-11T22:07:35.725922+0000 mon.a (mon.0) 598 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-03-11T22:07:36.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: audit 2024-03-11T22:07:35.727112+0000 mon.a (mon.0) 599 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:36.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: audit 2024-03-11T22:07:35.737211+0000 mon.a (mon.0) 600 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:36.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: audit 2024-03-11T22:07:36.220638+0000 mon.a (mon.0) 601 : audit 1 from='osd.7 ' entity='osd.7' 2024-03-11T22:07:36.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: audit 2024-03-11T22:07:36.635831+0000 mon.a (mon.0) 602 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:36.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: audit 2024-03-11T22:07:36.645648+0000 mon.a (mon.0) 603 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:36.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: audit 2024-03-11T22:07:36.648083+0000 mon.a (mon.0) 604 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:07:36.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:36 smithi187 bash[23415]: cluster 2024-03-11T22:07:36.727355+0000 mon.a (mon.0) 605 : cluster 1 osd.7 v1:172.21.15.187:6812/3018671607 boot 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: audit 2024-03-11T22:07:35.719812+0000 mon.a (mon.0) 597 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: cluster 2024-03-11T22:07:35.725922+0000 mon.a (mon.0) 598 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: audit 2024-03-11T22:07:35.727112+0000 mon.a (mon.0) 599 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: audit 2024-03-11T22:07:35.737211+0000 mon.a (mon.0) 600 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: audit 2024-03-11T22:07:36.220638+0000 mon.a (mon.0) 601 : audit 1 from='osd.7 ' entity='osd.7' 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: audit 2024-03-11T22:07:36.635831+0000 mon.a (mon.0) 602 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: audit 2024-03-11T22:07:36.645648+0000 mon.a (mon.0) 603 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: audit 2024-03-11T22:07:36.648083+0000 mon.a (mon.0) 604 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:07:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[21434]: cluster 2024-03-11T22:07:36.727355+0000 mon.a (mon.0) 605 : cluster 1 osd.7 v1:172.21.15.187:6812/3018671607 boot 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: audit 2024-03-11T22:07:35.719812+0000 mon.a (mon.0) 597 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: cluster 2024-03-11T22:07:35.725922+0000 mon.a (mon.0) 598 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: audit 2024-03-11T22:07:35.727112+0000 mon.a (mon.0) 599 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: audit 2024-03-11T22:07:35.737211+0000 mon.a (mon.0) 600 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: audit 2024-03-11T22:07:36.220638+0000 mon.a (mon.0) 601 : audit 1 from='osd.7 ' entity='osd.7' 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: audit 2024-03-11T22:07:36.635831+0000 mon.a (mon.0) 602 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: audit 2024-03-11T22:07:36.645648+0000 mon.a (mon.0) 603 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: audit 2024-03-11T22:07:36.648083+0000 mon.a (mon.0) 604 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:07:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:36 smithi049 bash[28804]: cluster 2024-03-11T22:07:36.727355+0000 mon.a (mon.0) 605 : cluster 1 osd.7 v1:172.21.15.187:6812/3018671607 boot 2024-03-11T22:07:37.441 DEBUG:teuthology.orchestra.run.smithi187:osd.7> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.7.service 2024-03-11T22:07:37.443 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-11T22:07:37.444 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd stat -f json 2024-03-11T22:07:37.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:37 smithi187 bash[23415]: cluster 2024-03-11T22:07:35.163302+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:07:37.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:37 smithi187 bash[23415]: cluster 2024-03-11T22:07:35.163393+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:07:37.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:37 smithi187 bash[23415]: cluster 2024-03-11T22:07:36.727428+0000 mon.a (mon.0) 606 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-03-11T22:07:37.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:37 smithi187 bash[23415]: audit 2024-03-11T22:07:36.727743+0000 mon.a (mon.0) 607 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:37.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:37 smithi187 bash[23415]: cluster 2024-03-11T22:07:36.781547+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[21434]: cluster 2024-03-11T22:07:35.163302+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[21434]: cluster 2024-03-11T22:07:35.163393+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[21434]: cluster 2024-03-11T22:07:36.727428+0000 mon.a (mon.0) 606 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[21434]: audit 2024-03-11T22:07:36.727743+0000 mon.a (mon.0) 607 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[21434]: cluster 2024-03-11T22:07:36.781547+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[28804]: cluster 2024-03-11T22:07:35.163302+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[28804]: cluster 2024-03-11T22:07:35.163393+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[28804]: cluster 2024-03-11T22:07:36.727428+0000 mon.a (mon.0) 606 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[28804]: audit 2024-03-11T22:07:36.727743+0000 mon.a (mon.0) 607 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:07:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:37 smithi049 bash[28804]: cluster 2024-03-11T22:07:36.781547+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:38 smithi049 bash[21434]: cluster 2024-03-11T22:07:37.746137+0000 mon.a (mon.0) 608 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-03-11T22:07:39.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:38 smithi049 bash[28804]: cluster 2024-03-11T22:07:37.746137+0000 mon.a (mon.0) 608 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-03-11T22:07:39.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:38 smithi187 bash[23415]: cluster 2024-03-11T22:07:37.746137+0000 mon.a (mon.0) 608 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-03-11T22:07:40.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:39 smithi049 bash[21434]: cluster 2024-03-11T22:07:38.746144+0000 mon.a (mon.0) 609 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-03-11T22:07:40.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:39 smithi049 bash[21434]: cluster 2024-03-11T22:07:38.782064+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v302: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:40.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:39 smithi049 bash[28804]: cluster 2024-03-11T22:07:38.746144+0000 mon.a (mon.0) 609 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-03-11T22:07:40.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:39 smithi049 bash[28804]: cluster 2024-03-11T22:07:38.782064+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v302: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:40.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:39 smithi187 bash[23415]: cluster 2024-03-11T22:07:38.746144+0000 mon.a (mon.0) 609 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-03-11T22:07:40.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:39 smithi187 bash[23415]: cluster 2024-03-11T22:07:38.782064+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v302: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:40 smithi049 bash[21434]: cluster 2024-03-11T22:07:39.762626+0000 mon.a (mon.0) 610 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-03-11T22:07:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:40 smithi049 bash[28804]: cluster 2024-03-11T22:07:39.762626+0000 mon.a (mon.0) 610 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-03-11T22:07:41.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:40 smithi187 bash[23415]: cluster 2024-03-11T22:07:39.762626+0000 mon.a (mon.0) 610 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-03-11T22:07:41.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:41 smithi187 bash[23415]: cluster 2024-03-11T22:07:40.763666+0000 mon.a (mon.0) 611 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-03-11T22:07:41.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:41 smithi187 bash[23415]: cluster 2024-03-11T22:07:40.782576+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v305: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:42.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:41 smithi049 bash[21434]: cluster 2024-03-11T22:07:40.763666+0000 mon.a (mon.0) 611 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-03-11T22:07:42.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:41 smithi049 bash[21434]: cluster 2024-03-11T22:07:40.782576+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v305: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:42.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:41 smithi049 bash[28804]: cluster 2024-03-11T22:07:40.763666+0000 mon.a (mon.0) 611 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-03-11T22:07:42.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:41 smithi049 bash[28804]: cluster 2024-03-11T22:07:40.782576+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v305: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:42.207 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:07:43.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:43 smithi187 bash[23415]: cluster 2024-03-11T22:07:42.783196+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-03-11T22:07:44.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:43 smithi049 bash[21434]: cluster 2024-03-11T22:07:42.783196+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-03-11T22:07:44.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:43 smithi049 bash[28804]: cluster 2024-03-11T22:07:42.783196+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-03-11T22:07:44.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- 172.21.15.49:0/67044257 >> v1:172.21.15.49:6789/0 conn(0x7f8464103c90 legacy=0x7f84641040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:44.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- 172.21.15.49:0/67044257 shutdown_connections 2024-03-11T22:07:44.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- 172.21.15.49:0/67044257 >> 172.21.15.49:0/67044257 conn(0x7f84640ff250 msgr2=0x7f8464101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:07:44.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- 172.21.15.49:0/67044257 shutdown_connections 2024-03-11T22:07:44.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- 172.21.15.49:0/67044257 wait complete. 2024-03-11T22:07:44.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 Processor -- start 2024-03-11T22:07:44.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- start start 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8464199a90 con 0x7f84641080c0 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f84641a5280 con 0x7f8464103c90 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f84641a6420 con 0x7f846410be00 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f845b7fe700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f84641080c0 0x7f846419f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36982/0 (socket says 172.21.15.49:36982) 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8468d3c700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f846410be00 0x7f84641a2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:55340/0 (socket says 172.21.15.49:55340) 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f845b7fe700 1 -- 172.21.15.49:0/3412227886 learned_addr learned my addr 172.21.15.49:0/3412227886 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627098405 0 0) 0x7f84641a6420 con 0x7f846410be00 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84500035b0 con 0x7f846410be00 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084362687 0 0) 0x7f8464199a90 con 0x7f84641080c0 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84641a6420 con 0x7f84641080c0 2024-03-11T22:07:44.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3184689177 0 0) 0x7f84500035b0 con 0x7f846410be00 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8464199a90 con 0x7f846410be00 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f845c001bb0 con 0x7f846410be00 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436073788 0 0) 0x7f84641a5280 con 0x7f8464103c90 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84500035b0 con 0x7f8464103c90 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1551567844 0 0) 0x7f84641a6420 con 0x7f84641080c0 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f84641a5280 con 0x7f84641080c0 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f844c001650 con 0x7f84641080c0 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1128459378 0 0) 0x7f8464199a90 con 0x7f846410be00 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 >> v1:172.21.15.187:6789/0 conn(0x7f8464103c90 legacy=0x7f8464198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 >> v1:172.21.15.49:6789/0 conn(0x7f84641080c0 legacy=0x7f846419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84641a75c0 con 0x7f846410be00 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84641a42d0 con 0x7f846410be00 2024-03-11T22:07:44.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f84641a47d0 con 0x7f846410be00 2024-03-11T22:07:44.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f845c0020e0 con 0x7f846410be00 2024-03-11T22:07:44.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.956+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f845c005f40 con 0x7f846410be00 2024-03-11T22:07:44.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.960+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8444005150 con 0x7f846410be00 2024-03-11T22:07:44.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.960+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f845c003a20 con 0x7f846410be00 2024-03-11T22:07:44.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.960+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 1748729994 0 0) 0x7f845c087cb0 con 0x7f846410be00 2024-03-11T22:07:44.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:44.964+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f845c051e50 con 0x7f846410be00 2024-03-11T22:07:45.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.176+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f8444005400 con 0x7f846410be00 2024-03-11T22:07:45.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.176+0000 7f8461ffb700 1 -- 172.21.15.49:0/3412227886 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v58) v1 ==== 74+0+130 (unknown 4023224526 0 2110128478) 0x7f845c053d80 con 0x7f846410be00 2024-03-11T22:07:45.167 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:07:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.180+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 >> v1:172.21.15.49:6800/4076252288 conn(0x7f845006e5b0 legacy=0x7f8450070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.180+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 >> v1:172.21.15.49:6790/0 conn(0x7f846410be00 legacy=0x7f84641a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.180+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 shutdown_connections 2024-03-11T22:07:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.180+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 >> 172.21.15.49:0/3412227886 conn(0x7f84640ff250 msgr2=0x7f846410a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:07:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.180+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 shutdown_connections 2024-03-11T22:07:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:45.180+0000 7f846a79f700 1 -- 172.21.15.49:0/3412227886 wait complete. 2024-03-11T22:07:45.896 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:45 smithi187 bash[23415]: cluster 2024-03-11T22:07:44.783617+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-11T22:07:45.896 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:45 smithi187 bash[23415]: audit 2024-03-11T22:07:45.178675+0000 mon.c (mon.2) 11 : audit 0 from='client.? v1:172.21.15.49:0/3412227886' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-11T22:07:45.936 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1710194856,"num_in_osds":8,"osd_in_since":1710194829,"num_remapped_pgs":0} 2024-03-11T22:07:45.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd dump --format=json 2024-03-11T22:07:46.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:45 smithi049 bash[28804]: cluster 2024-03-11T22:07:44.783617+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-11T22:07:46.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:45 smithi049 bash[28804]: audit 2024-03-11T22:07:45.178675+0000 mon.c (mon.2) 11 : audit 0 from='client.? v1:172.21.15.49:0/3412227886' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-11T22:07:46.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:45 smithi049 bash[21434]: cluster 2024-03-11T22:07:44.783617+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-11T22:07:46.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:45 smithi049 bash[21434]: audit 2024-03-11T22:07:45.178675+0000 mon.c (mon.2) 11 : audit 0 from='client.? v1:172.21.15.49:0/3412227886' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: cephadm 2024-03-11T22:07:46.491395+0000 mgr.y (mgr.14152) 321 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.500515+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.511163+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.513898+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.515703+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.517323+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.518991+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: cephadm 2024-03-11T22:07:46.520303+0000 mgr.y (mgr.14152) 322 : cephadm 1 Adjusting osd_memory_target on smithi187 to 4316M 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.526709+0000 mon.a (mon.0) 618 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.531286+0000 mon.a (mon.0) 619 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.533058+0000 mon.a (mon.0) 620 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: audit 2024-03-11T22:07:46.542900+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[21434]: cluster 2024-03-11T22:07:46.784185+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: cephadm 2024-03-11T22:07:46.491395+0000 mgr.y (mgr.14152) 321 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.500515+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.511163+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.513898+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.515703+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.517323+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.518991+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: cephadm 2024-03-11T22:07:46.520303+0000 mgr.y (mgr.14152) 322 : cephadm 1 Adjusting osd_memory_target on smithi187 to 4316M 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.526709+0000 mon.a (mon.0) 618 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.531286+0000 mon.a (mon.0) 619 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.533058+0000 mon.a (mon.0) 620 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:07:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: audit 2024-03-11T22:07:46.542900+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:47 smithi049 bash[28804]: cluster 2024-03-11T22:07:46.784185+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: cephadm 2024-03-11T22:07:46.491395+0000 mgr.y (mgr.14152) 321 : cephadm 1 Detected new or changed devices on smithi187 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.500515+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.511163+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.513898+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.515703+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.517323+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.518991+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: cephadm 2024-03-11T22:07:46.520303+0000 mgr.y (mgr.14152) 322 : cephadm 1 Adjusting osd_memory_target on smithi187 to 4316M 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.526709+0000 mon.a (mon.0) 618 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.531286+0000 mon.a (mon.0) 619 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.533058+0000 mon.a (mon.0) 620 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: audit 2024-03-11T22:07:46.542900+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:07:47.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:47 smithi187 bash[23415]: cluster 2024-03-11T22:07:46.784185+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-11T22:07:50.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:49 smithi187 bash[23415]: cluster 2024-03-11T22:07:48.784778+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-11T22:07:50.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:49 smithi049 bash[21434]: cluster 2024-03-11T22:07:48.784778+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-11T22:07:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:49 smithi049 bash[28804]: cluster 2024-03-11T22:07:48.784778+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-11T22:07:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:07:52.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:51 smithi187 bash[23415]: cluster 2024-03-11T22:07:50.785411+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-11T22:07:52.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:51 smithi049 bash[21434]: cluster 2024-03-11T22:07:50.785411+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-11T22:07:52.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:51 smithi049 bash[28804]: cluster 2024-03-11T22:07:50.785411+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-11T22:07:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- 172.21.15.49:0/221449228 >> v1:172.21.15.49:6789/0 conn(0x7f223010d3a0 legacy=0x7f223010f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- 172.21.15.49:0/221449228 shutdown_connections 2024-03-11T22:07:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- 172.21.15.49:0/221449228 >> 172.21.15.49:0/221449228 conn(0x7f22300fc410 msgr2=0x7f22300fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:07:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- 172.21.15.49:0/221449228 shutdown_connections 2024-03-11T22:07:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- 172.21.15.49:0/221449228 wait complete. 2024-03-11T22:07:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 Processor -- start 2024-03-11T22:07:53.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- start start 2024-03-11T22:07:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f22301a6900 con 0x7f2230106920 2024-03-11T22:07:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f22301a7ae0 con 0x7f22301097d0 2024-03-11T22:07:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f22301a8ce0 con 0x7f223010d3a0 2024-03-11T22:07:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f222f59e700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f223010d3a0 0x7f22301a4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:55364/0 (socket says 172.21.15.49:55364) 2024-03-11T22:07:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f222ed9d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2230106920 0x7f223010ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37002/0 (socket says 172.21.15.49:37002) 2024-03-11T22:07:53.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f222f59e700 1 -- 172.21.15.49:0/2364261861 learned_addr learned my addr 172.21.15.49:0/2364261861 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720782469 0 0) 0x7f22301a8ce0 con 0x7f223010d3a0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f221c0035b0 con 0x7f223010d3a0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067583960 0 0) 0x7f22301a6900 con 0x7f2230106920 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22301a8ce0 con 0x7f2230106920 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998595798 0 0) 0x7f22301a7ae0 con 0x7f22301097d0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22301a6900 con 0x7f22301097d0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2813801638 0 0) 0x7f221c0035b0 con 0x7f223010d3a0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f22301a7ae0 con 0x7f223010d3a0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f22280047d0 con 0x7f223010d3a0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2850762745 0 0) 0x7f22301a8ce0 con 0x7f2230106920 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f221c0035b0 con 0x7f2230106920 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2220001920 con 0x7f2230106920 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 526472136 0 0) 0x7f22301a7ae0 con 0x7f223010d3a0 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 >> v1:172.21.15.187:6789/0 conn(0x7f22301097d0 legacy=0x7f22301a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 >> v1:172.21.15.49:6789/0 conn(0x7f2230106920 legacy=0x7f223010ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22301a9ee0 con 0x7f223010d3a0 2024-03-11T22:07:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22301a6af0 con 0x7f223010d3a0 2024-03-11T22:07:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f22301a6f70 con 0x7f223010d3a0 2024-03-11T22:07:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f2228001e20 con 0x7f223010d3a0 2024-03-11T22:07:53.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.448+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2228005100 con 0x7f223010d3a0 2024-03-11T22:07:53.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.452+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2210005120 con 0x7f223010d3a0 2024-03-11T22:07:53.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.452+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f2228005280 con 0x7f223010d3a0 2024-03-11T22:07:53.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.452+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 1748729994 0 0) 0x7f2228087f60 con 0x7f223010d3a0 2024-03-11T22:07:53.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.456+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2228052140 con 0x7f223010d3a0 2024-03-11T22:07:53.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.664+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22100053d0 con 0x7f223010d3a0 2024-03-11T22:07:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.664+0000 7f2227fff700 1 -- 172.21.15.49:0/2364261861 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+11504 (unknown 2626357731 0 1372393201) 0x7f2228054070 con 0x7f223010d3a0 2024-03-11T22:07:53.654 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:07:53.655 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"377df5b0-dff2-11ee-95c8-87774f69a715","created":"2024-03-11T21:57:59.882687+0000","modified":"2024-03-11T22:07:40.756331+0000","last_up_change":"2024-03-11T22:07:36.719734+0000","last_in_change":"2024-03-11T22:07:09.390512+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-11T22:03:15.301419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5539a6f5-8ee5-43a7-b42c-83eaad23ebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6801","nonce":1383006495}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6802","nonce":1383006495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6804","nonce":1383006495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6803","nonce":1383006495}]},"public_addr":"172.21.15.49:6801/1383006495","cluster_addr":"172.21.15.49:6802/1383006495","heartbeat_back_addr":"172.21.15.49:6804/1383006495","heartbeat_front_addr":"172.21.15.49:6803/1383006495","state":["exists","up"]},{"osd":1,"uuid":"e57e1dff-7e3e-4924-ae2d-6b921cb9d99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6805","nonce":3491699509}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6806","nonce":3491699509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6808","nonce":3491699509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6807","nonce":3491699509}]},"public_addr":"172.21.15.49:6805/3491699509","cluster_addr":"172.21.15.49:6806/3491699509","heartbeat_back_addr":"172.21.15.49:6808/3491699509","heartbeat_front_addr":"172.21.15.49:6807/3491699509","state":["exists","up"]},{"osd":2,"uuid":"f8230702-b6f3-4390-8902-24cec89cb476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6809","nonce":535303154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6810","nonce":535303154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6812","nonce":535303154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6811","nonce":535303154}]},"public_addr":"172.21.15.49:6809/535303154","cluster_addr":"172.21.15.49:6810/535303154","heartbeat_back_addr":"172.21.15.49:6812/535303154","heartbeat_front_addr":"172.21.15.49:6811/535303154","state":["exists","up"]},{"osd":3,"uuid":"046c12b6-90f4-4c80-9d33-b644551e6649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6813","nonce":4161800259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6814","nonce":4161800259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6816","nonce":4161800259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6815","nonce":4161800259}]},"public_addr":"172.21.15.49:6813/4161800259","cluster_addr":"172.21.15.49:6814/4161800259","heartbeat_back_addr":"172.21.15.49:6816/4161800259","heartbeat_front_addr":"172.21.15.49:6815/4161800259","state":["exists","up"]},{"osd":4,"uuid":"93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6800","nonce":4268742344}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6801","nonce":4268742344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6803","nonce":4268742344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6802","nonce":4268742344}]},"public_addr":"172.21.15.187:6800/4268742344","cluster_addr":"172.21.15.187:6801/4268742344","heartbeat_back_addr":"172.21.15.187:6803/4268742344","heartbeat_front_addr":"172.21.15.187:6802/4268742344","state":["exists","up"]},{"osd":5,"uuid":"f1cd359e-0186-4ad1-bccb-e71dc10206a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6804","nonce":2249702314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6805","nonce":2249702314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6807","nonce":2249702314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6806","nonce":2249702314}]},"public_addr":"172.21.15.187:6804/2249702314","cluster_addr":"172.21.15.187:6805/2249702314","heartbeat_back_addr":"172.21.15.187:6807/2249702314","heartbeat_front_addr":"172.21.15.187:6806/2249702314","state":["exists","up"]},{"osd":6,"uuid":"742c8fbe-3d0b-4586-aa9a-4bb91082fba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6808","nonce":2887830694}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6809","nonce":2887830694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6811","nonce":2887830694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6810","nonce":2887830694}]},"public_addr":"172.21.15.187:6808/2887830694","cluster_addr":"172.21.15.187:6809/2887830694","heartbeat_back_addr":"172.21.15.187:6811/2887830694","heartbeat_front_addr":"172.21.15.187:6810/2887830694","state":["exists","up"]},{"osd":7,"uuid":"0434ed1b-889d-4e07-bce8-98641881ec0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6812","nonce":3018671607}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6813","nonce":3018671607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6815","nonce":3018671607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6814","nonce":3018671607}]},"public_addr":"172.21.15.187:6812/3018671607","cluster_addr":"172.21.15.187:6813/3018671607","heartbeat_back_addr":"172.21.15.187:6815/3018671607","heartbeat_front_addr":"172.21.15.187:6814/3018671607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:01:30.591418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:02:20.916346+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:03:12.089410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:04:04.714425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:04:54.167706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:05:47.502591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:06:39.482362+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:07:35.163397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6800/2600502005":"2024-03-12T21:59:06.647009+0000","172.21.15.49:6800/653572163":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/1299294381":"2024-03-12T21:59:06.647009+0000","172.21.15.49:0/3331119922":"2024-03-12T21:59:06.647009+0000","172.21.15.49:0/3658055689":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/358645426":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/1446475445":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/3264123515":"2024-03-12T21:59:06.647009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-11T22:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.664+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 >> v1:172.21.15.49:6800/4076252288 conn(0x7f221c076cd0 legacy=0x7f221c079190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.664+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 >> v1:172.21.15.49:6790/0 conn(0x7f223010d3a0 legacy=0x7f22301a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.668+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 shutdown_connections 2024-03-11T22:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.668+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 >> 172.21.15.49:0/2364261861 conn(0x7f22300fc410 msgr2=0x7f22300ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.668+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 shutdown_connections 2024-03-11T22:07:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:07:53.668+0000 7f22351e9700 1 -- 172.21.15.49:0/2364261861 wait complete. 2024-03-11T22:07:54.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:53 smithi049 bash[21434]: cluster 2024-03-11T22:07:52.785978+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-11T22:07:54.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:53 smithi049 bash[21434]: audit 2024-03-11T22:07:53.665851+0000 mon.c (mon.2) 12 : audit 0 from='client.? v1:172.21.15.49:0/2364261861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:07:54.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:53 smithi049 bash[28804]: cluster 2024-03-11T22:07:52.785978+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-11T22:07:54.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:53 smithi049 bash[28804]: audit 2024-03-11T22:07:53.665851+0000 mon.c (mon.2) 12 : audit 0 from='client.? v1:172.21.15.49:0/2364261861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:07:54.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:53 smithi187 bash[23415]: cluster 2024-03-11T22:07:52.785978+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-11T22:07:54.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:53 smithi187 bash[23415]: audit 2024-03-11T22:07:53.665851+0000 mon.c (mon.2) 12 : audit 0 from='client.? v1:172.21.15.49:0/2364261861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:07:54.360 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-11T22:03:15.301419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-11T22:07:54.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-11T22:07:56.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:55 smithi187 bash[23415]: cluster 2024-03-11T22:07:54.786564+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:56.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:55 smithi049 bash[21434]: cluster 2024-03-11T22:07:54.786564+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:56.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:55 smithi049 bash[28804]: cluster 2024-03-11T22:07:54.786564+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:58.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:57 smithi187 bash[23415]: cluster 2024-03-11T22:07:56.787159+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:58.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:57 smithi049 bash[28804]: cluster 2024-03-11T22:07:56.787159+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:57 smithi049 bash[21434]: cluster 2024-03-11T22:07:56.787159+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:07:59.126 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:08:00.104 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:07:59 smithi049 bash[21434]: cluster 2024-03-11T22:07:58.787728+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:00.105 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:07:59 smithi049 bash[28804]: cluster 2024-03-11T22:07:58.787728+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:00.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:07:59 smithi187 bash[23415]: cluster 2024-03-11T22:07:58.787728+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:01.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.760+0000 7fefdcc91700 1 -- 172.21.15.49:0/553821640 >> v1:172.21.15.49:6789/0 conn(0x7fefd8074a80 legacy=0x7fefd810ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.760+0000 7fefdcc91700 1 -- 172.21.15.49:0/553821640 shutdown_connections 2024-03-11T22:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.760+0000 7fefdcc91700 1 -- 172.21.15.49:0/553821640 >> 172.21.15.49:0/553821640 conn(0x7fefd80fd530 msgr2=0x7fefd80ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- 172.21.15.49:0/553821640 shutdown_connections 2024-03-11T22:08:01.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- 172.21.15.49:0/553821640 wait complete. 2024-03-11T22:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 Processor -- start 2024-03-11T22:08:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- start start 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fefd81a8c20 con 0x7fefd81106d0 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fefd81a9e00 con 0x7fefd8073f90 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fefd81ab000 con 0x7fefd8074a80 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefd5d9b700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fefd8074a80 0x7fefd81a3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:52892/0 (socket says 172.21.15.49:52892) 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefd5d9b700 1 -- 172.21.15.49:0/948209488 learned_addr learned my addr 172.21.15.49:0/948209488 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefd6d9d700 1 --1- 172.21.15.49:0/948209488 >> v1:172.21.15.49:6789/0 conn(0x7fefd81106d0 0x7fefd81a72e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34340/0 (socket says 172.21.15.49:34340) 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808461342 0 0) 0x7fefd81ab000 con 0x7fefd8074a80 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc00037f0 con 0x7fefd8074a80 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299537019 0 0) 0x7fefd81a8c20 con 0x7fefd81106d0 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd81ab000 con 0x7fefd81106d0 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 966889272 0 0) 0x7fefc00037f0 con 0x7fefd8074a80 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fefd81a8c20 con 0x7fefd8074a80 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fefcc0018f0 con 0x7fefd8074a80 2024-03-11T22:08:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2025801944 0 0) 0x7fefd81ab000 con 0x7fefd81106d0 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fefc00037f0 con 0x7fefd81106d0 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765151483 0 0) 0x7fefd81a9e00 con 0x7fefd8073f90 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd81ab000 con 0x7fefd8073f90 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fefd0001b30 con 0x7fefd81106d0 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2914595973 0 0) 0x7fefd81a8c20 con 0x7fefd8074a80 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 >> v1:172.21.15.187:6789/0 conn(0x7fefd8073f90 legacy=0x7fefd810ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 >> v1:172.21.15.49:6789/0 conn(0x7fefd81106d0 legacy=0x7fefd81a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd81ac200 con 0x7fefd8074a80 2024-03-11T22:08:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd81ab1f0 con 0x7fefd8074a80 2024-03-11T22:08:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd81ab670 con 0x7fefd8074a80 2024-03-11T22:08:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fefcc001b10 con 0x7fefd8074a80 2024-03-11T22:08:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fefcc004de0 con 0x7fefd8074a80 2024-03-11T22:08:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb8005120 con 0x7fefd8074a80 2024-03-11T22:08:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.764+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7fefcc000fe0 con 0x7fefd8074a80 2024-03-11T22:08:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.768+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 1748729994 0 0) 0x7fefcc087cb0 con 0x7fefd8074a80 2024-03-11T22:08:01.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.772+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fefcc051e50 con 0x7fefd8074a80 2024-03-11T22:08:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.984+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefb8005950 con 0x7fefd8074a80 2024-03-11T22:08:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.988+0000 7fefc77fe700 1 -- 172.21.15.49:0/948209488 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (unknown 3844627101 0 2170607528) 0x7fefcc053d80 con 0x7fefd8074a80 2024-03-11T22:08:01.977 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-11T22:08:01.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.988+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 >> v1:172.21.15.49:6800/4076252288 conn(0x7fefc006e670 legacy=0x7fefc0070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:01.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.988+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 >> v1:172.21.15.49:6790/0 conn(0x7fefd8074a80 legacy=0x7fefd81a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.988+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 shutdown_connections 2024-03-11T22:08:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.988+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 >> 172.21.15.49:0/948209488 conn(0x7fefd80fd530 msgr2=0x7fefd810fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.988+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 shutdown_connections 2024-03-11T22:08:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:08:01.988+0000 7fefdcc91700 1 -- 172.21.15.49:0/948209488 wait complete. 2024-03-11T22:08:02.159 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:01 smithi049 bash[21434]: cluster 2024-03-11T22:08:00.788170+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:02.160 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:01 smithi049 bash[28804]: cluster 2024-03-11T22:08:00.788170+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:02.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:01 smithi187 bash[23415]: cluster 2024-03-11T22:08:00.788170+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:02.637 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi049 2024-03-11T22:08:02.638 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply rgw foo.a --placement '1;smithi049=foo.a' 2024-03-11T22:08:02.986 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:02 smithi187 bash[23415]: audit 2024-03-11T22:08:01.989022+0000 mon.c (mon.2) 13 : audit 0 from='client.? v1:172.21.15.49:0/948209488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-11T22:08:03.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:02 smithi049 bash[21434]: audit 2024-03-11T22:08:01.989022+0000 mon.c (mon.2) 13 : audit 0 from='client.? v1:172.21.15.49:0/948209488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-11T22:08:03.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:02 smithi049 bash[28804]: audit 2024-03-11T22:08:01.989022+0000 mon.c (mon.2) 13 : audit 0 from='client.? v1:172.21.15.49:0/948209488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-11T22:08:04.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:03 smithi187 bash[23415]: cluster 2024-03-11T22:08:02.788718+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:04.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:03 smithi049 bash[21434]: cluster 2024-03-11T22:08:02.788718+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:04.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:03 smithi049 bash[28804]: cluster 2024-03-11T22:08:02.788718+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:06.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:05 smithi187 bash[23415]: cluster 2024-03-11T22:08:04.789328+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:06.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:05 smithi049 bash[21434]: cluster 2024-03-11T22:08:04.789328+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:05 smithi049 bash[28804]: cluster 2024-03-11T22:08:04.789328+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:07.385 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:08:08.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:07 smithi187 bash[23415]: cluster 2024-03-11T22:08:06.789842+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:07 smithi049 bash[21434]: cluster 2024-03-11T22:08:06.789842+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:08.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:07 smithi049 bash[28804]: cluster 2024-03-11T22:08:06.789842+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:10.153 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:09 smithi187 bash[23415]: cluster 2024-03-11T22:08:08.790369+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:10.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:09 smithi049 bash[28804]: cluster 2024-03-11T22:08:08.790369+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:10.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:09 smithi049 bash[21434]: cluster 2024-03-11T22:08:08.790369+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:10.333 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.337+0000 7f9f69bcf700 1 -- 172.21.15.187:0/1647102745 >> v1:172.21.15.187:6789/0 conn(0x7f9f64075ca0 legacy=0x7f9f64074100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:10.334 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.337+0000 7f9f69bcf700 1 -- 172.21.15.187:0/1647102745 shutdown_connections 2024-03-11T22:08:10.334 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.337+0000 7f9f69bcf700 1 -- 172.21.15.187:0/1647102745 >> 172.21.15.187:0/1647102745 conn(0x7f9f640fd020 msgr2=0x7f9f640ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:10.334 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.337+0000 7f9f69bcf700 1 -- 172.21.15.187:0/1647102745 shutdown_connections 2024-03-11T22:08:10.334 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.337+0000 7f9f69bcf700 1 -- 172.21.15.187:0/1647102745 wait complete. 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 Processor -- start 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 -- start start 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f641173d0 con 0x7f9f64075ca0 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f6419e0e0 con 0x7f9f640748d0 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f641aa880 con 0x7f9f64104b50 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f637fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9f640748d0 0x7f9f6419d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:38100/0 (socket says 172.21.15.187:38100) 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f637fe700 1 -- 172.21.15.187:0/3748591930 learned_addr learned my addr 172.21.15.187:0/3748591930 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366868991 0 0) 0x7f9f6419e0e0 con 0x7f9f640748d0 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f500035b0 con 0x7f9f640748d0 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3397627481 0 0) 0x7f9f500035b0 con 0x7f9f640748d0 2024-03-11T22:08:10.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f6419e0e0 con 0x7f9f640748d0 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f9f54001430 con 0x7f9f640748d0 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902011192 0 0) 0x7f9f641aa880 con 0x7f9f64104b50 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f500035b0 con 0x7f9f64104b50 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 575258451 0 0) 0x7f9f6419e0e0 con 0x7f9f640748d0 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 >> v1:172.21.15.49:6790/0 conn(0x7f9f64104b50 legacy=0x7f9f641a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 >> v1:172.21.15.49:6789/0 conn(0x7f9f64075ca0 legacy=0x7f9f641a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f641aba20 con 0x7f9f640748d0 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f641aaa70 con 0x7f9f640748d0 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f641aaf70 con 0x7f9f640748d0 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f9f54003d20 con 0x7f9f640748d0 2024-03-11T22:08:10.337 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f9f540051f0 con 0x7f9f640748d0 2024-03-11T22:08:10.338 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f44005150 con 0x7f9f640748d0 2024-03-11T22:08:10.338 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f9f54004a80 con 0x7f9f640748d0 2024-03-11T22:08:10.338 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.341+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 1748729994 0 0) 0x7f9f54087f60 con 0x7f9f640748d0 2024-03-11T22:08:10.342 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.349+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9f54052100 con 0x7f9f640748d0 2024-03-11T22:08:10.565 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.569+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi049=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f44000bc0 con 0x7f9f5006e230 2024-03-11T22:08:10.580 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.585+0000 7f9f60ff9700 1 -- 172.21.15.187:0/3748591930 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (unknown 0 0 1123153589) 0x7f9f44000bc0 con 0x7f9f5006e230 2024-03-11T22:08:10.580 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled rgw.foo.a update... 2024-03-11T22:08:10.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.589+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 >> v1:172.21.15.49:6800/4076252288 conn(0x7f9f5006e230 legacy=0x7f9f500706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:10.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.589+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 >> v1:172.21.15.187:6789/0 conn(0x7f9f640748d0 legacy=0x7f9f6419d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:10.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.589+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 shutdown_connections 2024-03-11T22:08:10.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.589+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 >> 172.21.15.187:0/3748591930 conn(0x7f9f640fd020 msgr2=0x7f9f640fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:10.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.589+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 shutdown_connections 2024-03-11T22:08:10.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:10.589+0000 7f9f69bcf700 1 -- 172.21.15.187:0/3748591930 wait complete. 2024-03-11T22:08:11.381 DEBUG:teuthology.orchestra.run.smithi049:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@rgw.foo.a.service 2024-03-11T22:08:11.384 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi187 2024-03-11T22:08:11.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd pool create datapool 3 3 replicated 2024-03-11T22:08:11.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.579707+0000 mgr.y (mgr.14152) 335 : audit 0 from='client.24364 v1:172.21.15.187:0/3748591930' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi049=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: cephadm 2024-03-11T22:08:10.583784+0000 mgr.y (mgr.14152) 336 : cephadm 1 Saving service rgw.foo.a spec with placement smithi049=foo.a;count:1 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.591661+0000 mon.a (mon.0) 622 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.595733+0000 mon.a (mon.0) 623 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.599441+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.601185+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.612818+0000 mon.a (mon.0) 626 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.619437+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.622557+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.637324+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: audit 2024-03-11T22:08:10.642359+0000 mon.a (mon.0) 630 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: cephadm 2024-03-11T22:08:10.644505+0000 mgr.y (mgr.14152) 337 : cephadm 1 Deploying daemon rgw.foo.a on smithi049 2024-03-11T22:08:11.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:11 smithi187 bash[23415]: cluster 2024-03-11T22:08:10.790958+0000 mgr.y (mgr.14152) 338 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:11.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.579707+0000 mgr.y (mgr.14152) 335 : audit 0 from='client.24364 v1:172.21.15.187:0/3748591930' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi049=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:11.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: cephadm 2024-03-11T22:08:10.583784+0000 mgr.y (mgr.14152) 336 : cephadm 1 Saving service rgw.foo.a spec with placement smithi049=foo.a;count:1 2024-03-11T22:08:11.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.591661+0000 mon.a (mon.0) 622 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.595733+0000 mon.a (mon.0) 623 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.599441+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.601185+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.612818+0000 mon.a (mon.0) 626 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.619437+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.622557+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.637324+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: audit 2024-03-11T22:08:10.642359+0000 mon.a (mon.0) 630 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: cephadm 2024-03-11T22:08:10.644505+0000 mgr.y (mgr.14152) 337 : cephadm 1 Deploying daemon rgw.foo.a on smithi049 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[21434]: cluster 2024-03-11T22:08:10.790958+0000 mgr.y (mgr.14152) 338 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.579707+0000 mgr.y (mgr.14152) 335 : audit 0 from='client.24364 v1:172.21.15.187:0/3748591930' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi049=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: cephadm 2024-03-11T22:08:10.583784+0000 mgr.y (mgr.14152) 336 : cephadm 1 Saving service rgw.foo.a spec with placement smithi049=foo.a;count:1 2024-03-11T22:08:11.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.591661+0000 mon.a (mon.0) 622 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.595733+0000 mon.a (mon.0) 623 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.599441+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.601185+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.612818+0000 mon.a (mon.0) 626 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.619437+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.622557+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.637324+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: audit 2024-03-11T22:08:10.642359+0000 mon.a (mon.0) 630 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: cephadm 2024-03-11T22:08:10.644505+0000 mgr.y (mgr.14152) 337 : cephadm 1 Deploying daemon rgw.foo.a on smithi049 2024-03-11T22:08:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:11 smithi049 bash[28804]: cluster 2024-03-11T22:08:10.790958+0000 mgr.y (mgr.14152) 338 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:13.288 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.289 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.289 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.290 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.290 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.290 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.291 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.587 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.587 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.588 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.588 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.588 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.588 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.589 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.589 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.589 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.589 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: Started Ceph rgw.foo.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:08:13.589 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:13.589 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:08:13 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:14.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[28804]: cluster 2024-03-11T22:08:12.791536+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:14.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[28804]: audit 2024-03-11T22:08:13.591728+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[28804]: audit 2024-03-11T22:08:13.598475+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[28804]: audit 2024-03-11T22:08:13.619695+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[28804]: audit 2024-03-11T22:08:13.623713+0000 mon.a (mon.0) 634 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[28804]: audit 2024-03-11T22:08:13.627809+0000 mon.a (mon.0) 635 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[28804]: audit 2024-03-11T22:08:13.676245+0000 mon.a (mon.0) 636 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[21434]: cluster 2024-03-11T22:08:12.791536+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[21434]: audit 2024-03-11T22:08:13.591728+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[21434]: audit 2024-03-11T22:08:13.598475+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[21434]: audit 2024-03-11T22:08:13.619695+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[21434]: audit 2024-03-11T22:08:13.623713+0000 mon.a (mon.0) 634 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[21434]: audit 2024-03-11T22:08:13.627809+0000 mon.a (mon.0) 635 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:13 smithi049 bash[21434]: audit 2024-03-11T22:08:13.676245+0000 mon.a (mon.0) 636 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:14.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:13 smithi187 bash[23415]: cluster 2024-03-11T22:08:12.791536+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:14.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:13 smithi187 bash[23415]: audit 2024-03-11T22:08:13.591728+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:13 smithi187 bash[23415]: audit 2024-03-11T22:08:13.598475+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:13 smithi187 bash[23415]: audit 2024-03-11T22:08:13.619695+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:13 smithi187 bash[23415]: audit 2024-03-11T22:08:13.623713+0000 mon.a (mon.0) 634 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:13 smithi187 bash[23415]: audit 2024-03-11T22:08:13.627809+0000 mon.a (mon.0) 635 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:14.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:13 smithi187 bash[23415]: audit 2024-03-11T22:08:13.676245+0000 mon.a (mon.0) 636 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:15.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:15 smithi187 bash[23415]: cephadm 2024-03-11T22:08:13.620354+0000 mgr.y (mgr.14152) 340 : cephadm 1 Saving service rgw.foo.a spec with placement smithi049=foo.a;count:1 2024-03-11T22:08:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:15 smithi049 bash[21434]: cephadm 2024-03-11T22:08:13.620354+0000 mgr.y (mgr.14152) 340 : cephadm 1 Saving service rgw.foo.a spec with placement smithi049=foo.a;count:1 2024-03-11T22:08:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:15 smithi049 bash[28804]: cephadm 2024-03-11T22:08:13.620354+0000 mgr.y (mgr.14152) 340 : cephadm 1 Saving service rgw.foo.a spec with placement smithi049=foo.a;count:1 2024-03-11T22:08:16.134 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:08:16.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:16 smithi187 bash[23415]: cluster 2024-03-11T22:08:14.791837+0000 mgr.y (mgr.14152) 341 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:16.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:16 smithi187 bash[23415]: cluster 2024-03-11T22:08:15.248553+0000 mon.a (mon.0) 637 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-03-11T22:08:16.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:16 smithi187 bash[23415]: audit 2024-03-11T22:08:15.251277+0000 mon.c (mon.2) 14 : audit 1 from='client.? v1:172.21.15.49:0/1979804929' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-11T22:08:16.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:16 smithi187 bash[23415]: audit 2024-03-11T22:08:15.260798+0000 mon.a (mon.0) 638 : audit 1 from='client.24353 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-11T22:08:16.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:16 smithi187 bash[23415]: audit 2024-03-11T22:08:15.876845+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:16.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[21434]: cluster 2024-03-11T22:08:14.791837+0000 mgr.y (mgr.14152) 341 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:16.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[21434]: cluster 2024-03-11T22:08:15.248553+0000 mon.a (mon.0) 637 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-03-11T22:08:16.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[21434]: audit 2024-03-11T22:08:15.251277+0000 mon.c (mon.2) 14 : audit 1 from='client.? v1:172.21.15.49:0/1979804929' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-11T22:08:16.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[21434]: audit 2024-03-11T22:08:15.260798+0000 mon.a (mon.0) 638 : audit 1 from='client.24353 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-11T22:08:16.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[21434]: audit 2024-03-11T22:08:15.876845+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[28804]: cluster 2024-03-11T22:08:14.791837+0000 mgr.y (mgr.14152) 341 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:16.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[28804]: cluster 2024-03-11T22:08:15.248553+0000 mon.a (mon.0) 637 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-03-11T22:08:16.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[28804]: audit 2024-03-11T22:08:15.251277+0000 mon.c (mon.2) 14 : audit 1 from='client.? v1:172.21.15.49:0/1979804929' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-11T22:08:16.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[28804]: audit 2024-03-11T22:08:15.260798+0000 mon.a (mon.0) 638 : audit 1 from='client.24353 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-11T22:08:16.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:16 smithi049 bash[28804]: audit 2024-03-11T22:08:15.876845+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:17.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:17 smithi187 bash[23415]: audit 2024-03-11T22:08:16.246494+0000 mon.a (mon.0) 640 : audit 1 from='client.24353 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-11T22:08:17.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:17 smithi187 bash[23415]: cluster 2024-03-11T22:08:16.254411+0000 mon.a (mon.0) 641 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-03-11T22:08:17.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:17 smithi049 bash[21434]: audit 2024-03-11T22:08:16.246494+0000 mon.a (mon.0) 640 : audit 1 from='client.24353 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-11T22:08:17.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:17 smithi049 bash[21434]: cluster 2024-03-11T22:08:16.254411+0000 mon.a (mon.0) 641 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-03-11T22:08:17.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:17 smithi049 bash[28804]: audit 2024-03-11T22:08:16.246494+0000 mon.a (mon.0) 640 : audit 1 from='client.24353 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-11T22:08:17.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:17 smithi049 bash[28804]: cluster 2024-03-11T22:08:16.254411+0000 mon.a (mon.0) 641 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-03-11T22:08:18.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:18 smithi187 bash[23415]: cluster 2024-03-11T22:08:16.792335+0000 mgr.y (mgr.14152) 342 : cluster 0 pgmap v325: 33 pgs: 7 active+clean, 6 creating+peering, 20 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 0 op/s 2024-03-11T22:08:18.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:18 smithi187 bash[23415]: cluster 2024-03-11T22:08:17.274638+0000 mon.a (mon.0) 642 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-03-11T22:08:18.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:18 smithi187 bash[23415]: audit 2024-03-11T22:08:17.279174+0000 mon.c (mon.2) 15 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-11T22:08:18.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:18 smithi187 bash[23415]: audit 2024-03-11T22:08:17.281092+0000 mon.a (mon.0) 643 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-11T22:08:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[28804]: cluster 2024-03-11T22:08:16.792335+0000 mgr.y (mgr.14152) 342 : cluster 0 pgmap v325: 33 pgs: 7 active+clean, 6 creating+peering, 20 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 0 op/s 2024-03-11T22:08:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[28804]: cluster 2024-03-11T22:08:17.274638+0000 mon.a (mon.0) 642 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-03-11T22:08:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[28804]: audit 2024-03-11T22:08:17.279174+0000 mon.c (mon.2) 15 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-11T22:08:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[28804]: audit 2024-03-11T22:08:17.281092+0000 mon.a (mon.0) 643 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-11T22:08:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[21434]: cluster 2024-03-11T22:08:16.792335+0000 mgr.y (mgr.14152) 342 : cluster 0 pgmap v325: 33 pgs: 7 active+clean, 6 creating+peering, 20 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 0 op/s 2024-03-11T22:08:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[21434]: cluster 2024-03-11T22:08:17.274638+0000 mon.a (mon.0) 642 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-03-11T22:08:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[21434]: audit 2024-03-11T22:08:17.279174+0000 mon.c (mon.2) 15 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-11T22:08:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:18 smithi049 bash[21434]: audit 2024-03-11T22:08:17.281092+0000 mon.a (mon.0) 643 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-11T22:08:19.055 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/1213839593 >> v1:172.21.15.187:6789/0 conn(0x7f6a78103e60 legacy=0x7f6a7810f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:19.055 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/1213839593 shutdown_connections 2024-03-11T22:08:19.055 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/1213839593 >> 172.21.15.187:0/1213839593 conn(0x7f6a780fbf30 msgr2=0x7f6a780fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:19.055 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/1213839593 shutdown_connections 2024-03-11T22:08:19.055 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/1213839593 wait complete. 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 Processor -- start 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- start start 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6a78117320 con 0x7f6a78106320 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6a7819df50 con 0x7f6a78100310 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6a781aa6f0 con 0x7f6a78103e60 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7d740700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f6a78100310 0x7f6a7819d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:41796/0 (socket says 172.21.15.187:41796) 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7d740700 1 -- 172.21.15.187:0/2062197793 learned_addr learned my addr 172.21.15.187:0/2062197793 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721377950 0 0) 0x7f6a7819df50 con 0x7f6a78100310 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a640035b0 con 0x7f6a78100310 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3406357718 0 0) 0x7f6a640035b0 con 0x7f6a78100310 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6a7819df50 con 0x7f6a78100310 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f6a68001910 con 0x7f6a78100310 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405388528 0 0) 0x7f6a781aa6f0 con 0x7f6a78103e60 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a640035b0 con 0x7f6a78103e60 2024-03-11T22:08:19.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3792028659 0 0) 0x7f6a7819df50 con 0x7f6a78100310 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 >> v1:172.21.15.49:6790/0 conn(0x7f6a78103e60 legacy=0x7f6a781a3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 >> v1:172.21.15.49:6789/0 conn(0x7f6a78106320 legacy=0x7f6a781a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a781ab890 con 0x7f6a78100310 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a781aa8e0 con 0x7f6a78100310 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a781aade0 con 0x7f6a78100310 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f6a68001d30 con 0x7f6a78100310 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f6a68005dd0 con 0x7f6a78100310 2024-03-11T22:08:19.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c005150 con 0x7f6a78100310 2024-03-11T22:08:19.059 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.065+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f6a68003990 con 0x7f6a78100310 2024-03-11T22:08:19.059 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.069+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(62..62 src has 1..62) v4 ==== 4805+0+0 (unknown 749347234 0 0) 0x7f6a68087dd0 con 0x7f6a78100310 2024-03-11T22:08:19.063 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.073+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f6a68051ad0 con 0x7f6a78100310 2024-03-11T22:08:19.279 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:19.285+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7f6a5c005980 con 0x7f6a78100310 2024-03-11T22:08:19.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:19 smithi187 bash[23415]: audit 2024-03-11T22:08:18.276973+0000 mon.a (mon.0) 644 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-03-11T22:08:19.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:19 smithi187 bash[23415]: cluster 2024-03-11T22:08:18.283544+0000 mon.a (mon.0) 645 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-03-11T22:08:19.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:19 smithi187 bash[23415]: audit 2024-03-11T22:08:19.065231+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:19 smithi187 bash[23415]: audit 2024-03-11T22:08:19.075776+0000 mon.a (mon.0) 647 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:19 smithi187 bash[23415]: audit 2024-03-11T22:08:19.077831+0000 mon.a (mon.0) 648 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:19 smithi187 bash[23415]: audit 2024-03-11T22:08:19.079065+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[21434]: audit 2024-03-11T22:08:18.276973+0000 mon.a (mon.0) 644 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-03-11T22:08:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[21434]: cluster 2024-03-11T22:08:18.283544+0000 mon.a (mon.0) 645 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-03-11T22:08:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[21434]: audit 2024-03-11T22:08:19.065231+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[21434]: audit 2024-03-11T22:08:19.075776+0000 mon.a (mon.0) 647 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[21434]: audit 2024-03-11T22:08:19.077831+0000 mon.a (mon.0) 648 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[21434]: audit 2024-03-11T22:08:19.079065+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[28804]: audit 2024-03-11T22:08:18.276973+0000 mon.a (mon.0) 644 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-03-11T22:08:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[28804]: cluster 2024-03-11T22:08:18.283544+0000 mon.a (mon.0) 645 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-03-11T22:08:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[28804]: audit 2024-03-11T22:08:19.065231+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[28804]: audit 2024-03-11T22:08:19.075776+0000 mon.a (mon.0) 647 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[28804]: audit 2024-03-11T22:08:19.077831+0000 mon.a (mon.0) 648 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:19 smithi049 bash[28804]: audit 2024-03-11T22:08:19.079065+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:20.285 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:20.293+0000 7f6a6e7fc700 1 -- 172.21.15.187:0/2062197793 <== mon.1 v1:172.21.15.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v64) v1 ==== 160+0+0 (unknown 2423491992 0 0) 0x7f6a68053bd0 con 0x7f6a78100310 2024-03-11T22:08:20.294 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:20.301+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 >> v1:172.21.15.49:6800/4076252288 conn(0x7f6a6406e370 legacy=0x7f6a64070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:20.294 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:20.301+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 >> v1:172.21.15.187:6789/0 conn(0x7f6a78100310 legacy=0x7f6a7819d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:20.296 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:20.305+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 shutdown_connections 2024-03-11T22:08:20.296 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:20.305+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 >> 172.21.15.187:0/2062197793 conn(0x7f6a780fbf30 msgr2=0x7f6a78102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:20.300 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:20.309+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 shutdown_connections 2024-03-11T22:08:20.301 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:20.309+0000 7f6a7f9a4700 1 -- 172.21.15.187:0/2062197793 wait complete. 2024-03-11T22:08:20.303 INFO:teuthology.orchestra.run.smithi187.stderr:pool 'datapool' created 2024-03-11T22:08:20.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:20 smithi187 bash[23415]: cluster 2024-03-11T22:08:18.792756+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v328: 65 pgs: 14 active+clean, 4 creating+activating, 12 creating+peering, 35 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:08:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:20 smithi187 bash[23415]: cephadm 2024-03-11T22:08:19.089581+0000 mgr.y (mgr.14152) 344 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-11T22:08:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:20 smithi187 bash[23415]: cluster 2024-03-11T22:08:19.289324+0000 mon.a (mon.0) 650 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-03-11T22:08:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:20 smithi187 bash[23415]: audit 2024-03-11T22:08:19.290409+0000 mon.b (mon.1) 25 : audit 1 from='client.? v1:172.21.15.187:0/2062197793' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-11T22:08:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:20 smithi187 bash[23415]: audit 2024-03-11T22:08:19.290445+0000 mon.c (mon.2) 16 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-11T22:08:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:20 smithi187 bash[23415]: audit 2024-03-11T22:08:19.291103+0000 mon.a (mon.0) 651 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-11T22:08:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:20 smithi187 bash[23415]: audit 2024-03-11T22:08:19.294823+0000 mon.a (mon.0) 652 : audit 1 from='client.24388 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[21434]: cluster 2024-03-11T22:08:18.792756+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v328: 65 pgs: 14 active+clean, 4 creating+activating, 12 creating+peering, 35 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[21434]: cephadm 2024-03-11T22:08:19.089581+0000 mgr.y (mgr.14152) 344 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[21434]: cluster 2024-03-11T22:08:19.289324+0000 mon.a (mon.0) 650 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[21434]: audit 2024-03-11T22:08:19.290409+0000 mon.b (mon.1) 25 : audit 1 from='client.? v1:172.21.15.187:0/2062197793' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[21434]: audit 2024-03-11T22:08:19.290445+0000 mon.c (mon.2) 16 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[21434]: audit 2024-03-11T22:08:19.291103+0000 mon.a (mon.0) 651 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[21434]: audit 2024-03-11T22:08:19.294823+0000 mon.a (mon.0) 652 : audit 1 from='client.24388 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-11T22:08:20.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[28804]: cluster 2024-03-11T22:08:18.792756+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v328: 65 pgs: 14 active+clean, 4 creating+activating, 12 creating+peering, 35 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:08:20.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[28804]: cephadm 2024-03-11T22:08:19.089581+0000 mgr.y (mgr.14152) 344 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-11T22:08:20.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[28804]: cluster 2024-03-11T22:08:19.289324+0000 mon.a (mon.0) 650 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-03-11T22:08:20.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[28804]: audit 2024-03-11T22:08:19.290409+0000 mon.b (mon.1) 25 : audit 1 from='client.? v1:172.21.15.187:0/2062197793' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-11T22:08:20.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[28804]: audit 2024-03-11T22:08:19.290445+0000 mon.c (mon.2) 16 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-11T22:08:20.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[28804]: audit 2024-03-11T22:08:19.291103+0000 mon.a (mon.0) 651 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-11T22:08:20.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:20 smithi049 bash[28804]: audit 2024-03-11T22:08:19.294823+0000 mon.a (mon.0) 652 : audit 1 from='client.24388 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-11T22:08:21.177 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- rbd pool init datapool 2024-03-11T22:08:21.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:21 smithi187 bash[23415]: audit 2024-03-11T22:08:20.289096+0000 mon.a (mon.0) 653 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-03-11T22:08:21.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:21 smithi187 bash[23415]: audit 2024-03-11T22:08:20.289342+0000 mon.a (mon.0) 654 : audit 1 from='client.24388 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-03-11T22:08:21.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:21 smithi187 bash[23415]: cluster 2024-03-11T22:08:20.297838+0000 mon.a (mon.0) 655 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-03-11T22:08:21.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:21 smithi187 bash[23415]: cluster 2024-03-11T22:08:21.338126+0000 mon.a (mon.0) 656 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[21434]: audit 2024-03-11T22:08:20.289096+0000 mon.a (mon.0) 653 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[21434]: audit 2024-03-11T22:08:20.289342+0000 mon.a (mon.0) 654 : audit 1 from='client.24388 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[21434]: cluster 2024-03-11T22:08:20.297838+0000 mon.a (mon.0) 655 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[21434]: cluster 2024-03-11T22:08:21.338126+0000 mon.a (mon.0) 656 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[28804]: audit 2024-03-11T22:08:20.289096+0000 mon.a (mon.0) 653 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[28804]: audit 2024-03-11T22:08:20.289342+0000 mon.a (mon.0) 654 : audit 1 from='client.24388 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[28804]: cluster 2024-03-11T22:08:20.297838+0000 mon.a (mon.0) 655 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-03-11T22:08:21.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:21 smithi049 bash[28804]: cluster 2024-03-11T22:08:21.338126+0000 mon.a (mon.0) 656 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: cluster 2024-03-11T22:08:20.793525+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v331: 100 pgs: 37 active+clean, 4 creating+activating, 15 creating+peering, 44 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:21.341448+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: cluster 2024-03-11T22:08:21.343102+0000 mon.a (mon.0) 657 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:21.347274+0000 mon.a (mon.0) 658 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:21.348147+0000 mon.a (mon.0) 659 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:22.333302+0000 mon.a (mon.0) 660 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:22.333533+0000 mon.a (mon.0) 661 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-11T22:08:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: cluster 2024-03-11T22:08:22.340744+0000 mon.a (mon.0) 662 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-03-11T22:08:22.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:22.343010+0000 mon.c (mon.2) 18 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:22.345197+0000 mon.a (mon.0) 663 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:22 smithi187 bash[23415]: audit 2024-03-11T22:08:22.350216+0000 mon.a (mon.0) 664 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: cluster 2024-03-11T22:08:20.793525+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v331: 100 pgs: 37 active+clean, 4 creating+activating, 15 creating+peering, 44 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:08:22.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:21.341448+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: cluster 2024-03-11T22:08:21.343102+0000 mon.a (mon.0) 657 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:08:22.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:21.347274+0000 mon.a (mon.0) 658 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:21.348147+0000 mon.a (mon.0) 659 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:22.333302+0000 mon.a (mon.0) 660 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:22.333533+0000 mon.a (mon.0) 661 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: cluster 2024-03-11T22:08:22.340744+0000 mon.a (mon.0) 662 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:22.343010+0000 mon.c (mon.2) 18 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:22.345197+0000 mon.a (mon.0) 663 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[21434]: audit 2024-03-11T22:08:22.350216+0000 mon.a (mon.0) 664 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: cluster 2024-03-11T22:08:20.793525+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v331: 100 pgs: 37 active+clean, 4 creating+activating, 15 creating+peering, 44 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:21.341448+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: cluster 2024-03-11T22:08:21.343102+0000 mon.a (mon.0) 657 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:21.347274+0000 mon.a (mon.0) 658 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:21.348147+0000 mon.a (mon.0) 659 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:22.333302+0000 mon.a (mon.0) 660 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-11T22:08:22.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:22.333533+0000 mon.a (mon.0) 661 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-11T22:08:22.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: cluster 2024-03-11T22:08:22.340744+0000 mon.a (mon.0) 662 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-03-11T22:08:22.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:22.343010+0000 mon.c (mon.2) 18 : audit 1 from='client.? v1:172.21.15.49:0/1576994088' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:22.345197+0000 mon.a (mon.0) 663 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:22.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:22 smithi049 bash[28804]: audit 2024-03-11T22:08:22.350216+0000 mon.a (mon.0) 664 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: cluster 2024-03-11T22:08:22.794413+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v334: 132 pgs: 88 active+clean, 4 creating+activating, 11 creating+peering, 29 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.335652+0000 mon.a (mon.0) 665 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.335862+0000 mon.a (mon.0) 666 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: cluster 2024-03-11T22:08:23.343336+0000 mon.a (mon.0) 667 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.627421+0000 mon.a (mon.0) 668 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.633745+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.639358+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.718823+0000 mon.a (mon.0) 671 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.720934+0000 mon.a (mon.0) 672 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:23.721846+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:24 smithi187 bash[23415]: audit 2024-03-11T22:08:24.270925+0000 mon.a (mon.0) 674 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: cluster 2024-03-11T22:08:22.794413+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v334: 132 pgs: 88 active+clean, 4 creating+activating, 11 creating+peering, 29 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.335652+0000 mon.a (mon.0) 665 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.335862+0000 mon.a (mon.0) 666 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: cluster 2024-03-11T22:08:23.343336+0000 mon.a (mon.0) 667 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.627421+0000 mon.a (mon.0) 668 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.633745+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.639358+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.718823+0000 mon.a (mon.0) 671 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.720934+0000 mon.a (mon.0) 672 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:23.721846+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[21434]: audit 2024-03-11T22:08:24.270925+0000 mon.a (mon.0) 674 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: cluster 2024-03-11T22:08:22.794413+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v334: 132 pgs: 88 active+clean, 4 creating+activating, 11 creating+peering, 29 unknown; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.335652+0000 mon.a (mon.0) 665 : audit 1 from='client.24362 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.335862+0000 mon.a (mon.0) 666 : audit 1 from='client.? v1:172.21.15.49:0/2057514826' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-11T22:08:24.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: cluster 2024-03-11T22:08:23.343336+0000 mon.a (mon.0) 667 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-03-11T22:08:24.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.627421+0000 mon.a (mon.0) 668 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.633745+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.639358+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:24.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.718823+0000 mon.a (mon.0) 671 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:24.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.720934+0000 mon.a (mon.0) 672 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:24.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:23.721846+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:24.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:24 smithi049 bash[28804]: audit 2024-03-11T22:08:24.270925+0000 mon.a (mon.0) 674 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:25.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:25 smithi187 bash[23415]: cephadm 2024-03-11T22:08:24.007529+0000 mgr.y (mgr.14152) 347 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-11T22:08:25.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:25 smithi049 bash[21434]: cephadm 2024-03-11T22:08:24.007529+0000 mgr.y (mgr.14152) 347 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-11T22:08:25.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:25 smithi049 bash[28804]: cephadm 2024-03-11T22:08:24.007529+0000 mgr.y (mgr.14152) 347 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-11T22:08:25.936 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:08:26.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:26 smithi187 bash[23415]: cluster 2024-03-11T22:08:24.795771+0000 mgr.y (mgr.14152) 348 : cluster 0 pgmap v336: 132 pgs: 116 active+clean, 9 creating+peering, 7 unknown; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 3.1 KiB/s wr, 79 op/s 2024-03-11T22:08:26.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:26 smithi049 bash[21434]: cluster 2024-03-11T22:08:24.795771+0000 mgr.y (mgr.14152) 348 : cluster 0 pgmap v336: 132 pgs: 116 active+clean, 9 creating+peering, 7 unknown; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 3.1 KiB/s wr, 79 op/s 2024-03-11T22:08:26.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:26 smithi049 bash[28804]: cluster 2024-03-11T22:08:24.795771+0000 mgr.y (mgr.14152) 348 : cluster 0 pgmap v336: 132 pgs: 116 active+clean, 9 creating+peering, 7 unknown; 579 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 3.1 KiB/s wr, 79 op/s 2024-03-11T22:08:28.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:28 smithi187 bash[23415]: cluster 2024-03-11T22:08:26.797013+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v337: 132 pgs: 132 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-03-11T22:08:28.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:28 smithi049 bash[21434]: cluster 2024-03-11T22:08:26.797013+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v337: 132 pgs: 132 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-03-11T22:08:28.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:28 smithi049 bash[28804]: cluster 2024-03-11T22:08:26.797013+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v337: 132 pgs: 132 active+clean; 581 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-03-11T22:08:29.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:29 smithi187 bash[23415]: audit 2024-03-11T22:08:28.860004+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.187:0/1467160238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-11T22:08:29.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:29 smithi187 bash[23415]: audit 2024-03-11T22:08:28.862608+0000 mon.a (mon.0) 675 : audit 1 from='client.24460 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-11T22:08:29.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:29 smithi049 bash[21434]: audit 2024-03-11T22:08:28.860004+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.187:0/1467160238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-11T22:08:29.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:29 smithi049 bash[21434]: audit 2024-03-11T22:08:28.862608+0000 mon.a (mon.0) 675 : audit 1 from='client.24460 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-11T22:08:29.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:29 smithi049 bash[28804]: audit 2024-03-11T22:08:28.860004+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.187:0/1467160238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-11T22:08:29.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:29 smithi049 bash[28804]: audit 2024-03-11T22:08:28.862608+0000 mon.a (mon.0) 675 : audit 1 from='client.24460 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-11T22:08:30.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:30 smithi187 bash[23415]: cluster 2024-03-11T22:08:28.798072+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 4.8 KiB/s wr, 153 op/s 2024-03-11T22:08:30.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:30 smithi187 bash[23415]: audit 2024-03-11T22:08:29.362574+0000 mon.a (mon.0) 676 : audit 1 from='client.24460 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-03-11T22:08:30.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:30 smithi187 bash[23415]: cluster 2024-03-11T22:08:29.369955+0000 mon.a (mon.0) 677 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-03-11T22:08:30.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:30 smithi049 bash[21434]: cluster 2024-03-11T22:08:28.798072+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 4.8 KiB/s wr, 153 op/s 2024-03-11T22:08:30.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:30 smithi049 bash[21434]: audit 2024-03-11T22:08:29.362574+0000 mon.a (mon.0) 676 : audit 1 from='client.24460 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-03-11T22:08:30.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:30 smithi049 bash[21434]: cluster 2024-03-11T22:08:29.369955+0000 mon.a (mon.0) 677 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-03-11T22:08:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:30 smithi049 bash[28804]: cluster 2024-03-11T22:08:28.798072+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s rd, 4.8 KiB/s wr, 153 op/s 2024-03-11T22:08:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:30 smithi049 bash[28804]: audit 2024-03-11T22:08:29.362574+0000 mon.a (mon.0) 676 : audit 1 from='client.24460 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-03-11T22:08:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:30 smithi049 bash[28804]: cluster 2024-03-11T22:08:29.369955+0000 mon.a (mon.0) 677 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-03-11T22:08:31.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:31 smithi187 bash[23415]: cluster 2024-03-11T22:08:30.371183+0000 mon.a (mon.0) 678 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-03-11T22:08:31.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:31 smithi187 bash[23415]: cluster 2024-03-11T22:08:30.798790+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 4.8 KiB/s wr, 153 op/s 2024-03-11T22:08:31.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:31 smithi049 bash[21434]: cluster 2024-03-11T22:08:30.371183+0000 mon.a (mon.0) 678 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-03-11T22:08:31.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:31 smithi049 bash[21434]: cluster 2024-03-11T22:08:30.798790+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 4.8 KiB/s wr, 153 op/s 2024-03-11T22:08:31.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:31 smithi049 bash[28804]: cluster 2024-03-11T22:08:30.371183+0000 mon.a (mon.0) 678 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-03-11T22:08:31.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:31 smithi049 bash[28804]: cluster 2024-03-11T22:08:30.798790+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 4.8 KiB/s wr, 153 op/s 2024-03-11T22:08:32.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.187 --placement '1;smithi187=iscsi.a' 2024-03-11T22:08:32.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:32 smithi187 bash[23415]: cluster 2024-03-11T22:08:31.373473+0000 mon.a (mon.0) 679 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-11T22:08:32.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:32 smithi187 bash[23415]: cluster 2024-03-11T22:08:31.373524+0000 mon.a (mon.0) 680 : cluster 1 Cluster is now healthy 2024-03-11T22:08:32.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:32 smithi187 bash[23415]: cluster 2024-03-11T22:08:31.390317+0000 mon.a (mon.0) 681 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-03-11T22:08:32.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:32 smithi049 bash[21434]: cluster 2024-03-11T22:08:31.373473+0000 mon.a (mon.0) 679 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-11T22:08:32.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:32 smithi049 bash[21434]: cluster 2024-03-11T22:08:31.373524+0000 mon.a (mon.0) 680 : cluster 1 Cluster is now healthy 2024-03-11T22:08:32.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:32 smithi049 bash[21434]: cluster 2024-03-11T22:08:31.390317+0000 mon.a (mon.0) 681 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-03-11T22:08:32.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:32 smithi049 bash[28804]: cluster 2024-03-11T22:08:31.373473+0000 mon.a (mon.0) 679 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-11T22:08:32.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:32 smithi049 bash[28804]: cluster 2024-03-11T22:08:31.373524+0000 mon.a (mon.0) 680 : cluster 1 Cluster is now healthy 2024-03-11T22:08:32.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:32 smithi049 bash[28804]: cluster 2024-03-11T22:08:31.390317+0000 mon.a (mon.0) 681 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-03-11T22:08:33.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:33 smithi187 bash[23415]: cluster 2024-03-11T22:08:32.799892+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 1.7 KiB/s wr, 59 op/s 2024-03-11T22:08:33.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:33 smithi049 bash[28804]: cluster 2024-03-11T22:08:32.799892+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 1.7 KiB/s wr, 59 op/s 2024-03-11T22:08:33.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:33 smithi049 bash[21434]: cluster 2024-03-11T22:08:32.799892+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 1.7 KiB/s wr, 59 op/s 2024-03-11T22:08:36.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:35 smithi187 bash[23415]: cluster 2024-03-11T22:08:34.800998+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 170 B/s wr, 0 op/s 2024-03-11T22:08:36.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:35 smithi049 bash[21434]: cluster 2024-03-11T22:08:34.800998+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 170 B/s wr, 0 op/s 2024-03-11T22:08:36.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:35 smithi049 bash[28804]: cluster 2024-03-11T22:08:34.800998+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 170 B/s wr, 0 op/s 2024-03-11T22:08:36.943 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:08:38.203 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:37 smithi187 bash[23415]: cluster 2024-03-11T22:08:36.802243+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 275 B/s wr, 0 op/s 2024-03-11T22:08:38.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:37 smithi049 bash[21434]: cluster 2024-03-11T22:08:36.802243+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 275 B/s wr, 0 op/s 2024-03-11T22:08:38.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:37 smithi049 bash[28804]: cluster 2024-03-11T22:08:36.802243+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 275 B/s wr, 0 op/s 2024-03-11T22:08:39.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/3530099097 >> v1:172.21.15.187:6789/0 conn(0x7f4e4c101a50 legacy=0x7f4e4c101e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:39.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/3530099097 shutdown_connections 2024-03-11T22:08:39.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/3530099097 >> 172.21.15.187:0/3530099097 conn(0x7f4e4c0fd010 msgr2=0x7f4e4c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:39.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/3530099097 shutdown_connections 2024-03-11T22:08:39.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/3530099097 wait complete. 2024-03-11T22:08:39.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 Processor -- start 2024-03-11T22:08:39.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- start start 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4e4c1a45f0 con 0x7f4e4c10d110 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4e4c1a57d0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4e4c1a69d0 con 0x7f4e4c105e80 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e42ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4e4c109bc0 0x7f4e4c19f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:50766/0 (socket says 172.21.15.187:50766) 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e42ffd700 1 -- 172.21.15.187:0/27976630 learned_addr learned my addr 172.21.15.187:0/27976630 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075226124 0 0) 0x7f4e4c1a57d0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e380035b0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2526756121 0 0) 0x7f4e380035b0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e4c1a57d0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4e340018a0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871149762 0 0) 0x7f4e4c1a45f0 con 0x7f4e4c10d110 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e380035b0 con 0x7f4e4c10d110 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1851883471 0 0) 0x7f4e4c1a57d0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 >> v1:172.21.15.49:6790/0 conn(0x7f4e4c105e80 legacy=0x7f4e4c10c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 >> v1:172.21.15.49:6789/0 conn(0x7f4e4c10d110 legacy=0x7f4e4c1a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c1a7bd0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c1a6bc0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c1a70c0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f4e34003b30 con 0x7f4e4c109bc0 2024-03-11T22:08:39.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4e34005cc0 con 0x7f4e4c109bc0 2024-03-11T22:08:39.772 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.776+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c005150 con 0x7f4e4c109bc0 2024-03-11T22:08:39.772 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.780+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 15) v1 ==== 91045+0+0 (unknown 2812561132 0 0) 0x7f4e34003680 con 0x7f4e4c109bc0 2024-03-11T22:08:39.772 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.780+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(70..70 src has 1..70) v4 ==== 5970+0+0 (unknown 1669537171 0 0) 0x7f4e34088310 con 0x7f4e4c109bc0 2024-03-11T22:08:39.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:39.784+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f4e34051b80 con 0x7f4e4c109bc0 2024-03-11T22:08:39.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.004+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.187", "placement": "1;smithi187=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e2c000c90 con 0x7f4e3806e240 2024-03-11T22:08:40.017 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.024+0000 7f4e497fa700 1 -- 172.21.15.187:0/27976630 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (unknown 0 0 803663096) 0x7f4e2c000c90 con 0x7f4e3806e240 2024-03-11T22:08:40.017 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled iscsi.datapool update... 2024-03-11T22:08:40.019 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.028+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 >> v1:172.21.15.49:6800/4076252288 conn(0x7f4e3806e240 legacy=0x7f4e38070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:40.019 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.028+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 >> v1:172.21.15.187:6789/0 conn(0x7f4e4c109bc0 legacy=0x7f4e4c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:40.020 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.028+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 shutdown_connections 2024-03-11T22:08:40.020 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.028+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 >> 172.21.15.187:0/27976630 conn(0x7f4e4c0fd010 msgr2=0x7f4e4c073ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:40.020 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.028+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 shutdown_connections 2024-03-11T22:08:40.020 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:40.028+0000 7f4e51d03700 1 -- 172.21.15.187:0/27976630 wait complete. 2024-03-11T22:08:40.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:39 smithi187 bash[23415]: cluster 2024-03-11T22:08:38.803252+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 242 B/s wr, 0 op/s 2024-03-11T22:08:40.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:39 smithi049 bash[21434]: cluster 2024-03-11T22:08:38.803252+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 242 B/s wr, 0 op/s 2024-03-11T22:08:40.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:39 smithi049 bash[28804]: cluster 2024-03-11T22:08:38.803252+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 242 B/s wr, 0 op/s 2024-03-11T22:08:40.800 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-03-11T22:08:40.800 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T22:08:40.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-03-11T22:08:40.814 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T22:08:40.814 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-03-11T22:08:40.828 DEBUG:teuthology.orchestra.run.smithi187:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@iscsi.iscsi.a.service 2024-03-11T22:08:40.872 INFO:tasks.cephadm:Adding prometheus.a on smithi187 2024-03-11T22:08:40.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply prometheus '1;smithi187=a' 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.012737+0000 mgr.y (mgr.14152) 356 : audit 0 from='client.24466 v1:172.21.15.187:0/27976630' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.187", "placement": "1;smithi187=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: cephadm 2024-03-11T22:08:40.019104+0000 mgr.y (mgr.14152) 357 : cephadm 1 Saving service iscsi.datapool spec with placement smithi187=iscsi.a;count:1 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.028573+0000 mon.a (mon.0) 682 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.062191+0000 mon.a (mon.0) 683 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.804421+0000 mon.a (mon.0) 684 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.805972+0000 mon.a (mon.0) 685 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.817411+0000 mon.a (mon.0) 686 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.824510+0000 mon.a (mon.0) 687 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.827239+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: audit 2024-03-11T22:08:40.847592+0000 mon.a (mon.0) 689 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:41.229 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:41 smithi187 bash[23415]: cluster 2024-03-11T22:08:40.905259+0000 mon.a (mon.0) 690 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-03-11T22:08:41.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.012737+0000 mgr.y (mgr.14152) 356 : audit 0 from='client.24466 v1:172.21.15.187:0/27976630' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.187", "placement": "1;smithi187=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:41.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: cephadm 2024-03-11T22:08:40.019104+0000 mgr.y (mgr.14152) 357 : cephadm 1 Saving service iscsi.datapool spec with placement smithi187=iscsi.a;count:1 2024-03-11T22:08:41.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.028573+0000 mon.a (mon.0) 682 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:41.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.062191+0000 mon.a (mon.0) 683 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:41.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.804421+0000 mon.a (mon.0) 684 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:41.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.805972+0000 mon.a (mon.0) 685 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:41.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.817411+0000 mon.a (mon.0) 686 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.824510+0000 mon.a (mon.0) 687 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.827239+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: audit 2024-03-11T22:08:40.847592+0000 mon.a (mon.0) 689 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[21434]: cluster 2024-03-11T22:08:40.905259+0000 mon.a (mon.0) 690 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.012737+0000 mgr.y (mgr.14152) 356 : audit 0 from='client.24466 v1:172.21.15.187:0/27976630' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.187", "placement": "1;smithi187=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: cephadm 2024-03-11T22:08:40.019104+0000 mgr.y (mgr.14152) 357 : cephadm 1 Saving service iscsi.datapool spec with placement smithi187=iscsi.a;count:1 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.028573+0000 mon.a (mon.0) 682 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.062191+0000 mon.a (mon.0) 683 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.804421+0000 mon.a (mon.0) 684 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.805972+0000 mon.a (mon.0) 685 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:41.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.817411+0000 mon.a (mon.0) 686 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:41.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.824510+0000 mon.a (mon.0) 687 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-11T22:08:41.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.827239+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-11T22:08:41.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: audit 2024-03-11T22:08:40.847592+0000 mon.a (mon.0) 689 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:41.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:41 smithi049 bash[28804]: cluster 2024-03-11T22:08:40.905259+0000 mon.a (mon.0) 690 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-03-11T22:08:41.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:41 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:42.280 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:42 smithi187 bash[23415]: cluster 2024-03-11T22:08:40.804406+0000 mgr.y (mgr.14152) 358 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-03-11T22:08:42.280 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:42 smithi187 bash[23415]: cephadm 2024-03-11T22:08:40.848919+0000 mgr.y (mgr.14152) 359 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi187 2024-03-11T22:08:42.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:42 smithi049 bash[28804]: cluster 2024-03-11T22:08:40.804406+0000 mgr.y (mgr.14152) 358 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-03-11T22:08:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:42 smithi049 bash[28804]: cephadm 2024-03-11T22:08:40.848919+0000 mgr.y (mgr.14152) 359 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi187 2024-03-11T22:08:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:42 smithi049 bash[21434]: cluster 2024-03-11T22:08:40.804406+0000 mgr.y (mgr.14152) 358 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-03-11T22:08:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:42 smithi049 bash[21434]: cephadm 2024-03-11T22:08:40.848919+0000 mgr.y (mgr.14152) 359 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi187 2024-03-11T22:08:43.465 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.465 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.466 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.466 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.466 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.467 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.716 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.716 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.716 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.717 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.718 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.718 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:43.986 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:43 smithi187 systemd[1]: Started Ceph iscsi.iscsi.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:08:44.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:44 smithi187 bash[23415]: cluster 2024-03-11T22:08:42.805653+0000 mgr.y (mgr.14152) 360 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-03-11T22:08:44.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:44 smithi187 bash[23415]: audit 2024-03-11T22:08:43.785325+0000 mon.a (mon.0) 691 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:44 smithi187 bash[23415]: audit 2024-03-11T22:08:43.795443+0000 mon.a (mon.0) 692 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:44 smithi187 bash[23415]: audit 2024-03-11T22:08:43.832043+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:44 smithi187 bash[23415]: audit 2024-03-11T22:08:43.847023+0000 mon.a (mon.0) 694 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:44 smithi187 bash[23415]: audit 2024-03-11T22:08:43.912330+0000 mon.a (mon.0) 695 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:44.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[21434]: cluster 2024-03-11T22:08:42.805653+0000 mgr.y (mgr.14152) 360 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-03-11T22:08:44.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[21434]: audit 2024-03-11T22:08:43.785325+0000 mon.a (mon.0) 691 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[21434]: audit 2024-03-11T22:08:43.795443+0000 mon.a (mon.0) 692 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[21434]: audit 2024-03-11T22:08:43.832043+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[21434]: audit 2024-03-11T22:08:43.847023+0000 mon.a (mon.0) 694 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[21434]: audit 2024-03-11T22:08:43.912330+0000 mon.a (mon.0) 695 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[28804]: cluster 2024-03-11T22:08:42.805653+0000 mgr.y (mgr.14152) 360 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[28804]: audit 2024-03-11T22:08:43.785325+0000 mon.a (mon.0) 691 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[28804]: audit 2024-03-11T22:08:43.795443+0000 mon.a (mon.0) 692 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[28804]: audit 2024-03-11T22:08:43.832043+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[28804]: audit 2024-03-11T22:08:43.847023+0000 mon.a (mon.0) 694 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:44.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:44 smithi049 bash[28804]: audit 2024-03-11T22:08:43.912330+0000 mon.a (mon.0) 695 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:08:45.472 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:45 smithi187 bash[23415]: cephadm 2024-03-11T22:08:43.833736+0000 mgr.y (mgr.14152) 361 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-03-11T22:08:45.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:45 smithi049 bash[21434]: cephadm 2024-03-11T22:08:43.833736+0000 mgr.y (mgr.14152) 361 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-03-11T22:08:45.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:45 smithi049 bash[28804]: cephadm 2024-03-11T22:08:43.833736+0000 mgr.y (mgr.14152) 361 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-03-11T22:08:45.652 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:08:46.157 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:46 smithi187 bash[23415]: cluster 2024-03-11T22:08:44.806743+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-03-11T22:08:46.157 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:46 smithi187 bash[23415]: audit 2024-03-11T22:08:45.888900+0000 mon.a (mon.0) 696 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:46.157 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:45 smithi187 bash[47695]: debug Started the configuration object watcher 2024-03-11T22:08:46.157 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:45 smithi187 bash[47695]: debug Checking for config object changes every 1s 2024-03-11T22:08:46.157 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:45 smithi187 bash[47695]: debug Processing osd blocklist entries for this node 2024-03-11T22:08:46.486 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:46 smithi187 bash[47695]: debug Reading the configuration object to update local LIO configuration 2024-03-11T22:08:46.486 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:46 smithi187 bash[47695]: debug Configuration does not have an entry for this host(smithi187.front.sepia.ceph.com) - nothing to define to LIO 2024-03-11T22:08:46.487 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:46 smithi187 bash[47695]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-03-11T22:08:46.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:46 smithi049 bash[21434]: cluster 2024-03-11T22:08:44.806743+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-03-11T22:08:46.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:46 smithi049 bash[21434]: audit 2024-03-11T22:08:45.888900+0000 mon.a (mon.0) 696 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:46.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:46 smithi049 bash[28804]: cluster 2024-03-11T22:08:44.806743+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-03-11T22:08:46.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:46 smithi049 bash[28804]: audit 2024-03-11T22:08:45.888900+0000 mon.a (mon.0) 696 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:47.486 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:47 smithi187 bash[23415]: cluster 2024-03-11T22:08:46.072969+0000 mon.a (mon.0) 697 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-03-11T22:08:47.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:47 smithi187 bash[23415]: audit 2024-03-11T22:08:46.152840+0000 mon.b (mon.1) 27 : audit 0 from='client.? v1:172.21.15.187:0/103626605' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-11T22:08:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:47 smithi049 bash[21434]: cluster 2024-03-11T22:08:46.072969+0000 mon.a (mon.0) 697 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-03-11T22:08:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:47 smithi049 bash[21434]: audit 2024-03-11T22:08:46.152840+0000 mon.b (mon.1) 27 : audit 0 from='client.? v1:172.21.15.187:0/103626605' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-11T22:08:47.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:47 smithi049 bash[28804]: cluster 2024-03-11T22:08:46.072969+0000 mon.a (mon.0) 697 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-03-11T22:08:47.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:47 smithi049 bash[28804]: audit 2024-03-11T22:08:46.152840+0000 mon.b (mon.1) 27 : audit 0 from='client.? v1:172.21.15.187:0/103626605' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-11T22:08:48.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:48 smithi187 bash[23415]: cluster 2024-03-11T22:08:46.807925+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:48 smithi049 bash[21434]: cluster 2024-03-11T22:08:46.807925+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:48 smithi049 bash[28804]: cluster 2024-03-11T22:08:46.807925+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:08:49.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/519404544 >> v1:172.21.15.187:6789/0 conn(0x7f5890109ba0 legacy=0x7f589010c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:49.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/519404544 shutdown_connections 2024-03-11T22:08:49.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/519404544 >> 172.21.15.187:0/519404544 conn(0x7f58900fbf00 msgr2=0x7f58900fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:49.768 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/519404544 shutdown_connections 2024-03-11T22:08:49.769 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/519404544 wait complete. 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 Processor -- start 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- start start 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5890109530 con 0x7f5890106060 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f58901a5360 con 0x7f5890102550 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5895e5b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5890102550 0x7f58901089c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45822/0 (socket says 172.21.15.187:45822) 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5895e5b700 1 -- 172.21.15.187:0/2234795403 learned_addr learned my addr 172.21.15.187:0/2234795403 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f58901a6500 con 0x7f5890109ba0 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976909815 0 0) 0x7f58901a5360 con 0x7f5890102550 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c0035b0 con 0x7f5890102550 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 347836307 0 0) 0x7f587c0035b0 con 0x7f5890102550 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58901a5360 con 0x7f5890102550 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f588c001930 con 0x7f5890102550 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776023799 0 0) 0x7f58901a6500 con 0x7f5890109ba0 2024-03-11T22:08:49.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c0035b0 con 0x7f5890109ba0 2024-03-11T22:08:49.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2682262773 0 0) 0x7f58901a5360 con 0x7f5890102550 2024-03-11T22:08:49.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 >> v1:172.21.15.49:6790/0 conn(0x7f5890109ba0 legacy=0x7f58901a2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:49.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 >> v1:172.21.15.49:6789/0 conn(0x7f5890106060 legacy=0x7f589019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:49.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58901a76a0 con 0x7f5890102550 2024-03-11T22:08:49.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58901a66f0 con 0x7f5890102550 2024-03-11T22:08:49.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.776+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f58901a6bf0 con 0x7f5890102550 2024-03-11T22:08:49.771 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.780+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f588c003bb0 con 0x7f5890102550 2024-03-11T22:08:49.772 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.780+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f588c005d10 con 0x7f5890102550 2024-03-11T22:08:49.772 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.780+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5874005150 con 0x7f5890102550 2024-03-11T22:08:49.772 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.780+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 16) v1 ==== 91096+0+0 (unknown 888336521 0 0) 0x7f588c01c330 con 0x7f5890102550 2024-03-11T22:08:49.772 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.780+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 5942+0+0 (unknown 864696127 0 0) 0x7f588c0883c0 con 0x7f5890102550 2024-03-11T22:08:49.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:49.784+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f588c052b90 con 0x7f5890102550 2024-03-11T22:08:50.012 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.020+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f5874000bc0 con 0x7f587c06e3d0 2024-03-11T22:08:50.026 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.032+0000 7f5886ffd700 1 -- 172.21.15.187:0/2234795403 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (unknown 0 0 1342662408) 0x7f5874000bc0 con 0x7f587c06e3d0 2024-03-11T22:08:50.026 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled prometheus update... 2024-03-11T22:08:50.028 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.036+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 >> v1:172.21.15.49:6800/4076252288 conn(0x7f587c06e3d0 legacy=0x7f587c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:50.028 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.036+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 >> v1:172.21.15.187:6789/0 conn(0x7f5890102550 legacy=0x7f58901089c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:08:50.028 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.036+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 shutdown_connections 2024-03-11T22:08:50.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.036+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 >> 172.21.15.187:0/2234795403 conn(0x7f58900fbf00 msgr2=0x7f5890100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:08:50.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.036+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 shutdown_connections 2024-03-11T22:08:50.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:08:50.036+0000 7f58980bf700 1 -- 172.21.15.187:0/2234795403 wait complete. 2024-03-11T22:08:50.316 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:50 smithi187 bash[23415]: cluster 2024-03-11T22:08:48.808948+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:08:50.316 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:50 smithi187 bash[23415]: audit 2024-03-11T22:08:50.038078+0000 mon.a (mon.0) 698 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:50.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:50 smithi049 bash[28804]: cluster 2024-03-11T22:08:48.808948+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:08:50.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:50 smithi049 bash[28804]: audit 2024-03-11T22:08:50.038078+0000 mon.a (mon.0) 698 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:50 smithi049 bash[21434]: cluster 2024-03-11T22:08:48.808948+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:08:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:50 smithi049 bash[21434]: audit 2024-03-11T22:08:50.038078+0000 mon.a (mon.0) 698 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:50.881 DEBUG:teuthology.orchestra.run.smithi187:prometheus.a> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@prometheus.a.service 2024-03-11T22:08:50.883 INFO:tasks.cephadm:Adding node-exporter.a on smithi049 2024-03-11T22:08:50.883 INFO:tasks.cephadm:Adding node-exporter.b on smithi187 2024-03-11T22:08:50.884 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply node-exporter '2;smithi049=a;smithi187=b' 2024-03-11T22:08:51.237 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:08:51 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:08:51.296 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:51 smithi187 bash[23415]: audit 2024-03-11T22:08:50.026921+0000 mgr.y (mgr.14152) 365 : audit 0 from='client.24502 v1:172.21.15.187:0/2234795403' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:51.296 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:51 smithi187 bash[23415]: cephadm 2024-03-11T22:08:50.030642+0000 mgr.y (mgr.14152) 366 : cephadm 1 Saving service prometheus spec with placement smithi187=a;count:1 2024-03-11T22:08:51.296 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:51 smithi187 bash[23415]: audit 2024-03-11T22:08:50.309577+0000 mon.a (mon.0) 699 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.296 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:51 smithi187 bash[23415]: audit 2024-03-11T22:08:50.321264+0000 mon.a (mon.0) 700 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.297 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:51 smithi187 bash[23415]: audit 2024-03-11T22:08:50.324481+0000 mon.a (mon.0) 701 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:51.297 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:51 smithi187 bash[23415]: audit 2024-03-11T22:08:50.326773+0000 mon.a (mon.0) 702 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:51.297 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:51 smithi187 bash[23415]: audit 2024-03-11T22:08:50.336963+0000 mon.a (mon.0) 703 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[21434]: audit 2024-03-11T22:08:50.026921+0000 mgr.y (mgr.14152) 365 : audit 0 from='client.24502 v1:172.21.15.187:0/2234795403' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[21434]: cephadm 2024-03-11T22:08:50.030642+0000 mgr.y (mgr.14152) 366 : cephadm 1 Saving service prometheus spec with placement smithi187=a;count:1 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[21434]: audit 2024-03-11T22:08:50.309577+0000 mon.a (mon.0) 699 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[21434]: audit 2024-03-11T22:08:50.321264+0000 mon.a (mon.0) 700 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[21434]: audit 2024-03-11T22:08:50.324481+0000 mon.a (mon.0) 701 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[21434]: audit 2024-03-11T22:08:50.326773+0000 mon.a (mon.0) 702 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[21434]: audit 2024-03-11T22:08:50.336963+0000 mon.a (mon.0) 703 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[28804]: audit 2024-03-11T22:08:50.026921+0000 mgr.y (mgr.14152) 365 : audit 0 from='client.24502 v1:172.21.15.187:0/2234795403' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[28804]: cephadm 2024-03-11T22:08:50.030642+0000 mgr.y (mgr.14152) 366 : cephadm 1 Saving service prometheus spec with placement smithi187=a;count:1 2024-03-11T22:08:51.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[28804]: audit 2024-03-11T22:08:50.309577+0000 mon.a (mon.0) 699 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[28804]: audit 2024-03-11T22:08:50.321264+0000 mon.a (mon.0) 700 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:51.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[28804]: audit 2024-03-11T22:08:50.324481+0000 mon.a (mon.0) 701 : audit 0 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:08:51.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[28804]: audit 2024-03-11T22:08:50.326773+0000 mon.a (mon.0) 702 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:08:51.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:51 smithi049 bash[28804]: audit 2024-03-11T22:08:50.336963+0000 mon.a (mon.0) 703 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:08:52.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:52 smithi187 bash[23415]: cephadm 2024-03-11T22:08:50.651540+0000 mgr.y (mgr.14152) 367 : cephadm 1 Deploying daemon prometheus.a on smithi187 2024-03-11T22:08:52.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:52 smithi187 bash[23415]: cluster 2024-03-11T22:08:50.809894+0000 mgr.y (mgr.14152) 368 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:08:52.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:52 smithi049 bash[21434]: cephadm 2024-03-11T22:08:50.651540+0000 mgr.y (mgr.14152) 367 : cephadm 1 Deploying daemon prometheus.a on smithi187 2024-03-11T22:08:52.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:52 smithi049 bash[21434]: cluster 2024-03-11T22:08:50.809894+0000 mgr.y (mgr.14152) 368 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:08:52.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:52 smithi049 bash[28804]: cephadm 2024-03-11T22:08:50.651540+0000 mgr.y (mgr.14152) 367 : cephadm 1 Deploying daemon prometheus.a on smithi187 2024-03-11T22:08:52.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:52 smithi049 bash[28804]: cluster 2024-03-11T22:08:50.809894+0000 mgr.y (mgr.14152) 368 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:08:54.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:54 smithi187 bash[23415]: cluster 2024-03-11T22:08:52.811059+0000 mgr.y (mgr.14152) 369 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:54.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:54 smithi049 bash[21434]: cluster 2024-03-11T22:08:52.811059+0000 mgr.y (mgr.14152) 369 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:54.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:54 smithi049 bash[28804]: cluster 2024-03-11T22:08:52.811059+0000 mgr.y (mgr.14152) 369 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:55.669 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:08:56.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:08:55 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:08:56.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:56 smithi187 bash[23415]: cluster 2024-03-11T22:08:54.812140+0000 mgr.y (mgr.14152) 370 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:56 smithi049 bash[21434]: cluster 2024-03-11T22:08:54.812140+0000 mgr.y (mgr.14152) 370 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:56.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:56 smithi049 bash[28804]: cluster 2024-03-11T22:08:54.812140+0000 mgr.y (mgr.14152) 370 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:57.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:57 smithi187 bash[23415]: audit 2024-03-11T22:08:55.837472+0000 mgr.y (mgr.14152) 371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:08:57.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:57 smithi049 bash[21434]: audit 2024-03-11T22:08:55.837472+0000 mgr.y (mgr.14152) 371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:08:57.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:57 smithi049 bash[28804]: audit 2024-03-11T22:08:55.837472+0000 mgr.y (mgr.14152) 371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:08:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:08:58 smithi187 bash[23415]: cluster 2024-03-11T22:08:56.813266+0000 mgr.y (mgr.14152) 372 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:58.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:08:58 smithi049 bash[21434]: cluster 2024-03-11T22:08:56.813266+0000 mgr.y (mgr.14152) 372 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:08:58.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:08:58 smithi049 bash[28804]: cluster 2024-03-11T22:08:56.813266+0000 mgr.y (mgr.14152) 372 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:09:00.633 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:00 smithi187 bash[23415]: cluster 2024-03-11T22:08:58.814281+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:09:00.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:00 smithi049 bash[21434]: cluster 2024-03-11T22:08:58.814281+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:09:00.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:00 smithi049 bash[28804]: cluster 2024-03-11T22:08:58.814281+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-03-11T22:09:02.423 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:02 smithi187 bash[23415]: cluster 2024-03-11T22:09:00.815429+0000 mgr.y (mgr.14152) 374 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:02.608 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- 172.21.15.187:0/3637331183 >> v1:172.21.15.187:6789/0 conn(0x7f4edc109be0 legacy=0x7f4edc10c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:02.608 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- 172.21.15.187:0/3637331183 shutdown_connections 2024-03-11T22:09:02.608 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- 172.21.15.187:0/3637331183 >> 172.21.15.187:0/3637331183 conn(0x7f4edc0fbf60 msgr2=0x7f4edc0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:02.608 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- 172.21.15.187:0/3637331183 shutdown_connections 2024-03-11T22:09:02.608 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- 172.21.15.187:0/3637331183 wait complete. 2024-03-11T22:09:02.609 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 Processor -- start 2024-03-11T22:09:02.609 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- start start 2024-03-11T22:09:02.609 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4edc109510 con 0x7f4edc102530 2024-03-11T22:09:02.609 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4edc1a5390 con 0x7f4edc109be0 2024-03-11T22:09:02.609 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4edc1a6530 con 0x7f4edc106040 2024-03-11T22:09:02.609 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee2c65700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4edc109be0 0x7f4edc1a2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:59870/0 (socket says 172.21.15.187:59870) 2024-03-11T22:09:02.609 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee2c65700 1 -- 172.21.15.187:0/1990984570 learned_addr learned my addr 172.21.15.187:0/1990984570 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:09:02.610 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649727363 0 0) 0x7f4edc1a5390 con 0x7f4edc109be0 2024-03-11T22:09:02.610 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec40035b0 con 0x7f4edc109be0 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1801700285 0 0) 0x7f4ec40035b0 con 0x7f4edc109be0 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4edc1a5390 con 0x7f4edc109be0 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4ed4001c40 con 0x7f4edc109be0 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333130931 0 0) 0x7f4edc109510 con 0x7f4edc102530 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec40035b0 con 0x7f4edc102530 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199613319 0 0) 0x7f4edc1a6530 con 0x7f4edc106040 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc109510 con 0x7f4edc106040 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3474890162 0 0) 0x7f4edc1a5390 con 0x7f4edc109be0 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 >> v1:172.21.15.49:6790/0 conn(0x7f4edc106040 legacy=0x7f4edc19f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:02.611 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 >> v1:172.21.15.49:6789/0 conn(0x7f4edc102530 legacy=0x7f4edc1089c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc1a76d0 con 0x7f4edc109be0 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc1a43e0 con 0x7f4edc109be0 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc1a48e0 con 0x7f4edc109be0 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f4ed4001580 con 0x7f4edc109be0 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.616+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4ed4005350 con 0x7f4edc109be0 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.620+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec8005150 con 0x7f4edc109be0 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.620+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 16) v1 ==== 91096+0+0 (unknown 888336521 0 0) 0x7f4ed4003c80 con 0x7f4edc109be0 2024-03-11T22:09:02.612 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.620+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 5942+0+0 (unknown 864696127 0 0) 0x7f4ed4088920 con 0x7f4edc109be0 2024-03-11T22:09:02.616 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.624+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f4ed40522e0 con 0x7f4edc109be0 2024-03-11T22:09:02.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:02 smithi049 bash[21434]: cluster 2024-03-11T22:09:00.815429+0000 mgr.y (mgr.14152) 374 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:02.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:02 smithi049 bash[28804]: cluster 2024-03-11T22:09:00.815429+0000 mgr.y (mgr.14152) 374 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:02.832 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.840+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi049=a;smithi187=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ec8000bc0 con 0x7f4ec406e520 2024-03-11T22:09:02.846 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled node-exporter update... 2024-03-11T22:09:02.846 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.852+0000 7f4edb7fe700 1 -- 172.21.15.187:0/1990984570 <== mgr.14152 v1:172.21.15.49:6800/4076252288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (unknown 0 0 240551134) 0x7f4ec8000bc0 con 0x7f4ec406e520 2024-03-11T22:09:02.849 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.856+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 >> v1:172.21.15.49:6800/4076252288 conn(0x7f4ec406e520 legacy=0x7f4ec40709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:02.849 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.856+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 >> v1:172.21.15.187:6789/0 conn(0x7f4edc109be0 legacy=0x7f4edc1a2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:02.849 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.856+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 shutdown_connections 2024-03-11T22:09:02.849 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.856+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 >> 172.21.15.187:0/1990984570 conn(0x7f4edc0fbf60 msgr2=0x7f4edc100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:02.849 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.856+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 shutdown_connections 2024-03-11T22:09:02.849 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:02.856+0000 7f4ee46c8700 1 -- 172.21.15.187:0/1990984570 wait complete. 2024-03-11T22:09:04.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:03 smithi187 bash[23415]: cluster 2024-03-11T22:09:02.816644+0000 mgr.y (mgr.14152) 375 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:04.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:03 smithi187 bash[23415]: audit 2024-03-11T22:09:02.847332+0000 mgr.y (mgr.14152) 376 : audit 0 from='client.24508 v1:172.21.15.187:0/1990984570' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi049=a;smithi187=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:04.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:03 smithi187 bash[23415]: cephadm 2024-03-11T22:09:02.851025+0000 mgr.y (mgr.14152) 377 : cephadm 1 Saving service node-exporter spec with placement smithi049=a;smithi187=b;count:2 2024-03-11T22:09:04.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:03 smithi187 bash[23415]: audit 2024-03-11T22:09:02.858176+0000 mon.a (mon.0) 704 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:04.148 DEBUG:teuthology.orchestra.run.smithi049:node-exporter.a> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@node-exporter.a.service 2024-03-11T22:09:04.150 DEBUG:teuthology.orchestra.run.smithi187:node-exporter.b> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@node-exporter.b.service 2024-03-11T22:09:04.153 INFO:tasks.cephadm:Adding alertmanager.a on smithi049 2024-03-11T22:09:04.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply alertmanager '1;smithi049=a' 2024-03-11T22:09:04.159 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[28804]: cluster 2024-03-11T22:09:02.816644+0000 mgr.y (mgr.14152) 375 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:04.159 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[28804]: audit 2024-03-11T22:09:02.847332+0000 mgr.y (mgr.14152) 376 : audit 0 from='client.24508 v1:172.21.15.187:0/1990984570' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi049=a;smithi187=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:04.159 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[28804]: cephadm 2024-03-11T22:09:02.851025+0000 mgr.y (mgr.14152) 377 : cephadm 1 Saving service node-exporter spec with placement smithi049=a;smithi187=b;count:2 2024-03-11T22:09:04.159 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[28804]: audit 2024-03-11T22:09:02.858176+0000 mon.a (mon.0) 704 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:04.159 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[21434]: cluster 2024-03-11T22:09:02.816644+0000 mgr.y (mgr.14152) 375 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:04.160 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[21434]: audit 2024-03-11T22:09:02.847332+0000 mgr.y (mgr.14152) 376 : audit 0 from='client.24508 v1:172.21.15.187:0/1990984570' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi049=a;smithi187=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:04.160 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[21434]: cephadm 2024-03-11T22:09:02.851025+0000 mgr.y (mgr.14152) 377 : cephadm 1 Saving service node-exporter spec with placement smithi049=a;smithi187=b;count:2 2024-03-11T22:09:04.160 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:03 smithi049 bash[21434]: audit 2024-03-11T22:09:02.858176+0000 mon.a (mon.0) 704 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:06.217 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:05 smithi187 bash[23415]: cluster 2024-03-11T22:09:04.817729+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:06.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:05 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:09:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:05 smithi049 bash[21434]: cluster 2024-03-11T22:09:04.817729+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:06.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:05 smithi049 bash[28804]: cluster 2024-03-11T22:09:04.817729+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:07.226 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:06 smithi187 bash[23415]: audit 2024-03-11T22:09:05.849082+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:07.226 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:06 smithi187 bash[23415]: audit 2024-03-11T22:09:06.732789+0000 mon.a (mon.0) 705 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2024-03-11T22:09:07.226 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:06 smithi187 bash[23415]: audit 2024-03-11T22:09:06.733318+0000 mon.a (mon.0) 706 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-03-11T22:09:07.226 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:06 smithi187 bash[23415]: audit 2024-03-11T22:09:06.733726+0000 mon.a (mon.0) 707 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-03-11T22:09:07.226 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:06 smithi187 bash[23415]: audit 2024-03-11T22:09:06.734131+0000 mon.a (mon.0) 708 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-03-11T22:09:07.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[28804]: audit 2024-03-11T22:09:05.849082+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:07.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[28804]: audit 2024-03-11T22:09:06.732789+0000 mon.a (mon.0) 705 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2024-03-11T22:09:07.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[28804]: audit 2024-03-11T22:09:06.733318+0000 mon.a (mon.0) 706 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-03-11T22:09:07.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[28804]: audit 2024-03-11T22:09:06.733726+0000 mon.a (mon.0) 707 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-03-11T22:09:07.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[28804]: audit 2024-03-11T22:09:06.734131+0000 mon.a (mon.0) 708 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-03-11T22:09:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[21434]: audit 2024-03-11T22:09:05.849082+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[21434]: audit 2024-03-11T22:09:06.732789+0000 mon.a (mon.0) 705 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2024-03-11T22:09:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[21434]: audit 2024-03-11T22:09:06.733318+0000 mon.a (mon.0) 706 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-03-11T22:09:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[21434]: audit 2024-03-11T22:09:06.733726+0000 mon.a (mon.0) 707 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-03-11T22:09:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:06 smithi049 bash[21434]: audit 2024-03-11T22:09:06.734131+0000 mon.a (mon.0) 708 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-03-11T22:09:07.480 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.480 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.481 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.481 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.481 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.481 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.482 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.737 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.737 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.738 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.738 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.738 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.738 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.738 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.739 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:07.739 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:08.237 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:07 smithi187 systemd[1]: Started Ceph prometheus.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: cluster 2024-03-11T22:09:06.818857+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: audit 2024-03-11T22:09:06.862078+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: audit 2024-03-11T22:09:06.862270+0000 mon.a (mon.0) 710 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: audit 2024-03-11T22:09:06.862509+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: audit 2024-03-11T22:09:06.862707+0000 mon.a (mon.0) 712 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: cluster 2024-03-11T22:09:06.869134+0000 mon.a (mon.0) 713 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: audit 2024-03-11T22:09:07.810646+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: audit 2024-03-11T22:09:07.821364+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:08.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:07 smithi187 bash[23415]: cluster 2024-03-11T22:09:07.870927+0000 mon.a (mon.0) 716 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-03-11T22:09:08.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: cluster 2024-03-11T22:09:06.818857+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:08.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: audit 2024-03-11T22:09:06.862078+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2024-03-11T22:09:08.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: audit 2024-03-11T22:09:06.862270+0000 mon.a (mon.0) 710 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-03-11T22:09:08.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: audit 2024-03-11T22:09:06.862509+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: audit 2024-03-11T22:09:06.862707+0000 mon.a (mon.0) 712 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: cluster 2024-03-11T22:09:06.869134+0000 mon.a (mon.0) 713 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: audit 2024-03-11T22:09:07.810646+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: audit 2024-03-11T22:09:07.821364+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[28804]: cluster 2024-03-11T22:09:07.870927+0000 mon.a (mon.0) 716 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: cluster 2024-03-11T22:09:06.818857+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: audit 2024-03-11T22:09:06.862078+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: audit 2024-03-11T22:09:06.862270+0000 mon.a (mon.0) 710 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: audit 2024-03-11T22:09:06.862509+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]': finished 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: audit 2024-03-11T22:09:06.862707+0000 mon.a (mon.0) 712 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: cluster 2024-03-11T22:09:06.869134+0000 mon.a (mon.0) 713 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: audit 2024-03-11T22:09:07.810646+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:08.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: audit 2024-03-11T22:09:07.821364+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:08.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:07 smithi049 bash[21434]: cluster 2024-03-11T22:09:07.870927+0000 mon.a (mon.0) 716 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-03-11T22:09:09.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:08 smithi187 bash[24316]: ignoring --setuser ceph since I am not root 2024-03-11T22:09:09.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:08 smithi187 bash[24316]: ignoring --setgroup ceph since I am not root 2024-03-11T22:09:09.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[24316]: debug 2024-03-11T22:09:09.108+0000 7ff13e481200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-11T22:09:09.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:08 smithi187 bash[23415]: audit 2024-03-11T22:09:07.882347+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:09.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:08 smithi187 bash[23415]: audit 2024-03-11T22:09:07.893973+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-11T22:09:09.237 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.111Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.111Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.111Z caller=main.go:570 level=info host_details="(Linux 5.15.0-100-generic #110-Ubuntu SMP Wed Feb 7 13:27:48 UTC 2024 x86_64 smithi187 (none))" 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.111Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.111Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.113Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.113Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.115Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.115Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.117Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.117Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.482µs 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.117Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.118Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.118Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=34.643µs wal_replay_duration=245.755µs wbl_replay_duration=140ns total_replay_duration=312.532µs 2024-03-11T22:09:09.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.119Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-11T22:09:09.239 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.119Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-11T22:09:09.239 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.119Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-11T22:09:09.239 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.120Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.49:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.49:8765: connect: connection refused" 2024-03-11T22:09:09.239 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.120Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.49:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.49:8765: connect: connection refused" 2024-03-11T22:09:09.239 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.142Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=23.153144ms db_storage=852ns remote_storage=1.308µs web_handler=357ns query_engine=957ns scrape=300.425µs scrape_sd=84.979µs notify=801ns notify_sd=1.475µs rules=22.523547ms tracing=6.732µs 2024-03-11T22:09:09.239 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.142Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-11T22:09:09.239 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[48807]: ts=2024-03-11T22:09:09.142Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-11T22:09:09.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:08 smithi049 bash[21434]: audit 2024-03-11T22:09:07.882347+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:09.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:08 smithi049 bash[21434]: audit 2024-03-11T22:09:07.893973+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-11T22:09:09.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:08 smithi049 bash[28804]: audit 2024-03-11T22:09:07.882347+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' 2024-03-11T22:09:09.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:08 smithi049 bash[28804]: audit 2024-03-11T22:09:07.893973+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-11T22:09:09.268 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:08 smithi049 bash[21686]: ignoring --setuser ceph since I am not root 2024-03-11T22:09:09.268 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:08 smithi049 bash[21686]: ignoring --setgroup ceph since I am not root 2024-03-11T22:09:09.268 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:09 smithi049 bash[21686]: debug 2024-03-11T22:09:09.108+0000 7f561a8f1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-11T22:09:10.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[23415]: audit 2024-03-11T22:09:08.895957+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-11T22:09:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:09 smithi187 bash[23415]: cluster 2024-03-11T22:09:08.908944+0000 mon.a (mon.0) 720 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-03-11T22:09:10.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:09 smithi049 bash[21434]: audit 2024-03-11T22:09:08.895957+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-11T22:09:10.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:09 smithi049 bash[21434]: cluster 2024-03-11T22:09:08.908944+0000 mon.a (mon.0) 720 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-03-11T22:09:10.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:09 smithi049 bash[28804]: audit 2024-03-11T22:09:08.895957+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 v1:172.21.15.49:0/1018040643' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-11T22:09:10.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:09 smithi049 bash[28804]: cluster 2024-03-11T22:09:08.908944+0000 mon.a (mon.0) 720 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-03-11T22:09:10.987 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:10 smithi187 bash[24316]: debug 2024-03-11T22:09:10.672+0000 7ff13e481200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-11T22:09:10.987 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:10 smithi187 bash[24316]: debug 2024-03-11T22:09:10.768+0000 7ff13e481200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-11T22:09:11.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:10 smithi049 bash[21686]: debug 2024-03-11T22:09:10.740+0000 7f561a8f1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-11T22:09:11.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:10 smithi049 bash[21686]: debug 2024-03-11T22:09:10.844+0000 7f561a8f1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-11T22:09:11.166 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:09:11.487 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:11 smithi187 bash[24316]: debug 2024-03-11T22:09:11.016+0000 7ff13e481200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-11T22:09:11.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:11 smithi049 bash[21686]: debug 2024-03-11T22:09:11.100+0000 7f561a8f1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-11T22:09:12.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:11 smithi187 bash[24316]: debug 2024-03-11T22:09:11.816+0000 7ff13e481200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-11T22:09:12.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:11 smithi187 bash[24316]: debug 2024-03-11T22:09:11.924+0000 7ff13e481200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-11T22:09:12.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:12 smithi187 bash[24316]: debug 2024-03-11T22:09:12.028+0000 7ff13e481200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-11T22:09:12.267 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:11 smithi049 bash[21686]: debug 2024-03-11T22:09:11.924+0000 7f561a8f1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-11T22:09:12.267 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:12 smithi049 bash[21686]: debug 2024-03-11T22:09:12.040+0000 7f561a8f1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-11T22:09:12.267 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:12 smithi049 bash[21686]: debug 2024-03-11T22:09:12.152+0000 7f561a8f1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-11T22:09:12.737 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:12 smithi187 bash[24316]: debug 2024-03-11T22:09:12.392+0000 7ff13e481200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-11T22:09:12.737 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:12 smithi187 bash[24316]: debug 2024-03-11T22:09:12.508+0000 7ff13e481200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-11T22:09:12.737 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:12 smithi187 bash[24316]: debug 2024-03-11T22:09:12.616+0000 7ff13e481200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-11T22:09:12.769 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:12 smithi049 bash[21686]: debug 2024-03-11T22:09:12.520+0000 7f561a8f1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-11T22:09:12.769 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:12 smithi049 bash[21686]: debug 2024-03-11T22:09:12.640+0000 7f561a8f1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-11T22:09:12.769 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:12 smithi049 bash[21686]: debug 2024-03-11T22:09:12.748+0000 7f561a8f1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-11T22:09:13.211 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:12 smithi187 bash[24316]: debug 2024-03-11T22:09:12.976+0000 7ff13e481200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-11T22:09:13.473 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:13 smithi187 bash[24316]: debug 2024-03-11T22:09:13.216+0000 7ff13e481200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-11T22:09:13.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:13 smithi049 bash[21686]: debug 2024-03-11T22:09:13.120+0000 7f561a8f1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-11T22:09:13.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:13 smithi049 bash[21686]: debug 2024-03-11T22:09:13.368+0000 7f561a8f1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-11T22:09:13.736 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:13 smithi187 bash[24316]: debug 2024-03-11T22:09:13.480+0000 7ff13e481200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-11T22:09:13.737 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:13 smithi187 bash[24316]: debug 2024-03-11T22:09:13.592+0000 7ff13e481200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-11T22:09:14.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:13 smithi049 bash[21686]: debug 2024-03-11T22:09:13.640+0000 7f561a8f1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-11T22:09:14.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:13 smithi049 bash[21686]: debug 2024-03-11T22:09:13.756+0000 7f561a8f1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-11T22:09:14.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:13 smithi187 bash[24316]: debug 2024-03-11T22:09:13.864+0000 7ff13e481200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-11T22:09:14.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:14 smithi187 bash[24316]: debug 2024-03-11T22:09:14.108+0000 7ff13e481200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-11T22:09:14.287 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:14 smithi049 bash[21686]: debug 2024-03-11T22:09:14.044+0000 7f561a8f1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-11T22:09:14.483 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/2902287646 >> v1:172.21.15.187:6789/0 conn(0x7f2660104d90 legacy=0x7f26601071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:14.483 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/2902287646 shutdown_connections 2024-03-11T22:09:14.483 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/2902287646 >> 172.21.15.187:0/2902287646 conn(0x7f26600fbf00 msgr2=0x7f26600fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:14.484 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/2902287646 shutdown_connections 2024-03-11T22:09:14.484 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/2902287646 wait complete. 2024-03-11T22:09:14.484 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 Processor -- start 2024-03-11T22:09:14.484 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- start start 2024-03-11T22:09:14.485 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f26601a4080 con 0x7f2660104d90 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f26601a5280 con 0x7f2660108ad0 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f26601a6480 con 0x7f2660100960 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26659a6700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f2660108ad0 0x7f26601a2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:33590/0 (socket says 172.21.15.187:33590) 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26659a6700 1 -- 172.21.15.187:0/1699154937 learned_addr learned my addr 172.21.15.187:0/1699154937 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518905987 0 0) 0x7f26601a5280 con 0x7f2660108ad0 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264c0035b0 con 0x7f2660108ad0 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3066358387 0 0) 0x7f264c0035b0 con 0x7f2660108ad0 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26601a5280 con 0x7f2660108ad0 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2658001c10 con 0x7f2660108ad0 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269587831 0 0) 0x7f26601a6480 con 0x7f2660100960 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264c0035b0 con 0x7f2660100960 2024-03-11T22:09:14.486 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312005859 0 0) 0x7f26601a4080 con 0x7f2660104d90 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26601a6480 con 0x7f2660104d90 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1504494763 0 0) 0x7f26601a5280 con 0x7f2660108ad0 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6790/0 conn(0x7f2660100960 legacy=0x7f2660106c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6789/0 conn(0x7f2660104d90 legacy=0x7f266019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26601a7680 con 0x7f2660108ad0 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26601a4270 con 0x7f2660108ad0 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f26601a4770 con 0x7f2660108ad0 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f2658003e90 con 0x7f2660108ad0 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2658005fb0 con 0x7f2660108ad0 2024-03-11T22:09:14.487 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.492+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2644005150 con 0x7f2660108ad0 2024-03-11T22:09:14.488 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.496+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 17) v1 ==== 91110+0+0 (unknown 3402405770 0 0) 0x7f265801c500 con 0x7f2660108ad0 2024-03-11T22:09:14.488 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.496+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(73..73 src has 1..73) v4 ==== 6030+0+0 (unknown 1763693446 0 0) 0x7f26580886e0 con 0x7f2660108ad0 2024-03-11T22:09:14.488 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.496+0000 7f26651a5700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6800/4076252288 conn(0x7f264c06e520 legacy=0x7f264c0709e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/4076252288 2024-03-11T22:09:14.496 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.504+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2658051dc0 con 0x7f2660108ad0 2024-03-11T22:09:14.651 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:14 smithi187 bash[24316]: debug 2024-03-11T22:09:14.540+0000 7ff13e481200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-11T22:09:14.691 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.700+0000 7f26651a5700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6800/4076252288 conn(0x7f264c06e520 legacy=0x7f264c0709e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/4076252288 2024-03-11T22:09:14.709 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:14.716+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.49:6800/4076252288 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi049=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f2644000bc0 con 0x7f264c06e520 2024-03-11T22:09:14.711 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:14 smithi049 bash[21686]: debug 2024-03-11T22:09:14.296+0000 7f561a8f1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-11T22:09:14.986 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:14 smithi187 bash[24316]: debug 2024-03-11T22:09:14.660+0000 7ff13e481200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-11T22:09:14.987 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:14 smithi187 bash[24316]: debug 2024-03-11T22:09:14.904+0000 7ff13e481200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-11T22:09:15.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:14 smithi049 bash[21686]: debug 2024-03-11T22:09:14.720+0000 7f561a8f1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-11T22:09:15.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:14 smithi049 bash[21686]: debug 2024-03-11T22:09:14.848+0000 7f561a8f1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-11T22:09:15.095 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:15.104+0000 7f26651a5700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6800/4076252288 conn(0x7f264c06e520 legacy=0x7f264c0709e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/4076252288 2024-03-11T22:09:15.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:15 smithi049 bash[21686]: debug 2024-03-11T22:09:15.104+0000 7f561a8f1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-11T22:09:15.899 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:15.908+0000 7f26651a5700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6800/4076252288 conn(0x7f264c06e520 legacy=0x7f264c0709e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.49:6800/4076252288 2024-03-11T22:09:16.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:15 smithi187 bash[24316]: debug 2024-03-11T22:09:15.908+0000 7ff13e481200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-11T22:09:16.237 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:16 smithi187 bash[24316]: debug 2024-03-11T22:09:16.024+0000 7ff13e481200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-11T22:09:16.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:16 smithi049 bash[21686]: debug 2024-03-11T22:09:16.148+0000 7f561a8f1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-11T22:09:16.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:16 smithi049 bash[21686]: debug 2024-03-11T22:09:16.268+0000 7f561a8f1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-11T22:09:16.736 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:16 smithi187 bash[24316]: debug 2024-03-11T22:09:16.316+0000 7ff13e481200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-11T22:09:16.737 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:16 smithi187 bash[24316]: debug 2024-03-11T22:09:16.432+0000 7ff13e481200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-11T22:09:17.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:16 smithi049 bash[21686]: debug 2024-03-11T22:09:16.580+0000 7f561a8f1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-11T22:09:17.017 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:16 smithi049 bash[21686]: debug 2024-03-11T22:09:16.700+0000 7f561a8f1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-11T22:09:17.072 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:17.080+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 10 ==== mgrmap(e 18) v1 ==== 91110+0+0 (unknown 1078888062 0 0) 0x7f2658051a40 con 0x7f2660108ad0 2024-03-11T22:09:17.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[23415]: audit 2024-03-11T22:09:17.025900+0000 mon.b (mon.1) 28 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-11T22:09:17.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[23415]: audit 2024-03-11T22:09:17.026732+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-11T22:09:17.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.027640+0000 mon.a (mon.0) 721 : cluster 0 Standby manager daemon x restarted 2024-03-11T22:09:17.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.027835+0000 mon.a (mon.0) 722 : cluster 0 Standby manager daemon x started 2024-03-11T22:09:17.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[23415]: audit 2024-03-11T22:09:17.029203+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-11T22:09:17.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[23415]: audit 2024-03-11T22:09:17.029595+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-11T22:09:17.238 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:16 smithi187 bash[24316]: debug 2024-03-11T22:09:16.880+0000 7ff13e481200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-11T22:09:17.238 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[24316]: debug 2024-03-11T22:09:17.000+0000 7ff13e481200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-11T22:09:17.238 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[24316]: [11/Mar/2024:22:09:17] ENGINE Bus STARTING 2024-03-11T22:09:17.238 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[24316]: CherryPy Checker: 2024-03-11T22:09:17.238 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[24316]: The Application mounted at '' has an empty config. 2024-03-11T22:09:17.238 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[24316]: [11/Mar/2024:22:09:17] ENGINE Serving on http://:::9283 2024-03-11T22:09:17.238 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:17 smithi187 bash[24316]: [11/Mar/2024:22:09:17] ENGINE Bus STARTED 2024-03-11T22:09:17.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:17.344+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 11 ==== mgrmap(e 19) v1 ==== 90762+0+0 (unknown 3399877678 0 0) 0x7f2658053a70 con 0x7f2660108ad0 2024-03-11T22:09:17.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:17.344+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6800/4076252288 conn(0x7f264c06e520 legacy=0x7f264c0709e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-11T22:09:17.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21434]: audit 2024-03-11T22:09:17.025900+0000 mon.b (mon.1) 28 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-11T22:09:17.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21434]: audit 2024-03-11T22:09:17.026732+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-11T22:09:17.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.027640+0000 mon.a (mon.0) 721 : cluster 0 Standby manager daemon x restarted 2024-03-11T22:09:17.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.027835+0000 mon.a (mon.0) 722 : cluster 0 Standby manager daemon x started 2024-03-11T22:09:17.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21434]: audit 2024-03-11T22:09:17.029203+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-11T22:09:17.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21434]: audit 2024-03-11T22:09:17.029595+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21686]: debug 2024-03-11T22:09:17.176+0000 7f561a8f1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21686]: debug 2024-03-11T22:09:17.304+0000 7f561a8f1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21686]: [11/Mar/2024:22:09:17] ENGINE Bus STARTING 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[28804]: audit 2024-03-11T22:09:17.025900+0000 mon.b (mon.1) 28 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[28804]: audit 2024-03-11T22:09:17.026732+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.027640+0000 mon.a (mon.0) 721 : cluster 0 Standby manager daemon x restarted 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.027835+0000 mon.a (mon.0) 722 : cluster 0 Standby manager daemon x started 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[28804]: audit 2024-03-11T22:09:17.029203+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-11T22:09:17.436 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[28804]: audit 2024-03-11T22:09:17.029595+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? v1:172.21.15.187:0/3325888744' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-11T22:09:17.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21686]: CherryPy Checker: 2024-03-11T22:09:17.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21686]: The Application mounted at '' has an empty config. 2024-03-11T22:09:17.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21686]: [11/Mar/2024:22:09:17] ENGINE Serving on http://:::9283 2024-03-11T22:09:17.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:17 smithi049 bash[21686]: [11/Mar/2024:22:09:17] ENGINE Bus STARTED 2024-03-11T22:09:18.339 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.344+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mon.1 v1:172.21.15.187:6789/0 12 ==== mgrmap(e 20) v1 ==== 90854+0+0 (unknown 176734085 0 0) 0x7f2658003a00 con 0x7f2660108ad0 2024-03-11T22:09:18.339 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.344+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 --> v1:172.21.15.49:6800/915645872 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi049=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f2644000bc0 con 0x7f264c078750 2024-03-11T22:09:18.340 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.092137+0000 mon.a (mon.0) 723 : cluster 0 mgrmap e18: y(active, since 10m), standbys: x 2024-03-11T22:09:18.340 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.326608+0000 mon.a (mon.0) 724 : cluster 1 Active manager daemon y restarted 2024-03-11T22:09:18.341 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.327801+0000 mon.a (mon.0) 725 : cluster 1 Activating manager daemon y 2024-03-11T22:09:18.341 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.345395+0000 mon.a (mon.0) 726 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-03-11T22:09:18.341 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.345936+0000 mon.a (mon.0) 727 : cluster 0 mgrmap e19: y(active, starting, since 0.0185463s), standbys: x 2024-03-11T22:09:18.341 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.347405+0000 mon.c (mon.2) 19 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:09:18.341 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.347642+0000 mon.c (mon.2) 20 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:09:18.341 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.347827+0000 mon.c (mon.2) 21 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:09:18.341 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.350392+0000 mon.c (mon.2) 22 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.350561+0000 mon.c (mon.2) 23 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.351240+0000 mon.c (mon.2) 24 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.351539+0000 mon.c (mon.2) 25 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.351737+0000 mon.c (mon.2) 26 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.352033+0000 mon.c (mon.2) 27 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.352318+0000 mon.c (mon.2) 28 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.352596+0000 mon.c (mon.2) 29 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:09:18.342 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.352881+0000 mon.c (mon.2) 30 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.353162+0000 mon.c (mon.2) 31 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.353762+0000 mon.c (mon.2) 32 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.354081+0000 mon.c (mon.2) 33 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.354815+0000 mon.c (mon.2) 34 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: cluster 2024-03-11T22:09:17.379812+0000 mon.a (mon.0) 728 : cluster 1 Manager daemon y is now available 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.420340+0000 mon.c (mon.2) 35 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.423291+0000 mon.c (mon.2) 36 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.436707+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.447694+0000 mon.c (mon.2) 37 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.457578+0000 mon.c (mon.2) 38 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.457941+0000 mon.a (mon.0) 730 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.481556+0000 mon.c (mon.2) 39 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: audit 2024-03-11T22:09:17.482013+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T22:09:18.343 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[23415]: cephadm 2024-03-11T22:09:17.900684+0000 mgr.y (mgr.14601) 1 : cephadm 1 [11/Mar/2024:22:09:17] ENGINE Bus STARTING 2024-03-11T22:09:18.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.360+0000 7f26567fc700 1 -- 172.21.15.187:0/1699154937 <== mgr.14601 v1:172.21.15.49:6800/915645872 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (unknown 0 0 1850065467) 0x7f2644000bc0 con 0x7f264c078750 2024-03-11T22:09:18.353 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled alertmanager update... 2024-03-11T22:09:18.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.364+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.49:6800/915645872 conn(0x7f264c078750 legacy=0x7f264c07ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:18.356 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.364+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 >> v1:172.21.15.187:6789/0 conn(0x7f2660108ad0 legacy=0x7f26601a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:18.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.364+0000 7f26659a6700 1 -- 172.21.15.187:0/1699154937 reap_dead start 2024-03-11T22:09:18.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.364+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 shutdown_connections 2024-03-11T22:09:18.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.364+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 >> 172.21.15.187:0/1699154937 conn(0x7f26600fbf00 msgr2=0x7f2660069d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:18.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.364+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 shutdown_connections 2024-03-11T22:09:18.357 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:18.364+0000 7f2667409700 1 -- 172.21.15.187:0/1699154937 wait complete. 2024-03-11T22:09:18.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.092137+0000 mon.a (mon.0) 723 : cluster 0 mgrmap e18: y(active, since 10m), standbys: x 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.326608+0000 mon.a (mon.0) 724 : cluster 1 Active manager daemon y restarted 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.327801+0000 mon.a (mon.0) 725 : cluster 1 Activating manager daemon y 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.345395+0000 mon.a (mon.0) 726 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.345936+0000 mon.a (mon.0) 727 : cluster 0 mgrmap e19: y(active, starting, since 0.0185463s), standbys: x 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.347405+0000 mon.c (mon.2) 19 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.347642+0000 mon.c (mon.2) 20 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.347827+0000 mon.c (mon.2) 21 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.350392+0000 mon.c (mon.2) 22 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.350561+0000 mon.c (mon.2) 23 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.351240+0000 mon.c (mon.2) 24 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.351539+0000 mon.c (mon.2) 25 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.351737+0000 mon.c (mon.2) 26 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:09:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.352033+0000 mon.c (mon.2) 27 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.352318+0000 mon.c (mon.2) 28 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.352596+0000 mon.c (mon.2) 29 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.352881+0000 mon.c (mon.2) 30 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.353162+0000 mon.c (mon.2) 31 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.353762+0000 mon.c (mon.2) 32 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.354081+0000 mon.c (mon.2) 33 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.354815+0000 mon.c (mon.2) 34 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: cluster 2024-03-11T22:09:17.379812+0000 mon.a (mon.0) 728 : cluster 1 Manager daemon y is now available 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.420340+0000 mon.c (mon.2) 35 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.423291+0000 mon.c (mon.2) 36 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.436707+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.447694+0000 mon.c (mon.2) 37 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.457578+0000 mon.c (mon.2) 38 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.457941+0000 mon.a (mon.0) 730 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.481556+0000 mon.c (mon.2) 39 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T22:09:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: audit 2024-03-11T22:09:17.482013+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[21434]: cephadm 2024-03-11T22:09:17.900684+0000 mgr.y (mgr.14601) 1 : cephadm 1 [11/Mar/2024:22:09:17] ENGINE Bus STARTING 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.092137+0000 mon.a (mon.0) 723 : cluster 0 mgrmap e18: y(active, since 10m), standbys: x 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.326608+0000 mon.a (mon.0) 724 : cluster 1 Active manager daemon y restarted 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.327801+0000 mon.a (mon.0) 725 : cluster 1 Activating manager daemon y 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.345395+0000 mon.a (mon.0) 726 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.345936+0000 mon.a (mon.0) 727 : cluster 0 mgrmap e19: y(active, starting, since 0.0185463s), standbys: x 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.347405+0000 mon.c (mon.2) 19 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.347642+0000 mon.c (mon.2) 20 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.347827+0000 mon.c (mon.2) 21 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.350392+0000 mon.c (mon.2) 22 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.350561+0000 mon.c (mon.2) 23 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-11T22:09:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.351240+0000 mon.c (mon.2) 24 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.351539+0000 mon.c (mon.2) 25 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.351737+0000 mon.c (mon.2) 26 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.352033+0000 mon.c (mon.2) 27 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.352318+0000 mon.c (mon.2) 28 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.352596+0000 mon.c (mon.2) 29 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.352881+0000 mon.c (mon.2) 30 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.353162+0000 mon.c (mon.2) 31 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.353762+0000 mon.c (mon.2) 32 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.354081+0000 mon.c (mon.2) 33 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.354815+0000 mon.c (mon.2) 34 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: cluster 2024-03-11T22:09:17.379812+0000 mon.a (mon.0) 728 : cluster 1 Manager daemon y is now available 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.420340+0000 mon.c (mon.2) 35 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.423291+0000 mon.c (mon.2) 36 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.436707+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.447694+0000 mon.c (mon.2) 37 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.457578+0000 mon.c (mon.2) 38 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T22:09:18.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.457941+0000 mon.a (mon.0) 730 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-11T22:09:18.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.481556+0000 mon.c (mon.2) 39 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T22:09:18.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: audit 2024-03-11T22:09:17.482013+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-11T22:09:18.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:18 smithi049 bash[28804]: cephadm 2024-03-11T22:09:17.900684+0000 mgr.y (mgr.14601) 1 : cephadm 1 [11/Mar/2024:22:09:17] ENGINE Bus STARTING 2024-03-11T22:09:18.678 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:09:19.296 DEBUG:teuthology.orchestra.run.smithi049:alertmanager.a> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@alertmanager.a.service 2024-03-11T22:09:19.299 INFO:tasks.cephadm:Adding grafana.a on smithi187 2024-03-11T22:09:19.299 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph orch apply grafana '1;smithi187=a' 2024-03-11T22:09:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: cephadm 2024-03-11T22:09:18.018375+0000 mgr.y (mgr.14601) 2 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Serving on https://172.21.15.49:7150 2024-03-11T22:09:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: cephadm 2024-03-11T22:09:18.120137+0000 mgr.y (mgr.14601) 3 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Serving on http://172.21.15.49:8765 2024-03-11T22:09:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: cephadm 2024-03-11T22:09:18.120386+0000 mgr.y (mgr.14601) 4 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Bus STARTED 2024-03-11T22:09:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: audit 2024-03-11T22:09:18.331334+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: cluster 2024-03-11T22:09:18.346210+0000 mon.a (mon.0) 733 : cluster 0 mgrmap e20: y(active, since 1.01881s), standbys: x 2024-03-11T22:09:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: audit 2024-03-11T22:09:18.351240+0000 mgr.y (mgr.14601) 5 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: audit 2024-03-11T22:09:18.354203+0000 mgr.y (mgr.14601) 6 : audit 0 from='client.24523 v1:172.21.15.187:0/1699154937' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi049=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:19.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: cluster 2024-03-11T22:09:18.356216+0000 mgr.y (mgr.14601) 7 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:19.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: cephadm 2024-03-11T22:09:18.358888+0000 mgr.y (mgr.14601) 8 : cephadm 1 Saving service alertmanager spec with placement smithi049=a;count:1 2024-03-11T22:09:19.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: audit 2024-03-11T22:09:18.359094+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:19 smithi187 bash[23415]: audit 2024-03-11T22:09:18.364683+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: cephadm 2024-03-11T22:09:18.018375+0000 mgr.y (mgr.14601) 2 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Serving on https://172.21.15.49:7150 2024-03-11T22:09:19.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: cephadm 2024-03-11T22:09:18.120137+0000 mgr.y (mgr.14601) 3 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Serving on http://172.21.15.49:8765 2024-03-11T22:09:19.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: cephadm 2024-03-11T22:09:18.120386+0000 mgr.y (mgr.14601) 4 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Bus STARTED 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: audit 2024-03-11T22:09:18.331334+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: cluster 2024-03-11T22:09:18.346210+0000 mon.a (mon.0) 733 : cluster 0 mgrmap e20: y(active, since 1.01881s), standbys: x 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: audit 2024-03-11T22:09:18.351240+0000 mgr.y (mgr.14601) 5 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: audit 2024-03-11T22:09:18.354203+0000 mgr.y (mgr.14601) 6 : audit 0 from='client.24523 v1:172.21.15.187:0/1699154937' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi049=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: cluster 2024-03-11T22:09:18.356216+0000 mgr.y (mgr.14601) 7 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: cephadm 2024-03-11T22:09:18.358888+0000 mgr.y (mgr.14601) 8 : cephadm 1 Saving service alertmanager spec with placement smithi049=a;count:1 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: audit 2024-03-11T22:09:18.359094+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[21434]: audit 2024-03-11T22:09:18.364683+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: cephadm 2024-03-11T22:09:18.018375+0000 mgr.y (mgr.14601) 2 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Serving on https://172.21.15.49:7150 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: cephadm 2024-03-11T22:09:18.120137+0000 mgr.y (mgr.14601) 3 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Serving on http://172.21.15.49:8765 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: cephadm 2024-03-11T22:09:18.120386+0000 mgr.y (mgr.14601) 4 : cephadm 1 [11/Mar/2024:22:09:18] ENGINE Bus STARTED 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: audit 2024-03-11T22:09:18.331334+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: cluster 2024-03-11T22:09:18.346210+0000 mon.a (mon.0) 733 : cluster 0 mgrmap e20: y(active, since 1.01881s), standbys: x 2024-03-11T22:09:19.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: audit 2024-03-11T22:09:18.351240+0000 mgr.y (mgr.14601) 5 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: audit 2024-03-11T22:09:18.354203+0000 mgr.y (mgr.14601) 6 : audit 0 from='client.24523 v1:172.21.15.187:0/1699154937' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi049=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: cluster 2024-03-11T22:09:18.356216+0000 mgr.y (mgr.14601) 7 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: cephadm 2024-03-11T22:09:18.358888+0000 mgr.y (mgr.14601) 8 : cephadm 1 Saving service alertmanager spec with placement smithi049=a;count:1 2024-03-11T22:09:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: audit 2024-03-11T22:09:18.359094+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:19.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:19 smithi049 bash[28804]: audit 2024-03-11T22:09:18.364683+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:20 smithi187 bash[23415]: cluster 2024-03-11T22:09:19.353945+0000 mgr.y (mgr.14601) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:20.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:20 smithi187 bash[23415]: cluster 2024-03-11T22:09:20.347451+0000 mon.a (mon.0) 736 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-03-11T22:09:20.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:20 smithi049 bash[21434]: cluster 2024-03-11T22:09:19.353945+0000 mgr.y (mgr.14601) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:20.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:20 smithi049 bash[21434]: cluster 2024-03-11T22:09:20.347451+0000 mon.a (mon.0) 736 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-03-11T22:09:20.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:20 smithi049 bash[28804]: cluster 2024-03-11T22:09:19.353945+0000 mgr.y (mgr.14601) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:20.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:20 smithi049 bash[28804]: cluster 2024-03-11T22:09:20.347451+0000 mon.a (mon.0) 736 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-03-11T22:09:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:22 smithi187 bash[23415]: cluster 2024-03-11T22:09:21.354471+0000 mgr.y (mgr.14601) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:22.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:22 smithi049 bash[21434]: cluster 2024-03-11T22:09:21.354471+0000 mgr.y (mgr.14601) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:22.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:22 smithi049 bash[28804]: cluster 2024-03-11T22:09:21.354471+0000 mgr.y (mgr.14601) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:09:23.736 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:23 smithi187 bash[23415]: cluster 2024-03-11T22:09:22.381676+0000 mon.a (mon.0) 737 : cluster 0 mgrmap e22: y(active, since 5s), standbys: x 2024-03-11T22:09:23.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:23 smithi049 bash[21434]: cluster 2024-03-11T22:09:22.381676+0000 mon.a (mon.0) 737 : cluster 0 mgrmap e22: y(active, since 5s), standbys: x 2024-03-11T22:09:23.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:23 smithi049 bash[28804]: cluster 2024-03-11T22:09:22.381676+0000 mon.a (mon.0) 737 : cluster 0 mgrmap e22: y(active, since 5s), standbys: x 2024-03-11T22:09:23.838 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:09:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:24 smithi187 bash[23415]: cluster 2024-03-11T22:09:23.355413+0000 mgr.y (mgr.14601) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-03-11T22:09:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:24 smithi187 bash[23415]: audit 2024-03-11T22:09:23.488233+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:24 smithi187 bash[23415]: audit 2024-03-11T22:09:23.494310+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:24 smithi187 bash[23415]: audit 2024-03-11T22:09:23.797262+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:24 smithi187 bash[23415]: audit 2024-03-11T22:09:23.808372+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[21434]: cluster 2024-03-11T22:09:23.355413+0000 mgr.y (mgr.14601) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[21434]: audit 2024-03-11T22:09:23.488233+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[21434]: audit 2024-03-11T22:09:23.494310+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[21434]: audit 2024-03-11T22:09:23.797262+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[21434]: audit 2024-03-11T22:09:23.808372+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[28804]: cluster 2024-03-11T22:09:23.355413+0000 mgr.y (mgr.14601) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[28804]: audit 2024-03-11T22:09:23.488233+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[28804]: audit 2024-03-11T22:09:23.494310+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[28804]: audit 2024-03-11T22:09:23.797262+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:24.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:24 smithi049 bash[28804]: audit 2024-03-11T22:09:23.808372+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:25.915 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.562753+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:25.915 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.576418+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:25.915 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.580822+0000 mon.c (mon.2) 40 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.581373+0000 mon.a (mon.0) 744 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.583087+0000 mon.c (mon.2) 41 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.583533+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.585145+0000 mon.c (mon.2) 42 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.585572+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.587175+0000 mon.c (mon.2) 43 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.587724+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: cephadm 2024-03-11T22:09:24.589157+0000 mgr.y (mgr.14601) 12 : cephadm 1 Adjusting osd_memory_target on smithi187 to 3804M 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.595992+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.936047+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.948277+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.952284+0000 mon.c (mon.2) 44 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.952760+0000 mon.a (mon.0) 751 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.954047+0000 mon.c (mon.2) 45 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.954488+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.955744+0000 mon.c (mon.2) 46 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.956231+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.957513+0000 mon.c (mon.2) 47 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.957997+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: cephadm 2024-03-11T22:09:24.959231+0000 mgr.y (mgr.14601) 13 : cephadm 1 Adjusting osd_memory_target on smithi049 to 3804M 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.965977+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.971511+0000 mon.c (mon.2) 48 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:09:25.917 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:25 smithi187 bash[23415]: audit 2024-03-11T22:09:24.972806+0000 mon.c (mon.2) 49 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.562753+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.576418+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.580822+0000 mon.c (mon.2) 40 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.581373+0000 mon.a (mon.0) 744 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.583087+0000 mon.c (mon.2) 41 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.583533+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.585145+0000 mon.c (mon.2) 42 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.585572+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.587175+0000 mon.c (mon.2) 43 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.587724+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: cephadm 2024-03-11T22:09:24.589157+0000 mgr.y (mgr.14601) 12 : cephadm 1 Adjusting osd_memory_target on smithi187 to 3804M 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.595992+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.936047+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.948277+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.952284+0000 mon.c (mon.2) 44 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.952760+0000 mon.a (mon.0) 751 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.954047+0000 mon.c (mon.2) 45 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.954488+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.955744+0000 mon.c (mon.2) 46 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.562753+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.576418+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.580822+0000 mon.c (mon.2) 40 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.581373+0000 mon.a (mon.0) 744 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.583087+0000 mon.c (mon.2) 41 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.583533+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.585145+0000 mon.c (mon.2) 42 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.585572+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.587175+0000 mon.c (mon.2) 43 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.587724+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: cephadm 2024-03-11T22:09:24.589157+0000 mgr.y (mgr.14601) 12 : cephadm 1 Adjusting osd_memory_target on smithi187 to 3804M 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.595992+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.936047+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.948277+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.952284+0000 mon.c (mon.2) 44 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.952760+0000 mon.a (mon.0) 751 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.954047+0000 mon.c (mon.2) 45 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.954488+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.955744+0000 mon.c (mon.2) 46 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.956231+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.957513+0000 mon.c (mon.2) 47 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.957997+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: cephadm 2024-03-11T22:09:24.959231+0000 mgr.y (mgr.14601) 13 : cephadm 1 Adjusting osd_memory_target on smithi049 to 3804M 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.965977+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.971511+0000 mon.c (mon.2) 48 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[21434]: audit 2024-03-11T22:09:24.972806+0000 mon.c (mon.2) 49 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:09:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.956231+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.957513+0000 mon.c (mon.2) 47 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.957997+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:09:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: cephadm 2024-03-11T22:09:24.959231+0000 mgr.y (mgr.14601) 13 : cephadm 1 Adjusting osd_memory_target on smithi049 to 3804M 2024-03-11T22:09:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.965977+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.971511+0000 mon.c (mon.2) 48 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:09:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:25 smithi049 bash[28804]: audit 2024-03-11T22:09:24.972806+0000 mon.c (mon.2) 49 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:09:26.612 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.613 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.613 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.613 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.614 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.614 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.614 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.615 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.894 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.895 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.895 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.895 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: Started Ceph node-exporter.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:09:26.896 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.896 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.896 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:24.975068+0000 mgr.y (mgr.14601) 14 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:24.975473+0000 mgr.y (mgr.14601) 15 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:25.240751+0000 mgr.y (mgr.14601) 16 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:25.241958+0000 mgr.y (mgr.14601) 17 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cluster 2024-03-11T22:09:25.355899+0000 mgr.y (mgr.14601) 18 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:25.405067+0000 mgr.y (mgr.14601) 19 : cephadm 1 Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:25.519453+0000 mgr.y (mgr.14601) 20 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:25.557365+0000 mgr.y (mgr.14601) 21 : cephadm 1 Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: audit 2024-03-11T22:09:25.692891+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: audit 2024-03-11T22:09:25.703064+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:25.722508+0000 mgr.y (mgr.14601) 22 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: audit 2024-03-11T22:09:25.845997+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: audit 2024-03-11T22:09:25.860376+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: audit 2024-03-11T22:09:25.871104+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[21434]: cephadm 2024-03-11T22:09:25.879581+0000 mgr.y (mgr.14601) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi049 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:24.975068+0000 mgr.y (mgr.14601) 14 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:24.975473+0000 mgr.y (mgr.14601) 15 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:25.240751+0000 mgr.y (mgr.14601) 16 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:25.241958+0000 mgr.y (mgr.14601) 17 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cluster 2024-03-11T22:09:25.355899+0000 mgr.y (mgr.14601) 18 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:25.405067+0000 mgr.y (mgr.14601) 19 : cephadm 1 Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:25.519453+0000 mgr.y (mgr.14601) 20 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:09:26.898 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:25.557365+0000 mgr.y (mgr.14601) 21 : cephadm 1 Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: audit 2024-03-11T22:09:25.692891+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: audit 2024-03-11T22:09:25.703064+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:25.722508+0000 mgr.y (mgr.14601) 22 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: audit 2024-03-11T22:09:25.845997+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: audit 2024-03-11T22:09:25.860376+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: audit 2024-03-11T22:09:25.871104+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[28804]: cephadm 2024-03-11T22:09:25.879581+0000 mgr.y (mgr.14601) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi049 2024-03-11T22:09:26.899 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:26 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:26.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:24.975068+0000 mgr.y (mgr.14601) 14 : cephadm 1 Updating smithi049:/etc/ceph/ceph.conf 2024-03-11T22:09:26.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:24.975473+0000 mgr.y (mgr.14601) 15 : cephadm 1 Updating smithi187:/etc/ceph/ceph.conf 2024-03-11T22:09:26.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:25.240751+0000 mgr.y (mgr.14601) 16 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:09:26.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:25.241958+0000 mgr.y (mgr.14601) 17 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-11T22:09:26.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cluster 2024-03-11T22:09:25.355899+0000 mgr.y (mgr.14601) 18 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:25.405067+0000 mgr.y (mgr.14601) 19 : cephadm 1 Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:25.519453+0000 mgr.y (mgr.14601) 20 : cephadm 1 Updating smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:25.557365+0000 mgr.y (mgr.14601) 21 : cephadm 1 Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: audit 2024-03-11T22:09:25.692891+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: audit 2024-03-11T22:09:25.703064+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:25.722508+0000 mgr.y (mgr.14601) 22 : cephadm 1 Updating smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: audit 2024-03-11T22:09:25.845997+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: audit 2024-03-11T22:09:25.860376+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: audit 2024-03-11T22:09:25.871104+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:26.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:26 smithi187 bash[23415]: cephadm 2024-03-11T22:09:25.879581+0000 mgr.y (mgr.14601) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi049 2024-03-11T22:09:27.179 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- 172.21.15.187:0/3028788502 >> v1:172.21.15.187:6789/0 conn(0x7fe004107a20 legacy=0x7fe004107e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:27.180 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- 172.21.15.187:0/3028788502 shutdown_connections 2024-03-11T22:09:27.180 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- 172.21.15.187:0/3028788502 >> 172.21.15.187:0/3028788502 conn(0x7fe0040fd550 msgr2=0x7fe0040ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:27.180 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- 172.21.15.187:0/3028788502 shutdown_connections 2024-03-11T22:09:27.180 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- 172.21.15.187:0/3028788502 wait complete. 2024-03-11T22:09:27.181 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 Processor -- start 2024-03-11T22:09:27.181 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- start start 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe0041a6a00 con 0x7fe00410e4a0 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe0041a7be0 con 0x7fe004107a20 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe0041a8de0 con 0x7fe00410a8d0 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe002ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe004107a20 0x7fe00410dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:49338/0 (socket says 172.21.15.187:49338) 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe002ffd700 1 -- 172.21.15.187:0/3441693651 learned_addr learned my addr 172.21.15.187:0/3441693651 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223642718 0 0) 0x7fe0041a7be0 con 0x7fe004107a20 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff00035b0 con 0x7fe004107a20 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3354972557 0 0) 0x7fdff00035b0 con 0x7fe004107a20 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe0041a7be0 con 0x7fe004107a20 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fdff40015d0 con 0x7fe004107a20 2024-03-11T22:09:27.182 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480224100 0 0) 0x7fe0041a8de0 con 0x7fe00410a8d0 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff00035b0 con 0x7fe00410a8d0 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762487605 0 0) 0x7fe0041a6a00 con 0x7fe00410e4a0 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0041a8de0 con 0x7fe00410e4a0 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 82180000 0 0) 0x7fe0041a7be0 con 0x7fe004107a20 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 >> v1:172.21.15.49:6790/0 conn(0x7fe00410a8d0 legacy=0x7fe0041a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 >> v1:172.21.15.49:6789/0 conn(0x7fe00410e4a0 legacy=0x7fe0041a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0041a9fe0 con 0x7fe004107a20 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0041a8fd0 con 0x7fe004107a20 2024-03-11T22:09:27.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0041a9450 con 0x7fe004107a20 2024-03-11T22:09:27.184 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fdff4001160 con 0x7fe004107a20 2024-03-11T22:09:27.184 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.187+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fdff4004f70 con 0x7fe004107a20 2024-03-11T22:09:27.184 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.191+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe4005120 con 0x7fe004107a20 2024-03-11T22:09:27.184 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.191+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fdff4005190 con 0x7fe004107a20 2024-03-11T22:09:27.184 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.191+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fdff40887a0 con 0x7fe004107a20 2024-03-11T22:09:27.189 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.195+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fdff4055cd0 con 0x7fe004107a20 2024-03-11T22:09:27.267 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:26 smithi049 bash[57549]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-03-11T22:09:27.409 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.415+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 --> v1:172.21.15.49:6800/915645872 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfe4000b90 con 0x7fdff006e550 2024-03-11T22:09:27.426 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.431+0000 7fe0089f7700 1 -- 172.21.15.187:0/3441693651 <== mgr.14601 v1:172.21.15.49:6800/915645872 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (unknown 0 0 664801700) 0x7fdfe4000b90 con 0x7fdff006e550 2024-03-11T22:09:27.426 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled grafana update... 2024-03-11T22:09:27.428 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.435+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 >> v1:172.21.15.49:6800/915645872 conn(0x7fdff006e550 legacy=0x7fdff0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:27.428 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.435+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 >> v1:172.21.15.187:6789/0 conn(0x7fe004107a20 legacy=0x7fe00410dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:27.428 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.435+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 shutdown_connections 2024-03-11T22:09:27.428 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.435+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 >> 172.21.15.187:0/3441693651 conn(0x7fe0040fd550 msgr2=0x7fe004101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:27.428 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.435+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 shutdown_connections 2024-03-11T22:09:27.429 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:27.435+0000 7fe0099f9700 1 -- 172.21.15.187:0/3441693651 wait complete. 2024-03-11T22:09:27.832 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[57549]: v1.5.0: Pulling from prometheus/node-exporter 2024-03-11T22:09:27.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:27.875 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:27.875 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:27.876 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:27.876 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:27.876 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:27.877 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:27.877 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.129 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[28804]: audit 2024-03-11T22:09:26.918843+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.129 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[28804]: audit 2024-03-11T22:09:26.925731+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.129 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[28804]: audit 2024-03-11T22:09:26.950153+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.130 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[28804]: cephadm 2024-03-11T22:09:26.951563+0000 mgr.y (mgr.14601) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi187 2024-03-11T22:09:28.130 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[28804]: audit 2024-03-11T22:09:27.437430+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.130 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[57549]: 22b70bddd3ac: Pulling fs layer 2024-03-11T22:09:28.130 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[57549]: 5c12815fee55: Pulling fs layer 2024-03-11T22:09:28.130 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[57549]: c0e87333d380: Pulling fs layer 2024-03-11T22:09:28.130 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[21434]: audit 2024-03-11T22:09:26.918843+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.131 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[21434]: audit 2024-03-11T22:09:26.925731+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.131 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[21434]: audit 2024-03-11T22:09:26.950153+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.131 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[21434]: cephadm 2024-03-11T22:09:26.951563+0000 mgr.y (mgr.14601) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi187 2024-03-11T22:09:28.131 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:27 smithi049 bash[21434]: audit 2024-03-11T22:09:27.437430+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.237 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.237 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.237 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.238 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.238 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.238 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:27 smithi187 bash[23415]: audit 2024-03-11T22:09:26.918843+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:27 smithi187 bash[23415]: audit 2024-03-11T22:09:26.925731+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:27 smithi187 bash[23415]: audit 2024-03-11T22:09:26.950153+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:27 smithi187 bash[23415]: cephadm 2024-03-11T22:09:26.951563+0000 mgr.y (mgr.14601) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi187 2024-03-11T22:09:28.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:27 smithi187 bash[23415]: audit 2024-03-11T22:09:27.437430+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:28.239 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:09:27 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:28.239 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:28 smithi187 systemd[1]: Started Ceph node-exporter.b for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:09:28.239 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[49818]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-03-11T22:09:28.305 DEBUG:teuthology.orchestra.run.smithi187:grafana.a> sudo journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@grafana.a.service 2024-03-11T22:09:28.308 INFO:tasks.cephadm:Setting up client nodes... 2024-03-11T22:09:28.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-11T22:09:28.516 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: 5c12815fee55: Verifying Checksum 2024-03-11T22:09:28.517 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: 5c12815fee55: Download complete 2024-03-11T22:09:28.517 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: 22b70bddd3ac: Verifying Checksum 2024-03-11T22:09:28.517 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: 22b70bddd3ac: Download complete 2024-03-11T22:09:28.517 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: 22b70bddd3ac: Pull complete 2024-03-11T22:09:28.517 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: c0e87333d380: Verifying Checksum 2024-03-11T22:09:28.517 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: c0e87333d380: Download complete 2024-03-11T22:09:28.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:09:28.938 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[57549]: 5c12815fee55: Pull complete 2024-03-11T22:09:28.939 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:28 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:29.237 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[49818]: v1.5.0: Pulling from prometheus/node-exporter 2024-03-11T22:09:29.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: cluster 2024-03-11T22:09:27.356582+0000 mgr.y (mgr.14601) 25 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-11T22:09:29.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: audit 2024-03-11T22:09:27.425405+0000 mgr.y (mgr.14601) 26 : audit 0 from='client.24547 v1:172.21.15.187:0/3441693651' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:29.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: cephadm 2024-03-11T22:09:27.429767+0000 mgr.y (mgr.14601) 27 : cephadm 1 Saving service grafana spec with placement smithi187=a;count:1 2024-03-11T22:09:29.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: audit 2024-03-11T22:09:28.052766+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: audit 2024-03-11T22:09:28.068241+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: audit 2024-03-11T22:09:28.127099+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: audit 2024-03-11T22:09:28.136974+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:28 smithi187 bash[23415]: audit 2024-03-11T22:09:28.156444+0000 mon.a (mon.0) 769 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.267 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:29 smithi049 bash[57549]: c0e87333d380: Pull complete 2024-03-11T22:09:29.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: cluster 2024-03-11T22:09:27.356582+0000 mgr.y (mgr.14601) 25 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-11T22:09:29.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: audit 2024-03-11T22:09:27.425405+0000 mgr.y (mgr.14601) 26 : audit 0 from='client.24547 v1:172.21.15.187:0/3441693651' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:29.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: cephadm 2024-03-11T22:09:27.429767+0000 mgr.y (mgr.14601) 27 : cephadm 1 Saving service grafana spec with placement smithi187=a;count:1 2024-03-11T22:09:29.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: audit 2024-03-11T22:09:28.052766+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: audit 2024-03-11T22:09:28.068241+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: audit 2024-03-11T22:09:28.127099+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: audit 2024-03-11T22:09:28.136974+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[28804]: audit 2024-03-11T22:09:28.156444+0000 mon.a (mon.0) 769 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: cluster 2024-03-11T22:09:27.356582+0000 mgr.y (mgr.14601) 25 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: audit 2024-03-11T22:09:27.425405+0000 mgr.y (mgr.14601) 26 : audit 0 from='client.24547 v1:172.21.15.187:0/3441693651' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi187=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: cephadm 2024-03-11T22:09:27.429767+0000 mgr.y (mgr.14601) 27 : cephadm 1 Saving service grafana spec with placement smithi187=a;count:1 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: audit 2024-03-11T22:09:28.052766+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: audit 2024-03-11T22:09:28.068241+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: audit 2024-03-11T22:09:28.127099+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: audit 2024-03-11T22:09:28.136974+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:28 smithi049 bash[21434]: audit 2024-03-11T22:09:28.156444+0000 mon.a (mon.0) 769 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:29.575 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: 22b70bddd3ac: Pulling fs layer 2024-03-11T22:09:29.575 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: 5c12815fee55: Pulling fs layer 2024-03-11T22:09:29.575 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: c0e87333d380: Pulling fs layer 2024-03-11T22:09:29.575 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: 5c12815fee55: Verifying Checksum 2024-03-11T22:09:29.575 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: 5c12815fee55: Download complete 2024-03-11T22:09:29.575 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: c0e87333d380: Verifying Checksum 2024-03-11T22:09:29.575 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: c0e87333d380: Download complete 2024-03-11T22:09:29.646 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:29 smithi049 bash[57549]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-03-11T22:09:29.947 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:29 smithi049 bash[57549]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-03-11T22:09:29.947 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: 22b70bddd3ac: Verifying Checksum 2024-03-11T22:09:29.947 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: 22b70bddd3ac: Download complete 2024-03-11T22:09:29.947 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[49818]: 22b70bddd3ac: Pull complete 2024-03-11T22:09:30.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[23415]: cephadm 2024-03-11T22:09:28.198808+0000 mgr.y (mgr.14601) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi049 2024-03-11T22:09:30.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:29 smithi187 bash[23415]: audit 2024-03-11T22:09:28.353543+0000 mgr.y (mgr.14601) 29 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:30.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:29 smithi049 bash[21434]: cephadm 2024-03-11T22:09:28.198808+0000 mgr.y (mgr.14601) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi049 2024-03-11T22:09:30.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:29 smithi049 bash[21434]: audit 2024-03-11T22:09:28.353543+0000 mgr.y (mgr.14601) 29 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:30.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:29 smithi049 bash[28804]: cephadm 2024-03-11T22:09:28.198808+0000 mgr.y (mgr.14601) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi049 2024-03-11T22:09:30.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:29 smithi049 bash[28804]: audit 2024-03-11T22:09:28.353543+0000 mgr.y (mgr.14601) 29 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:30.627 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:30 smithi187 bash[49818]: 5c12815fee55: Pull complete 2024-03-11T22:09:30.910 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:30 smithi187 bash[49818]: c0e87333d380: Pull complete 2024-03-11T22:09:30.910 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:30 smithi187 bash[49818]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-03-11T22:09:30.910 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:30 smithi187 bash[49818]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-03-11T22:09:31.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:30 smithi187 bash[23415]: cluster 2024-03-11T22:09:29.358096+0000 mgr.y (mgr.14601) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-11T22:09:31.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:30 smithi049 bash[21434]: cluster 2024-03-11T22:09:29.358096+0000 mgr.y (mgr.14601) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-11T22:09:31.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:30 smithi049 bash[28804]: cluster 2024-03-11T22:09:29.358096+0000 mgr.y (mgr.14601) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.681Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.681Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.682Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.682Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.682Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=arp 2024-03-11T22:09:32.017 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=edac 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-11T22:09:32.018 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=os 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-11T22:09:32.019 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=stat 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=time 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=uname 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-11T22:09:32.020 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:31 smithi049 bash[57549]: ts=2024-03-11T22:09:31.683Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-11T22:09:32.737 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.532Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.532Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=arp 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-11T22:09:32.738 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=edac 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.533Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-11T22:09:32.739 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=os 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-11T22:09:32.740 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=stat 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=time 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=uname 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-11T22:09:32.741 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[49818]: ts=2024-03-11T22:09:32.534Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-11T22:09:33.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[23415]: cluster 2024-03-11T22:09:31.358802+0000 mgr.y (mgr.14601) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-11T22:09:33.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[23415]: audit 2024-03-11T22:09:32.451635+0000 mon.a (mon.0) 770 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:33.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:32 smithi187 bash[23415]: audit 2024-03-11T22:09:32.471900+0000 mon.c (mon.2) 50 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:33.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:32 smithi049 bash[21434]: cluster 2024-03-11T22:09:31.358802+0000 mgr.y (mgr.14601) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-11T22:09:33.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:32 smithi049 bash[21434]: audit 2024-03-11T22:09:32.451635+0000 mon.a (mon.0) 770 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:33.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:32 smithi049 bash[21434]: audit 2024-03-11T22:09:32.471900+0000 mon.c (mon.2) 50 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:33.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:32 smithi049 bash[28804]: cluster 2024-03-11T22:09:31.358802+0000 mgr.y (mgr.14601) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-11T22:09:33.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:32 smithi049 bash[28804]: audit 2024-03-11T22:09:32.451635+0000 mon.a (mon.0) 770 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:33.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:32 smithi049 bash[28804]: audit 2024-03-11T22:09:32.471900+0000 mon.c (mon.2) 50 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:34.097 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:09:35.226 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:34 smithi049 bash[21434]: cluster 2024-03-11T22:09:33.360256+0000 mgr.y (mgr.14601) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-11T22:09:35.227 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:34 smithi049 bash[28804]: cluster 2024-03-11T22:09:33.360256+0000 mgr.y (mgr.14601) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-11T22:09:35.236 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:34 smithi187 bash[23415]: cluster 2024-03-11T22:09:33.360256+0000 mgr.y (mgr.14601) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-11T22:09:37.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:36 smithi187 bash[23415]: cluster 2024-03-11T22:09:35.360929+0000 mgr.y (mgr.14601) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:37.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:36 smithi049 bash[28804]: cluster 2024-03-11T22:09:35.360929+0000 mgr.y (mgr.14601) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:37.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:36 smithi049 bash[21434]: cluster 2024-03-11T22:09:35.360929+0000 mgr.y (mgr.14601) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- 172.21.15.49:0/2593883877 >> v1:172.21.15.49:6789/0 conn(0x7fb55c107a20 legacy=0x7fb55c107e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- 172.21.15.49:0/2593883877 shutdown_connections 2024-03-11T22:09:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- 172.21.15.49:0/2593883877 >> 172.21.15.49:0/2593883877 conn(0x7fb55c0fd550 msgr2=0x7fb55c0ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- 172.21.15.49:0/2593883877 shutdown_connections 2024-03-11T22:09:37.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- 172.21.15.49:0/2593883877 wait complete. 2024-03-11T22:09:37.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 Processor -- start 2024-03-11T22:09:37.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- start start 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb55c1a6a00 con 0x7fb55c10a8d0 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb55c1a7be0 con 0x7fb55c10e4a0 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb55c1a8de0 con 0x7fb55c107a20 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb55b7fe700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fb55c107a20 0x7fb55c10dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:55886/0 (socket says 172.21.15.49:55886) 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb55b7fe700 1 -- 172.21.15.49:0/82919556 learned_addr learned my addr 172.21.15.49:0/82919556 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057216158 0 0) 0x7fb55c1a8de0 con 0x7fb55c107a20 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5480035b0 con 0x7fb55c107a20 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218813992 0 0) 0x7fb55c1a6a00 con 0x7fb55c10a8d0 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c1a8de0 con 0x7fb55c10a8d0 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1952151995 0 0) 0x7fb5480035b0 con 0x7fb55c107a20 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb55c1a6a00 con 0x7fb55c107a20 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb54c0047c0 con 0x7fb55c107a20 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1010255029 0 0) 0x7fb55c1a8de0 con 0x7fb55c10a8d0 2024-03-11T22:09:37.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb5480035b0 con 0x7fb55c10a8d0 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb544001850 con 0x7fb55c10a8d0 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595089160 0 0) 0x7fb55c1a7be0 con 0x7fb55c10e4a0 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c1a8de0 con 0x7fb55c10e4a0 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 562836499 0 0) 0x7fb55c1a6a00 con 0x7fb55c107a20 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 >> v1:172.21.15.187:6789/0 conn(0x7fb55c10e4a0 legacy=0x7fb55c1a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 >> v1:172.21.15.49:6789/0 conn(0x7fb55c10a8d0 legacy=0x7fb55c1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c1a9fe0 con 0x7fb55c107a20 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c1a6bf0 con 0x7fb55c107a20 2024-03-11T22:09:37.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c1a7070 con 0x7fb55c107a20 2024-03-11T22:09:37.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fb54c004000 con 0x7fb55c107a20 2024-03-11T22:09:37.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.687+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb54c005440 con 0x7fb55c107a20 2024-03-11T22:09:37.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.691+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c005120 con 0x7fb55c107a20 2024-03-11T22:09:37.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.691+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fb54c003b70 con 0x7fb55c107a20 2024-03-11T22:09:37.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.691+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fb54c088a60 con 0x7fb55c107a20 2024-03-11T22:09:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.695+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb54c055f90 con 0x7fb55c107a20 2024-03-11T22:09:37.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.987+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb53c0053d0 con 0x7fb55c107a20 2024-03-11T22:09:37.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.999+0000 7fb558ff9700 1 -- 172.21.15.49:0/82919556 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v20) v1 ==== 170+0+59 (unknown 2256165530 0 1490114299) 0x7fb54c054300 con 0x7fb55c107a20 2024-03-11T22:09:37.987 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-11T22:09:37.987 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAhge9lweYzOxAA5gJRr8NOiRPcjWMNhztylg== 2024-03-11T22:09:37.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.999+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 >> v1:172.21.15.49:6800/915645872 conn(0x7fb54806e520 legacy=0x7fb5480709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:37.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.999+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 >> v1:172.21.15.49:6790/0 conn(0x7fb55c107a20 legacy=0x7fb55c10dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:37.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.999+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 shutdown_connections 2024-03-11T22:09:37.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.999+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 >> 172.21.15.49:0/82919556 conn(0x7fb55c0fd550 msgr2=0x7fb55c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:37.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.999+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 shutdown_connections 2024-03-11T22:09:37.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:37.999+0000 7fb56204e700 1 -- 172.21.15.49:0/82919556 wait complete. 2024-03-11T22:09:38.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:37 smithi187 bash[23415]: cluster 2024-03-11T22:09:37.361619+0000 mgr.y (mgr.14601) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:38.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:37 smithi049 bash[21434]: cluster 2024-03-11T22:09:37.361619+0000 mgr.y (mgr.14601) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:38.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:37 smithi049 bash[28804]: cluster 2024-03-11T22:09:37.361619+0000 mgr.y (mgr.14601) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:38.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:09:39.055 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T22:09:39.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-11T22:09:39.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-11T22:09:39.076 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-11T22:09:39.220 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.220 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.221 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.221 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.221 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.222 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[21434]: audit 2024-03-11T22:09:37.992126+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.49:0/82919556' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:39.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[21434]: audit 2024-03-11T22:09:37.992829+0000 mon.a (mon.0) 771 : audit 1 from='client.24527 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:39.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[21434]: audit 2024-03-11T22:09:37.996952+0000 mon.a (mon.0) 772 : audit 1 from='client.24527 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-11T22:09:39.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[21434]: audit 2024-03-11T22:09:38.361514+0000 mgr.y (mgr.14601) 35 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:39.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.222 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[28804]: audit 2024-03-11T22:09:37.992126+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.49:0/82919556' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:39.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[28804]: audit 2024-03-11T22:09:37.992829+0000 mon.a (mon.0) 771 : audit 1 from='client.24527 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:39.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[28804]: audit 2024-03-11T22:09:37.996952+0000 mon.a (mon.0) 772 : audit 1 from='client.24527 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-11T22:09:39.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:38 smithi049 bash[28804]: audit 2024-03-11T22:09:38.361514+0000 mgr.y (mgr.14601) 35 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:39.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:38 smithi187 bash[23415]: audit 2024-03-11T22:09:37.992126+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.49:0/82919556' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:39.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:38 smithi187 bash[23415]: audit 2024-03-11T22:09:37.992829+0000 mon.a (mon.0) 771 : audit 1 from='client.24527 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:39.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:38 smithi187 bash[23415]: audit 2024-03-11T22:09:37.996952+0000 mon.a (mon.0) 772 : audit 1 from='client.24527 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-11T22:09:39.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:38 smithi187 bash[23415]: audit 2024-03-11T22:09:38.361514+0000 mgr.y (mgr.14601) 35 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:39.349 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.350 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.350 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.506 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.506 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.507 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.507 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.507 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.508 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.508 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.508 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.508 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:39.508 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: Started Ceph alertmanager.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:09:39.509 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:40.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[28804]: cluster 2024-03-11T22:09:39.362363+0000 mgr.y (mgr.14601) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:40.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[28804]: audit 2024-03-11T22:09:39.525802+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[28804]: audit 2024-03-11T22:09:39.548362+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[28804]: audit 2024-03-11T22:09:39.594577+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[28804]: audit 2024-03-11T22:09:39.602854+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[28804]: audit 2024-03-11T22:09:39.669959+0000 mon.c (mon.2) 52 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:40.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[21434]: cluster 2024-03-11T22:09:39.362363+0000 mgr.y (mgr.14601) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:40.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[21434]: audit 2024-03-11T22:09:39.525802+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[21434]: audit 2024-03-11T22:09:39.548362+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[21434]: audit 2024-03-11T22:09:39.594577+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[21434]: audit 2024-03-11T22:09:39.602854+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[21434]: audit 2024-03-11T22:09:39.669959+0000 mon.c (mon.2) 52 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:40.768 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.658Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-11T22:09:40.768 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.658Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-11T22:09:40.768 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.660Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.49 port=9094 2024-03-11T22:09:40.768 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.661Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-11T22:09:40.768 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.692Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-11T22:09:40.768 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.692Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-11T22:09:40.768 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.696Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-11T22:09:40.769 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:40 smithi049 bash[58100]: ts=2024-03-11T22:09:40.696Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-11T22:09:40.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:40 smithi187 bash[23415]: cluster 2024-03-11T22:09:39.362363+0000 mgr.y (mgr.14601) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:40.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:40 smithi187 bash[23415]: audit 2024-03-11T22:09:39.525802+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:40 smithi187 bash[23415]: audit 2024-03-11T22:09:39.548362+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:40 smithi187 bash[23415]: audit 2024-03-11T22:09:39.594577+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:40 smithi187 bash[23415]: audit 2024-03-11T22:09:39.602854+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:40.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:40 smithi187 bash[23415]: audit 2024-03-11T22:09:39.669959+0000 mon.c (mon.2) 52 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:09:42.766 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:42 smithi049 bash[58100]: ts=2024-03-11T22:09:42.661Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000174853s 2024-03-11T22:09:42.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:42 smithi049 bash[21434]: cluster 2024-03-11T22:09:41.362980+0000 mgr.y (mgr.14601) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:42.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:42 smithi049 bash[21434]: audit 2024-03-11T22:09:42.463950+0000 mon.a (mon.0) 777 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:42.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:42 smithi049 bash[28804]: cluster 2024-03-11T22:09:41.362980+0000 mgr.y (mgr.14601) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:42.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:42 smithi049 bash[28804]: audit 2024-03-11T22:09:42.463950+0000 mon.a (mon.0) 777 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:42.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:42 smithi187 bash[23415]: cluster 2024-03-11T22:09:41.362980+0000 mgr.y (mgr.14601) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:42.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:42 smithi187 bash[23415]: audit 2024-03-11T22:09:42.463950+0000 mon.a (mon.0) 777 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:43.869 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.b/config 2024-03-11T22:09:44.970 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:44 smithi187 bash[23415]: cluster 2024-03-11T22:09:43.364512+0000 mgr.y (mgr.14601) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:45.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:44 smithi049 bash[21434]: cluster 2024-03-11T22:09:43.364512+0000 mgr.y (mgr.14601) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:45.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:44 smithi049 bash[28804]: cluster 2024-03-11T22:09:43.364512+0000 mgr.y (mgr.14601) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21686]: [11/Mar/2024:22:09:45] ENGINE Bus STOPPING 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21686]: [11/Mar/2024:22:09:45] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21686]: [11/Mar/2024:22:09:45] ENGINE Bus STOPPED 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21686]: [11/Mar/2024:22:09:45] ENGINE Bus STARTING 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21686]: [11/Mar/2024:22:09:45] ENGINE Serving on http://:::9283 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21686]: [11/Mar/2024:22:09:45] ENGINE Bus STARTED 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:44.714356+0000 mon.a (mon.0) 778 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:44.730281+0000 mon.a (mon.0) 779 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.358169+0000 mon.a (mon.0) 780 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.364962+0000 mon.a (mon.0) 781 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.366628+0000 mon.c (mon.2) 53 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.367351+0000 mon.c (mon.2) 54 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.372381+0000 mon.a (mon.0) 782 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.482151+0000 mon.a (mon.0) 783 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.489961+0000 mon.a (mon.0) 784 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.496085+0000 mon.c (mon.2) 55 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[21434]: audit 2024-03-11T22:09:45.502580+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:44.714356+0000 mon.a (mon.0) 778 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:44.730281+0000 mon.a (mon.0) 779 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.358169+0000 mon.a (mon.0) 780 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.364962+0000 mon.a (mon.0) 781 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.366628+0000 mon.c (mon.2) 53 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:09:45.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.367351+0000 mon.c (mon.2) 54 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:09:45.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.372381+0000 mon.a (mon.0) 782 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.482151+0000 mon.a (mon.0) 783 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.489961+0000 mon.a (mon.0) 784 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.496085+0000 mon.c (mon.2) 55 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-11T22:09:45.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:45 smithi049 bash[28804]: audit 2024-03-11T22:09:45.502580+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.987 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:09:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:09:45.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:44.714356+0000 mon.a (mon.0) 778 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:44.730281+0000 mon.a (mon.0) 779 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.358169+0000 mon.a (mon.0) 780 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.364962+0000 mon.a (mon.0) 781 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.366628+0000 mon.c (mon.2) 53 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:09:45.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.367351+0000 mon.c (mon.2) 54 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:09:45.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.372381+0000 mon.a (mon.0) 782 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.482151+0000 mon.a (mon.0) 783 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.489961+0000 mon.a (mon.0) 784 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:45.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.496085+0000 mon.c (mon.2) 55 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-11T22:09:45.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:45 smithi187 bash[23415]: audit 2024-03-11T22:09:45.502580+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:09:46.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:46 smithi187 bash[23415]: cluster 2024-03-11T22:09:45.364959+0000 mgr.y (mgr.14601) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:46.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:46 smithi187 bash[23415]: cephadm 2024-03-11T22:09:45.387956+0000 mgr.y (mgr.14601) 40 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-03-11T22:09:46.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:46 smithi187 bash[23415]: audit 2024-03-11T22:09:45.497182+0000 mgr.y (mgr.14601) 41 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-11T22:09:46.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:46 smithi187 bash[23415]: cephadm 2024-03-11T22:09:45.517935+0000 mgr.y (mgr.14601) 42 : cephadm 1 Deploying daemon grafana.a on smithi187 2024-03-11T22:09:47.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[21434]: cluster 2024-03-11T22:09:45.364959+0000 mgr.y (mgr.14601) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:47.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[21434]: cephadm 2024-03-11T22:09:45.387956+0000 mgr.y (mgr.14601) 40 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-03-11T22:09:47.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[21434]: audit 2024-03-11T22:09:45.497182+0000 mgr.y (mgr.14601) 41 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-11T22:09:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[21434]: cephadm 2024-03-11T22:09:45.517935+0000 mgr.y (mgr.14601) 42 : cephadm 1 Deploying daemon grafana.a on smithi187 2024-03-11T22:09:47.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[28804]: cluster 2024-03-11T22:09:45.364959+0000 mgr.y (mgr.14601) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:47.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[28804]: cephadm 2024-03-11T22:09:45.387956+0000 mgr.y (mgr.14601) 40 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-03-11T22:09:47.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[28804]: audit 2024-03-11T22:09:45.497182+0000 mgr.y (mgr.14601) 41 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-11T22:09:47.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:46 smithi049 bash[28804]: cephadm 2024-03-11T22:09:45.517935+0000 mgr.y (mgr.14601) 42 : cephadm 1 Deploying daemon grafana.a on smithi187 2024-03-11T22:09:47.397 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- 172.21.15.187:0/3307851662 >> v1:172.21.15.187:6789/0 conn(0x7f9f3c10cb10 legacy=0x7f9f3c10ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:47.398 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- 172.21.15.187:0/3307851662 shutdown_connections 2024-03-11T22:09:47.398 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- 172.21.15.187:0/3307851662 >> 172.21.15.187:0/3307851662 conn(0x7f9f3c0ff710 msgr2=0x7f9f3c101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:47.398 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- 172.21.15.187:0/3307851662 shutdown_connections 2024-03-11T22:09:47.398 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- 172.21.15.187:0/3307851662 wait complete. 2024-03-11T22:09:47.398 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 Processor -- start 2024-03-11T22:09:47.398 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- start start 2024-03-11T22:09:47.399 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f3c1a8ca0 con 0x7f9f3c103e80 2024-03-11T22:09:47.399 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.403+0000 7f9f42509700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f3c1a9e80 con 0x7f9f3c10cb10 2024-03-11T22:09:47.399 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f42509700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f3c1ab080 con 0x7f9f3c1106b0 2024-03-11T22:09:47.399 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f3b7fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9f3c10cb10 0x7f9f3c1a3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:40268/0 (socket says 172.21.15.187:40268) 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f3b7fe700 1 -- 172.21.15.187:0/1608896896 learned_addr learned my addr 172.21.15.187:0/1608896896 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70362591 0 0) 0x7f9f3c1a9e80 con 0x7f9f3c10cb10 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f280035b0 con 0x7f9f3c10cb10 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1713078284 0 0) 0x7f9f280035b0 con 0x7f9f3c10cb10 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f3c1a9e80 con 0x7f9f3c10cb10 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f9f24001c80 con 0x7f9f3c10cb10 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572771726 0 0) 0x7f9f3c1ab080 con 0x7f9f3c1106b0 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f280035b0 con 0x7f9f3c1106b0 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705302592 0 0) 0x7f9f3c1a8ca0 con 0x7f9f3c103e80 2024-03-11T22:09:47.400 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c1ab080 con 0x7f9f3c103e80 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1381376020 0 0) 0x7f9f3c1a9e80 con 0x7f9f3c10cb10 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 >> v1:172.21.15.49:6790/0 conn(0x7f9f3c1106b0 legacy=0x7f9f3c1a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 >> v1:172.21.15.49:6789/0 conn(0x7f9f3c103e80 legacy=0x7f9f3c109230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c1ac280 con 0x7f9f3c10cb10 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c1ab270 con 0x7f9f3c10cb10 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c1ab6f0 con 0x7f9f3c10cb10 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f9f240045b0 con 0x7f9f3c10cb10 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f9f24005380 con 0x7f9f3c10cb10 2024-03-11T22:09:47.401 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c005120 con 0x7f9f3c10cb10 2024-03-11T22:09:47.402 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f9f24004120 con 0x7f9f3c10cb10 2024-03-11T22:09:47.402 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.407+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f9f24088a90 con 0x7f9f3c10cb10 2024-03-11T22:09:47.407 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.415+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9f24055f60 con 0x7f9f3c10cb10 2024-03-11T22:09:47.704 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.711+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9f1c0053d0 con 0x7f9f3c10cb10 2024-03-11T22:09:47.714 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.719+0000 7f9f397fa700 1 -- 172.21.15.187:0/1608896896 <== mon.1 v1:172.21.15.187:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v21) v1 ==== 170+0+59 (unknown 1461870620 0 2973110863) 0x7f9f24001f30 con 0x7f9f3c10cb10 2024-03-11T22:09:47.714 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2024-03-11T22:09:47.715 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQArge9lcYYFKxAAZDjo4MnZMPUX7ZCq8FHhVg== 2024-03-11T22:09:47.717 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.723+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 >> v1:172.21.15.49:6800/915645872 conn(0x7f9f2806e4b0 legacy=0x7f9f28070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:47.717 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.723+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 >> v1:172.21.15.187:6789/0 conn(0x7f9f3c10cb10 legacy=0x7f9f3c1a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:47.717 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.723+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 shutdown_connections 2024-03-11T22:09:47.717 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.723+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 >> 172.21.15.187:0/1608896896 conn(0x7f9f3c0ff710 msgr2=0x7f9f3c113300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:47.717 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.723+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 shutdown_connections 2024-03-11T22:09:47.717 INFO:teuthology.orchestra.run.smithi187.stderr:2024-03-11T22:09:47.723+0000 7f9f42509700 1 -- 172.21.15.187:0/1608896896 wait complete. 2024-03-11T22:09:48.706 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:09:48.982 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:48 smithi187 bash[23415]: cluster 2024-03-11T22:09:47.365653+0000 mgr.y (mgr.14601) 43 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:48.983 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:48 smithi187 bash[23415]: audit 2024-03-11T22:09:47.717104+0000 mon.b (mon.1) 32 : audit 1 from='client.? v1:172.21.15.187:0/1608896896' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:48.983 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:48 smithi187 bash[23415]: audit 2024-03-11T22:09:47.721467+0000 mon.a (mon.0) 786 : audit 1 from='client.24556 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:48.983 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:48 smithi187 bash[23415]: audit 2024-03-11T22:09:47.724813+0000 mon.a (mon.0) 787 : audit 1 from='client.24556 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-11T22:09:48.983 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:48 smithi187 bash[23415]: audit 2024-03-11T22:09:47.812425+0000 mon.c (mon.2) 56 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:48.984 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-03-11T22:09:48.984 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-11T22:09:48.984 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-11T22:09:49.008 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-11T22:09:49.008 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-11T22:09:49.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph mgr dump --format=json 2024-03-11T22:09:49.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[21434]: cluster 2024-03-11T22:09:47.365653+0000 mgr.y (mgr.14601) 43 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:49.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[21434]: audit 2024-03-11T22:09:47.717104+0000 mon.b (mon.1) 32 : audit 1 from='client.? v1:172.21.15.187:0/1608896896' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[21434]: audit 2024-03-11T22:09:47.721467+0000 mon.a (mon.0) 786 : audit 1 from='client.24556 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[21434]: audit 2024-03-11T22:09:47.724813+0000 mon.a (mon.0) 787 : audit 1 from='client.24556 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[21434]: audit 2024-03-11T22:09:47.812425+0000 mon.c (mon.2) 56 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[28804]: cluster 2024-03-11T22:09:47.365653+0000 mgr.y (mgr.14601) 43 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[28804]: audit 2024-03-11T22:09:47.717104+0000 mon.b (mon.1) 32 : audit 1 from='client.? v1:172.21.15.187:0/1608896896' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[28804]: audit 2024-03-11T22:09:47.721467+0000 mon.a (mon.0) 786 : audit 1 from='client.24556 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[28804]: audit 2024-03-11T22:09:47.724813+0000 mon.a (mon.0) 787 : audit 1 from='client.24556 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-11T22:09:49.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:48 smithi049 bash[28804]: audit 2024-03-11T22:09:47.812425+0000 mon.c (mon.2) 56 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:09:49.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:49 smithi187 bash[23415]: audit 2024-03-11T22:09:48.369861+0000 mgr.y (mgr.14601) 44 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:50.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:49 smithi049 bash[21434]: audit 2024-03-11T22:09:48.369861+0000 mgr.y (mgr.14601) 44 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:50.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:49 smithi049 bash[28804]: audit 2024-03-11T22:09:48.369861+0000 mgr.y (mgr.14601) 44 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:09:50.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:50 smithi187 bash[23415]: cluster 2024-03-11T22:09:49.367121+0000 mgr.y (mgr.14601) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:51.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:50 smithi049 bash[21434]: cluster 2024-03-11T22:09:49.367121+0000 mgr.y (mgr.14601) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:51.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:50 smithi049 bash[28804]: cluster 2024-03-11T22:09:49.367121+0000 mgr.y (mgr.14601) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:51.017 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:09:50 smithi049 bash[58100]: ts=2024-03-11T22:09:50.662Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.001702976s 2024-03-11T22:09:52.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:52 smithi187 bash[23415]: cluster 2024-03-11T22:09:51.367886+0000 mgr.y (mgr.14601) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:53.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:52 smithi049 bash[21434]: cluster 2024-03-11T22:09:51.367886+0000 mgr.y (mgr.14601) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:53.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:52 smithi049 bash[28804]: cluster 2024-03-11T22:09:51.367886+0000 mgr.y (mgr.14601) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:53.798 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:09:54.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:54 smithi187 bash[23415]: cluster 2024-03-11T22:09:53.369335+0000 mgr.y (mgr.14601) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:54.988 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:54 smithi049 bash[21434]: cluster 2024-03-11T22:09:53.369335+0000 mgr.y (mgr.14601) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:54.988 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:54 smithi049 bash[28804]: cluster 2024-03-11T22:09:53.369335+0000 mgr.y (mgr.14601) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:09:56.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- 172.21.15.49:0/728619770 >> v1:172.21.15.49:6789/0 conn(0x7faa88074b90 legacy=0x7faa8810ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:56.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- 172.21.15.49:0/728619770 shutdown_connections 2024-03-11T22:09:56.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- 172.21.15.49:0/728619770 >> 172.21.15.49:0/728619770 conn(0x7faa880fd530 msgr2=0x7faa880ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- 172.21.15.49:0/728619770 shutdown_connections 2024-03-11T22:09:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- 172.21.15.49:0/728619770 wait complete. 2024-03-11T22:09:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 Processor -- start 2024-03-11T22:09:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- start start 2024-03-11T22:09:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faa881a8a30 con 0x7faa880740a0 2024-03-11T22:09:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faa881a9c10 con 0x7faa88074b90 2024-03-11T22:09:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faa881aae10 con 0x7faa881106c0 2024-03-11T22:09:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa8e342700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7faa880740a0 0x7faa8810c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:60804/0 (socket says 172.21.15.49:60804) 2024-03-11T22:09:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa8e342700 1 -- 172.21.15.49:0/671981315 learned_addr learned my addr 172.21.15.49:0/671981315 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:09:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa8eb43700 1 --1- 172.21.15.49:0/671981315 >> v1:172.21.15.49:6790/0 conn(0x7faa881106c0 0x7faa881a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:39850/0 (socket says 172.21.15.49:39850) 2024-03-11T22:09:56.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127353278 0 0) 0x7faa881a8a30 con 0x7faa880740a0 2024-03-11T22:09:56.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa740037f0 con 0x7faa880740a0 2024-03-11T22:09:56.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107860776 0 0) 0x7faa881aae10 con 0x7faa881106c0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa881a8a30 con 0x7faa881106c0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544218239 0 0) 0x7faa881a9c10 con 0x7faa88074b90 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa881aae10 con 0x7faa88074b90 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3044004263 0 0) 0x7faa740037f0 con 0x7faa880740a0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa881a9c10 con 0x7faa880740a0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7faa7c0018b0 con 0x7faa880740a0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1511351793 0 0) 0x7faa881a8a30 con 0x7faa881106c0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa740037f0 con 0x7faa881106c0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7faa80001c30 con 0x7faa881106c0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 73521037 0 0) 0x7faa881aae10 con 0x7faa88074b90 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa881a8a30 con 0x7faa88074b90 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7faa84004460 con 0x7faa88074b90 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1791245640 0 0) 0x7faa881a9c10 con 0x7faa880740a0 2024-03-11T22:09:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 >> v1:172.21.15.49:6790/0 conn(0x7faa881106c0 legacy=0x7faa881a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 >> v1:172.21.15.187:6789/0 conn(0x7faa88074b90 legacy=0x7faa881a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa881ac010 con 0x7faa880740a0 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa881a8c20 con 0x7faa880740a0 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faa881a90a0 con 0x7faa880740a0 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7faa7c003b30 con 0x7faa880740a0 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.607+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7faa7c005b50 con 0x7faa880740a0 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.611+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c005120 con 0x7faa880740a0 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.611+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7faa7c0036a0 con 0x7faa880740a0 2024-03-11T22:09:56.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.611+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7faa7c088220 con 0x7faa880740a0 2024-03-11T22:09:56.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.615+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7faa7c0556f0 con 0x7faa880740a0 2024-03-11T22:09:56.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.891+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7faa6c0053d0 con 0x7faa880740a0 2024-03-11T22:09:56.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.899+0000 7faa7b7fe700 1 -- 172.21.15.49:0/671981315 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) v1 ==== 74+0+174216 (unknown 3269696449 0 3337977617) 0x7faa7c053a60 con 0x7faa880740a0 2024-03-11T22:09:56.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:09:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.899+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 >> v1:172.21.15.49:6800/915645872 conn(0x7faa7406e8f0 legacy=0x7faa74070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.899+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 >> v1:172.21.15.49:6789/0 conn(0x7faa880740a0 legacy=0x7faa8810c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:09:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.899+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 shutdown_connections 2024-03-11T22:09:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.899+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 >> 172.21.15.49:0/671981315 conn(0x7faa880fd530 msgr2=0x7faa8810ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:09:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.903+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 shutdown_connections 2024-03-11T22:09:56.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:09:56.903+0000 7faa905a6700 1 -- 172.21.15.49:0/671981315 wait complete. 2024-03-11T22:09:56.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:56 smithi187 bash[23415]: cluster 2024-03-11T22:09:55.369976+0000 mgr.y (mgr.14601) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:57.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:56 smithi049 bash[21434]: cluster 2024-03-11T22:09:55.369976+0000 mgr.y (mgr.14601) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:57.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:56 smithi049 bash[28804]: cluster 2024-03-11T22:09:55.369976+0000 mgr.y (mgr.14601) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:57.566 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"flags":0,"active_gid":14601,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6800","nonce":915645872}]},"active_addr":"172.21.15.49:6800/915645872","active_change":"2024-03-11T22:09:17.327376+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24514,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.49:8443/","prometheus":"http://172.21.15.49:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":74,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3473417168}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2153923604}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":253268345}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3524596220}]}]} 2024-03-11T22:09:57.570 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-11T22:09:57.570 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-11T22:09:57.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd dump --format=json 2024-03-11T22:09:58.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:57 smithi049 bash[21434]: audit 2024-03-11T22:09:56.893761+0000 mon.a (mon.0) 788 : audit 0 from='client.? v1:172.21.15.49:0/671981315' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-11T22:09:58.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:57 smithi049 bash[28804]: audit 2024-03-11T22:09:56.893761+0000 mon.a (mon.0) 788 : audit 0 from='client.? v1:172.21.15.49:0/671981315' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-11T22:09:58.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:57 smithi187 bash[23415]: audit 2024-03-11T22:09:56.893761+0000 mon.a (mon.0) 788 : audit 0 from='client.? v1:172.21.15.49:0/671981315' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-11T22:09:58.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:09:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:09:59.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:58 smithi049 bash[21434]: cluster 2024-03-11T22:09:57.370791+0000 mgr.y (mgr.14601) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:59.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:58 smithi049 bash[28804]: cluster 2024-03-11T22:09:57.370791+0000 mgr.y (mgr.14601) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:09:59.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:58 smithi187 bash[23415]: cluster 2024-03-11T22:09:57.370791+0000 mgr.y (mgr.14601) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:00.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:09:59 smithi049 bash[21434]: audit 2024-03-11T22:09:58.377953+0000 mgr.y (mgr.14601) 50 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:00.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:09:59 smithi049 bash[28804]: audit 2024-03-11T22:09:58.377953+0000 mgr.y (mgr.14601) 50 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:00.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:09:59 smithi187 bash[23415]: audit 2024-03-11T22:09:58.377953+0000 mgr.y (mgr.14601) 50 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:01.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:00 smithi049 bash[28804]: cluster 2024-03-11T22:09:59.372396+0000 mgr.y (mgr.14601) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:01.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:00 smithi049 bash[28804]: cluster 2024-03-11T22:10:00.000158+0000 mon.a (mon.0) 789 : cluster 1 overall HEALTH_OK 2024-03-11T22:10:01.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:00 smithi049 bash[21434]: cluster 2024-03-11T22:09:59.372396+0000 mgr.y (mgr.14601) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:01.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:00 smithi049 bash[21434]: cluster 2024-03-11T22:10:00.000158+0000 mon.a (mon.0) 789 : cluster 1 overall HEALTH_OK 2024-03-11T22:10:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:00 smithi187 bash[23415]: cluster 2024-03-11T22:09:59.372396+0000 mgr.y (mgr.14601) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:00 smithi187 bash[23415]: cluster 2024-03-11T22:10:00.000158+0000 mon.a (mon.0) 789 : cluster 1 overall HEALTH_OK 2024-03-11T22:10:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:03.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:02 smithi187 bash[23415]: cluster 2024-03-11T22:10:01.373169+0000 mgr.y (mgr.14601) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:03.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:02 smithi187 bash[23415]: audit 2024-03-11T22:10:02.840716+0000 mon.c (mon.2) 57 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:03.260 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:02 smithi049 bash[21434]: cluster 2024-03-11T22:10:01.373169+0000 mgr.y (mgr.14601) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:03.260 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:02 smithi049 bash[21434]: audit 2024-03-11T22:10:02.840716+0000 mon.c (mon.2) 57 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:03.260 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:02 smithi049 bash[28804]: cluster 2024-03-11T22:10:01.373169+0000 mgr.y (mgr.14601) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:03.260 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:02 smithi049 bash[28804]: audit 2024-03-11T22:10:02.840716+0000 mon.c (mon.2) 57 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- 172.21.15.49:0/4013467242 >> v1:172.21.15.49:6789/0 conn(0x7f1034101350 legacy=0x7f103410edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- 172.21.15.49:0/4013467242 shutdown_connections 2024-03-11T22:10:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- 172.21.15.49:0/4013467242 >> 172.21.15.49:0/4013467242 conn(0x7f10340fc410 msgr2=0x7f10340fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- 172.21.15.49:0/4013467242 shutdown_connections 2024-03-11T22:10:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- 172.21.15.49:0/4013467242 wait complete. 2024-03-11T22:10:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 Processor -- start 2024-03-11T22:10:04.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- start start 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f10341a8ac0 con 0x7f1034100770 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f10341a9ca0 con 0x7f1034101350 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f10341aaea0 con 0x7f10341106a0 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103a132700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f1034100770 0x7f103410ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55402/0 (socket says 172.21.15.49:55402) 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103a132700 1 -- 172.21.15.49:0/1048401746 learned_addr learned my addr 172.21.15.49:0/1048401746 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767784503 0 0) 0x7f10341a8ac0 con 0x7f1034100770 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10200035b0 con 0x7f1034100770 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690962922 0 0) 0x7f10341aaea0 con 0x7f10341106a0 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10341a8ac0 con 0x7f10341106a0 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282959944 0 0) 0x7f10341a9ca0 con 0x7f1034101350 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10341aaea0 con 0x7f1034101350 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2448150998 0 0) 0x7f10200035b0 con 0x7f1034100770 2024-03-11T22:10:04.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f10341a9ca0 con 0x7f1034100770 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1893928519 0 0) 0x7f10341a8ac0 con 0x7f10341106a0 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f10200035b0 con 0x7f10341106a0 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f10300019a0 con 0x7f1034100770 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f102c001af0 con 0x7f10341106a0 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 62590100 0 0) 0x7f10341a9ca0 con 0x7f1034100770 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 >> v1:172.21.15.49:6790/0 conn(0x7f10341106a0 legacy=0x7f10341a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 >> v1:172.21.15.187:6789/0 conn(0x7f1034101350 legacy=0x7f10341a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10341ac0a0 con 0x7f1034100770 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10341ab090 con 0x7f1034100770 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f10341ab510 con 0x7f1034100770 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f1030003b10 con 0x7f1034100770 2024-03-11T22:10:04.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.991+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f1030005c00 con 0x7f1034100770 2024-03-11T22:10:04.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.995+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1018005120 con 0x7f1034100770 2024-03-11T22:10:04.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.995+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f1030003680 con 0x7f1034100770 2024-03-11T22:10:04.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.995+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f10300883d0 con 0x7f1034100770 2024-03-11T22:10:04.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:04.999+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f1030055900 con 0x7f1034100770 2024-03-11T22:10:05.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.207+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10180053d0 con 0x7f1034100770 2024-03-11T22:10:05.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.211+0000 7f102b7fe700 1 -- 172.21.15.49:0/1048401746 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+21098 (unknown 2627823564 0 974086303) 0x7f1030053c70 con 0x7f1034100770 2024-03-11T22:10:05.202 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:10:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"fsid":"377df5b0-dff2-11ee-95c8-87774f69a715","created":"2024-03-11T21:57:59.882687+0000","modified":"2024-03-11T22:09:17.326833+0000","last_up_change":"2024-03-11T22:07:36.719734+0000","last_in_change":"2024-03-11T22:07:09.390512+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-11T22:03:15.301419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-03-11T22:08:15.190956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-03-11T22:08:16.820300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-03-11T22:08:18.765172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"datapool","create_time":"2024-03-11T22:08:19.726440+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-03-11T22:08:20.890744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5539a6f5-8ee5-43a7-b42c-83eaad23ebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6801","nonce":1383006495}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6802","nonce":1383006495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6804","nonce":1383006495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6803","nonce":1383006495}]},"public_addr":"172.21.15.49:6801/1383006495","cluster_addr":"172.21.15.49:6802/1383006495","heartbeat_back_addr":"172.21.15.49:6804/1383006495","heartbeat_front_addr":"172.21.15.49:6803/1383006495","state":["exists","up"]},{"osd":1,"uuid":"e57e1dff-7e3e-4924-ae2d-6b921cb9d99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6805","nonce":3491699509}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6806","nonce":3491699509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6808","nonce":3491699509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6807","nonce":3491699509}]},"public_addr":"172.21.15.49:6805/3491699509","cluster_addr":"172.21.15.49:6806/3491699509","heartbeat_back_addr":"172.21.15.49:6808/3491699509","heartbeat_front_addr":"172.21.15.49:6807/3491699509","state":["exists","up"]},{"osd":2,"uuid":"f8230702-b6f3-4390-8902-24cec89cb476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6809","nonce":535303154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6810","nonce":535303154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6812","nonce":535303154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6811","nonce":535303154}]},"public_addr":"172.21.15.49:6809/535303154","cluster_addr":"172.21.15.49:6810/535303154","heartbeat_back_addr":"172.21.15.49:6812/535303154","heartbeat_front_addr":"172.21.15.49:6811/535303154","state":["exists","up"]},{"osd":3,"uuid":"046c12b6-90f4-4c80-9d33-b644551e6649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6813","nonce":4161800259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6814","nonce":4161800259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6816","nonce":4161800259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6815","nonce":4161800259}]},"public_addr":"172.21.15.49:6813/4161800259","cluster_addr":"172.21.15.49:6814/4161800259","heartbeat_back_addr":"172.21.15.49:6816/4161800259","heartbeat_front_addr":"172.21.15.49:6815/4161800259","state":["exists","up"]},{"osd":4,"uuid":"93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6800","nonce":4268742344}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6801","nonce":4268742344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6803","nonce":4268742344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6802","nonce":4268742344}]},"public_addr":"172.21.15.187:6800/4268742344","cluster_addr":"172.21.15.187:6801/4268742344","heartbeat_back_addr":"172.21.15.187:6803/4268742344","heartbeat_front_addr":"172.21.15.187:6802/4268742344","state":["exists","up"]},{"osd":5,"uuid":"f1cd359e-0186-4ad1-bccb-e71dc10206a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6804","nonce":2249702314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6805","nonce":2249702314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6807","nonce":2249702314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6806","nonce":2249702314}]},"public_addr":"172.21.15.187:6804/2249702314","cluster_addr":"172.21.15.187:6805/2249702314","heartbeat_back_addr":"172.21.15.187:6807/2249702314","heartbeat_front_addr":"172.21.15.187:6806/2249702314","state":["exists","up"]},{"osd":6,"uuid":"742c8fbe-3d0b-4586-aa9a-4bb91082fba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6808","nonce":2887830694}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6809","nonce":2887830694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6811","nonce":2887830694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6810","nonce":2887830694}]},"public_addr":"172.21.15.187:6808/2887830694","cluster_addr":"172.21.15.187:6809/2887830694","heartbeat_back_addr":"172.21.15.187:6811/2887830694","heartbeat_front_addr":"172.21.15.187:6810/2887830694","state":["exists","up"]},{"osd":7,"uuid":"0434ed1b-889d-4e07-bce8-98641881ec0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6812","nonce":3018671607}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6813","nonce":3018671607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6815","nonce":3018671607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6814","nonce":3018671607}]},"public_addr":"172.21.15.187:6812/3018671607","cluster_addr":"172.21.15.187:6813/3018671607","heartbeat_back_addr":"172.21.15.187:6815/3018671607","heartbeat_front_addr":"172.21.15.187:6814/3018671607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:01:30.591418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:02:20.916346+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:03:12.089410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:04:04.714425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:04:54.167706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:05:47.502591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:06:39.482362+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:07:35.163397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.12","mappings":[{"from":7,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1036465404":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/3770975136":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/1600196633":"2024-03-12T22:09:17.326670+0000","172.21.15.49:6800/4076252288":"2024-03-12T22:09:17.326670+0000","172.21.15.49:6800/2600502005":"2024-03-12T21:59:06.647009+0000","172.21.15.49:6800/653572163":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/1299294381":"2024-03-12T21:59:06.647009+0000","172.21.15.49:0/3331119922":"2024-03-12T21:59:06.647009+0000","172.21.15.49:0/2219357335":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/3658055689":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/358645426":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/3829805881":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/1446475445":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/3264123515":"2024-03-12T21:59:06.647009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-11T22:10:05.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.215+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 >> v1:172.21.15.49:6800/915645872 conn(0x7f102006e5e0 legacy=0x7f1020070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:05.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.215+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 >> v1:172.21.15.49:6789/0 conn(0x7f1034100770 legacy=0x7f103410ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.215+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 shutdown_connections 2024-03-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.215+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 >> 172.21.15.49:0/1048401746 conn(0x7f10340fc410 msgr2=0x7f103410fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.215+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 shutdown_connections 2024-03-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:05.215+0000 7f103c396700 1 -- 172.21.15.49:0/1048401746 wait complete. 2024-03-11T22:10:05.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:04 smithi049 bash[21434]: cluster 2024-03-11T22:10:03.373909+0000 mgr.y (mgr.14601) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:05.217 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:04 smithi049 bash[28804]: cluster 2024-03-11T22:10:03.373909+0000 mgr.y (mgr.14601) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:05.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:04 smithi187 bash[23415]: cluster 2024-03-11T22:10:03.373909+0000 mgr.y (mgr.14601) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:05.875 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-11T22:10:05.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd dump --format=json 2024-03-11T22:10:06.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:05 smithi187 bash[23415]: audit 2024-03-11T22:10:05.212759+0000 mon.a (mon.0) 790 : audit 0 from='client.? v1:172.21.15.49:0/1048401746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:10:06.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:05 smithi049 bash[21434]: audit 2024-03-11T22:10:05.212759+0000 mon.a (mon.0) 790 : audit 0 from='client.? v1:172.21.15.49:0/1048401746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:10:06.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:05 smithi049 bash[28804]: audit 2024-03-11T22:10:05.212759+0000 mon.a (mon.0) 790 : audit 0 from='client.? v1:172.21.15.49:0/1048401746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:10:07.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:06 smithi187 bash[23415]: cluster 2024-03-11T22:10:05.374494+0000 mgr.y (mgr.14601) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:07.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:06 smithi049 bash[21434]: cluster 2024-03-11T22:10:05.374494+0000 mgr.y (mgr.14601) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:07.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:06 smithi049 bash[28804]: cluster 2024-03-11T22:10:05.374494+0000 mgr.y (mgr.14601) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:08.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:10:09.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:08 smithi187 bash[23415]: cluster 2024-03-11T22:10:07.375201+0000 mgr.y (mgr.14601) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:09.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:08 smithi049 bash[21434]: cluster 2024-03-11T22:10:07.375201+0000 mgr.y (mgr.14601) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:09.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:08 smithi049 bash[28804]: cluster 2024-03-11T22:10:07.375201+0000 mgr.y (mgr.14601) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:09 smithi187 bash[23415]: audit 2024-03-11T22:10:08.389355+0000 mgr.y (mgr.14601) 56 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:10.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:09 smithi049 bash[21434]: audit 2024-03-11T22:10:08.389355+0000 mgr.y (mgr.14601) 56 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:10.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:09 smithi049 bash[28804]: audit 2024-03-11T22:10:08.389355+0000 mgr.y (mgr.14601) 56 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:11.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:10 smithi049 bash[21434]: cluster 2024-03-11T22:10:09.376706+0000 mgr.y (mgr.14601) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:11.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:10 smithi049 bash[28804]: cluster 2024-03-11T22:10:09.376706+0000 mgr.y (mgr.14601) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:11.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:10 smithi187 bash[23415]: cluster 2024-03-11T22:10:09.376706+0000 mgr.y (mgr.14601) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:13.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:12 smithi187 bash[23415]: cluster 2024-03-11T22:10:11.377450+0000 mgr.y (mgr.14601) 58 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- 172.21.15.49:0/244186600 >> v1:172.21.15.49:6789/0 conn(0x7f79bc10a8f0 legacy=0x7f79bc10cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- 172.21.15.49:0/244186600 shutdown_connections 2024-03-11T22:10:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- 172.21.15.49:0/244186600 >> 172.21.15.49:0/244186600 conn(0x7f79bc0fd550 msgr2=0x7f79bc0ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- 172.21.15.49:0/244186600 shutdown_connections 2024-03-11T22:10:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- 172.21.15.49:0/244186600 wait complete. 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 Processor -- start 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- start start 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f79bc1a8c10 con 0x7f79bc107a40 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f79bc1a9df0 con 0x7f79bc10a8f0 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79c0da5700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f79bc1aaff0 con 0x7f79bc10e4c0 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ba59c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f79bc107a40 0x7f79bc10dd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55420/0 (socket says 172.21.15.49:55420) 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ba59c700 1 -- 172.21.15.49:0/123478288 learned_addr learned my addr 172.21.15.49:0/123478288 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154446648 0 0) 0x7f79bc1a8c10 con 0x7f79bc107a40 2024-03-11T22:10:13.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a40035b0 con 0x7f79bc107a40 2024-03-11T22:10:13.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633406306 0 0) 0x7f79bc1aaff0 con 0x7f79bc10e4c0 2024-03-11T22:10:13.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79bc1a8c10 con 0x7f79bc10e4c0 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 513781568 0 0) 0x7f79a40035b0 con 0x7f79bc107a40 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79bc1aaff0 con 0x7f79bc107a40 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.211+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f79ac0019f0 con 0x7f79bc107a40 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3048972908 0 0) 0x7f79bc1a8c10 con 0x7f79bc10e4c0 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79a40035b0 con 0x7f79bc10e4c0 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788092894 0 0) 0x7f79bc1a9df0 con 0x7f79bc10a8f0 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79bc1a8c10 con 0x7f79bc10a8f0 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f79b4001b30 con 0x7f79bc10e4c0 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3579488770 0 0) 0x7f79bc1aaff0 con 0x7f79bc107a40 2024-03-11T22:10:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 >> v1:172.21.15.49:6790/0 conn(0x7f79bc10e4c0 legacy=0x7f79bc1a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 >> v1:172.21.15.187:6789/0 conn(0x7f79bc10a8f0 legacy=0x7f79bc1a3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc1ac1f0 con 0x7f79bc107a40 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc1ab1e0 con 0x7f79bc107a40 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc1ab660 con 0x7f79bc107a40 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f79ac003b10 con 0x7f79bc107a40 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f79ac005c00 con 0x7f79bc107a40 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c005150 con 0x7f79bc107a40 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f79ac003680 con 0x7f79bc107a40 2024-03-11T22:10:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.215+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f79ac0882b0 con 0x7f79bc107a40 2024-03-11T22:10:13.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.219+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f79ac055780 con 0x7f79bc107a40 2024-03-11T22:10:13.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:12 smithi049 bash[28804]: cluster 2024-03-11T22:10:11.377450+0000 mgr.y (mgr.14601) 58 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:13.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:12 smithi049 bash[21434]: cluster 2024-03-11T22:10:11.377450+0000 mgr.y (mgr.14601) 58 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:13.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.431+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f799c005400 con 0x7f79bc107a40 2024-03-11T22:10:13.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.435+0000 7f79ab7fe700 1 -- 172.21.15.49:0/123478288 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+21098 (unknown 2627823564 0 974086303) 0x7f79ac053af0 con 0x7f79bc107a40 2024-03-11T22:10:13.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:10:13.426 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"fsid":"377df5b0-dff2-11ee-95c8-87774f69a715","created":"2024-03-11T21:57:59.882687+0000","modified":"2024-03-11T22:09:17.326833+0000","last_up_change":"2024-03-11T22:07:36.719734+0000","last_in_change":"2024-03-11T22:07:09.390512+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-11T22:03:15.301419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-03-11T22:08:15.190956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-03-11T22:08:16.820300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-03-11T22:08:18.765172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"datapool","create_time":"2024-03-11T22:08:19.726440+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-03-11T22:08:20.890744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5539a6f5-8ee5-43a7-b42c-83eaad23ebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6801","nonce":1383006495}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6802","nonce":1383006495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6804","nonce":1383006495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6803","nonce":1383006495}]},"public_addr":"172.21.15.49:6801/1383006495","cluster_addr":"172.21.15.49:6802/1383006495","heartbeat_back_addr":"172.21.15.49:6804/1383006495","heartbeat_front_addr":"172.21.15.49:6803/1383006495","state":["exists","up"]},{"osd":1,"uuid":"e57e1dff-7e3e-4924-ae2d-6b921cb9d99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6805","nonce":3491699509}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6806","nonce":3491699509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6808","nonce":3491699509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6807","nonce":3491699509}]},"public_addr":"172.21.15.49:6805/3491699509","cluster_addr":"172.21.15.49:6806/3491699509","heartbeat_back_addr":"172.21.15.49:6808/3491699509","heartbeat_front_addr":"172.21.15.49:6807/3491699509","state":["exists","up"]},{"osd":2,"uuid":"f8230702-b6f3-4390-8902-24cec89cb476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6809","nonce":535303154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6810","nonce":535303154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6812","nonce":535303154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6811","nonce":535303154}]},"public_addr":"172.21.15.49:6809/535303154","cluster_addr":"172.21.15.49:6810/535303154","heartbeat_back_addr":"172.21.15.49:6812/535303154","heartbeat_front_addr":"172.21.15.49:6811/535303154","state":["exists","up"]},{"osd":3,"uuid":"046c12b6-90f4-4c80-9d33-b644551e6649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6813","nonce":4161800259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6814","nonce":4161800259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6816","nonce":4161800259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.49:6815","nonce":4161800259}]},"public_addr":"172.21.15.49:6813/4161800259","cluster_addr":"172.21.15.49:6814/4161800259","heartbeat_back_addr":"172.21.15.49:6816/4161800259","heartbeat_front_addr":"172.21.15.49:6815/4161800259","state":["exists","up"]},{"osd":4,"uuid":"93a8eb6b-fc1f-4ab6-9bd7-82491d65f8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6800","nonce":4268742344}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6801","nonce":4268742344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6803","nonce":4268742344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6802","nonce":4268742344}]},"public_addr":"172.21.15.187:6800/4268742344","cluster_addr":"172.21.15.187:6801/4268742344","heartbeat_back_addr":"172.21.15.187:6803/4268742344","heartbeat_front_addr":"172.21.15.187:6802/4268742344","state":["exists","up"]},{"osd":5,"uuid":"f1cd359e-0186-4ad1-bccb-e71dc10206a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6804","nonce":2249702314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6805","nonce":2249702314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6807","nonce":2249702314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6806","nonce":2249702314}]},"public_addr":"172.21.15.187:6804/2249702314","cluster_addr":"172.21.15.187:6805/2249702314","heartbeat_back_addr":"172.21.15.187:6807/2249702314","heartbeat_front_addr":"172.21.15.187:6806/2249702314","state":["exists","up"]},{"osd":6,"uuid":"742c8fbe-3d0b-4586-aa9a-4bb91082fba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6808","nonce":2887830694}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6809","nonce":2887830694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6811","nonce":2887830694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6810","nonce":2887830694}]},"public_addr":"172.21.15.187:6808/2887830694","cluster_addr":"172.21.15.187:6809/2887830694","heartbeat_back_addr":"172.21.15.187:6811/2887830694","heartbeat_front_addr":"172.21.15.187:6810/2887830694","state":["exists","up"]},{"osd":7,"uuid":"0434ed1b-889d-4e07-bce8-98641881ec0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6812","nonce":3018671607}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6813","nonce":3018671607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6815","nonce":3018671607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6814","nonce":3018671607}]},"public_addr":"172.21.15.187:6812/3018671607","cluster_addr":"172.21.15.187:6813/3018671607","heartbeat_back_addr":"172.21.15.187:6815/3018671607","heartbeat_front_addr":"172.21.15.187:6814/3018671607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:01:30.591418+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:02:20.916346+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:03:12.089410+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:04:04.714425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:04:54.167706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:05:47.502591+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:06:39.482362+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-11T22:07:35.163397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.12","mappings":[{"from":7,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1036465404":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/3770975136":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/1600196633":"2024-03-12T22:09:17.326670+0000","172.21.15.49:6800/4076252288":"2024-03-12T22:09:17.326670+0000","172.21.15.49:6800/2600502005":"2024-03-12T21:59:06.647009+0000","172.21.15.49:6800/653572163":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/1299294381":"2024-03-12T21:59:06.647009+0000","172.21.15.49:0/3331119922":"2024-03-12T21:59:06.647009+0000","172.21.15.49:0/2219357335":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/3658055689":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/358645426":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/3829805881":"2024-03-12T22:09:17.326670+0000","172.21.15.49:0/1446475445":"2024-03-12T21:58:31.634598+0000","172.21.15.49:0/3264123515":"2024-03-12T21:59:06.647009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-11T22:10:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.439+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 >> v1:172.21.15.49:6800/915645872 conn(0x7f79a406e5c0 legacy=0x7f79a4070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.439+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 >> v1:172.21.15.49:6789/0 conn(0x7f79bc107a40 legacy=0x7f79bc10dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.439+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 shutdown_connections 2024-03-11T22:10:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.439+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 >> 172.21.15.49:0/123478288 conn(0x7f79bc0fd550 msgr2=0x7f79bc101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.439+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 shutdown_connections 2024-03-11T22:10:13.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:13.439+0000 7f79c0da5700 1 -- 172.21.15.49:0/123478288 wait complete. 2024-03-11T22:10:13.948 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.948 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.949 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.949 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.949 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.950 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.950 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.951 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:13.951 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-11T22:10:14.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-11T22:10:14.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-11T22:10:14.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-11T22:10:14.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-11T22:10:14.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-11T22:10:14.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-11T22:10:14.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-11T22:10:14.209 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.210 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:13 smithi187 bash[23415]: audit 2024-03-11T22:10:13.436568+0000 mon.a (mon.0) 791 : audit 0 from='client.? v1:172.21.15.49:0/123478288' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:10:14.210 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.210 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.210 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.210 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:13 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.211 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.211 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.211 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.211 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.212 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.212 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.212 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.212 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:10:14.220 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:13 smithi049 bash[28804]: audit 2024-03-11T22:10:13.436568+0000 mon.a (mon.0) 791 : audit 0 from='client.? v1:172.21.15.49:0/123478288' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:10:14.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:13 smithi049 bash[21434]: audit 2024-03-11T22:10:13.436568+0000 mon.a (mon.0) 791 : audit 0 from='client.? v1:172.21.15.49:0/123478288' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-11T22:10:14.487 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:14 smithi187 systemd[1]: Started Ceph grafana.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:10:14.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:10:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:10:15.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: cluster 2024-03-11T22:10:13.378780+0000 mgr.y (mgr.14601) 59 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:15.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: audit 2024-03-11T22:10:14.271206+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: audit 2024-03-11T22:10:14.286116+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: audit 2024-03-11T22:10:14.330721+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: audit 2024-03-11T22:10:14.340084+0000 mon.a (mon.0) 795 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: audit 2024-03-11T22:10:14.444517+0000 mon.c (mon.2) 58 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:10:15.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: audit 2024-03-11T22:10:14.919296+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:14 smithi187 bash[23415]: audit 2024-03-11T22:10:14.932965+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: cluster 2024-03-11T22:10:13.378780+0000 mgr.y (mgr.14601) 59 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: audit 2024-03-11T22:10:14.271206+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: audit 2024-03-11T22:10:14.286116+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: audit 2024-03-11T22:10:14.330721+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: audit 2024-03-11T22:10:14.340084+0000 mon.a (mon.0) 795 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: audit 2024-03-11T22:10:14.444517+0000 mon.c (mon.2) 58 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: audit 2024-03-11T22:10:14.919296+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[21434]: audit 2024-03-11T22:10:14.932965+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: cluster 2024-03-11T22:10:13.378780+0000 mgr.y (mgr.14601) 59 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: audit 2024-03-11T22:10:14.271206+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: audit 2024-03-11T22:10:14.286116+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: audit 2024-03-11T22:10:14.330721+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: audit 2024-03-11T22:10:14.340084+0000 mon.a (mon.0) 795 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: audit 2024-03-11T22:10:14.444517+0000 mon.c (mon.2) 58 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:10:15.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: audit 2024-03-11T22:10:14.919296+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:14 smithi049 bash[28804]: audit 2024-03-11T22:10:14.932965+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580384363Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580614303Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580635274Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580649797Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580657324Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580665785Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580676575Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580683203Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580692242Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580704121Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580713823Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-11T22:10:15.858 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580723475Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580734952Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=settings t=2024-03-11T22:10:15.580745961Z level=info msg="App mode production" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=sqlstore t=2024-03-11T22:10:15.580816166Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=sqlstore t=2024-03-11T22:10:15.580847306Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.581874477Z level=info msg="Starting DB migrations" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.581977235Z level=info msg="Executing migration" id="create migration_log table" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.631555876Z level=info msg="Executing migration" id="create user table" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.665046882Z level=info msg="Executing migration" id="add unique index user.login" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.715512322Z level=info msg="Executing migration" id="add unique index user.email" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.749194697Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.782713424Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.816349946Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-03-11T22:10:15.859 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.866699329Z level=info msg="Executing migration" id="create user table v2" 2024-03-11T22:10:16.109 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.925534139Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-03-11T22:10:16.109 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:15 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:15.975852543Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-03-11T22:10:16.109 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.001314843Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-03-11T22:10:16.109 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.026490428Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-03-11T22:10:16.109 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.051797315Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-03-11T22:10:16.109 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.077119031Z level=info msg="Executing migration" id="Update user table charset" 2024-03-11T22:10:16.110 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.119034092Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.144338558Z level=info msg="Executing migration" id="Add missing user data" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.169838379Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.211819238Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.237085456Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.26231177Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.304491419Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.321579421Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.338412568Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.355323902Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-03-11T22:10:16.363 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.37226274Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.389142426Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.431115742Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.47312687Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.498369289Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.523664708Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.565644014Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.590909375Z level=info msg="Executing migration" id="create temp_user v2" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.616144037Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-03-11T22:10:16.632 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.641421221Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-03-11T22:10:16.884 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.666665132Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-03-11T22:10:16.884 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.708695296Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-03-11T22:10:16.884 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.73402243Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-03-11T22:10:16.884 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.759228938Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-03-11T22:10:16.884 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.801156688Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-03-11T22:10:16.885 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.826427872Z level=info msg="Executing migration" id="create star table" 2024-03-11T22:10:16.885 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.868496537Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-03-11T22:10:16.885 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.893887485Z level=info msg="Executing migration" id="create org table v1" 2024-03-11T22:10:17.137 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[23415]: cluster 2024-03-11T22:10:15.379452+0000 mgr.y (mgr.14601) 60 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:17.137 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:16 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:16.935815185Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-03-11T22:10:17.137 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.005322659Z level=info msg="Executing migration" id="create org_user table v1" 2024-03-11T22:10:17.137 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.045375237Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-03-11T22:10:17.137 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.087317764Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-03-11T22:10:17.137 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.112615201Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-03-11T22:10:17.137 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.12955933Z level=info msg="Executing migration" id="Update org table charset" 2024-03-11T22:10:17.137 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.146515772Z level=info msg="Executing migration" id="Update org_user table charset" 2024-03-11T22:10:17.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:16 smithi049 bash[21434]: cluster 2024-03-11T22:10:15.379452+0000 mgr.y (mgr.14601) 60 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:17.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:16 smithi049 bash[28804]: cluster 2024-03-11T22:10:15.379452+0000 mgr.y (mgr.14601) 60 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:17.389 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.163442404Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-03-11T22:10:17.389 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.188724845Z level=info msg="Executing migration" id="create dashboard table" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.205672486Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.239272331Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.256254426Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.273142462Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.290093393Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.306927673Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.357363525Z level=info msg="Executing migration" id="create dashboard v2" 2024-03-11T22:10:17.390 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.399364815Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-03-11T22:10:17.658 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.424708512Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-03-11T22:10:17.659 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.449911258Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-03-11T22:10:17.659 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.491805693Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-03-11T22:10:17.659 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.517120441Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-03-11T22:10:17.659 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.559105211Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-03-11T22:10:17.659 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.601083145Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-03-11T22:10:17.659 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.643063368Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-03-11T22:10:17.659 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.668376619Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-03-11T22:10:17.944 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.693656183Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-03-11T22:10:17.944 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.735580672Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-03-11T22:10:17.944 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.760879109Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-03-11T22:10:17.944 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.80287814Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-03-11T22:10:17.944 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.845151765Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-03-11T22:10:17.945 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.87043562Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-03-11T22:10:17.945 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.912254388Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-03-11T22:10:17.945 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.954277517Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-03-11T22:10:18.197 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:17 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:17.996343836Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-03-11T22:10:18.197 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.021350575Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-03-11T22:10:18.197 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.046728661Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-03-11T22:10:18.197 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.072049345Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-03-11T22:10:18.197 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.097364008Z level=info msg="Executing migration" id="Update dashboard title length" 2024-03-11T22:10:18.198 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.12255393Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-03-11T22:10:18.198 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.164486474Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-03-11T22:10:18.198 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.189959853Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-03-11T22:10:18.198 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.206825883Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-03-11T22:10:18.449 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:10:18.449 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.223766689Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-03-11T22:10:18.450 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.257437053Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-03-11T22:10:18.450 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.316110698Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-03-11T22:10:18.450 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.349865427Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-03-11T22:10:18.450 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.392132168Z level=info msg="Executing migration" id="Add check_sum column" 2024-03-11T22:10:18.450 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.43411287Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-03-11T22:10:18.450 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.459340546Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-03-11T22:10:18.702 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.484502241Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-03-11T22:10:18.702 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.509802444Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-03-11T22:10:18.702 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.535138358Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-03-11T22:10:18.702 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.59384546Z level=info msg="Executing migration" id="create data_source table" 2024-03-11T22:10:18.702 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.619052851Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-03-11T22:10:18.702 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.64432876Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-03-11T22:10:18.702 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.669645785Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-03-11T22:10:18.703 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.71179757Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-03-11T22:10:18.979 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[23415]: cluster 2024-03-11T22:10:17.380168+0000 mgr.y (mgr.14601) 61 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:18.979 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[23415]: audit 2024-03-11T22:10:17.825637+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:18.979 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[23415]: audit 2024-03-11T22:10:17.871252+0000 mon.c (mon.2) 59 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:18.980 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.753895977Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-03-11T22:10:18.980 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.795923268Z level=info msg="Executing migration" id="create data_source table v2" 2024-03-11T22:10:18.980 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.838025024Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-03-11T22:10:18.980 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.871585944Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-03-11T22:10:18.980 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.905185286Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-03-11T22:10:18.980 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.955536031Z level=info msg="Executing migration" id="Add column with_credentials" 2024-03-11T22:10:18.980 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:18 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:18.989159358Z level=info msg="Executing migration" id="Add secure json data column" 2024-03-11T22:10:19.017 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.017 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.021 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.022 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.023 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:19.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.022787584Z level=info msg="Executing migration" id="Update data_source table charset" 2024-03-11T22:10:19.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.056402368Z level=info msg="Executing migration" id="Update initial version to 1" 2024-03-11T22:10:19.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.090006917Z level=info msg="Executing migration" id="Add read_only data column" 2024-03-11T22:10:19.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.140309441Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-03-11T22:10:19.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.173955603Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-03-11T22:10:19.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.20756973Z level=info msg="Executing migration" id="Add uid column" 2024-03-11T22:10:19.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:18 smithi049 bash[21434]: cluster 2024-03-11T22:10:17.380168+0000 mgr.y (mgr.14601) 61 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:19.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:18 smithi049 bash[21434]: audit 2024-03-11T22:10:17.825637+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:19.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:18 smithi049 bash[21434]: audit 2024-03-11T22:10:17.871252+0000 mon.c (mon.2) 59 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:19.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:18 smithi049 bash[28804]: cluster 2024-03-11T22:10:17.380168+0000 mgr.y (mgr.14601) 61 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:19.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:18 smithi049 bash[28804]: audit 2024-03-11T22:10:17.825637+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:19.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:18 smithi049 bash[28804]: audit 2024-03-11T22:10:17.871252+0000 mon.c (mon.2) 59 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:19.501 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.257893696Z level=info msg="Executing migration" id="Update uid value" 2024-03-11T22:10:19.502 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.28315148Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-03-11T22:10:19.502 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.325164855Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-03-11T22:10:19.502 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.350493395Z level=info msg="Executing migration" id="create api_key table" 2024-03-11T22:10:19.502 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.392469717Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-03-11T22:10:19.502 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.417775083Z level=info msg="Executing migration" id="add index api_key.key" 2024-03-11T22:10:19.502 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.459913344Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-03-11T22:10:19.503 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.485274205Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-03-11T22:10:19.503 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.510356694Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-03-11T22:10:19.753 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.535668831Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-03-11T22:10:19.753 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.577651234Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-03-11T22:10:19.753 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.619651913Z level=info msg="Executing migration" id="create api_key table v2" 2024-03-11T22:10:19.753 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.670281771Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-03-11T22:10:19.753 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.695530504Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-03-11T22:10:19.753 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.721223211Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-03-11T22:10:19.753 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.762736748Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-03-11T22:10:20.039 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[23415]: audit 2024-03-11T22:10:18.398114+0000 mgr.y (mgr.14601) 62 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:20.039 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[23415]: audit 2024-03-11T22:10:19.644505+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:20.039 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[23415]: audit 2024-03-11T22:10:19.651427+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:20.039 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.787966528Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-03-11T22:10:20.039 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.871928259Z level=info msg="Executing migration" id="Update api_key table charset" 2024-03-11T22:10:20.039 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.905694542Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-03-11T22:10:20.039 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.922613031Z level=info msg="Executing migration" id="Add service account foreign key" 2024-03-11T22:10:20.039 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.95633121Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-03-11T22:10:20.039 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.97322079Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-03-11T22:10:20.039 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:19 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:19.998314241Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-03-11T22:10:20.040 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.049004644Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-03-11T22:10:20.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:19 smithi049 bash[21434]: audit 2024-03-11T22:10:18.398114+0000 mgr.y (mgr.14601) 62 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:20.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:19 smithi049 bash[21434]: audit 2024-03-11T22:10:19.644505+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:20.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:19 smithi049 bash[21434]: audit 2024-03-11T22:10:19.651427+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:20.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:19 smithi049 bash[28804]: audit 2024-03-11T22:10:18.398114+0000 mgr.y (mgr.14601) 62 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:20.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:19 smithi049 bash[28804]: audit 2024-03-11T22:10:19.644505+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:20.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:19 smithi049 bash[28804]: audit 2024-03-11T22:10:19.651427+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:20.289 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.207703242Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-03-11T22:10:20.558 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.299847416Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-03-11T22:10:20.559 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.400357288Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-03-11T22:10:20.559 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.425693584Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-03-11T22:10:20.559 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.451065513Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-03-11T22:10:20.559 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.476294864Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-03-11T22:10:20.559 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.501487472Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-03-11T22:10:20.559 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.52672074Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-03-11T22:10:20.559 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.568797558Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-03-11T22:10:20.819 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.594277859Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-03-11T22:10:20.819 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.619492489Z level=info msg="Executing migration" id="create quota table v1" 2024-03-11T22:10:20.819 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.661891185Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-03-11T22:10:20.819 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.704065859Z level=info msg="Executing migration" id="Update quota table charset" 2024-03-11T22:10:20.819 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.746135911Z level=info msg="Executing migration" id="create plugin_setting table" 2024-03-11T22:10:20.819 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.788371179Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[23415]: cluster 2024-03-11T22:10:19.381013+0000 mgr.y (mgr.14601) 63 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.830526674Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.872687607Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.897988387Z level=info msg="Executing migration" id="create session table" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.939860474Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.956890929Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:20 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:20.973769622Z level=info msg="Executing migration" id="create playlist table v2" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.007656673Z level=info msg="Executing migration" id="create playlist item table v2" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.024660169Z level=info msg="Executing migration" id="Update playlist table charset" 2024-03-11T22:10:21.082 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.041292854Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-03-11T22:10:21.083 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.06658946Z level=info msg="Executing migration" id="drop preferences table v2" 2024-03-11T22:10:21.083 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.091814806Z level=info msg="Executing migration" id="drop preferences table v3" 2024-03-11T22:10:21.114 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:20 smithi049 bash[21434]: cluster 2024-03-11T22:10:19.381013+0000 mgr.y (mgr.14601) 63 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:21.114 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:20 smithi049 bash[28804]: cluster 2024-03-11T22:10:19.381013+0000 mgr.y (mgr.14601) 63 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:21.335 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.117283235Z level=info msg="Executing migration" id="create preferences table v3" 2024-03-11T22:10:21.335 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.142363217Z level=info msg="Executing migration" id="Update preferences table charset" 2024-03-11T22:10:21.335 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.184523272Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-03-11T22:10:21.335 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.226659856Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-03-11T22:10:21.335 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.251931877Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-03-11T22:10:21.335 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.277214181Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-03-11T22:10:21.335 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.319189597Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-03-11T22:10:21.587 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.344508481Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-03-11T22:10:21.587 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.386562772Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-03-11T22:10:21.587 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.41223523Z level=info msg="Executing migration" id="create alert table v1" 2024-03-11T22:10:21.588 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.454071235Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-03-11T22:10:21.588 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.479487977Z level=info msg="Executing migration" id="add index alert state" 2024-03-11T22:10:21.588 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.504734822Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-03-11T22:10:21.588 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.530030037Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-03-11T22:10:21.588 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.571943653Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-03-11T22:10:21.588 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.597181952Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-03-11T22:10:21.839 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.63918849Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-03-11T22:10:21.840 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.689594918Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-03-11T22:10:21.840 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.731477869Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-03-11T22:10:21.840 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.756933327Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-03-11T22:10:21.840 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.798806931Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-03-11T22:10:21.840 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.824112435Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.849418352Z level=info msg="Executing migration" id="Add column is_default" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.874629699Z level=info msg="Executing migration" id="Add column frequency" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.899948542Z level=info msg="Executing migration" id="Add column send_reminder" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.925164711Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:21.967195399Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.009335032Z level=info msg="Executing migration" id="Update alert table charset" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.034619121Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.059886576Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.085073679Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-03-11T22:10:22.101 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.110429534Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: audit 2024-03-11T22:10:20.984327+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: audit 2024-03-11T22:10:20.991403+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: audit 2024-03-11T22:10:20.993212+0000 mon.c (mon.2) 60 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: audit 2024-03-11T22:10:20.994076+0000 mon.c (mon.2) 61 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: audit 2024-03-11T22:10:20.999942+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: cephadm 2024-03-11T22:10:21.053517+0000 mgr.y (mgr.14601) 64 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: cephadm 2024-03-11T22:10:21.057579+0000 mgr.y (mgr.14601) 65 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi049 2024-03-11T22:10:22.102 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:21 smithi187 bash[23415]: cluster 2024-03-11T22:10:21.381643+0000 mgr.y (mgr.14601) 66 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:22.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: audit 2024-03-11T22:10:20.984327+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: audit 2024-03-11T22:10:20.991403+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: audit 2024-03-11T22:10:20.993212+0000 mon.c (mon.2) 60 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: audit 2024-03-11T22:10:20.994076+0000 mon.c (mon.2) 61 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: audit 2024-03-11T22:10:20.999942+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: cephadm 2024-03-11T22:10:21.053517+0000 mgr.y (mgr.14601) 64 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: cephadm 2024-03-11T22:10:21.057579+0000 mgr.y (mgr.14601) 65 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi049 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[21434]: cluster 2024-03-11T22:10:21.381643+0000 mgr.y (mgr.14601) 66 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: audit 2024-03-11T22:10:20.984327+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: audit 2024-03-11T22:10:20.991403+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: audit 2024-03-11T22:10:20.993212+0000 mon.c (mon.2) 60 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:10:22.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: audit 2024-03-11T22:10:20.994076+0000 mon.c (mon.2) 61 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:10:22.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: audit 2024-03-11T22:10:20.999942+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:22.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: cephadm 2024-03-11T22:10:21.053517+0000 mgr.y (mgr.14601) 64 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-03-11T22:10:22.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: cephadm 2024-03-11T22:10:21.057579+0000 mgr.y (mgr.14601) 65 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi049 2024-03-11T22:10:22.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:21 smithi049 bash[28804]: cluster 2024-03-11T22:10:21.381643+0000 mgr.y (mgr.14601) 66 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:22.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.185706046Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-03-11T22:10:22.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.210971661Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-03-11T22:10:22.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.236332422Z level=info msg="Executing migration" id="Add for to alert table" 2024-03-11T22:10:22.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.261534435Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-03-11T22:10:22.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.312143779Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-03-11T22:10:22.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.337442097Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-03-11T22:10:22.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.379609761Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-03-11T22:10:22.622 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.421587497Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-03-11T22:10:22.622 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.446816127Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-03-11T22:10:22.623 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.472087975Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-03-11T22:10:22.623 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.497390947Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-03-11T22:10:22.623 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.522643989Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-03-11T22:10:22.623 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.564571797Z level=info msg="Executing migration" id="create annotation table v5" 2024-03-11T22:10:22.623 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.606684195Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-03-11T22:10:22.623 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.631918008Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-03-11T22:10:22.875 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.657202756Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-03-11T22:10:22.875 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.682342841Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-03-11T22:10:22.875 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.724358197Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-03-11T22:10:22.875 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.741399263Z level=info msg="Executing migration" id="Update annotation table charset" 2024-03-11T22:10:22.876 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.75815543Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-03-11T22:10:22.876 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.775161881Z level=info msg="Executing migration" id="Drop category_id index" 2024-03-11T22:10:22.876 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.792134751Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-03-11T22:10:22.876 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.809012293Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-03-11T22:10:22.876 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.842705235Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-03-11T22:10:22.876 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.859641856Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-03-11T22:10:22.876 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.884884875Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-03-11T22:10:23.144 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.918504738Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-03-11T22:10:23.144 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:22 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:22.960468491Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-03-11T22:10:23.144 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.002485908Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-03-11T22:10:23.144 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.02782124Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-03-11T22:10:23.145 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.053069046Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-03-11T22:10:23.145 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.078315659Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-03-11T22:10:23.145 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.103610415Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-03-11T22:10:23.145 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.15399557Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-03-11T22:10:23.413 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.179391505Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-03-11T22:10:23.414 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.2047287Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-03-11T22:10:23.414 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.246670602Z level=info msg="Executing migration" id="Add epoch_end column" 2024-03-11T22:10:23.414 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.271979364Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-03-11T22:10:23.414 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.313921537Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-03-11T22:10:23.414 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.339156023Z level=info msg="Executing migration" id="Move region to single row" 2024-03-11T22:10:23.414 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.381303508Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-03-11T22:10:23.414 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.423233027Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-03-11T22:10:23.666 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.465272885Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-03-11T22:10:23.666 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.490559914Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-03-11T22:10:23.666 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.515763581Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-03-11T22:10:23.666 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.557775432Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-03-11T22:10:23.666 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.583041942Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-03-11T22:10:23.667 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.608250326Z level=info msg="Executing migration" id="create test_data table" 2024-03-11T22:10:23.667 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.633673179Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-03-11T22:10:23.667 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.675595292Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-03-11T22:10:23.951 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.700888927Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-03-11T22:10:23.951 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.742819197Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-03-11T22:10:23.952 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.776479043Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-03-11T22:10:23.952 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.82676665Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-03-11T22:10:23.952 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.860344558Z level=info msg="Executing migration" id="create team table" 2024-03-11T22:10:23.952 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.910671787Z level=info msg="Executing migration" id="add index team.org_id" 2024-03-11T22:10:23.952 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:23 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:23.961130194Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-03-11T22:10:24.204 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.011475645Z level=info msg="Executing migration" id="create team member table" 2024-03-11T22:10:24.204 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.053569937Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-03-11T22:10:24.204 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.095896667Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-03-11T22:10:24.204 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.121177694Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-03-11T22:10:24.204 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.146429121Z level=info msg="Executing migration" id="Add column email to team table" 2024-03-11T22:10:24.204 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.171680492Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-03-11T22:10:24.204 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.213665758Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-03-11T22:10:24.482 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[23415]: cluster 2024-03-11T22:10:23.382984+0000 mgr.y (mgr.14601) 67 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:24.482 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.239014144Z level=info msg="Executing migration" id="create dashboard acl table" 2024-03-11T22:10:24.482 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.280847475Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-03-11T22:10:24.482 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.32311771Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-03-11T22:10:24.482 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.340162067Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-03-11T22:10:24.482 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.36549403Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-03-11T22:10:24.482 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.39081886Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-03-11T22:10:24.483 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.416029817Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-03-11T22:10:24.483 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.458090536Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-03-11T22:10:24.483 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.491761656Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-03-11T22:10:24.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:24 smithi049 bash[21434]: cluster 2024-03-11T22:10:23.382984+0000 mgr.y (mgr.14601) 67 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:24.516 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:24 smithi049 bash[28804]: cluster 2024-03-11T22:10:23.382984+0000 mgr.y (mgr.14601) 67 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:24.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:10:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:10:24.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.525354942Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-03-11T22:10:24.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.575646973Z level=info msg="Executing migration" id="create tag table" 2024-03-11T22:10:24.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.609342567Z level=info msg="Executing migration" id="add index tag.key_value" 2024-03-11T22:10:24.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.642937276Z level=info msg="Executing migration" id="create login attempt table" 2024-03-11T22:10:24.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.676587307Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-03-11T22:10:24.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.726975626Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-03-11T22:10:25.020 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.768960652Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-03-11T22:10:25.020 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.81928307Z level=info msg="Executing migration" id="create login_attempt v2" 2024-03-11T22:10:25.020 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.844536081Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-03-11T22:10:25.020 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.869851697Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-03-11T22:10:25.020 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:24 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:24.911845133Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-03-11T22:10:25.020 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.004385923Z level=info msg="Executing migration" id="create user auth table" 2024-03-11T22:10:25.020 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.029730566Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-03-11T22:10:25.297 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.055018427Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-03-11T22:10:25.297 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.080214782Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-03-11T22:10:25.297 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.105540169Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-03-11T22:10:25.297 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.14744998Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-03-11T22:10:25.297 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.172779801Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-03-11T22:10:25.297 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.264908827Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-03-11T22:10:25.297 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.306863055Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-03-11T22:10:25.549 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.332155619Z level=info msg="Executing migration" id="create server_lock table" 2024-03-11T22:10:25.606 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.37409008Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-03-11T22:10:25.606 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.399508456Z level=info msg="Executing migration" id="create user auth token table" 2024-03-11T22:10:25.607 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.424661058Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-03-11T22:10:25.607 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.466682405Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-03-11T22:10:25.607 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.491927493Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-03-11T22:10:25.607 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.517159049Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-03-11T22:10:25.607 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.559089913Z level=info msg="Executing migration" id="create cache_data table" 2024-03-11T22:10:25.827 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.5844291Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-03-11T22:10:25.827 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.609717437Z level=info msg="Executing migration" id="create short_url table v1" 2024-03-11T22:10:25.827 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.634939399Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-03-11T22:10:25.827 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.660225074Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-03-11T22:10:25.827 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.702065599Z level=info msg="Executing migration" id="delete alert_definition table" 2024-03-11T22:10:25.827 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.744211018Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-03-11T22:10:25.827 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.769549231Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-03-11T22:10:25.828 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.794734534Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-03-11T22:10:25.828 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.83674903Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.878657966Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.904288898Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:25 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:25.929745222Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.013277501Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.030122046Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.06392635Z level=info msg="Executing migration" id="drop alert_definition table" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.08085681Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-03-11T22:10:26.105 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.114452473Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-03-11T22:10:26.357 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.139780951Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-03-11T22:10:26.357 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.16503889Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-03-11T22:10:26.358 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.190175844Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-03-11T22:10:26.358 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.215437112Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-03-11T22:10:26.358 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.240805646Z level=info msg="Executing migration" id="create alert_instance table" 2024-03-11T22:10:26.358 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.282725512Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-03-11T22:10:26.358 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.324783913Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-03-11T22:10:26.358 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.367005148Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-03-11T22:10:26.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[23415]: cluster 2024-03-11T22:10:25.383647+0000 mgr.y (mgr.14601) 68 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:26.609 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.39224186Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-03-11T22:10:26.609 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.43414948Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-03-11T22:10:26.610 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.476356745Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-03-11T22:10:26.610 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.518236962Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-03-11T22:10:26.610 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.576897401Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-03-11T22:10:26.610 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.602053188Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-03-11T22:10:26.610 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.619060613Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-03-11T22:10:26.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:26 smithi049 bash[28804]: cluster 2024-03-11T22:10:25.383647+0000 mgr.y (mgr.14601) 68 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:26.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:26 smithi049 bash[21434]: cluster 2024-03-11T22:10:25.383647+0000 mgr.y (mgr.14601) 68 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:26.862 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.644422644Z level=info msg="Executing migration" id="create alert_rule table" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.661303778Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.686507777Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.703477897Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.728781175Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.754278973Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.796252485Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.821581916Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.846858891Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-03-11T22:10:26.863 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.872111556Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.897323429Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.939285951Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:26 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:26.964701908Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.006615167Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.031947999Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.057183189Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.099212325Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-03-11T22:10:27.115 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.124583889Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.149848715Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.183499999Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.20868474Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.250701663Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.276005851Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.301220145Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.326495511Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.351727561Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-03-11T22:10:27.384 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.393675988Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.418989669Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.46094516Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.486114414Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.511554171Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.536771004Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.570313717Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.587331162Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.604528622Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.629773521Z level=info msg="Executing migration" id="create provenance_type table" 2024-03-11T22:10:27.637 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.646627763Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-03-11T22:10:27.914 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.672004631Z level=info msg="Executing migration" id="create alert_image table" 2024-03-11T22:10:27.914 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.713893612Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-03-11T22:10:27.914 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.739230437Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-03-11T22:10:27.915 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.764422214Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-03-11T22:10:27.915 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.789776322Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-03-11T22:10:27.915 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.840048476Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-03-11T22:10:27.915 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.840391506Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-03-11T22:10:27.915 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.873725949Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-03-11T22:10:27.915 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.924050505Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-03-11T22:10:28.166 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.97434624Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-03-11T22:10:28.166 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.974875488Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-03-11T22:10:28.166 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:27 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:27.975308195Z level=info msg="alerts found to migrate" alerts=0 2024-03-11T22:10:28.166 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.008051957Z level=info msg="Executing migration" id="create library_element table v1" 2024-03-11T22:10:28.167 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.058339331Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-03-11T22:10:28.167 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.108736997Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-03-11T22:10:28.167 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.142291023Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-03-11T22:10:28.167 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.176001738Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-03-11T22:10:28.434 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:10:28.434 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.209656513Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-03-11T22:10:28.434 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.259871398Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-03-11T22:10:28.434 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.285217807Z level=info msg="Executing migration" id="create data_keys table" 2024-03-11T22:10:28.434 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.327256744Z level=info msg="Executing migration" id="create secrets table" 2024-03-11T22:10:28.435 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.369387363Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-03-11T22:10:28.435 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.41983938Z level=info msg="Executing migration" id="add name column into data_keys" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[23415]: cluster 2024-03-11T22:10:27.384321+0000 mgr.y (mgr.14601) 69 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.46198902Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.48722657Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.529504367Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.571474854Z level=info msg="Executing migration" id="create kv_store table v1" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.596769601Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.621947742Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.647274188Z level=info msg="Executing migration" id="create permission table" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.672577928Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-03-11T22:10:28.705 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.714629584Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-03-11T22:10:28.812 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:28 smithi049 bash[21434]: cluster 2024-03-11T22:10:27.384321+0000 mgr.y (mgr.14601) 69 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:28.813 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:28 smithi049 bash[28804]: cluster 2024-03-11T22:10:27.384321+0000 mgr.y (mgr.14601) 69 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:28.957 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.739951287Z level=info msg="Executing migration" id="create role table" 2024-03-11T22:10:28.957 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.781819206Z level=info msg="Executing migration" id="add column display_name" 2024-03-11T22:10:28.957 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.807126282Z level=info msg="Executing migration" id="add column group_name" 2024-03-11T22:10:28.957 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.8491225Z level=info msg="Executing migration" id="add index role.org_id" 2024-03-11T22:10:28.957 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.874330034Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-03-11T22:10:28.958 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.899645174Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-03-11T22:10:28.958 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.941619715Z level=info msg="Executing migration" id="create team role table" 2024-03-11T22:10:28.958 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:28 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:28.966894766Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.00883187Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.034093457Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.059382715Z level=info msg="Executing migration" id="create user role table" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.084669595Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.126597039Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.151871526Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.177167553Z level=info msg="Executing migration" id="create builtin role table" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.202323023Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-03-11T22:10:29.235 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.244280509Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-03-11T22:10:29.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[23415]: audit 2024-03-11T22:10:28.404402+0000 mgr.y (mgr.14601) 70 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:29.487 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.269667504Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-03-11T22:10:29.487 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.294931348Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-03-11T22:10:29.487 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.320262894Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-03-11T22:10:29.488 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.362034424Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-03-11T22:10:29.488 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.387554134Z level=info msg="Executing migration" id="add unique index role.uid" 2024-03-11T22:10:29.488 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.412964882Z level=info msg="Executing migration" id="create seed assignment table" 2024-03-11T22:10:29.488 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.438292176Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-03-11T22:10:29.488 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.480467942Z level=info msg="Executing migration" id="add column hidden to role table" 2024-03-11T22:10:29.660 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:29 smithi049 bash[21434]: audit 2024-03-11T22:10:28.404402+0000 mgr.y (mgr.14601) 70 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:29.661 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:29 smithi049 bash[28804]: audit 2024-03-11T22:10:28.404402+0000 mgr.y (mgr.14601) 70 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.522379028Z level=info msg="Executing migration" id="create query_history table v1" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.564517182Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.589800663Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.615001335Z level=info msg="Executing migration" id="teams permissions migration" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.648657284Z level=info msg="Executing migration" id="dashboard permissions" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.682147356Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.732523897Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.766114017Z level=info msg="Executing migration" id="alerting notification permissions" 2024-03-11T22:10:29.832 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.841577372Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-03-11T22:10:30.117 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.875208495Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-03-11T22:10:30.117 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.925606589Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-03-11T22:10:30.118 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:29 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:29.967520635Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-03-11T22:10:30.118 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.009629489Z level=info msg="Executing migration" id="create correlation table v1" 2024-03-11T22:10:30.118 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.051652123Z level=info msg="Executing migration" id="add index correlations.uid" 2024-03-11T22:10:30.118 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.127080723Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-03-11T22:10:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- 172.21.15.49:0/3918245753 >> v1:172.21.15.49:6789/0 conn(0x7f2b7c10e500 legacy=0x7f2b7c110990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- 172.21.15.49:0/3918245753 shutdown_connections 2024-03-11T22:10:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- 172.21.15.49:0/3918245753 >> 172.21.15.49:0/3918245753 conn(0x7f2b7c0fc410 msgr2=0x7f2b7c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- 172.21.15.49:0/3918245753 shutdown_connections 2024-03-11T22:10:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- 172.21.15.49:0/3918245753 wait complete. 2024-03-11T22:10:30.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 Processor -- start 2024-03-11T22:10:30.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- start start 2024-03-11T22:10:30.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2b7c1a68d0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2b7c1a7ab0 con 0x7f2b7c10e500 2024-03-11T22:10:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b8203c700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2b7c1a8cb0 con 0x7f2b7c102be0 2024-03-11T22:10:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.215+0000 7f2b7affd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2b7c10a9f0 0x7f2b7c1a1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34722/0 (socket says 172.21.15.49:34722) 2024-03-11T22:10:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b7affd700 1 -- 172.21.15.49:0/645975429 learned_addr learned my addr 172.21.15.49:0/645975429 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69035852 0 0) 0x7f2b7c1a68d0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b680035b0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322710174 0 0) 0x7f2b7c1a8cb0 con 0x7f2b7c102be0 2024-03-11T22:10:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b7c1a68d0 con 0x7f2b7c102be0 2024-03-11T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1343233280 0 0) 0x7f2b680035b0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b7c1a8cb0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2b64001930 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 956268846 0 0) 0x7f2b7c1a68d0 con 0x7f2b7c102be0 2024-03-11T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b680035b0 con 0x7f2b7c102be0 2024-03-11T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2b6c001040 con 0x7f2b7c102be0 2024-03-11T22:10:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554375719 0 0) 0x7f2b7c1a7ab0 con 0x7f2b7c10e500 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b7c1a68d0 con 0x7f2b7c10e500 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3495698820 0 0) 0x7f2b7c1a8cb0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 >> v1:172.21.15.49:6790/0 conn(0x7f2b7c102be0 legacy=0x7f2b7c10a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 >> v1:172.21.15.187:6789/0 conn(0x7f2b7c10e500 legacy=0x7f2b7c1a4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c1a9eb0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c1a8ea0 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c1a9320 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f2b64003b30 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2b64005c90 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.49:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b5c000f80 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f2b64003680 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f2b64088460 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.187:6808/2887830694 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b6807cc40 con 0x7f2b68078f30 2024-03-11T22:10:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.219+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f2b64088800 con 0x7f2b7c10a9f0 2024-03-11T22:10:30.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.223+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== osd.6 v1:172.21.15.187:6808/2887830694 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f2b6807cc40 con 0x7f2b68078f30 2024-03-11T22:10:30.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.239+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 --> v1:172.21.15.187:6808/2887830694 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b5c002c40 con 0x7f2b68078f30 2024-03-11T22:10:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.239+0000 7f2b78ff9700 1 -- 172.21.15.49:0/645975429 <== osd.6 v1:172.21.15.187:6808/2887830694 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 64834654) 0x7f2b5c002c40 con 0x7f2b68078f30 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 >> v1:172.21.15.187:6808/2887830694 conn(0x7f2b68078f30 legacy=0x7f2b6807b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 >> v1:172.21.15.49:6800/915645872 conn(0x7f2b6806e650 legacy=0x7f2b68070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 >> v1:172.21.15.49:6789/0 conn(0x7f2b7c10a9f0 legacy=0x7f2b7c1a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b7bfff700 1 -- 172.21.15.49:0/645975429 reap_dead start 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 shutdown_connections 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 >> 172.21.15.49:0/645975429 conn(0x7f2b7c0fc410 msgr2=0x7f2b7c110950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 shutdown_connections 2024-03-11T22:10:30.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.243+0000 7f2b8203c700 1 -- 172.21.15.49:0/645975429 wait complete. 2024-03-11T22:10:30.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.160878435Z level=info msg="Executing migration" id="add correlation config column" 2024-03-11T22:10:30.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.194531532Z level=info msg="Executing migration" id="create entity_events table" 2024-03-11T22:10:30.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.245024805Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-03-11T22:10:30.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.295460363Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-11T22:10:30.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.295871987Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-11T22:10:30.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.337450487Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-11T22:10:30.370 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.337782359Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-11T22:10:30.371 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.379763082Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-03-11T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- 172.21.15.49:0/533955677 >> v1:172.21.15.49:6789/0 conn(0x7f42a010a980 legacy=0x7f42a010cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- 172.21.15.49:0/533955677 shutdown_connections 2024-03-11T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- 172.21.15.49:0/533955677 >> 172.21.15.49:0/533955677 conn(0x7f42a0075c10 msgr2=0x7f42a0076020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- 172.21.15.49:0/533955677 shutdown_connections 2024-03-11T22:10:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- 172.21.15.49:0/533955677 wait complete. 2024-03-11T22:10:30.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 Processor -- start 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- start start 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f42a01a8aa0 con 0x7f42a010e4f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f42a01a9c40 con 0x7f42a010a980 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f42a5b33700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f42a01aae40 con 0x7f42a01004f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f429f7fe700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f42a01004f0 0x7f42a0106d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:43166/0 (socket says 172.21.15.49:43166) 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.631+0000 7f429f7fe700 1 -- 172.21.15.49:0/1292456103 learned_addr learned my addr 172.21.15.49:0/1292456103 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242748601 0 0) 0x7f42a01aae40 con 0x7f42a01004f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42880035b0 con 0x7f42a01004f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210370805 0 0) 0x7f42a01a8aa0 con 0x7f42a010e4f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a01aae40 con 0x7f42a010e4f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 254266211 0 0) 0x7f42880035b0 con 0x7f42a01004f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f42a01a8aa0 con 0x7f42a01004f0 2024-03-11T22:10:30.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f42900017f0 con 0x7f42a01004f0 2024-03-11T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1273122400 0 0) 0x7f42a01aae40 con 0x7f42a010e4f0 2024-03-11T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f42880035b0 con 0x7f42a010e4f0 2024-03-11T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4298001ca0 con 0x7f42a010e4f0 2024-03-11T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4159028171 0 0) 0x7f42a01a8aa0 con 0x7f42a01004f0 2024-03-11T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 >> v1:172.21.15.187:6789/0 conn(0x7f42a010a980 legacy=0x7f42a01a3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 >> v1:172.21.15.49:6789/0 conn(0x7f42a010e4f0 legacy=0x7f42a01a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a01ac040 con 0x7f42a01004f0 2024-03-11T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a01a8c90 con 0x7f42a01004f0 2024-03-11T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a01a9110 con 0x7f42a01004f0 2024-03-11T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f4290001d80 con 0x7f42a01004f0 2024-03-11T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4290005ba0 con 0x7f42a01004f0 2024-03-11T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f428c000f80 con 0x7f42a01004f0 2024-03-11T22:10:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.635+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f4290004990 con 0x7f42a01004f0 2024-03-11T22:10:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.639+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f4290088310 con 0x7f42a01004f0 2024-03-11T22:10:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.639+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6809/535303154 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f428807ca00 con 0x7f4288078cf0 2024-03-11T22:10:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.639+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f42900886b0 con 0x7f42a01004f0 2024-03-11T22:10:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.639+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== osd.2 v1:172.21.15.49:6809/535303154 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f428807ca00 con 0x7f4288078cf0 2024-03-11T22:10:30.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 --> v1:172.21.15.49:6809/535303154 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f428c002c40 con 0x7f4288078cf0 2024-03-11T22:10:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f429cff9700 1 -- 172.21.15.49:0/1292456103 <== osd.2 v1:172.21.15.49:6809/535303154 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2658584461) 0x7f428c002c40 con 0x7f4288078cf0 2024-03-11T22:10:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 >> v1:172.21.15.49:6809/535303154 conn(0x7f4288078cf0 legacy=0x7f428807b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 >> v1:172.21.15.49:6800/915645872 conn(0x7f428806e480 legacy=0x7f4288070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 >> v1:172.21.15.49:6790/0 conn(0x7f42a01004f0 legacy=0x7f42a0106d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f429ffff700 1 -- 172.21.15.49:0/1292456103 reap_dead start 2024-03-11T22:10:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 shutdown_connections 2024-03-11T22:10:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 >> 172.21.15.49:0/1292456103 conn(0x7f42a0075c10 msgr2=0x7f42a0111ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 shutdown_connections 2024-03-11T22:10:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.659+0000 7f42a5b33700 1 -- 172.21.15.49:0/1292456103 wait complete. 2024-03-11T22:10:30.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:30 smithi049 bash[21434]: cluster 2024-03-11T22:10:29.385604+0000 mgr.y (mgr.14601) 71 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:30.691 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:30 smithi049 bash[28804]: cluster 2024-03-11T22:10:29.385604+0000 mgr.y (mgr.14601) 71 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:30.697 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[23415]: cluster 2024-03-11T22:10:29.385604+0000 mgr.y (mgr.14601) 71 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:30.697 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.43018209Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-03-11T22:10:30.697 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.472336381Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-03-11T22:10:30.697 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.514311765Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-11T22:10:30.697 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.556312612Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-03-11T22:10:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- 172.21.15.49:0/1452347957 >> v1:172.21.15.49:6789/0 conn(0x7fe8b41106a0 legacy=0x7fe8b4112b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- 172.21.15.49:0/1452347957 shutdown_connections 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- 172.21.15.49:0/1452347957 >> 172.21.15.49:0/1452347957 conn(0x7fe8b40ff700 msgr2=0x7fe8b4101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- 172.21.15.49:0/1452347957 shutdown_connections 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- 172.21.15.49:0/1452347957 wait complete. 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 Processor -- start 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- start start 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe8b41a8b00 con 0x7fe8b4103e70 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe8b41a9ce0 con 0x7fe8b41106a0 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8bb946700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe8b41aaee0 con 0x7fe8b410cb00 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8b96e2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe8b4103e70 0x7fe8b41090a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34764/0 (socket says 172.21.15.49:34764) 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8b96e2700 1 -- 172.21.15.49:0/1501189884 learned_addr learned my addr 172.21.15.49:0/1501189884 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583023704 0 0) 0x7fe8b41aaee0 con 0x7fe8b410cb00 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a00035b0 con 0x7fe8b410cb00 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128571880 0 0) 0x7fe8b41a8b00 con 0x7fe8b4103e70 2024-03-11T22:10:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.771+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b41aaee0 con 0x7fe8b4103e70 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4032241212 0 0) 0x7fe8a00035b0 con 0x7fe8b410cb00 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8b41a8b00 con 0x7fe8b410cb00 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1166469418 0 0) 0x7fe8b41aaee0 con 0x7fe8b4103e70 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8a00035b0 con 0x7fe8b4103e70 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fe8b00019f0 con 0x7fe8b4103e70 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fe8a40018d0 con 0x7fe8b410cb00 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157848065 0 0) 0x7fe8b41a9ce0 con 0x7fe8b41106a0 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b41aaee0 con 0x7fe8b41106a0 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 525270269 0 0) 0x7fe8b41a8b00 con 0x7fe8b410cb00 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 >> v1:172.21.15.187:6789/0 conn(0x7fe8b41106a0 legacy=0x7fe8b41a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 >> v1:172.21.15.49:6789/0 conn(0x7fe8b4103e70 legacy=0x7fe8b41090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b41ac0e0 con 0x7fe8b410cb00 2024-03-11T22:10:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b41a8cf0 con 0x7fe8b410cb00 2024-03-11T22:10:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b41a9170 con 0x7fe8b410cb00 2024-03-11T22:10:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fe8a4003b10 con 0x7fe8b410cb00 2024-03-11T22:10:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fe8a40049c0 con 0x7fe8b410cb00 2024-03-11T22:10:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe898000f80 con 0x7fe8b410cb00 2024-03-11T22:10:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fe8a4003680 con 0x7fe8b410cb00 2024-03-11T22:10:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fe8a40871c0 con 0x7fe8b410cb00 2024-03-11T22:10:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6801/1383006495 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8a007ca10 con 0x7fe8a0078d00 2024-03-11T22:10:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7fe8a4087560 con 0x7fe8b410cb00 2024-03-11T22:10:30.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.775+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== osd.0 v1:172.21.15.49:6801/1383006495 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe8ac008e90 con 0x7fe8a0078d00 2024-03-11T22:10:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 --> v1:172.21.15.49:6801/1383006495 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe898002c40 con 0x7fe8a0078d00 2024-03-11T22:10:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8aa7fc700 1 -- 172.21.15.49:0/1501189884 <== osd.0 v1:172.21.15.49:6801/1383006495 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 208011218) 0x7fe898002c40 con 0x7fe8a0078d00 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 >> v1:172.21.15.49:6801/1383006495 conn(0x7fe8a0078d00 legacy=0x7fe8a007b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 >> v1:172.21.15.49:6800/915645872 conn(0x7fe8a006e5a0 legacy=0x7fe8a0070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 >> v1:172.21.15.49:6790/0 conn(0x7fe8b410cb00 legacy=0x7fe8b41a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8b9ee3700 1 -- 172.21.15.49:0/1501189884 reap_dead start 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 shutdown_connections 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 >> 172.21.15.49:0/1501189884 conn(0x7fe8b40ff700 msgr2=0x7fe8b4113310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 shutdown_connections 2024-03-11T22:10:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:30.795+0000 7fe8bb946700 1 -- 172.21.15.49:0/1501189884 wait complete. 2024-03-11T22:10:30.965 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.706908747Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-11T22:10:30.965 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.749071181Z level=info msg="Executing migration" id="Drop public config table" 2024-03-11T22:10:30.965 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.849500254Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-03-11T22:10:30.966 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.899745352Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-03-11T22:10:30.966 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:30 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:30.975051131Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-11T22:10:31.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.000340059Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-03-11T22:10:31.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.025569415Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-03-11T22:10:31.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.059167474Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-03-11T22:10:31.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.109557144Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-03-11T22:10:31.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.143123664Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-03-11T22:10:31.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.176740836Z level=info msg="Executing migration" id="add share column" 2024-03-11T22:10:31.237 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.210295062Z level=info msg="Executing migration" id="create default alerting folders" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.260694866Z level=info msg="Executing migration" id="create file table" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.294316064Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.311410584Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.328392783Z level=info msg="Executing migration" id="create file_meta table" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.362003678Z level=info msg="Executing migration" id="file table idx: path key" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.395599267Z level=info msg="Executing migration" id="set path collation in file table" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.429108248Z level=info msg="Executing migration" id="managed permissions migration" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.488185669Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-03-11T22:10:31.504 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.513408215Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-03-11T22:10:31.773 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.538695037Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-03-11T22:10:31.773 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.580696535Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-03-11T22:10:31.773 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.605981677Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-03-11T22:10:31.773 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.631345298Z level=info msg="Executing migration" id="update group index for alert rules" 2024-03-11T22:10:31.773 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.656613257Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-03-11T22:10:31.773 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.698594855Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-03-11T22:10:31.773 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.740641682Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-03-11T22:10:31.774 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.782658283Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-03-11T22:10:31.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- 172.21.15.49:0/1810938295 >> v1:172.21.15.49:6789/0 conn(0x7fd560102bc0 legacy=0x7fd560102fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:31.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- 172.21.15.49:0/1810938295 shutdown_connections 2024-03-11T22:10:31.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- 172.21.15.49:0/1810938295 >> 172.21.15.49:0/1810938295 conn(0x7fd5600fc410 msgr2=0x7fd5600fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:31.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- 172.21.15.49:0/1810938295 shutdown_connections 2024-03-11T22:10:31.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- 172.21.15.49:0/1810938295 wait complete. 2024-03-11T22:10:31.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 Processor -- start 2024-03-11T22:10:31.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- start start 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd5601a8a40 con 0x7fd56010e4e0 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd5601a9c20 con 0x7fd560102bc0 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd56605d700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd5601aae00 con 0x7fd56010a9d0 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd55ffff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd56010e4e0 0x7fd5601a7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34776/0 (socket says 172.21.15.49:34776) 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd557fff700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fd56010a9d0 0x7fd5601a3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:43210/0 (socket says 172.21.15.49:43210) 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.823+0000 7fd55ffff700 1 -- 172.21.15.49:0/243081864 learned_addr learned my addr 172.21.15.49:0/243081864 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212592860 0 0) 0x7fd5601aae00 con 0x7fd56010a9d0 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5400031f0 con 0x7fd56010a9d0 2024-03-11T22:10:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655372037 0 0) 0x7fd5601a8a40 con 0x7fd56010e4e0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5601aae00 con 0x7fd56010e4e0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3333931961 0 0) 0x7fd5601aae00 con 0x7fd56010e4e0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5601a8a40 con 0x7fd56010e4e0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fd558001c30 con 0x7fd56010e4e0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3966246073 0 0) 0x7fd5400031f0 con 0x7fd56010a9d0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5601aae00 con 0x7fd56010a9d0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fd548001850 con 0x7fd56010a9d0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783823557 0 0) 0x7fd5601a9c20 con 0x7fd560102bc0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5400031f0 con 0x7fd560102bc0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1017135169 0 0) 0x7fd5601aae00 con 0x7fd56010a9d0 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 >> v1:172.21.15.187:6789/0 conn(0x7fd560102bc0 legacy=0x7fd560109e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 >> v1:172.21.15.49:6789/0 conn(0x7fd56010e4e0 legacy=0x7fd5601a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5601ac000 con 0x7fd56010a9d0 2024-03-11T22:10:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5601aaff0 con 0x7fd56010a9d0 2024-03-11T22:10:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601ab470 con 0x7fd56010a9d0 2024-03-11T22:10:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fd548003b10 con 0x7fd56010a9d0 2024-03-11T22:10:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fd548005ac0 con 0x7fd56010a9d0 2024-03-11T22:10:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.49:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd544000f80 con 0x7fd56010a9d0 2024-03-11T22:10:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fd54801c010 con 0x7fd56010a9d0 2024-03-11T22:10:31.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fd5480882b0 con 0x7fd56010a9d0 2024-03-11T22:10:31.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.187:6800/4268742344 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd54007ca10 con 0x7fd540078d00 2024-03-11T22:10:31.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.827+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7fd5480886e0 con 0x7fd56010a9d0 2024-03-11T22:10:31.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.831+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== osd.4 v1:172.21.15.187:6800/4268742344 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fd54007ca10 con 0x7fd540078d00 2024-03-11T22:10:31.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.847+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 --> v1:172.21.15.187:6800/4268742344 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd544002c40 con 0x7fd540078d00 2024-03-11T22:10:31.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.847+0000 7fd55d7fa700 1 -- 172.21.15.49:0/243081864 <== osd.4 v1:172.21.15.187:6800/4268742344 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3439995595) 0x7fd544002c40 con 0x7fd540078d00 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 >> v1:172.21.15.187:6800/4268742344 conn(0x7fd540078d00 legacy=0x7fd54007b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 >> v1:172.21.15.49:6800/915645872 conn(0x7fd54006e540 legacy=0x7fd540070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 >> v1:172.21.15.49:6790/0 conn(0x7fd56010a9d0 legacy=0x7fd5601a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd55ffff700 1 -- 172.21.15.49:0/243081864 reap_dead start 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 shutdown_connections 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 >> 172.21.15.49:0/243081864 conn(0x7fd5600fc410 msgr2=0x7fd560110970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 shutdown_connections 2024-03-11T22:10:31.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:31.851+0000 7fd56605d700 1 -- 172.21.15.49:0/243081864 wait complete. 2024-03-11T22:10:32.033 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.824653991Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-03-11T22:10:32.033 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.866765588Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-03-11T22:10:32.033 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.933784705Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-03-11T22:10:32.034 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.958989331Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-03-11T22:10:32.034 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:31 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:31.98427461Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-03-11T22:10:32.420 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.042908696Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-03-11T22:10:32.420 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.06816532Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-03-11T22:10:32.420 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.093427222Z level=info msg="Executing migration" id="create folder table" 2024-03-11T22:10:32.420 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.135391275Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-03-11T22:10:32.420 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.160704871Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-03-11T22:10:32.420 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.185925878Z level=info msg="Executing migration" id="Update folder title length" 2024-03-11T22:10:32.420 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.227892249Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-03-11T22:10:32.421 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=migrator t=2024-03-11T22:10:32.269929337Z level=info msg="migrations completed" performed=485 skipped=0 duration=16.687976438s 2024-03-11T22:10:32.421 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=sqlstore t=2024-03-11T22:10:32.271886749Z level=info msg="Created default organization" 2024-03-11T22:10:32.421 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=plugin.loader t=2024-03-11T22:10:32.429186156Z level=info msg="Plugin registered" pluginID=input 2024-03-11T22:10:32.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[23415]: cluster 2024-03-11T22:10:31.386564+0000 mgr.y (mgr.14601) 72 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:32.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=plugin.loader t=2024-03-11T22:10:32.490912606Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-03-11T22:10:32.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=plugin.loader t=2024-03-11T22:10:32.490986088Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-03-11T22:10:32.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=secrets t=2024-03-11T22:10:32.491093449Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-11T22:10:32.737 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=query_data t=2024-03-11T22:10:32.496490913Z level=info msg="Query Service initialization" 2024-03-11T22:10:32.738 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:32 smithi187 bash[50671]: logger=live.push_http t=2024-03-11T22:10:32.502786437Z level=info msg="Live Push Gateway initialization" 2024-03-11T22:10:32.822 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:32 smithi049 bash[21434]: cluster 2024-03-11T22:10:31.386564+0000 mgr.y (mgr.14601) 72 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:32.822 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:32 smithi049 bash[28804]: cluster 2024-03-11T22:10:31.386564+0000 mgr.y (mgr.14601) 72 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:33.686 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:33 smithi049 bash[21434]: audit 2024-03-11T22:10:32.902752+0000 mon.c (mon.2) 62 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:33.686 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:33 smithi049 bash[28804]: audit 2024-03-11T22:10:32.902752+0000 mon.c (mon.2) 62 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:33.732 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[23415]: audit 2024-03-11T22:10:32.902752+0000 mon.c (mon.2) 62 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=infra.usagestats.collector t=2024-03-11T22:10:33.541482662Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=provisioning.datasources t=2024-03-11T22:10:33.542629436Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=provisioning.datasources t=2024-03-11T22:10:33.580005791Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=provisioning.alerting t=2024-03-11T22:10:33.614069183Z level=info msg="starting to provision alerting" 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=provisioning.alerting t=2024-03-11T22:10:33.614093303Z level=info msg="finished to provision alerting" 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=grafanaStorageLogger t=2024-03-11T22:10:33.614247818Z level=info msg="storage starting" 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=ngalert.state.manager t=2024-03-11T22:10:33.61472107Z level=info msg="Warming state cache for startup" 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=http.server t=2024-03-11T22:10:33.61778954Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=ngalert.state.manager t=2024-03-11T22:10:33.668695958Z level=info msg="State cache has been initialized" states=0 duration=53.972158ms 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=ticker t=2024-03-11T22:10:33.668813632Z level=info msg=starting first_tick=2024-03-11T22:10:40Z 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=ngalert.multiorg.alertmanager t=2024-03-11T22:10:33.668818235Z level=info msg="starting MultiOrg Alertmanager" 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=sqlstore.transactions t=2024-03-11T22:10:33.685454391Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-11T22:10:33.733 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=sqlstore.transactions t=2024-03-11T22:10:33.742166304Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-11T22:10:33.987 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=sqlstore.transactions t=2024-03-11T22:10:33.750352366Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-03-11T22:10:33.987 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:10:33 smithi187 bash[50671]: logger=sqlstore.transactions t=2024-03-11T22:10:33.940020554Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-03-11T22:10:34.511 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:34 smithi049 bash[28804]: cluster 2024-03-11T22:10:33.387979+0000 mgr.y (mgr.14601) 73 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:34.511 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:10:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:10:34.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:34 smithi187 bash[23415]: cluster 2024-03-11T22:10:33.387979+0000 mgr.y (mgr.14601) 73 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:34.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:34 smithi049 bash[21434]: cluster 2024-03-11T22:10:33.387979+0000 mgr.y (mgr.14601) 73 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:35.213 INFO:teuthology.orchestra.run.smithi049.stdout:197568495663 2024-03-11T22:10:35.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-11T22:10:35.493 INFO:teuthology.orchestra.run.smithi049.stdout:77309411416 2024-03-11T22:10:35.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-11T22:10:35.781 INFO:teuthology.orchestra.run.smithi049.stdout:34359738477 2024-03-11T22:10:35.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-11T22:10:36.471 INFO:teuthology.orchestra.run.smithi049.stdout:128849018947 2024-03-11T22:10:36.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-11T22:10:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- 172.21.15.49:0/657515692 >> v1:172.21.15.49:6789/0 conn(0x7f8540107a30 legacy=0x7f8540107e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- 172.21.15.49:0/657515692 shutdown_connections 2024-03-11T22:10:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- 172.21.15.49:0/657515692 >> 172.21.15.49:0/657515692 conn(0x7f85400fd560 msgr2=0x7f85400ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- 172.21.15.49:0/657515692 shutdown_connections 2024-03-11T22:10:36.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- 172.21.15.49:0/657515692 wait complete. 2024-03-11T22:10:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 Processor -- start 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- start start 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8540075ec0 con 0x7f8540107a30 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f85401a9ab0 con 0x7f854010e4b0 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f85401aac90 con 0x7f854010a8e0 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f8545026700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8540107a30 0x7f8540075650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44386/0 (socket says 172.21.15.49:44386) 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f8545026700 1 -- 172.21.15.49:0/1649950991 learned_addr learned my addr 172.21.15.49:0/1649950991 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f8544825700 1 --1- 172.21.15.49:0/1649950991 >> v1:172.21.15.49:6790/0 conn(0x7f854010a8e0 0x7f85401a3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:39266/0 (socket says 172.21.15.49:39266) 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199343716 0 0) 0x7f8540075ec0 con 0x7f8540107a30 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f852c0031f0 con 0x7f8540107a30 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811802723 0 0) 0x7f85401aac90 con 0x7f854010a8e0 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540075ec0 con 0x7f854010a8e0 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4279346073 0 0) 0x7f852c0031f0 con 0x7f8540107a30 2024-03-11T22:10:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f85401aac90 con 0x7f8540107a30 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8530001510 con 0x7f8540107a30 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 474125564 0 0) 0x7f8540075ec0 con 0x7f854010a8e0 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f852c0031f0 con 0x7f854010a8e0 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f853c0017f0 con 0x7f854010a8e0 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125499006 0 0) 0x7f85401a9ab0 con 0x7f854010e4b0 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540075ec0 con 0x7f854010e4b0 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1550881363 0 0) 0x7f85401aac90 con 0x7f8540107a30 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 >> v1:172.21.15.49:6790/0 conn(0x7f854010a8e0 legacy=0x7f85401a3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 >> v1:172.21.15.187:6789/0 conn(0x7f854010e4b0 legacy=0x7f85401a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85401abe90 con 0x7f8540107a30 2024-03-11T22:10:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85401aae80 con 0x7f8540107a30 2024-03-11T22:10:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401ab300 con 0x7f8540107a30 2024-03-11T22:10:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f8530003ba0 con 0x7f8540107a30 2024-03-11T22:10:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.730+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8530004e80 con 0x7f8540107a30 2024-03-11T22:10:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.734+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8524000fb0 con 0x7f8540107a30 2024-03-11T22:10:36.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.734+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f8530003e10 con 0x7f8540107a30 2024-03-11T22:10:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.734+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f8530088610 con 0x7f8540107a30 2024-03-11T22:10:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.734+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6805/3491699509 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f852c07c9b0 con 0x7f852c078ca0 2024-03-11T22:10:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.734+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f8530088930 con 0x7f8540107a30 2024-03-11T22:10:36.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.734+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== osd.1 v1:172.21.15.49:6805/3491699509 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f852c07c9b0 con 0x7f852c078ca0 2024-03-11T22:10:36.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:36 smithi187 bash[23415]: cluster 2024-03-11T22:10:35.388466+0000 mgr.y (mgr.14601) 74 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:36.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 --> v1:172.21.15.49:6805/3491699509 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8524002c70 con 0x7f852c078ca0 2024-03-11T22:10:36.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f85367fc700 1 -- 172.21.15.49:0/1649950991 <== osd.1 v1:172.21.15.49:6805/3491699509 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2865910123) 0x7f8524002c70 con 0x7f852c078ca0 2024-03-11T22:10:36.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 >> v1:172.21.15.49:6805/3491699509 conn(0x7f852c078ca0 legacy=0x7f852c07b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 >> v1:172.21.15.49:6800/915645872 conn(0x7f852c06e540 legacy=0x7f852c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 >> v1:172.21.15.49:6789/0 conn(0x7f8540107a30 legacy=0x7f8540075650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f8545827700 1 -- 172.21.15.49:0/1649950991 reap_dead start 2024-03-11T22:10:36.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 shutdown_connections 2024-03-11T22:10:36.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 >> 172.21.15.49:0/1649950991 conn(0x7f85400fd560 msgr2=0x7f8540111140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:36.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 shutdown_connections 2024-03-11T22:10:36.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.754+0000 7f854728a700 1 -- 172.21.15.49:0/1649950991 wait complete. 2024-03-11T22:10:36.756 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:36 smithi049 bash[21434]: cluster 2024-03-11T22:10:35.388466+0000 mgr.y (mgr.14601) 74 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:36.756 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:36 smithi049 bash[28804]: cluster 2024-03-11T22:10:35.388466+0000 mgr.y (mgr.14601) 74 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.930+0000 7f82fd503700 1 -- 172.21.15.49:0/428390119 >> v1:172.21.15.49:6790/0 conn(0x7f82f8110680 legacy=0x7f82f8112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.930+0000 7f82fd503700 1 -- 172.21.15.49:0/428390119 shutdown_connections 2024-03-11T22:10:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.930+0000 7f82fd503700 1 -- 172.21.15.49:0/428390119 >> 172.21.15.49:0/428390119 conn(0x7f82f8076da0 msgr2=0x7f82f80fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:36.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.930+0000 7f82fd503700 1 -- 172.21.15.49:0/428390119 shutdown_connections 2024-03-11T22:10:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.930+0000 7f82fd503700 1 -- 172.21.15.49:0/428390119 wait complete. 2024-03-11T22:10:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.930+0000 7f82fd503700 1 Processor -- start 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.930+0000 7f82fd503700 1 -- start start 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82fd503700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f82f81a8ac0 con 0x7f82f8102940 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82fd503700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f82f81a9ca0 con 0x7f82f8110680 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82fd503700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f82f81aaea0 con 0x7f82f8102d20 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82f67fc700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f82f8102d20 0x7f82f81a39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:39284/0 (socket says 172.21.15.49:39284) 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82f6ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f82f8102940 0x7f82f810fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44410/0 (socket says 172.21.15.49:44410) 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82f67fc700 1 -- 172.21.15.49:0/2392591034 learned_addr learned my addr 172.21.15.49:0/2392591034 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447548548 0 0) 0x7f82f81aaea0 con 0x7f82f8102d20 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e40037f0 con 0x7f82f8102d20 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019482315 0 0) 0x7f82f81a8ac0 con 0x7f82f8102940 2024-03-11T22:10:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f81aaea0 con 0x7f82f8102940 2024-03-11T22:10:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3727492879 0 0) 0x7f82e40037f0 con 0x7f82f8102d20 2024-03-11T22:10:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82f81a8ac0 con 0x7f82f8102d20 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f82e80019f0 con 0x7f82f8102d20 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 328560674 0 0) 0x7f82f81aaea0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82e40037f0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f82f0001bb0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2064195428 0 0) 0x7f82e40037f0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 >> v1:172.21.15.49:6790/0 conn(0x7f82f8102d20 legacy=0x7f82f81a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 >> v1:172.21.15.187:6789/0 conn(0x7f82f8110680 legacy=0x7f82f81a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f81ac0a0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f81a8cb0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f81a9130 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f82f0003eb0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f82f0005ea0 con 0x7f82f8102940 2024-03-11T22:10:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.49:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82d8000f80 con 0x7f82f8102940 2024-03-11T22:10:36.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f82f0003a20 con 0x7f82f8102940 2024-03-11T22:10:36.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f82f0088790 con 0x7f82f8102940 2024-03-11T22:10:36.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.187:6804/2249702314 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82e407cbd0 con 0x7f82e4078ec0 2024-03-11T22:10:36.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.934+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f82f0088b60 con 0x7f82f8102940 2024-03-11T22:10:36.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.938+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== osd.5 v1:172.21.15.187:6804/2249702314 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f82e407cbd0 con 0x7f82e4078ec0 2024-03-11T22:10:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.954+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 --> v1:172.21.15.187:6804/2249702314 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82d8002c40 con 0x7f82e4078ec0 2024-03-11T22:10:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82effff700 1 -- 172.21.15.49:0/2392591034 <== osd.5 v1:172.21.15.187:6804/2249702314 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3685914696) 0x7f82d8002c40 con 0x7f82e4078ec0 2024-03-11T22:10:36.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 >> v1:172.21.15.187:6804/2249702314 conn(0x7f82e4078ec0 legacy=0x7f82e407b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 >> v1:172.21.15.49:6800/915645872 conn(0x7f82e406e5d0 legacy=0x7f82e4070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 >> v1:172.21.15.49:6789/0 conn(0x7f82f8102940 legacy=0x7f82f810fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82f77fe700 1 -- 172.21.15.49:0/2392591034 reap_dead start 2024-03-11T22:10:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 shutdown_connections 2024-03-11T22:10:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 >> 172.21.15.49:0/2392591034 conn(0x7f82f8076da0 msgr2=0x7f82f8113d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 shutdown_connections 2024-03-11T22:10:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:36.958+0000 7f82fd503700 1 -- 172.21.15.49:0/2392591034 wait complete. 2024-03-11T22:10:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- 172.21.15.49:0/3669854792 >> v1:172.21.15.49:6790/0 conn(0x7f9078073f90 legacy=0x7f9078074370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- 172.21.15.49:0/3669854792 shutdown_connections 2024-03-11T22:10:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- 172.21.15.49:0/3669854792 >> 172.21.15.49:0/3669854792 conn(0x7f90780fd520 msgr2=0x7f90780ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- 172.21.15.49:0/3669854792 shutdown_connections 2024-03-11T22:10:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- 172.21.15.49:0/3669854792 wait complete. 2024-03-11T22:10:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 Processor -- start 2024-03-11T22:10:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- start start 2024-03-11T22:10:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f90781a8aa0 con 0x7f90781106e0 2024-03-11T22:10:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f90781a9c80 con 0x7f9078074a80 2024-03-11T22:10:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f90781aae80 con 0x7f9078073f90 2024-03-11T22:10:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f907e91d700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f90781106e0 0x7f90781a7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44434/0 (socket says 172.21.15.49:44434) 2024-03-11T22:10:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f907e91d700 1 -- 172.21.15.49:0/539728529 learned_addr learned my addr 172.21.15.49:0/539728529 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f907e11c700 1 --1- 172.21.15.49:0/539728529 >> v1:172.21.15.49:6790/0 conn(0x7f9078073f90 0x7f907810eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:39294/0 (socket says 172.21.15.49:39294) 2024-03-11T22:10:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488335843 0 0) 0x7f90781aae80 con 0x7f9078073f90 2024-03-11T22:10:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90640031f0 con 0x7f9078073f90 2024-03-11T22:10:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281792627 0 0) 0x7f90781a8aa0 con 0x7f90781106e0 2024-03-11T22:10:37.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90781aae80 con 0x7f90781106e0 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4216159301 0 0) 0x7f90781aae80 con 0x7f90781106e0 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f90781a8aa0 con 0x7f90781106e0 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2924072149 0 0) 0x7f90640031f0 con 0x7f9078073f90 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f90781aae80 con 0x7f9078073f90 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f9070001c30 con 0x7f90781106e0 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f90740018f0 con 0x7f9078073f90 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2795025127 0 0) 0x7f90781a8aa0 con 0x7f90781106e0 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 >> v1:172.21.15.49:6790/0 conn(0x7f9078073f90 legacy=0x7f907810eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 >> v1:172.21.15.187:6789/0 conn(0x7f9078074a80 legacy=0x7f90781a3a10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-11T22:10:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90781ac080 con 0x7f90781106e0 2024-03-11T22:10:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90781a8c90 con 0x7f90781106e0 2024-03-11T22:10:37.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.542+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f90781a9110 con 0x7f90781106e0 2024-03-11T22:10:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f9070003eb0 con 0x7f90781106e0 2024-03-11T22:10:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9078114610 con 0x7f90781106e0 2024-03-11T22:10:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f9070006010 con 0x7f90781106e0 2024-03-11T22:10:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f907001c5c0 con 0x7f90781106e0 2024-03-11T22:10:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f9070087fe0 con 0x7f90781106e0 2024-03-11T22:10:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6813/4161800259 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f906407ce00 con 0x7f90640790f0 2024-03-11T22:10:37.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f9070088220 con 0x7f90781106e0 2024-03-11T22:10:37.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.546+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== osd.3 v1:172.21.15.49:6813/4161800259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f906407ce00 con 0x7f90640790f0 2024-03-11T22:10:37.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 --> v1:172.21.15.49:6813/4161800259 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90780feb60 con 0x7f90640790f0 2024-03-11T22:10:37.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f906f7fe700 1 -- 172.21.15.49:0/539728529 <== osd.3 v1:172.21.15.49:6813/4161800259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3804687086) 0x7f90780feb60 con 0x7f90640790f0 2024-03-11T22:10:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 >> v1:172.21.15.49:6813/4161800259 conn(0x7f90640790f0 legacy=0x7f906407b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 >> v1:172.21.15.49:6800/915645872 conn(0x7f906406e780 legacy=0x7f9064070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 >> v1:172.21.15.49:6789/0 conn(0x7f90781106e0 legacy=0x7f90781a7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f907e91d700 1 -- 172.21.15.49:0/539728529 reap_dead start 2024-03-11T22:10:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 shutdown_connections 2024-03-11T22:10:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 >> 172.21.15.49:0/539728529 conn(0x7f90780fd520 msgr2=0x7f9078112b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 shutdown_connections 2024-03-11T22:10:37.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:37.570+0000 7f9080380700 1 -- 172.21.15.49:0/539728529 wait complete. 2024-03-11T22:10:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- 172.21.15.49:0/3356611294 >> v1:172.21.15.49:6790/0 conn(0x7f857010e4a0 legacy=0x7f8570110960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- 172.21.15.49:0/3356611294 shutdown_connections 2024-03-11T22:10:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- 172.21.15.49:0/3356611294 >> 172.21.15.49:0/3356611294 conn(0x7f85700fd550 msgr2=0x7f85700ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- 172.21.15.49:0/3356611294 shutdown_connections 2024-03-11T22:10:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- 172.21.15.49:0/3356611294 wait complete. 2024-03-11T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 Processor -- start 2024-03-11T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- start start 2024-03-11T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f85701a8b20 con 0x7f857010a8d0 2024-03-11T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f85701a9d00 con 0x7f8570107a20 2024-03-11T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f857575a700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f85701aaee0 con 0x7f857010e4a0 2024-03-11T22:10:38.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f856f7fe700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f857010e4a0 0x7f85701a7370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:39320/0 (socket says 172.21.15.49:39320) 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.294+0000 7f856f7fe700 1 -- 172.21.15.49:0/4192484160 learned_addr learned my addr 172.21.15.49:0/4192484160 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181825265 0 0) 0x7f85701a8b20 con 0x7f857010a8d0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85580035b0 con 0x7f857010a8d0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670451326 0 0) 0x7f85701aaee0 con 0x7f857010e4a0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85701a8b20 con 0x7f857010e4a0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3654999217 0 0) 0x7f85580035b0 con 0x7f857010a8d0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f85701aaee0 con 0x7f857010a8d0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8564001830 con 0x7f857010a8d0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2944707011 0 0) 0x7f85701a8b20 con 0x7f857010e4a0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f85580035b0 con 0x7f857010e4a0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f85680017b0 con 0x7f857010e4a0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1839759532 0 0) 0x7f85701aaee0 con 0x7f857010a8d0 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 >> v1:172.21.15.49:6790/0 conn(0x7f857010e4a0 legacy=0x7f85701a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 >> v1:172.21.15.187:6789/0 conn(0x7f8570107a20 legacy=0x7f8570105d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85701ac0e0 con 0x7f857010a8d0 2024-03-11T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85701a8d10 con 0x7f857010a8d0 2024-03-11T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f85701a9190 con 0x7f857010a8d0 2024-03-11T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f8564003b10 con 0x7f857010a8d0 2024-03-11T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8564004980 con 0x7f857010a8d0 2024-03-11T22:10:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.49:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f855c000f80 con 0x7f857010a8d0 2024-03-11T22:10:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f8564003680 con 0x7f857010a8d0 2024-03-11T22:10:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f8564087190 con 0x7f857010a8d0 2024-03-11T22:10:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.187:6812/3018671607 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f855807cd80 con 0x7f8558079070 2024-03-11T22:10:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.298+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f8564087560 con 0x7f857010a8d0 2024-03-11T22:10:38.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.306+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== osd.7 v1:172.21.15.187:6812/3018671607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f855807cd80 con 0x7f8558079070 2024-03-11T22:10:38.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.322+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 --> v1:172.21.15.187:6812/3018671607 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f855c002c40 con 0x7f8558079070 2024-03-11T22:10:38.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.322+0000 7f8557fff700 1 -- 172.21.15.49:0/4192484160 <== osd.7 v1:172.21.15.187:6812/3018671607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1602979005) 0x7f855c002c40 con 0x7f8558079070 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.322+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 >> v1:172.21.15.187:6812/3018671607 conn(0x7f8558079070 legacy=0x7f855807b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.322+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 >> v1:172.21.15.49:6800/915645872 conn(0x7f855806e700 legacy=0x7f8558070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.322+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 >> v1:172.21.15.49:6789/0 conn(0x7f857010a8d0 legacy=0x7f85701a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.326+0000 7f856f7fe700 1 -- 172.21.15.49:0/4192484160 reap_dead start 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.326+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 shutdown_connections 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.326+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 >> 172.21.15.49:0/4192484160 conn(0x7f85700fd550 msgr2=0x7f8570100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.326+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 shutdown_connections 2024-03-11T22:10:38.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:38.326+0000 7f857575a700 1 -- 172.21.15.49:0/4192484160 wait complete. 2024-03-11T22:10:38.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:38 smithi049 bash[21434]: cluster 2024-03-11T22:10:37.389626+0000 mgr.y (mgr.14601) 75 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:38.516 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:38 smithi049 bash[28804]: cluster 2024-03-11T22:10:37.389626+0000 mgr.y (mgr.14601) 75 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:38.650 INFO:teuthology.orchestra.run.smithi049.stdout:55834574947 2024-03-11T22:10:38.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-11T22:10:38.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:38 smithi187 bash[23415]: cluster 2024-03-11T22:10:37.389626+0000 mgr.y (mgr.14601) 75 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:38.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:10:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:163208757306 2024-03-11T22:10:38.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-11T22:10:39.731 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:39 smithi049 bash[28804]: audit 2024-03-11T22:10:38.415773+0000 mgr.y (mgr.14601) 76 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:39.731 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:39 smithi049 bash[21434]: audit 2024-03-11T22:10:38.415773+0000 mgr.y (mgr.14601) 76 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:39.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:39 smithi187 bash[23415]: audit 2024-03-11T22:10:38.415773+0000 mgr.y (mgr.14601) 76 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:40.053 INFO:teuthology.orchestra.run.smithi049.stdout:107374182479 2024-03-11T22:10:40.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-11T22:10:40.318 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:40 smithi049 systemd[1]: Stopping Ceph alertmanager.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:10:40.319 INFO:teuthology.orchestra.run.smithi049.stdout:231928234021 2024-03-11T22:10:40.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-11T22:10:40.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:40 smithi049 bash[21434]: cluster 2024-03-11T22:10:39.391276+0000 mgr.y (mgr.14601) 77 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:40.516 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:40 smithi049 bash[28804]: cluster 2024-03-11T22:10:39.391276+0000 mgr.y (mgr.14601) 77 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:40.517 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:40 smithi049 bash[58100]: ts=2024-03-11T22:10:40.370Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-11T22:10:40.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:40 smithi187 bash[23415]: cluster 2024-03-11T22:10:39.391276+0000 mgr.y (mgr.14601) 77 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:40.822 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:40 smithi049 bash[61341]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-alertmanager-a 2024-03-11T22:10:41.266 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 bash[61490]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-alertmanager-a 2024-03-11T22:10:41.266 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-03-11T22:10:41.266 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 systemd[1]: Stopped Ceph alertmanager.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:10:41.266 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 systemd[1]: Started Ceph alertmanager.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:10:42.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[21434]: audit 2024-03-11T22:10:41.101023+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:42.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[21434]: audit 2024-03-11T22:10:41.108950+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:42.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[21434]: cephadm 2024-03-11T22:10:41.115130+0000 mgr.y (mgr.14601) 78 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-03-11T22:10:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[21434]: cephadm 2024-03-11T22:10:41.369465+0000 mgr.y (mgr.14601) 79 : cephadm 1 Reconfiguring daemon prometheus.a on smithi187 2024-03-11T22:10:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[21434]: cluster 2024-03-11T22:10:41.392042+0000 mgr.y (mgr.14601) 80 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[28804]: audit 2024-03-11T22:10:41.101023+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[28804]: audit 2024-03-11T22:10:41.108950+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[28804]: cephadm 2024-03-11T22:10:41.115130+0000 mgr.y (mgr.14601) 78 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-03-11T22:10:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[28804]: cephadm 2024-03-11T22:10:41.369465+0000 mgr.y (mgr.14601) 79 : cephadm 1 Reconfiguring daemon prometheus.a on smithi187 2024-03-11T22:10:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[28804]: cluster 2024-03-11T22:10:41.392042+0000 mgr.y (mgr.14601) 80 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:42.267 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 bash[61519]: ts=2024-03-11T22:10:41.978Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-11T22:10:42.268 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 bash[61519]: ts=2024-03-11T22:10:41.978Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-11T22:10:42.268 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 bash[61519]: ts=2024-03-11T22:10:41.979Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.49 port=9094 2024-03-11T22:10:42.268 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:41 smithi049 bash[61519]: ts=2024-03-11T22:10:41.980Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-11T22:10:42.268 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[61519]: ts=2024-03-11T22:10:42.011Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-11T22:10:42.268 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[61519]: ts=2024-03-11T22:10:42.011Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-11T22:10:42.268 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[61519]: ts=2024-03-11T22:10:42.015Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-11T22:10:42.268 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:42 smithi049 bash[61519]: ts=2024-03-11T22:10:42.015Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-11T22:10:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:42 smithi187 bash[23415]: audit 2024-03-11T22:10:41.101023+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:42 smithi187 bash[23415]: audit 2024-03-11T22:10:41.108950+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:42 smithi187 bash[23415]: cephadm 2024-03-11T22:10:41.115130+0000 mgr.y (mgr.14601) 78 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-03-11T22:10:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:42 smithi187 bash[23415]: cephadm 2024-03-11T22:10:41.369465+0000 mgr.y (mgr.14601) 79 : cephadm 1 Reconfiguring daemon prometheus.a on smithi187 2024-03-11T22:10:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:42 smithi187 bash[23415]: cluster 2024-03-11T22:10:41.392042+0000 mgr.y (mgr.14601) 80 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:43.577 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:43.578 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:43.578 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:43.579 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:43.583 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:44.219 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:43 smithi049 bash[61519]: ts=2024-03-11T22:10:43.981Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000316003s 2024-03-11T22:10:44.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:44 smithi187 bash[23415]: cluster 2024-03-11T22:10:43.393546+0000 mgr.y (mgr.14601) 81 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:44.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:44 smithi049 bash[21434]: cluster 2024-03-11T22:10:43.393546+0000 mgr.y (mgr.14601) 81 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:44.516 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:44 smithi049 bash[28804]: cluster 2024-03-11T22:10:43.393546+0000 mgr.y (mgr.14601) 81 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:44.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:10:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:10:46.147 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 systemd[1]: Stopping Ceph prometheus.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:10:46.147 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-11T22:10:46.147 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-11T22:10:46.147 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-11T22:10:46.147 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-11T22:10:46.147 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-11T22:10:46.148 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-11T22:10:46.148 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-11T22:10:46.148 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-11T22:10:46.148 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-11T22:10:46.148 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-11T22:10:46.148 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.932Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-11T22:10:46.148 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:45 smithi187 bash[48807]: ts=2024-03-11T22:10:45.933Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-11T22:10:46.694 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:46 smithi187 bash[23415]: cluster 2024-03-11T22:10:45.394017+0000 mgr.y (mgr.14601) 82 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:46.694 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:46 smithi187 bash[51333]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-prometheus-a 2024-03-11T22:10:46.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21434]: cluster 2024-03-11T22:10:45.394017+0000 mgr.y (mgr.14601) 82 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:46.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[28804]: cluster 2024-03-11T22:10:45.394017+0000 mgr.y (mgr.14601) 82 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:46.987 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:46 smithi187 bash[51393]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-prometheus-a 2024-03-11T22:10:46.987 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:46 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@prometheus.a.service: Deactivated successfully. 2024-03-11T22:10:46.987 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:46 smithi187 systemd[1]: Stopped Ceph prometheus.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:10:46.987 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:46 smithi187 systemd[1]: Started Ceph prometheus.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:10:47.069 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Bus STOPPING 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Bus STOPPED 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Bus STARTING 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Serving on http://:::9283 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Bus STARTED 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Bus STOPPING 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Bus STOPPED 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:46 smithi049 bash[21686]: [11/Mar/2024:22:10:46] ENGINE Bus STARTING 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE Serving on http://:::9283 2024-03-11T22:10:47.070 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE Bus STARTED 2024-03-11T22:10:47.071 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE Bus STOPPING 2024-03-11T22:10:47.071 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-11T22:10:47.071 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE Bus STOPPED 2024-03-11T22:10:47.071 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE Bus STARTING 2024-03-11T22:10:47.361 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE Serving on http://:::9283 2024-03-11T22:10:47.361 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21686]: [11/Mar/2024:22:10:47] ENGINE Bus STARTED 2024-03-11T22:10:48.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.759753+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.774993+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.812804+0000 mon.c (mon.2) 63 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-11T22:10:48.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.813743+0000 mgr.y (mgr.14601) 83 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.815810+0000 mon.c (mon.2) 64 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.816888+0000 mgr.y (mgr.14601) 84 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.824529+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.846357+0000 mon.c (mon.2) 65 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.847398+0000 mgr.y (mgr.14601) 85 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.853205+0000 mon.c (mon.2) 66 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi187.front.sepia.ceph.com:9095"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.853896+0000 mgr.y (mgr.14601) 86 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi187.front.sepia.ceph.com:9095"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.859818+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.872013+0000 mon.c (mon.2) 67 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.872579+0000 mgr.y (mgr.14601) 87 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.878280+0000 mon.c (mon.2) 68 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi187.front.sepia.ceph.com:3000"}]: dispatch 2024-03-11T22:10:48.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.878829+0000 mgr.y (mgr.14601) 88 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi187.front.sepia.ceph.com:3000"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.884088+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[21434]: audit 2024-03-11T22:10:46.902153+0000 mon.c (mon.2) 69 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.759753+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.774993+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.812804+0000 mon.c (mon.2) 63 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.813743+0000 mgr.y (mgr.14601) 83 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.815810+0000 mon.c (mon.2) 64 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.816888+0000 mgr.y (mgr.14601) 84 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.824529+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.846357+0000 mon.c (mon.2) 65 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.847398+0000 mgr.y (mgr.14601) 85 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-11T22:10:48.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.853205+0000 mon.c (mon.2) 66 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi187.front.sepia.ceph.com:9095"}]: dispatch 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.853896+0000 mgr.y (mgr.14601) 86 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi187.front.sepia.ceph.com:9095"}]: dispatch 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.859818+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.872013+0000 mon.c (mon.2) 67 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.872579+0000 mgr.y (mgr.14601) 87 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.878280+0000 mon.c (mon.2) 68 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi187.front.sepia.ceph.com:3000"}]: dispatch 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.878829+0000 mgr.y (mgr.14601) 88 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi187.front.sepia.ceph.com:3000"}]: dispatch 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.884088+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:47 smithi049 bash[28804]: audit 2024-03-11T22:10:46.902153+0000 mon.c (mon.2) 69 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:10:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.759753+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.774993+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.812804+0000 mon.c (mon.2) 63 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-11T22:10:48.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.813743+0000 mgr.y (mgr.14601) 83 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-11T22:10:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.815810+0000 mon.c (mon.2) 64 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-03-11T22:10:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.816888+0000 mgr.y (mgr.14601) 84 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-03-11T22:10:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.824529+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.846357+0000 mon.c (mon.2) 65 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-11T22:10:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.847398+0000 mgr.y (mgr.14601) 85 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-11T22:10:48.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.853205+0000 mon.c (mon.2) 66 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi187.front.sepia.ceph.com:9095"}]: dispatch 2024-03-11T22:10:48.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.853896+0000 mgr.y (mgr.14601) 86 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi187.front.sepia.ceph.com:9095"}]: dispatch 2024-03-11T22:10:48.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.859818+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.872013+0000 mon.c (mon.2) 67 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-11T22:10:48.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.872579+0000 mgr.y (mgr.14601) 87 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-11T22:10:48.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.878280+0000 mon.c (mon.2) 68 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi187.front.sepia.ceph.com:3000"}]: dispatch 2024-03-11T22:10:48.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.878829+0000 mgr.y (mgr.14601) 88 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi187.front.sepia.ceph.com:3000"}]: dispatch 2024-03-11T22:10:48.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.884088+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:48.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[23415]: audit 2024-03-11T22:10:46.902153+0000 mon.c (mon.2) 69 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:10:48.241 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.847Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-11T22:10:48.241 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.847Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-11T22:10:48.241 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.847Z caller=main.go:570 level=info host_details="(Linux 5.15.0-100-generic #110-Ubuntu SMP Wed Feb 7 13:27:48 UTC 2024 x86_64 smithi187 (none))" 2024-03-11T22:10:48.242 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.847Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-11T22:10:48.242 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.847Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-11T22:10:48.242 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.849Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-11T22:10:48.242 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.849Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-11T22:10:48.242 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.851Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-11T22:10:48.242 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.851Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-11T22:10:48.243 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.853Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-11T22:10:48.243 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.853Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.744µs 2024-03-11T22:10:48.243 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.853Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-11T22:10:48.243 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.853Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-03-11T22:10:48.243 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.854Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-03-11T22:10:48.244 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.854Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=33.433µs wal_replay_duration=727.594µs wbl_replay_duration=106ns total_replay_duration=787.371µs 2024-03-11T22:10:48.244 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.855Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-11T22:10:48.244 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.855Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-11T22:10:48.244 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.855Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-11T22:10:48.244 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.876Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.273704ms db_storage=841ns remote_storage=1.2µs web_handler=360ns query_engine=678ns scrape=281.661µs scrape_sd=99.743µs notify=13.991µs notify_sd=9.441µs rules=20.616665ms tracing=7.022µs 2024-03-11T22:10:48.244 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.876Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-11T22:10:48.244 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:10:47 smithi187 bash[51422]: ts=2024-03-11T22:10:47.876Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-11T22:10:48.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:10:49.199 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:48 smithi049 bash[21434]: cluster 2024-03-11T22:10:47.394392+0000 mgr.y (mgr.14601) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:49.199 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:48 smithi049 bash[21434]: audit 2024-03-11T22:10:47.934431+0000 mon.c (mon.2) 70 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:49.199 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:48 smithi049 bash[28804]: cluster 2024-03-11T22:10:47.394392+0000 mgr.y (mgr.14601) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:49.199 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:48 smithi049 bash[28804]: audit 2024-03-11T22:10:47.934431+0000 mon.c (mon.2) 70 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:49.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:48 smithi187 bash[23415]: cluster 2024-03-11T22:10:47.394392+0000 mgr.y (mgr.14601) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:49.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:48 smithi187 bash[23415]: audit 2024-03-11T22:10:47.934431+0000 mon.c (mon.2) 70 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:10:49.954 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:49 smithi049 bash[21434]: audit 2024-03-11T22:10:48.420632+0000 mgr.y (mgr.14601) 90 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:50.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:49 smithi187 bash[23415]: audit 2024-03-11T22:10:48.420632+0000 mgr.y (mgr.14601) 90 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:50.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:49 smithi049 bash[28804]: audit 2024-03-11T22:10:48.420632+0000 mgr.y (mgr.14601) 90 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:10:51.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:50 smithi049 bash[21434]: cluster 2024-03-11T22:10:49.395880+0000 mgr.y (mgr.14601) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:51.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:50 smithi049 bash[28804]: cluster 2024-03-11T22:10:49.395880+0000 mgr.y (mgr.14601) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:51.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:50 smithi187 bash[23415]: cluster 2024-03-11T22:10:49.395880+0000 mgr.y (mgr.14601) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:51.391 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:10:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- 172.21.15.49:0/453682037 >> v1:172.21.15.49:6790/0 conn(0x7efcd810a8d0 legacy=0x7efcd810ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- 172.21.15.49:0/453682037 shutdown_connections 2024-03-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- 172.21.15.49:0/453682037 >> 172.21.15.49:0/453682037 conn(0x7efcd80fd510 msgr2=0x7efcd80ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- 172.21.15.49:0/453682037 shutdown_connections 2024-03-11T22:10:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- 172.21.15.49:0/453682037 wait complete. 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 Processor -- start 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- start start 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efcd81a8b20 con 0x7efcd810a8d0 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efcd81a9cc0 con 0x7efcd810e4a0 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcdd2d3700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efcd81aaea0 con 0x7efcd8107a20 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcd6ffd700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7efcd8107a20 0x7efcd8105d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:40212/0 (socket says 172.21.15.49:40212) 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcd6ffd700 1 -- 172.21.15.49:0/4264641967 learned_addr learned my addr 172.21.15.49:0/4264641967 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302958793 0 0) 0x7efcd81aaea0 con 0x7efcd8107a20 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc00049e0 con 0x7efcd8107a20 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025082934 0 0) 0x7efcd81a8b20 con 0x7efcd810a8d0 2024-03-11T22:10:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd81aaea0 con 0x7efcd810a8d0 2024-03-11T22:10:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274100640 0 0) 0x7efcd81a9cc0 con 0x7efcd810e4a0 2024-03-11T22:10:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.146+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd81a8b20 con 0x7efcd810e4a0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3784183206 0 0) 0x7efcc00049e0 con 0x7efcd8107a20 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efcd81a9cc0 con 0x7efcd8107a20 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1117639199 0 0) 0x7efcd81a8b20 con 0x7efcd810e4a0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efcc00049e0 con 0x7efcd810e4a0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7efcc80019f0 con 0x7efcd8107a20 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4288694367 0 0) 0x7efcd81aaea0 con 0x7efcd810a8d0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efcd81a8b20 con 0x7efcd810a8d0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7efcd0001bb0 con 0x7efcd810e4a0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7efccc0018a0 con 0x7efcd810a8d0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1223238995 0 0) 0x7efcc00049e0 con 0x7efcd810e4a0 2024-03-11T22:10:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 >> v1:172.21.15.49:6790/0 conn(0x7efcd8107a20 legacy=0x7efcd8105d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 >> v1:172.21.15.49:6789/0 conn(0x7efcd810a8d0 legacy=0x7efcd81a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd81ac080 con 0x7efcd810e4a0 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd81ab090 con 0x7efcd810e4a0 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd81ab510 con 0x7efcd810e4a0 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7efcd00020e0 con 0x7efcd810e4a0 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7efcd0004cc0 con 0x7efcd810e4a0 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd8103160 con 0x7efcd810e4a0 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7efcd0004f90 con 0x7efcd810e4a0 2024-03-11T22:10:52.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.150+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7efcd0087680 con 0x7efcd810e4a0 2024-03-11T22:10:52.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.158+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7efcd0054b90 con 0x7efcd810e4a0 2024-03-11T22:10:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.246+0000 7fbeb86cc700 1 -- 172.21.15.49:0/2703790181 >> v1:172.21.15.49:6789/0 conn(0x7fbeb01097b0 legacy=0x7fbeb010bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.246+0000 7fbeb86cc700 1 -- 172.21.15.49:0/2703790181 shutdown_connections 2024-03-11T22:10:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.246+0000 7fbeb86cc700 1 -- 172.21.15.49:0/2703790181 >> 172.21.15.49:0/2703790181 conn(0x7fbeb00fc410 msgr2=0x7fbeb00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.246+0000 7fbeb86cc700 1 -- 172.21.15.49:0/2703790181 shutdown_connections 2024-03-11T22:10:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.246+0000 7fbeb86cc700 1 -- 172.21.15.49:0/2703790181 wait complete. 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 Processor -- start 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 -- start start 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbeb01a8ae0 con 0x7fbeb010d380 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbeb01a9cc0 con 0x7fbeb01097b0 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbeb01aaea0 con 0x7fbeb0106900 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb6468700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fbeb0106900 0x7fbeb010cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:40238/0 (socket says 172.21.15.49:40238) 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb6468700 1 -- 172.21.15.49:0/657600272 learned_addr learned my addr 172.21.15.49:0/657600272 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016097820 0 0) 0x7fbeb01a8ae0 con 0x7fbeb010d380 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe9c0049e0 con 0x7fbeb010d380 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330070746 0 0) 0x7fbeb01aaea0 con 0x7fbeb0106900 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb01a8ae0 con 0x7fbeb0106900 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011651404 0 0) 0x7fbeb01a9cc0 con 0x7fbeb01097b0 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb01aaea0 con 0x7fbeb01097b0 2024-03-11T22:10:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1289368864 0 0) 0x7fbe9c0049e0 con 0x7fbeb010d380 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbeb01a9cc0 con 0x7fbeb010d380 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fbea8001c30 con 0x7fbeb010d380 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1051554968 0 0) 0x7fbeb01a8ae0 con 0x7fbeb0106900 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe9c0049e0 con 0x7fbeb0106900 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3641720944 0 0) 0x7fbeb01aaea0 con 0x7fbeb01097b0 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbeb01a8ae0 con 0x7fbeb01097b0 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fbea4001850 con 0x7fbeb0106900 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fbeac0018a0 con 0x7fbeb01097b0 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2245650093 0 0) 0x7fbeb01a9cc0 con 0x7fbeb010d380 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 >> v1:172.21.15.49:6790/0 conn(0x7fbeb0106900 legacy=0x7fbeb010cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 >> v1:172.21.15.187:6789/0 conn(0x7fbeb01097b0 legacy=0x7fbeb01a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb01ac0a0 con 0x7fbeb010d380 2024-03-11T22:10:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb01ab090 con 0x7fbeb010d380 2024-03-11T22:10:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb01ab510 con 0x7fbeb010d380 2024-03-11T22:10:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fbea8003eb0 con 0x7fbeb010d380 2024-03-11T22:10:52.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fbea8004d30 con 0x7fbeb010d380 2024-03-11T22:10:52.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe94005120 con 0x7fbeb010d380 2024-03-11T22:10:52.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.250+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fbea801b280 con 0x7fbeb010d380 2024-03-11T22:10:52.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.254+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fbea8087460 con 0x7fbeb010d380 2024-03-11T22:10:52.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.258+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fbea8054970 con 0x7fbeb010d380 2024-03-11T22:10:52.266 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:10:51 smithi049 bash[61519]: ts=2024-03-11T22:10:51.983Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002955199s 2024-03-11T22:10:52.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efcd8068560 con 0x7efcd810e4a0 2024-03-11T22:10:52.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcbffff700 1 -- 172.21.15.49:0/4264641967 <== mon.1 v1:172.21.15.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 1277925643) 0x7efcd0052f00 con 0x7efcd810e4a0 2024-03-11T22:10:52.367 INFO:teuthology.orchestra.run.smithi049.stdout:55834574950 2024-03-11T22:10:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 >> v1:172.21.15.49:6800/915645872 conn(0x7efcc006e5f0 legacy=0x7efcc0070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 >> v1:172.21.15.187:6789/0 conn(0x7efcd810e4a0 legacy=0x7efcd81a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 shutdown_connections 2024-03-11T22:10:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 >> 172.21.15.49:0/4264641967 conn(0x7efcd80fd510 msgr2=0x7efcd8111110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 shutdown_connections 2024-03-11T22:10:52.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.378+0000 7efcdd2d3700 1 -- 172.21.15.49:0/4264641967 wait complete. 2024-03-11T22:10:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.474+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe940053d0 con 0x7fbeb010d380 2024-03-11T22:10:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.474+0000 7fbea37fe700 1 -- 172.21.15.49:0/657600272 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 2087245573) 0x7fbea8052ce0 con 0x7fbeb010d380 2024-03-11T22:10:52.464 INFO:teuthology.orchestra.run.smithi049.stdout:34359738481 2024-03-11T22:10:52.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.474+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 >> v1:172.21.15.49:6800/915645872 conn(0x7fbe9c06e6d0 legacy=0x7fbe9c070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.474+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 >> v1:172.21.15.49:6789/0 conn(0x7fbeb010d380 legacy=0x7fbeb01a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.474+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 shutdown_connections 2024-03-11T22:10:52.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.474+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 >> 172.21.15.49:0/657600272 conn(0x7fbeb00fc410 msgr2=0x7fbeb0110880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:52.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.478+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 shutdown_connections 2024-03-11T22:10:52.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.478+0000 7fbeb86cc700 1 -- 172.21.15.49:0/657600272 wait complete. 2024-03-11T22:10:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.778+0000 7fd5e94f2700 1 -- 172.21.15.49:0/1742634824 >> v1:172.21.15.49:6790/0 conn(0x7fd5e410d380 legacy=0x7fd5e410f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.778+0000 7fd5e94f2700 1 -- 172.21.15.49:0/1742634824 shutdown_connections 2024-03-11T22:10:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.778+0000 7fd5e94f2700 1 -- 172.21.15.49:0/1742634824 >> 172.21.15.49:0/1742634824 conn(0x7fd5e40fc410 msgr2=0x7fd5e40fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.778+0000 7fd5e94f2700 1 -- 172.21.15.49:0/1742634824 shutdown_connections 2024-03-11T22:10:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.778+0000 7fd5e94f2700 1 -- 172.21.15.49:0/1742634824 wait complete. 2024-03-11T22:10:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.778+0000 7fd5e94f2700 1 Processor -- start 2024-03-11T22:10:52.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e94f2700 1 -- start start 2024-03-11T22:10:52.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e94f2700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd5e410d070 con 0x7fd5e4106900 2024-03-11T22:10:52.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e94f2700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd5e41a7ea0 con 0x7fd5e410d380 2024-03-11T22:10:52.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e94f2700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd5e41a9040 con 0x7fd5e41097b0 2024-03-11T22:10:52.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e2ffd700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd5e4106900 0x7fd5e410ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36494/0 (socket says 172.21.15.49:36494) 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e2ffd700 1 -- 172.21.15.49:0/4155782977 learned_addr learned my addr 172.21.15.49:0/4155782977 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e27fc700 1 --1- 172.21.15.49:0/4155782977 >> v1:172.21.15.49:6790/0 conn(0x7fd5e41097b0 0x7fd5e410b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:40266/0 (socket says 172.21.15.49:40266) 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692162935 0 0) 0x7fd5e410d070 con 0x7fd5e4106900 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5cc0035b0 con 0x7fd5e4106900 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306524887 0 0) 0x7fd5e41a7ea0 con 0x7fd5e410d380 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5e410d070 con 0x7fd5e410d380 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192015380 0 0) 0x7fd5e41a9040 con 0x7fd5e41097b0 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5e41a7ea0 con 0x7fd5e41097b0 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 942408828 0 0) 0x7fd5e410d070 con 0x7fd5e410d380 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5e41a9040 con 0x7fd5e410d380 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fd5dc001c00 con 0x7fd5e410d380 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1216918884 0 0) 0x7fd5cc0035b0 con 0x7fd5e4106900 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5e410d070 con 0x7fd5e4106900 2024-03-11T22:10:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fd5d40018b0 con 0x7fd5e4106900 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1256140445 0 0) 0x7fd5e41a7ea0 con 0x7fd5e41097b0 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5cc0035b0 con 0x7fd5e41097b0 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fd5d80017e0 con 0x7fd5e41097b0 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2386393776 0 0) 0x7fd5e41a9040 con 0x7fd5e410d380 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 >> v1:172.21.15.49:6790/0 conn(0x7fd5e41097b0 legacy=0x7fd5e410b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 >> v1:172.21.15.49:6789/0 conn(0x7fd5e4106900 legacy=0x7fd5e410ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e41aa1e0 con 0x7fd5e410d380 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.187:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e41a9230 con 0x7fd5e410d380 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.187:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e41a96b0 con 0x7fd5e410d380 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fd5dc001ed0 con 0x7fd5e410d380 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fd5dc005110 con 0x7fd5e410d380 2024-03-11T22:10:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d0005120 con 0x7fd5e410d380 2024-03-11T22:10:52.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fd5dc003c20 con 0x7fd5e410d380 2024-03-11T22:10:52.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.782+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fd5dc087690 con 0x7fd5e410d380 2024-03-11T22:10:52.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.786+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fd5dc054b60 con 0x7fd5e410d380 2024-03-11T22:10:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.962+0000 7f3b3c87f700 1 -- 172.21.15.49:0/2720844073 >> v1:172.21.15.49:6790/0 conn(0x7f3b38101550 legacy=0x7f3b38101930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.962+0000 7f3b3c87f700 1 -- 172.21.15.49:0/2720844073 shutdown_connections 2024-03-11T22:10:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.962+0000 7f3b3c87f700 1 -- 172.21.15.49:0/2720844073 >> 172.21.15.49:0/2720844073 conn(0x7f3b38075c60 msgr2=0x7f3b38076070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.962+0000 7f3b3c87f700 1 -- 172.21.15.49:0/2720844073 shutdown_connections 2024-03-11T22:10:52.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.962+0000 7f3b3c87f700 1 -- 172.21.15.49:0/2720844073 wait complete. 2024-03-11T22:10:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 Processor -- start 2024-03-11T22:10:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 -- start start 2024-03-11T22:10:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3b381a68d0 con 0x7f3b38101550 2024-03-11T22:10:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3b381a7a70 con 0x7f3b3810d3b0 2024-03-11T22:10:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3b381a8c70 con 0x7f3b38109810 2024-03-11T22:10:52.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3659c700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3b38101550 0x7f3b381009d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:36506/0 (socket says 172.21.15.49:36506) 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3659c700 1 -- 172.21.15.49:0/284271548 learned_addr learned my addr 172.21.15.49:0/284271548 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780092677 0 0) 0x7f3b381a8c70 con 0x7f3b38109810 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b200049e0 con 0x7f3b38109810 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877534381 0 0) 0x7f3b381a68d0 con 0x7f3b38101550 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b381a8c70 con 0x7f3b38101550 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349479492 0 0) 0x7f3b381a7a70 con 0x7f3b3810d3b0 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b381a68d0 con 0x7f3b3810d3b0 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1465031244 0 0) 0x7f3b200049e0 con 0x7f3b38109810 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b381a7a70 con 0x7f3b38109810 2024-03-11T22:10:52.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f3b2c0018d0 con 0x7f3b38109810 2024-03-11T22:10:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2529590882 0 0) 0x7f3b381a68d0 con 0x7f3b3810d3b0 2024-03-11T22:10:52.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.187:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b200049e0 con 0x7f3b3810d3b0 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f3b30001c30 con 0x7f3b3810d3b0 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3925031076 0 0) 0x7f3b381a8c70 con 0x7f3b38101550 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b381a68d0 con 0x7f3b38101550 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1389573118 0 0) 0x7f3b381a7a70 con 0x7f3b38109810 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 >> v1:172.21.15.187:6789/0 conn(0x7f3b3810d3b0 legacy=0x7f3b381a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 >> v1:172.21.15.49:6789/0 conn(0x7f3b38101550 legacy=0x7f3b381009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b381a9e70 con 0x7f3b38109810 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f3b2c003b30 con 0x7f3b38109810 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b381a8e60 con 0x7f3b38109810 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f3b2c004930 con 0x7f3b38109810 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b381a92e0 con 0x7f3b38109810 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f3b2c004c00 con 0x7f3b38109810 2024-03-11T22:10:52.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.966+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b38069dc0 con 0x7f3b38109810 2024-03-11T22:10:52.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.970+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f3b2c085a20 con 0x7f3b38109810 2024-03-11T22:10:52.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:52.974+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f3b2c0547b0 con 0x7f3b38109810 2024-03-11T22:10:52.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.006+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 --> v1:172.21.15.187:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd5d00053d0 con 0x7fd5e410d380 2024-03-11T22:10:52.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.006+0000 7fd5cbfff700 1 -- 172.21.15.49:0/4155782977 <== mon.1 v1:172.21.15.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (unknown 1274345170 0 3627479388) 0x7fd5dc052ed0 con 0x7fd5e410d380 2024-03-11T22:10:52.997 INFO:teuthology.orchestra.run.smithi049.stdout:197568495667 2024-03-11T22:10:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.010+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 >> v1:172.21.15.49:6800/915645872 conn(0x7fd5cc06e620 legacy=0x7fd5cc070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.010+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 >> v1:172.21.15.187:6789/0 conn(0x7fd5e410d380 legacy=0x7fd5e41a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.010+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 shutdown_connections 2024-03-11T22:10:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.010+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 >> 172.21.15.49:0/4155782977 conn(0x7fd5e40fc410 msgr2=0x7fd5e4100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.010+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 shutdown_connections 2024-03-11T22:10:52.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.010+0000 7fd5e94f2700 1 -- 172.21.15.49:0/4155782977 wait complete. 2024-03-11T22:10:53.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:52 smithi049 bash[21434]: cluster 2024-03-11T22:10:51.396593+0000 mgr.y (mgr.14601) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:53.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:52 smithi049 bash[21434]: audit 2024-03-11T22:10:52.377362+0000 mon.b (mon.1) 33 : audit 0 from='client.? v1:172.21.15.49:0/4264641967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-11T22:10:53.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:52 smithi049 bash[21434]: audit 2024-03-11T22:10:52.478567+0000 mon.a (mon.0) 811 : audit 0 from='client.? v1:172.21.15.49:0/657600272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-11T22:10:53.011 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:52 smithi049 bash[28804]: cluster 2024-03-11T22:10:51.396593+0000 mgr.y (mgr.14601) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:53.011 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:52 smithi049 bash[28804]: audit 2024-03-11T22:10:52.377362+0000 mon.b (mon.1) 33 : audit 0 from='client.? v1:172.21.15.49:0/4264641967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-11T22:10:53.011 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:52 smithi049 bash[28804]: audit 2024-03-11T22:10:52.478567+0000 mon.a (mon.0) 811 : audit 0 from='client.? v1:172.21.15.49:0/657600272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-11T22:10:53.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.182+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3b38068560 con 0x7f3b38109810 2024-03-11T22:10:53.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.182+0000 7f3b277fe700 1 -- 172.21.15.49:0/284271548 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (unknown 2131975755 0 1206048046) 0x7f3b2c052b20 con 0x7f3b38109810 2024-03-11T22:10:53.172 INFO:teuthology.orchestra.run.smithi049.stdout:163208757309 2024-03-11T22:10:53.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.182+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 >> v1:172.21.15.49:6800/915645872 conn(0x7f3b2006e7c0 legacy=0x7f3b20070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:53.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.182+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 >> v1:172.21.15.49:6790/0 conn(0x7f3b38109810 legacy=0x7f3b381a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:53.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.186+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 shutdown_connections 2024-03-11T22:10:53.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.186+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 >> 172.21.15.49:0/284271548 conn(0x7f3b38075c60 msgr2=0x7f3b381109b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:53.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.186+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 shutdown_connections 2024-03-11T22:10:53.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:53.186+0000 7f3b3c87f700 1 -- 172.21.15.49:0/284271548 wait complete. 2024-03-11T22:10:53.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:52 smithi187 bash[23415]: cluster 2024-03-11T22:10:51.396593+0000 mgr.y (mgr.14601) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:53.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:52 smithi187 bash[23415]: audit 2024-03-11T22:10:52.377362+0000 mon.b (mon.1) 33 : audit 0 from='client.? v1:172.21.15.49:0/4264641967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-11T22:10:53.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:52 smithi187 bash[23415]: audit 2024-03-11T22:10:52.478567+0000 mon.a (mon.0) 811 : audit 0 from='client.? v1:172.21.15.49:0/657600272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-11T22:10:54.024 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738477 got 34359738481 for osd.0 2024-03-11T22:10:54.024 DEBUG:teuthology.parallel:result is None 2024-03-11T22:10:54.220 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[28804]: audit 2024-03-11T22:10:52.940191+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:54.220 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[28804]: audit 2024-03-11T22:10:52.947339+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:54.221 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[28804]: audit 2024-03-11T22:10:53.006895+0000 mon.b (mon.1) 34 : audit 0 from='client.? v1:172.21.15.49:0/4155782977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-11T22:10:54.221 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[28804]: audit 2024-03-11T22:10:53.186500+0000 mon.c (mon.2) 71 : audit 0 from='client.? v1:172.21.15.49:0/284271548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-11T22:10:54.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[21434]: audit 2024-03-11T22:10:52.940191+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:54.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[21434]: audit 2024-03-11T22:10:52.947339+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:54.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[21434]: audit 2024-03-11T22:10:53.006895+0000 mon.b (mon.1) 34 : audit 0 from='client.? v1:172.21.15.49:0/4155782977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-11T22:10:54.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:53 smithi049 bash[21434]: audit 2024-03-11T22:10:53.186500+0000 mon.c (mon.2) 71 : audit 0 from='client.? v1:172.21.15.49:0/284271548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-11T22:10:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:53 smithi187 bash[23415]: audit 2024-03-11T22:10:52.940191+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:53 smithi187 bash[23415]: audit 2024-03-11T22:10:52.947339+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:10:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:53 smithi187 bash[23415]: audit 2024-03-11T22:10:53.006895+0000 mon.b (mon.1) 34 : audit 0 from='client.? v1:172.21.15.49:0/4155782977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-11T22:10:54.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:53 smithi187 bash[23415]: audit 2024-03-11T22:10:53.186500+0000 mon.c (mon.2) 71 : audit 0 from='client.? v1:172.21.15.49:0/284271548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-11T22:10:54.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:10:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:10:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:10:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/110397480 >> v1:172.21.15.49:6789/0 conn(0x7f0a8810a8d0 legacy=0x7f0a8810ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/110397480 shutdown_connections 2024-03-11T22:10:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/110397480 >> 172.21.15.49:0/110397480 conn(0x7f0a880fd550 msgr2=0x7f0a880ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/110397480 shutdown_connections 2024-03-11T22:10:54.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/110397480 wait complete. 2024-03-11T22:10:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 Processor -- start 2024-03-11T22:10:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- start start 2024-03-11T22:10:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0a881a6960 con 0x7f0a88107a20 2024-03-11T22:10:54.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.926+0000 7f0a8cf7f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0a881a7b40 con 0x7f0a8810e4a0 2024-03-11T22:10:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a8cf7f700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0a881a8d40 con 0x7f0a8810a8d0 2024-03-11T22:10:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a85d9b700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f0a8810a8d0 0x7f0a881a1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:45824/0 (socket says 172.21.15.49:45824) 2024-03-11T22:10:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a85d9b700 1 -- 172.21.15.49:0/3579625736 learned_addr learned my addr 172.21.15.49:0/3579625736 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863712261 0 0) 0x7f0a881a6960 con 0x7f0a88107a20 2024-03-11T22:10:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a700031f0 con 0x7f0a88107a20 2024-03-11T22:10:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460663270 0 0) 0x7f0a881a8d40 con 0x7f0a8810a8d0 2024-03-11T22:10:54.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a881a6960 con 0x7f0a8810a8d0 2024-03-11T22:10:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2734911931 0 0) 0x7f0a700031f0 con 0x7f0a88107a20 2024-03-11T22:10:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a881a8d40 con 0x7f0a88107a20 2024-03-11T22:10:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1401526611 0 0) 0x7f0a881a6960 con 0x7f0a8810a8d0 2024-03-11T22:10:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a700031f0 con 0x7f0a8810a8d0 2024-03-11T22:10:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f0a78001830 con 0x7f0a88107a20 2024-03-11T22:10:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f0a7c0043f0 con 0x7f0a8810a8d0 2024-03-11T22:10:54.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342855935 0 0) 0x7f0a881a7b40 con 0x7f0a8810e4a0 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a881a6960 con 0x7f0a8810e4a0 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1143522204 0 0) 0x7f0a881a8d40 con 0x7f0a88107a20 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 >> v1:172.21.15.49:6790/0 conn(0x7f0a8810a8d0 legacy=0x7f0a881a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 >> v1:172.21.15.187:6789/0 conn(0x7f0a8810e4a0 legacy=0x7f0a881a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a881a9f40 con 0x7f0a88107a20 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a881a8f30 con 0x7f0a88107a20 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a881a93b0 con 0x7f0a88107a20 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f0a780019e0 con 0x7f0a88107a20 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f0a78004a30 con 0x7f0a88107a20 2024-03-11T22:10:54.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a68005120 con 0x7f0a88107a20 2024-03-11T22:10:54.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f0a78003680 con 0x7f0a88107a20 2024-03-11T22:10:54.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.930+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f0a78087120 con 0x7f0a88107a20 2024-03-11T22:10:54.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:54.934+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0a780545f0 con 0x7f0a88107a20 2024-03-11T22:10:55.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:54 smithi049 bash[21434]: cluster 2024-03-11T22:10:53.397955+0000 mgr.y (mgr.14601) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:55.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:54 smithi049 bash[28804]: cluster 2024-03-11T22:10:53.397955+0000 mgr.y (mgr.14601) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:55.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.150+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a680053d0 con 0x7f0a88107a20 2024-03-11T22:10:55.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.150+0000 7f0a777fe700 1 -- 172.21.15.49:0/3579625736 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 3336642658) 0x7f0a78052960 con 0x7f0a88107a20 2024-03-11T22:10:55.142 INFO:teuthology.orchestra.run.smithi049.stdout:77309411421 2024-03-11T22:10:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.154+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 >> v1:172.21.15.49:6800/915645872 conn(0x7f0a7006e550 legacy=0x7f0a70070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.154+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 >> v1:172.21.15.49:6789/0 conn(0x7f0a88107a20 legacy=0x7f0a8810db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.154+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 shutdown_connections 2024-03-11T22:10:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.154+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 >> 172.21.15.49:0/3579625736 conn(0x7f0a880fd550 msgr2=0x7f0a88101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.154+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 shutdown_connections 2024-03-11T22:10:55.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:55.154+0000 7f0a8cf7f700 1 -- 172.21.15.49:0/3579625736 wait complete. 2024-03-11T22:10:55.152 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574947 got 55834574950 for osd.1 2024-03-11T22:10:55.152 DEBUG:teuthology.parallel:result is None 2024-03-11T22:10:55.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:54 smithi187 bash[23415]: cluster 2024-03-11T22:10:53.397955+0000 mgr.y (mgr.14601) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:10:56.160 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757306 got 163208757309 for osd.5 2024-03-11T22:10:56.188 DEBUG:teuthology.parallel:result is None 2024-03-11T22:10:56.209 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:55 smithi049 bash[21434]: audit 2024-03-11T22:10:55.156293+0000 mon.a (mon.0) 814 : audit 0 from='client.? v1:172.21.15.49:0/3579625736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-11T22:10:56.210 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:55 smithi049 bash[28804]: audit 2024-03-11T22:10:55.156293+0000 mon.a (mon.0) 814 : audit 0 from='client.? v1:172.21.15.49:0/3579625736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-11T22:10:56.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:55 smithi187 bash[23415]: audit 2024-03-11T22:10:55.156293+0000 mon.a (mon.0) 814 : audit 0 from='client.? v1:172.21.15.49:0/3579625736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-11T22:10:56.304 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495663 got 197568495667 for osd.6 2024-03-11T22:10:56.305 DEBUG:teuthology.parallel:result is None 2024-03-11T22:10:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- 172.21.15.49:0/999857629 >> v1:172.21.15.49:6789/0 conn(0x7fcf04106930 legacy=0x7fcf04106d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- 172.21.15.49:0/999857629 shutdown_connections 2024-03-11T22:10:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- 172.21.15.49:0/999857629 >> 172.21.15.49:0/999857629 conn(0x7fcf040fc440 msgr2=0x7fcf040fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- 172.21.15.49:0/999857629 shutdown_connections 2024-03-11T22:10:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- 172.21.15.49:0/999857629 wait complete. 2024-03-11T22:10:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 Processor -- start 2024-03-11T22:10:56.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- start start 2024-03-11T22:10:56.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcf041a8b10 con 0x7fcf041097e0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcf041a9cf0 con 0x7fcf04106930 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcf041aaed0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0a9a4700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fcf0410d3b0 0x7fcf041a7290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:45844/0 (socket says 172.21.15.49:45844) 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0a9a4700 1 -- 172.21.15.49:0/3741511673 learned_addr learned my addr 172.21.15.49:0/3741511673 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf099a2700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcf041097e0 0x7fcf041a3b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40752/0 (socket says 172.21.15.49:40752) 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76055497 0 0) 0x7fcf041aaed0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef00037f0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666370996 0 0) 0x7fcf041a8b10 con 0x7fcf041097e0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf041aaed0 con 0x7fcf041097e0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1469305666 0 0) 0x7fcef00037f0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcf041a8b10 con 0x7fcf0410d3b0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fcefc001c50 con 0x7fcf0410d3b0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1599005129 0 0) 0x7fcf041aaed0 con 0x7fcf041097e0 2024-03-11T22:10:56.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcef00037f0 con 0x7fcf041097e0 2024-03-11T22:10:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645797707 0 0) 0x7fcf041a9cf0 con 0x7fcf04106930 2024-03-11T22:10:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf041aaed0 con 0x7fcf04106930 2024-03-11T22:10:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fcef4003fd0 con 0x7fcf041097e0 2024-03-11T22:10:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1390253914 0 0) 0x7fcf041a8b10 con 0x7fcf0410d3b0 2024-03-11T22:10:56.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 >> v1:172.21.15.187:6789/0 conn(0x7fcf04106930 legacy=0x7fcf0410cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 >> v1:172.21.15.49:6789/0 conn(0x7fcf041097e0 legacy=0x7fcf041a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf041ac0d0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf041a8d00 con 0x7fcf0410d3b0 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf041a9180 con 0x7fcf0410d3b0 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fcefc003eb0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.378+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fcefc005f30 con 0x7fcf0410d3b0 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.382+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee8005120 con 0x7fcf0410d3b0 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.382+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fcefc01c540 con 0x7fcf0410d3b0 2024-03-11T22:10:56.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.382+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fcefc088780 con 0x7fcf0410d3b0 2024-03-11T22:10:56.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.386+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fcefc055c50 con 0x7fcf0410d3b0 2024-03-11T22:10:56.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.594+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcee80053d0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.594+0000 7fcefb7fe700 1 -- 172.21.15.49:0/3741511673 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (unknown 1823589948 0 3376596024) 0x7fcefc053fc0 con 0x7fcf0410d3b0 2024-03-11T22:10:56.586 INFO:teuthology.orchestra.run.smithi049.stdout:128849018952 2024-03-11T22:10:56.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.598+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 >> v1:172.21.15.49:6800/915645872 conn(0x7fcef006e710 legacy=0x7fcef0070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:56.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.598+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 >> v1:172.21.15.49:6790/0 conn(0x7fcf0410d3b0 legacy=0x7fcf041a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:10:56.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.598+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 shutdown_connections 2024-03-11T22:10:56.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.598+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 >> 172.21.15.49:0/3741511673 conn(0x7fcf040fc440 msgr2=0x7fcf0406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:10:56.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.598+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 shutdown_connections 2024-03-11T22:10:56.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:10:56.598+0000 7fcf0c407700 1 -- 172.21.15.49:0/3741511673 wait complete. 2024-03-11T22:10:57.197 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:56 smithi049 bash[21434]: cluster 2024-03-11T22:10:55.398374+0000 mgr.y (mgr.14601) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:57.197 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:56 smithi049 bash[21434]: audit 2024-03-11T22:10:56.600788+0000 mon.c (mon.2) 72 : audit 0 from='client.? v1:172.21.15.49:0/3741511673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-11T22:10:57.198 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:56 smithi049 bash[28804]: cluster 2024-03-11T22:10:55.398374+0000 mgr.y (mgr.14601) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:57.198 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:56 smithi049 bash[28804]: audit 2024-03-11T22:10:56.600788+0000 mon.c (mon.2) 72 : audit 0 from='client.? v1:172.21.15.49:0/3741511673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-11T22:10:57.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:56 smithi187 bash[23415]: cluster 2024-03-11T22:10:55.398374+0000 mgr.y (mgr.14601) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:57.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:56 smithi187 bash[23415]: audit 2024-03-11T22:10:56.600788+0000 mon.c (mon.2) 72 : audit 0 from='client.? v1:172.21.15.49:0/3741511673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-11T22:10:57.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411416 got 77309411421 for osd.2 2024-03-11T22:10:57.688 DEBUG:teuthology.parallel:result is None 2024-03-11T22:10:58.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:10:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:10:59.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:58 smithi187 bash[23415]: cluster 2024-03-11T22:10:57.398961+0000 mgr.y (mgr.14601) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:59.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:58 smithi049 bash[21434]: cluster 2024-03-11T22:10:57.398961+0000 mgr.y (mgr.14601) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:59.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:58 smithi049 bash[28804]: cluster 2024-03-11T22:10:57.398961+0000 mgr.y (mgr.14601) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:10:59.459 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018947 got 128849018952 for osd.4 2024-03-11T22:10:59.459 DEBUG:teuthology.parallel:result is None 2024-03-11T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 -- 172.21.15.49:0/3860487411 >> v1:172.21.15.49:6790/0 conn(0x7f0cb0106900 legacy=0x7f0cb0106ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 -- 172.21.15.49:0/3860487411 shutdown_connections 2024-03-11T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 -- 172.21.15.49:0/3860487411 >> 172.21.15.49:0/3860487411 conn(0x7f0cb00fc410 msgr2=0x7f0cb00fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 -- 172.21.15.49:0/3860487411 shutdown_connections 2024-03-11T22:11:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 -- 172.21.15.49:0/3860487411 wait complete. 2024-03-11T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 Processor -- start 2024-03-11T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 -- start start 2024-03-11T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.214+0000 7f0cb5288700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0cb01a6900 con 0x7f0cb010d380 2024-03-11T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0cb5288700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0cb01a7ae0 con 0x7f0cb01097b0 2024-03-11T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0cb5288700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0cb01a8ce0 con 0x7f0cb0106900 2024-03-11T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0caeffd700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f0cb0106900 0x7f0cb010cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:45866/0 (socket says 172.21.15.49:45866) 2024-03-11T22:11:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0caeffd700 1 -- 172.21.15.49:0/1352314789 learned_addr learned my addr 172.21.15.49:0/1352314789 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242351651 0 0) 0x7f0cb01a6900 con 0x7f0cb010d380 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c980035b0 con 0x7f0cb010d380 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921926173 0 0) 0x7f0cb01a8ce0 con 0x7f0cb0106900 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb01a6900 con 0x7f0cb0106900 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1747826535 0 0) 0x7f0cb01a6900 con 0x7f0cb0106900 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0cb01a8ce0 con 0x7f0cb0106900 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f0ca40045b0 con 0x7f0cb0106900 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3832563309 0 0) 0x7f0c980035b0 con 0x7f0cb010d380 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0cb01a6900 con 0x7f0cb010d380 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f0ca80013f0 con 0x7f0cb010d380 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938487957 0 0) 0x7f0cb01a7ae0 con 0x7f0cb01097b0 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c980035b0 con 0x7f0cb01097b0 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2118314560 0 0) 0x7f0cb01a8ce0 con 0x7f0cb0106900 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 >> v1:172.21.15.187:6789/0 conn(0x7f0cb01097b0 legacy=0x7f0cb01a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 >> v1:172.21.15.49:6789/0 conn(0x7f0cb010d380 legacy=0x7f0cb01a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb01a9ee0 con 0x7f0cb0106900 2024-03-11T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb01a6af0 con 0x7f0cb0106900 2024-03-11T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb01a6f70 con 0x7f0cb0106900 2024-03-11T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f0ca4003b10 con 0x7f0cb0106900 2024-03-11T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f0ca4004eb0 con 0x7f0cb0106900 2024-03-11T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c005150 con 0x7f0cb0106900 2024-03-11T22:11:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f0ca4003680 con 0x7f0cb0106900 2024-03-11T22:11:00.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.218+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f0ca4088690 con 0x7f0cb0106900 2024-03-11T22:11:00.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.226+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0ca4055b60 con 0x7f0cb0106900 2024-03-11T22:11:00.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:10:59 smithi187 bash[23415]: audit 2024-03-11T22:10:58.431222+0000 mgr.y (mgr.14601) 96 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:00.265 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:10:59 smithi049 bash[21434]: audit 2024-03-11T22:10:58.431222+0000 mgr.y (mgr.14601) 96 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:00.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:10:59 smithi049 bash[28804]: audit 2024-03-11T22:10:58.431222+0000 mgr.y (mgr.14601) 96 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:00.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- 172.21.15.49:0/3476330598 >> v1:172.21.15.49:6790/0 conn(0x7fc87410e580 legacy=0x7fc874110a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- 172.21.15.49:0/3476330598 shutdown_connections 2024-03-11T22:11:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- 172.21.15.49:0/3476330598 >> 172.21.15.49:0/3476330598 conn(0x7fc874076da0 msgr2=0x7fc8740fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- 172.21.15.49:0/3476330598 shutdown_connections 2024-03-11T22:11:00.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- 172.21.15.49:0/3476330598 wait complete. 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 Processor -- start 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- start start 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc8741a68e0 con 0x7fc87410a8b0 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc8741a7ac0 con 0x7fc87410e580 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc8741a8cc0 con 0x7fc874106a30 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87a210700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fc874106a30 0x7fc8740fee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:45886/0 (socket says 172.21.15.49:45886) 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87a210700 1 -- 172.21.15.49:0/577684437 learned_addr learned my addr 172.21.15.49:0/577684437 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc879a0f700 1 --1- 172.21.15.49:0/577684437 >> v1:172.21.15.49:6789/0 conn(0x7fc87410a8b0 0x7fc8741a1930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:40782/0 (socket says 172.21.15.49:40782) 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387664558 0 0) 0x7fc8741a68e0 con 0x7fc87410a8b0 2024-03-11T22:11:00.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8600031f0 con 0x7fc87410a8b0 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358841115 0 0) 0x7fc8741a8cc0 con 0x7fc874106a30 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8741a68e0 con 0x7fc874106a30 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3489660003 0 0) 0x7fc8600031f0 con 0x7fc87410a8b0 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8741a8cc0 con 0x7fc87410a8b0 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fc8640018d0 con 0x7fc87410a8b0 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2894127678 0 0) 0x7fc8741a68e0 con 0x7fc874106a30 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8600031f0 con 0x7fc874106a30 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fc870001930 con 0x7fc874106a30 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 399766549 0 0) 0x7fc8741a8cc0 con 0x7fc87410a8b0 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 >> v1:172.21.15.49:6790/0 conn(0x7fc874106a30 legacy=0x7fc8740fee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 >> v1:172.21.15.187:6789/0 conn(0x7fc87410e580 legacy=0x7fc8741a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8741a9ec0 con 0x7fc87410a8b0 2024-03-11T22:11:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.434+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8741a8eb0 con 0x7fc87410a8b0 2024-03-11T22:11:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.438+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8741a9330 con 0x7fc87410a8b0 2024-03-11T22:11:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.438+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fc864003b10 con 0x7fc87410a8b0 2024-03-11T22:11:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.438+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fc864005bd0 con 0x7fc87410a8b0 2024-03-11T22:11:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.438+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc858005120 con 0x7fc87410a8b0 2024-03-11T22:11:00.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.438+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fc864003680 con 0x7fc87410a8b0 2024-03-11T22:11:00.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.438+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7fc864088250 con 0x7fc87410a8b0 2024-03-11T22:11:00.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.442+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c9c005400 con 0x7f0cb0106900 2024-03-11T22:11:00.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.442+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fc864055720 con 0x7fc87410a8b0 2024-03-11T22:11:00.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.442+0000 7f0c97fff700 1 -- 172.21.15.49:0/1352314789 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (unknown 383520633 0 2832570704) 0x7f0ca4053ed0 con 0x7f0cb0106900 2024-03-11T22:11:00.433 INFO:teuthology.orchestra.run.smithi049.stdout:107374182484 2024-03-11T22:11:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.446+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 >> v1:172.21.15.49:6800/915645872 conn(0x7f0c9806e5f0 legacy=0x7f0c98070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.446+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 >> v1:172.21.15.49:6790/0 conn(0x7f0cb0106900 legacy=0x7f0cb010cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.446+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 shutdown_connections 2024-03-11T22:11:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.446+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 >> 172.21.15.49:0/1352314789 conn(0x7f0cb00fc410 msgr2=0x7f0cb01105c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.446+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 shutdown_connections 2024-03-11T22:11:00.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.446+0000 7f0cb5288700 1 -- 172.21.15.49:0/1352314789 wait complete. 2024-03-11T22:11:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.670+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc8580053d0 con 0x7fc87410a8b0 2024-03-11T22:11:00.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.674+0000 7fc86b7fe700 1 -- 172.21.15.49:0/577684437 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (unknown 1482059429 0 485315811) 0x7fc864053a90 con 0x7fc87410a8b0 2024-03-11T22:11:00.662 INFO:teuthology.orchestra.run.smithi049.stdout:231928234026 2024-03-11T22:11:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.674+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 >> v1:172.21.15.49:6800/915645872 conn(0x7fc86006e470 legacy=0x7fc860070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.674+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 >> v1:172.21.15.49:6789/0 conn(0x7fc87410a8b0 legacy=0x7fc8741a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.674+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 shutdown_connections 2024-03-11T22:11:00.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.674+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 >> 172.21.15.49:0/577684437 conn(0x7fc874076da0 msgr2=0x7fc87410d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.674+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 shutdown_connections 2024-03-11T22:11:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:00.674+0000 7fc87c474700 1 -- 172.21.15.49:0/577684437 wait complete. 2024-03-11T22:11:01.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: cluster 2024-03-11T22:10:59.400158+0000 mgr.y (mgr.14601) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.145776+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.153083+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.447835+0000 mon.c (mon.2) 73 : audit 0 from='client.? v1:172.21.15.49:0/1352314789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.677019+0000 mon.a (mon.0) 817 : audit 0 from='client.? v1:172.21.15.49:0/577684437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.724882+0000 mon.c (mon.2) 74 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.725762+0000 mon.c (mon.2) 75 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.731629+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.791442+0000 mon.c (mon.2) 76 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.793153+0000 mon.c (mon.2) 77 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.793831+0000 mon.c (mon.2) 78 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:11:01.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[28804]: audit 2024-03-11T22:11:00.799039+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: cluster 2024-03-11T22:10:59.400158+0000 mgr.y (mgr.14601) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.145776+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.153083+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.447835+0000 mon.c (mon.2) 73 : audit 0 from='client.? v1:172.21.15.49:0/1352314789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.677019+0000 mon.a (mon.0) 817 : audit 0 from='client.? v1:172.21.15.49:0/577684437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.724882+0000 mon.c (mon.2) 74 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.725762+0000 mon.c (mon.2) 75 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.731629+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.791442+0000 mon.c (mon.2) 76 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.793153+0000 mon.c (mon.2) 77 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.793831+0000 mon.c (mon.2) 78 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:11:01.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:00 smithi049 bash[21434]: audit 2024-03-11T22:11:00.799039+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: cluster 2024-03-11T22:10:59.400158+0000 mgr.y (mgr.14601) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.145776+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.153083+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.447835+0000 mon.c (mon.2) 73 : audit 0 from='client.? v1:172.21.15.49:0/1352314789' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-11T22:11:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.677019+0000 mon.a (mon.0) 817 : audit 0 from='client.? v1:172.21.15.49:0/577684437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-11T22:11:01.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.724882+0000 mon.c (mon.2) 74 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:11:01.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.725762+0000 mon.c (mon.2) 75 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:11:01.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.731629+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.791442+0000 mon.c (mon.2) 76 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:11:01.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.793153+0000 mon.c (mon.2) 77 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:11:01.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.793831+0000 mon.c (mon.2) 78 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:11:01.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:00 smithi187 bash[23415]: audit 2024-03-11T22:11:00.799039+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:11:01.338 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182479 got 107374182484 for osd.3 2024-03-11T22:11:01.339 DEBUG:teuthology.parallel:result is None 2024-03-11T22:11:01.719 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234021 got 231928234026 for osd.7 2024-03-11T22:11:01.719 DEBUG:teuthology.parallel:result is None 2024-03-11T22:11:01.719 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-11T22:11:01.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph pg dump --format=json 2024-03-11T22:11:03.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:02 smithi187 bash[23415]: cluster 2024-03-11T22:11:01.400825+0000 mgr.y (mgr.14601) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:03.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:02 smithi187 bash[23415]: audit 2024-03-11T22:11:02.964366+0000 mon.c (mon.2) 79 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:03.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:02 smithi049 bash[21434]: cluster 2024-03-11T22:11:01.400825+0000 mgr.y (mgr.14601) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:03.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:02 smithi049 bash[21434]: audit 2024-03-11T22:11:02.964366+0000 mon.c (mon.2) 79 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:03.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:02 smithi049 bash[28804]: cluster 2024-03-11T22:11:01.400825+0000 mgr.y (mgr.14601) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:03.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:02 smithi049 bash[28804]: audit 2024-03-11T22:11:02.964366+0000 mon.c (mon.2) 79 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:04.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:11:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:11:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:11:05.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:04 smithi187 bash[23415]: cluster 2024-03-11T22:11:03.402210+0000 mgr.y (mgr.14601) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:05.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:04 smithi049 bash[21434]: cluster 2024-03-11T22:11:03.402210+0000 mgr.y (mgr.14601) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:05.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:04 smithi049 bash[28804]: cluster 2024-03-11T22:11:03.402210+0000 mgr.y (mgr.14601) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:06.507 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:11:07.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:06 smithi187 bash[23415]: cluster 2024-03-11T22:11:05.402986+0000 mgr.y (mgr.14601) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:07.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:06 smithi049 bash[21434]: cluster 2024-03-11T22:11:05.402986+0000 mgr.y (mgr.14601) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:07.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:06 smithi049 bash[28804]: cluster 2024-03-11T22:11:05.402986+0000 mgr.y (mgr.14601) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:08.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:11:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:11:09.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- 172.21.15.49:0/12504624 >> v1:172.21.15.49:6789/0 conn(0x7f8ee810e500 legacy=0x7f8ee8110990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:09.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- 172.21.15.49:0/12504624 shutdown_connections 2024-03-11T22:11:09.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- 172.21.15.49:0/12504624 >> 172.21.15.49:0/12504624 conn(0x7f8ee80fc410 msgr2=0x7f8ee80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:09.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- 172.21.15.49:0/12504624 shutdown_connections 2024-03-11T22:11:09.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- 172.21.15.49:0/12504624 wait complete. 2024-03-11T22:11:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 Processor -- start 2024-03-11T22:11:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- start start 2024-03-11T22:11:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8ee8102340 con 0x7f8ee810e500 2024-03-11T22:11:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8ee8102510 con 0x7f8ee810a9f0 2024-03-11T22:11:09.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8ee81026e0 con 0x7f8ee8102be0 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eee2ec700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ee810e500 0x7f8ee81a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:42192/0 (socket says 172.21.15.49:42192) 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eee2ec700 1 -- 172.21.15.49:0/3582907105 learned_addr learned my addr 172.21.15.49:0/3582907105 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124717909 0 0) 0x7f8ee81026e0 con 0x7f8ee8102be0 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed40037f0 con 0x7f8ee8102be0 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817837884 0 0) 0x7f8ee8102340 con 0x7f8ee810e500 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee81026e0 con 0x7f8ee810e500 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1377789270 0 0) 0x7f8ed40037f0 con 0x7f8ee8102be0 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ee8102340 con 0x7f8ee8102be0 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8ed80018d0 con 0x7f8ee8102be0 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2630628809 0 0) 0x7f8ee81026e0 con 0x7f8ee810e500 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ed40037f0 con 0x7f8ee810e500 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8ee0001cf0 con 0x7f8ee810e500 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205774543 0 0) 0x7f8ee8102510 con 0x7f8ee810a9f0 2024-03-11T22:11:09.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee81026e0 con 0x7f8ee810a9f0 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 646400834 0 0) 0x7f8ee8102340 con 0x7f8ee8102be0 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 >> v1:172.21.15.187:6789/0 conn(0x7f8ee810a9f0 legacy=0x7f8ee8100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 >> v1:172.21.15.49:6789/0 conn(0x7f8ee810e500 legacy=0x7f8ee81a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee81ac390 con 0x7f8ee8102be0 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee81a93c0 con 0x7f8ee8102be0 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee81a9840 con 0x7f8ee8102be0 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f8ed8003b30 con 0x7f8ee8102be0 2024-03-11T22:11:09.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.190+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8ed8004a50 con 0x7f8ee8102be0 2024-03-11T22:11:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.194+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc005120 con 0x7f8ee8102be0 2024-03-11T22:11:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.194+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f8ed8003680 con 0x7f8ee8102be0 2024-03-11T22:11:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.194+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7f8ed8087160 con 0x7f8ee8102be0 2024-03-11T22:11:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.198+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8ed8054670 con 0x7f8ee8102be0 2024-03-11T22:11:09.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:08 smithi187 bash[23415]: cluster 2024-03-11T22:11:07.403582+0000 mgr.y (mgr.14601) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:09.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:08 smithi049 bash[21434]: cluster 2024-03-11T22:11:07.403582+0000 mgr.y (mgr.14601) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:09.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:08 smithi049 bash[28804]: cluster 2024-03-11T22:11:07.403582+0000 mgr.y (mgr.14601) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.418+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 --> v1:172.21.15.49:6800/915645872 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ecc000b90 con 0x7f8ed406e770 2024-03-11T22:11:09.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.438+0000 7f8edeffd700 1 -- 172.21.15.49:0/3582907105 <== mgr.14601 v1:172.21.15.49:6800/915645872 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+346507 (unknown 2965378022 0 2942786697) 0x7f8ecc000b90 con 0x7f8ed406e770 2024-03-11T22:11:09.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:11:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.442+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 >> v1:172.21.15.49:6800/915645872 conn(0x7f8ed406e770 legacy=0x7f8ed4070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.442+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 >> v1:172.21.15.49:6790/0 conn(0x7f8ee8102be0 legacy=0x7f8ee8100840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.442+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 shutdown_connections 2024-03-11T22:11:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.442+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 >> 172.21.15.49:0/3582907105 conn(0x7f8ee80fc410 msgr2=0x7f8ee8110950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.442+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 shutdown_connections 2024-03-11T22:11:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:09.442+0000 7f8eefd4f700 1 -- 172.21.15.49:0/3582907105 wait complete. 2024-03-11T22:11:09.436 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-11T22:11:10.123 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-03-11T22:11:09.403825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596316,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1098,"num_read_kb":944,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":248688,"kb_used_data":7580,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":749712528,"statfs":{"total":767960285184,"available":767705628672,"internally_reserved":0,"allocated":7761920,"data_stored":4123156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005254"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478103+0000","last_change":"2024-03-11T22:08:22.573422+0000","last_active":"2024-03-11T22:09:17.478103+0000","last_peered":"2024-03-11T22:09:17.478103+0000","last_clean":"2024-03-11T22:09:17.478103+0000","last_became_active":"2024-03-11T22:08:22.572436+0000","last_became_peered":"2024-03-11T22:08:22.572436+0000","last_unstale":"2024-03-11T22:09:17.478103+0000","last_undegraded":"2024-03-11T22:09:17.478103+0000","last_fullsized":"2024-03-11T22:09:17.478103+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:55:55.569272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477743+0000","last_change":"2024-03-11T22:08:20.342372+0000","last_active":"2024-03-11T22:09:17.477743+0000","last_peered":"2024-03-11T22:09:17.477743+0000","last_clean":"2024-03-11T22:09:17.477743+0000","last_became_active":"2024-03-11T22:08:20.341191+0000","last_became_peered":"2024-03-11T22:08:20.341191+0000","last_unstale":"2024-03-11T22:09:17.477743+0000","last_undegraded":"2024-03-11T22:09:17.477743+0000","last_fullsized":"2024-03-11T22:09:17.477743+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:53:02.429730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729838+0000","last_change":"2024-03-11T22:08:16.277816+0000","last_active":"2024-03-11T22:09:17.729838+0000","last_peered":"2024-03-11T22:09:17.729838+0000","last_clean":"2024-03-11T22:09:17.729838+0000","last_became_active":"2024-03-11T22:08:16.276668+0000","last_became_peered":"2024-03-11T22:08:16.276668+0000","last_unstale":"2024-03-11T22:09:17.729838+0000","last_undegraded":"2024-03-11T22:09:17.729838+0000","last_fullsized":"2024-03-11T22:09:17.729838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:46:05.596898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479138+0000","last_change":"2024-03-11T22:08:18.321267+0000","last_active":"2024-03-11T22:09:17.479138+0000","last_peered":"2024-03-11T22:09:17.479138+0000","last_clean":"2024-03-11T22:09:17.479138+0000","last_became_active":"2024-03-11T22:08:18.320778+0000","last_became_peered":"2024-03-11T22:08:18.320778+0000","last_unstale":"2024-03-11T22:09:17.479138+0000","last_undegraded":"2024-03-11T22:09:17.479138+0000","last_fullsized":"2024-03-11T22:09:17.479138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:52:47.792085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337269+0000","last_change":"2024-03-11T22:08:22.371322+0000","last_active":"2024-03-11T22:09:17.337269+0000","last_peered":"2024-03-11T22:09:17.337269+0000","last_clean":"2024-03-11T22:09:17.337269+0000","last_became_active":"2024-03-11T22:08:22.370505+0000","last_became_peered":"2024-03-11T22:08:22.370505+0000","last_unstale":"2024-03-11T22:09:17.337269+0000","last_undegraded":"2024-03-11T22:09:17.337269+0000","last_fullsized":"2024-03-11T22:09:17.337269+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:05:41.406179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336733+0000","last_change":"2024-03-11T22:08:20.325865+0000","last_active":"2024-03-11T22:09:17.336733+0000","last_peered":"2024-03-11T22:09:17.336733+0000","last_clean":"2024-03-11T22:09:17.336733+0000","last_became_active":"2024-03-11T22:08:20.325453+0000","last_became_peered":"2024-03-11T22:08:20.325453+0000","last_unstale":"2024-03-11T22:09:17.336733+0000","last_undegraded":"2024-03-11T22:09:17.336733+0000","last_fullsized":"2024-03-11T22:09:17.336733+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:24:45.227790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478882+0000","last_change":"2024-03-11T22:08:16.272075+0000","last_active":"2024-03-11T22:09:17.478882+0000","last_peered":"2024-03-11T22:09:17.478882+0000","last_clean":"2024-03-11T22:09:17.478882+0000","last_became_active":"2024-03-11T22:08:16.271395+0000","last_became_peered":"2024-03-11T22:08:16.271395+0000","last_unstale":"2024-03-11T22:09:17.478882+0000","last_undegraded":"2024-03-11T22:09:17.478882+0000","last_fullsized":"2024-03-11T22:09:17.478882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:22:53.774040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729593+0000","last_change":"2024-03-11T22:08:18.320646+0000","last_active":"2024-03-11T22:09:17.729593+0000","last_peered":"2024-03-11T22:09:17.729593+0000","last_clean":"2024-03-11T22:09:17.729593+0000","last_became_active":"2024-03-11T22:08:18.320065+0000","last_became_peered":"2024-03-11T22:08:18.320065+0000","last_unstale":"2024-03-11T22:09:17.729593+0000","last_undegraded":"2024-03-11T22:09:17.729593+0000","last_fullsized":"2024-03-11T22:09:17.729593+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:54:28.414234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555143+0000","last_change":"2024-03-11T22:08:22.375119+0000","last_active":"2024-03-11T22:09:17.555143+0000","last_peered":"2024-03-11T22:09:17.555143+0000","last_clean":"2024-03-11T22:09:17.555143+0000","last_became_active":"2024-03-11T22:08:22.374364+0000","last_became_peered":"2024-03-11T22:08:22.374364+0000","last_unstale":"2024-03-11T22:09:17.555143+0000","last_undegraded":"2024-03-11T22:09:17.555143+0000","last_fullsized":"2024-03-11T22:09:17.555143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:19:22.587500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337146+0000","last_change":"2024-03-11T22:09:08.100466+0000","last_active":"2024-03-11T22:09:17.337146+0000","last_peered":"2024-03-11T22:09:17.337146+0000","last_clean":"2024-03-11T22:09:17.337146+0000","last_became_active":"2024-03-11T22:09:08.099298+0000","last_became_peered":"2024-03-11T22:09:08.099298+0000","last_unstale":"2024-03-11T22:09:17.337146+0000","last_undegraded":"2024-03-11T22:09:17.337146+0000","last_fullsized":"2024-03-11T22:09:17.337146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:04:22.764310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429706+0000","last_change":"2024-03-11T22:08:16.286240+0000","last_active":"2024-03-11T22:09:17.429706+0000","last_peered":"2024-03-11T22:09:17.429706+0000","last_clean":"2024-03-11T22:09:17.429706+0000","last_became_active":"2024-03-11T22:08:16.284961+0000","last_became_peered":"2024-03-11T22:08:16.284961+0000","last_unstale":"2024-03-11T22:09:17.429706+0000","last_undegraded":"2024-03-11T22:09:17.429706+0000","last_fullsized":"2024-03-11T22:09:17.429706+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:07:17.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555933+0000","last_change":"2024-03-11T22:08:18.323994+0000","last_active":"2024-03-11T22:09:17.555933+0000","last_peered":"2024-03-11T22:09:17.555933+0000","last_clean":"2024-03-11T22:09:17.555933+0000","last_became_active":"2024-03-11T22:08:18.323056+0000","last_became_peered":"2024-03-11T22:08:18.323056+0000","last_unstale":"2024-03-11T22:09:17.555933+0000","last_undegraded":"2024-03-11T22:09:17.555933+0000","last_fullsized":"2024-03-11T22:09:17.555933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:30:52.079550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.726756+0000","last_change":"2024-03-11T22:08:22.387057+0000","last_active":"2024-03-11T22:09:17.726756+0000","last_peered":"2024-03-11T22:09:17.726756+0000","last_clean":"2024-03-11T22:09:17.726756+0000","last_became_active":"2024-03-11T22:08:22.382798+0000","last_became_peered":"2024-03-11T22:08:22.382798+0000","last_unstale":"2024-03-11T22:09:17.726756+0000","last_undegraded":"2024-03-11T22:09:17.726756+0000","last_fullsized":"2024-03-11T22:09:17.726756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:18:33.108051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.338239+0000","last_change":"2024-03-11T22:08:20.302187+0000","last_active":"2024-03-11T22:09:17.338239+0000","last_peered":"2024-03-11T22:09:17.338239+0000","last_clean":"2024-03-11T22:09:17.338239+0000","last_became_active":"2024-03-11T22:08:20.301708+0000","last_became_peered":"2024-03-11T22:08:20.301708+0000","last_unstale":"2024-03-11T22:09:17.338239+0000","last_undegraded":"2024-03-11T22:09:17.338239+0000","last_fullsized":"2024-03-11T22:09:17.338239+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:04:38.122798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429253+0000","last_change":"2024-03-11T22:08:16.287091+0000","last_active":"2024-03-11T22:09:17.429253+0000","last_peered":"2024-03-11T22:09:17.429253+0000","last_clean":"2024-03-11T22:09:17.429253+0000","last_became_active":"2024-03-11T22:08:16.286652+0000","last_became_peered":"2024-03-11T22:08:16.286652+0000","last_unstale":"2024-03-11T22:09:17.429253+0000","last_undegraded":"2024-03-11T22:09:17.429253+0000","last_fullsized":"2024-03-11T22:09:17.429253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:01:35.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555890+0000","last_change":"2024-03-11T22:08:18.322527+0000","last_active":"2024-03-11T22:09:17.555890+0000","last_peered":"2024-03-11T22:09:17.555890+0000","last_clean":"2024-03-11T22:09:17.555890+0000","last_became_active":"2024-03-11T22:08:18.321337+0000","last_became_peered":"2024-03-11T22:08:18.321337+0000","last_unstale":"2024-03-11T22:09:17.555890+0000","last_undegraded":"2024-03-11T22:09:17.555890+0000","last_fullsized":"2024-03-11T22:09:17.555890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:56:02.681152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479725+0000","last_change":"2024-03-11T22:08:22.569349+0000","last_active":"2024-03-11T22:09:17.479725+0000","last_peered":"2024-03-11T22:09:17.479725+0000","last_clean":"2024-03-11T22:09:17.479725+0000","last_became_active":"2024-03-11T22:08:22.568107+0000","last_became_peered":"2024-03-11T22:08:22.568107+0000","last_unstale":"2024-03-11T22:09:17.479725+0000","last_undegraded":"2024-03-11T22:09:17.479725+0000","last_fullsized":"2024-03-11T22:09:17.479725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:08:25.597091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478716+0000","last_change":"2024-03-11T22:08:20.331372+0000","last_active":"2024-03-11T22:09:17.478716+0000","last_peered":"2024-03-11T22:09:17.478716+0000","last_clean":"2024-03-11T22:09:17.478716+0000","last_became_active":"2024-03-11T22:08:20.330537+0000","last_became_peered":"2024-03-11T22:08:20.330537+0000","last_unstale":"2024-03-11T22:09:17.478716+0000","last_undegraded":"2024-03-11T22:09:17.478716+0000","last_fullsized":"2024-03-11T22:09:17.478716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:11:50.649025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478209+0000","last_change":"2024-03-11T22:08:16.271549+0000","last_active":"2024-03-11T22:09:17.478209+0000","last_peered":"2024-03-11T22:09:17.478209+0000","last_clean":"2024-03-11T22:09:17.478209+0000","last_became_active":"2024-03-11T22:08:16.271134+0000","last_became_peered":"2024-03-11T22:08:16.271134+0000","last_unstale":"2024-03-11T22:09:17.478209+0000","last_undegraded":"2024-03-11T22:09:17.478209+0000","last_fullsized":"2024-03-11T22:09:17.478209+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:03:35.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337384+0000","last_change":"2024-03-11T22:08:18.327414+0000","last_active":"2024-03-11T22:09:17.337384+0000","last_peered":"2024-03-11T22:09:17.337384+0000","last_clean":"2024-03-11T22:09:17.337384+0000","last_became_active":"2024-03-11T22:08:18.326612+0000","last_became_peered":"2024-03-11T22:08:18.326612+0000","last_unstale":"2024-03-11T22:09:17.337384+0000","last_undegraded":"2024-03-11T22:09:17.337384+0000","last_fullsized":"2024-03-11T22:09:17.337384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:56:35.602415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339119+0000","last_change":"2024-03-11T22:08:22.572971+0000","last_active":"2024-03-11T22:09:17.339119+0000","last_peered":"2024-03-11T22:09:17.339119+0000","last_clean":"2024-03-11T22:09:17.339119+0000","last_became_active":"2024-03-11T22:08:22.569412+0000","last_became_peered":"2024-03-11T22:08:22.569412+0000","last_unstale":"2024-03-11T22:09:17.339119+0000","last_undegraded":"2024-03-11T22:09:17.339119+0000","last_fullsized":"2024-03-11T22:09:17.339119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:17:35.971428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336577+0000","last_change":"2024-03-11T22:09:08.103217+0000","last_active":"2024-03-11T22:09:17.336577+0000","last_peered":"2024-03-11T22:09:17.336577+0000","last_clean":"2024-03-11T22:09:17.336577+0000","last_became_active":"2024-03-11T22:09:08.102024+0000","last_became_peered":"2024-03-11T22:09:08.102024+0000","last_unstale":"2024-03-11T22:09:17.336577+0000","last_undegraded":"2024-03-11T22:09:17.336577+0000","last_fullsized":"2024-03-11T22:09:17.336577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:55:41.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466039+0000","last_change":"2024-03-11T22:08:16.267425+0000","last_active":"2024-03-11T22:09:17.466039+0000","last_peered":"2024-03-11T22:09:17.466039+0000","last_clean":"2024-03-11T22:09:17.466039+0000","last_became_active":"2024-03-11T22:08:16.266326+0000","last_became_peered":"2024-03-11T22:08:16.266326+0000","last_unstale":"2024-03-11T22:09:17.466039+0000","last_undegraded":"2024-03-11T22:09:17.466039+0000","last_fullsized":"2024-03-11T22:09:17.466039+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:25:23.309706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728935+0000","last_change":"2024-03-11T22:08:18.311022+0000","last_active":"2024-03-11T22:09:17.728935+0000","last_peered":"2024-03-11T22:09:17.728935+0000","last_clean":"2024-03-11T22:09:17.728935+0000","last_became_active":"2024-03-11T22:08:18.309933+0000","last_became_peered":"2024-03-11T22:08:18.309933+0000","last_unstale":"2024-03-11T22:09:17.728935+0000","last_undegraded":"2024-03-11T22:09:17.728935+0000","last_fullsized":"2024-03-11T22:09:17.728935+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:22:38.187974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730218+0000","last_change":"2024-03-11T22:08:22.378257+0000","last_active":"2024-03-11T22:09:17.730218+0000","last_peered":"2024-03-11T22:09:17.730218+0000","last_clean":"2024-03-11T22:09:17.730218+0000","last_became_active":"2024-03-11T22:08:22.377525+0000","last_became_peered":"2024-03-11T22:08:22.377525+0000","last_unstale":"2024-03-11T22:09:17.730218+0000","last_undegraded":"2024-03-11T22:09:17.730218+0000","last_fullsized":"2024-03-11T22:09:17.730218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:21:07.776217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"67'11","reported_seq":80,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.477899+0000","last_change":"2024-03-11T22:08:20.327676+0000","last_active":"2024-03-11T22:11:01.477899+0000","last_peered":"2024-03-11T22:11:01.477899+0000","last_clean":"2024-03-11T22:11:01.477899+0000","last_became_active":"2024-03-11T22:08:20.327241+0000","last_became_peered":"2024-03-11T22:08:20.327241+0000","last_unstale":"2024-03-11T22:11:01.477899+0000","last_undegraded":"2024-03-11T22:11:01.477899+0000","last_fullsized":"2024-03-11T22:11:01.477899+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:55:46.714531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477907+0000","last_change":"2024-03-11T22:08:16.274325+0000","last_active":"2024-03-11T22:09:17.477907+0000","last_peered":"2024-03-11T22:09:17.477907+0000","last_clean":"2024-03-11T22:09:17.477907+0000","last_became_active":"2024-03-11T22:08:16.273533+0000","last_became_peered":"2024-03-11T22:08:16.273533+0000","last_unstale":"2024-03-11T22:09:17.477907+0000","last_undegraded":"2024-03-11T22:09:17.477907+0000","last_fullsized":"2024-03-11T22:09:17.477907+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:02:23.735419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477417+0000","last_change":"2024-03-11T22:08:18.295565+0000","last_active":"2024-03-11T22:09:17.477417+0000","last_peered":"2024-03-11T22:09:17.477417+0000","last_clean":"2024-03-11T22:09:17.477417+0000","last_became_active":"2024-03-11T22:08:18.295073+0000","last_became_peered":"2024-03-11T22:08:18.295073+0000","last_unstale":"2024-03-11T22:09:17.477417+0000","last_undegraded":"2024-03-11T22:09:17.477417+0000","last_fullsized":"2024-03-11T22:09:17.477417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:01:27.928498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428717+0000","last_change":"2024-03-11T22:08:22.357772+0000","last_active":"2024-03-11T22:09:17.428717+0000","last_peered":"2024-03-11T22:09:17.428717+0000","last_clean":"2024-03-11T22:09:17.428717+0000","last_became_active":"2024-03-11T22:08:22.356871+0000","last_became_peered":"2024-03-11T22:08:22.356871+0000","last_unstale":"2024-03-11T22:09:17.428717+0000","last_undegraded":"2024-03-11T22:09:17.428717+0000","last_fullsized":"2024-03-11T22:09:17.428717+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:12:48.155794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729605+0000","last_change":"2024-03-11T22:08:20.335022+0000","last_active":"2024-03-11T22:09:17.729605+0000","last_peered":"2024-03-11T22:09:17.729605+0000","last_clean":"2024-03-11T22:09:17.729605+0000","last_became_active":"2024-03-11T22:08:20.332633+0000","last_became_peered":"2024-03-11T22:08:20.332633+0000","last_unstale":"2024-03-11T22:09:17.729605+0000","last_undegraded":"2024-03-11T22:09:17.729605+0000","last_fullsized":"2024-03-11T22:09:17.729605+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:13:18.408394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555155+0000","last_change":"2024-03-11T22:08:16.287152+0000","last_active":"2024-03-11T22:09:17.555155+0000","last_peered":"2024-03-11T22:09:17.555155+0000","last_clean":"2024-03-11T22:09:17.555155+0000","last_became_active":"2024-03-11T22:08:16.286709+0000","last_became_peered":"2024-03-11T22:08:16.286709+0000","last_unstale":"2024-03-11T22:09:17.555155+0000","last_undegraded":"2024-03-11T22:09:17.555155+0000","last_fullsized":"2024-03-11T22:09:17.555155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:14:02.309733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727733+0000","last_change":"2024-03-11T22:08:18.323373+0000","last_active":"2024-03-11T22:09:17.727733+0000","last_peered":"2024-03-11T22:09:17.727733+0000","last_clean":"2024-03-11T22:09:17.727733+0000","last_became_active":"2024-03-11T22:08:18.321466+0000","last_became_peered":"2024-03-11T22:08:18.321466+0000","last_unstale":"2024-03-11T22:09:17.727733+0000","last_undegraded":"2024-03-11T22:09:17.727733+0000","last_fullsized":"2024-03-11T22:09:17.727733+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:14:36.581051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478374+0000","last_change":"2024-03-11T22:08:22.573294+0000","last_active":"2024-03-11T22:09:17.478374+0000","last_peered":"2024-03-11T22:09:17.478374+0000","last_clean":"2024-03-11T22:09:17.478374+0000","last_became_active":"2024-03-11T22:08:22.572198+0000","last_became_peered":"2024-03-11T22:08:22.572198+0000","last_unstale":"2024-03-11T22:09:17.478374+0000","last_undegraded":"2024-03-11T22:09:17.478374+0000","last_fullsized":"2024-03-11T22:09:17.478374+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:23:41.088071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478356+0000","last_change":"2024-03-11T22:08:20.319010+0000","last_active":"2024-03-11T22:09:17.478356+0000","last_peered":"2024-03-11T22:09:17.478356+0000","last_clean":"2024-03-11T22:09:17.478356+0000","last_became_active":"2024-03-11T22:08:20.318083+0000","last_became_peered":"2024-03-11T22:08:20.318083+0000","last_unstale":"2024-03-11T22:09:17.478356+0000","last_undegraded":"2024-03-11T22:09:17.478356+0000","last_fullsized":"2024-03-11T22:09:17.478356+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:19:20.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.467121+0000","last_change":"2024-03-11T22:08:16.287826+0000","last_active":"2024-03-11T22:09:17.467121+0000","last_peered":"2024-03-11T22:09:17.467121+0000","last_clean":"2024-03-11T22:09:17.467121+0000","last_became_active":"2024-03-11T22:08:16.286973+0000","last_became_peered":"2024-03-11T22:08:16.286973+0000","last_unstale":"2024-03-11T22:09:17.467121+0000","last_undegraded":"2024-03-11T22:09:17.467121+0000","last_fullsized":"2024-03-11T22:09:17.467121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:21:05.715825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556343+0000","last_change":"2024-03-11T22:08:18.304030+0000","last_active":"2024-03-11T22:09:17.556343+0000","last_peered":"2024-03-11T22:09:17.556343+0000","last_clean":"2024-03-11T22:09:17.556343+0000","last_became_active":"2024-03-11T22:08:18.303071+0000","last_became_peered":"2024-03-11T22:08:18.303071+0000","last_unstale":"2024-03-11T22:09:17.556343+0000","last_undegraded":"2024-03-11T22:09:17.556343+0000","last_fullsized":"2024-03-11T22:09:17.556343+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:56:42.548071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.427927+0000","last_change":"2024-03-11T22:08:22.361251+0000","last_active":"2024-03-11T22:09:17.427927+0000","last_peered":"2024-03-11T22:09:17.427927+0000","last_clean":"2024-03-11T22:09:17.427927+0000","last_became_active":"2024-03-11T22:08:22.359368+0000","last_became_peered":"2024-03-11T22:08:22.359368+0000","last_unstale":"2024-03-11T22:09:17.427927+0000","last_undegraded":"2024-03-11T22:09:17.427927+0000","last_fullsized":"2024-03-11T22:09:17.427927+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:27:32.394412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477454+0000","last_change":"2024-03-11T22:08:20.331346+0000","last_active":"2024-03-11T22:09:17.477454+0000","last_peered":"2024-03-11T22:09:17.477454+0000","last_clean":"2024-03-11T22:09:17.477454+0000","last_became_active":"2024-03-11T22:08:20.330456+0000","last_became_peered":"2024-03-11T22:08:20.330456+0000","last_unstale":"2024-03-11T22:09:17.477454+0000","last_undegraded":"2024-03-11T22:09:17.477454+0000","last_fullsized":"2024-03-11T22:09:17.477454+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:07:05.407514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556195+0000","last_change":"2024-03-11T22:08:16.281611+0000","last_active":"2024-03-11T22:09:17.556195+0000","last_peered":"2024-03-11T22:09:17.556195+0000","last_clean":"2024-03-11T22:09:17.556195+0000","last_became_active":"2024-03-11T22:08:16.281041+0000","last_became_peered":"2024-03-11T22:08:16.281041+0000","last_unstale":"2024-03-11T22:09:17.556195+0000","last_undegraded":"2024-03-11T22:09:17.556195+0000","last_fullsized":"2024-03-11T22:09:17.556195+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:13:21.092121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729408+0000","last_change":"2024-03-11T22:08:18.304995+0000","last_active":"2024-03-11T22:09:17.729408+0000","last_peered":"2024-03-11T22:09:17.729408+0000","last_clean":"2024-03-11T22:09:17.729408+0000","last_became_active":"2024-03-11T22:08:18.304383+0000","last_became_peered":"2024-03-11T22:08:18.304383+0000","last_unstale":"2024-03-11T22:09:17.729408+0000","last_undegraded":"2024-03-11T22:09:17.729408+0000","last_fullsized":"2024-03-11T22:09:17.729408+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:56:32.771846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477475+0000","last_change":"2024-03-11T22:08:22.384368+0000","last_active":"2024-03-11T22:09:17.477475+0000","last_peered":"2024-03-11T22:09:17.477475+0000","last_clean":"2024-03-11T22:09:17.477475+0000","last_became_active":"2024-03-11T22:08:22.383829+0000","last_became_peered":"2024-03-11T22:08:22.383829+0000","last_unstale":"2024-03-11T22:09:17.477475+0000","last_undegraded":"2024-03-11T22:09:17.477475+0000","last_fullsized":"2024-03-11T22:09:17.477475+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:31:19.404651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339486+0000","last_change":"2024-03-11T22:08:20.326234+0000","last_active":"2024-03-11T22:09:17.339486+0000","last_peered":"2024-03-11T22:09:17.339486+0000","last_clean":"2024-03-11T22:09:17.339486+0000","last_became_active":"2024-03-11T22:08:20.325018+0000","last_became_peered":"2024-03-11T22:08:20.325018+0000","last_unstale":"2024-03-11T22:09:17.339486+0000","last_undegraded":"2024-03-11T22:09:17.339486+0000","last_fullsized":"2024-03-11T22:09:17.339486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:10:22.998363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730655+0000","last_change":"2024-03-11T22:08:16.285657+0000","last_active":"2024-03-11T22:09:17.730655+0000","last_peered":"2024-03-11T22:09:17.730655+0000","last_clean":"2024-03-11T22:09:17.730655+0000","last_became_active":"2024-03-11T22:08:16.285313+0000","last_became_peered":"2024-03-11T22:08:16.285313+0000","last_unstale":"2024-03-11T22:09:17.730655+0000","last_undegraded":"2024-03-11T22:09:17.730655+0000","last_fullsized":"2024-03-11T22:09:17.730655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:06:54.396958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.338024+0000","last_change":"2024-03-11T22:08:18.323514+0000","last_active":"2024-03-11T22:09:17.338024+0000","last_peered":"2024-03-11T22:09:17.338024+0000","last_clean":"2024-03-11T22:09:17.338024+0000","last_became_active":"2024-03-11T22:08:18.322821+0000","last_became_peered":"2024-03-11T22:08:18.322821+0000","last_unstale":"2024-03-11T22:09:17.338024+0000","last_undegraded":"2024-03-11T22:09:17.338024+0000","last_fullsized":"2024-03-11T22:09:17.338024+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:09:04.210354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.726893+0000","last_change":"2024-03-11T22:08:22.384932+0000","last_active":"2024-03-11T22:09:17.726893+0000","last_peered":"2024-03-11T22:09:17.726893+0000","last_clean":"2024-03-11T22:09:17.726893+0000","last_became_active":"2024-03-11T22:08:22.370204+0000","last_became_peered":"2024-03-11T22:08:22.370204+0000","last_unstale":"2024-03-11T22:09:17.726893+0000","last_undegraded":"2024-03-11T22:09:17.726893+0000","last_fullsized":"2024-03-11T22:09:17.726893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:02:29.597396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555148+0000","last_change":"2024-03-11T22:09:07.874407+0000","last_active":"2024-03-11T22:09:17.555148+0000","last_peered":"2024-03-11T22:09:17.555148+0000","last_clean":"2024-03-11T22:09:17.555148+0000","last_became_active":"2024-03-11T22:09:07.873901+0000","last_became_peered":"2024-03-11T22:09:07.873901+0000","last_unstale":"2024-03-11T22:09:17.555148+0000","last_undegraded":"2024-03-11T22:09:17.555148+0000","last_fullsized":"2024-03-11T22:09:17.555148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:53:29.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466548+0000","last_change":"2024-03-11T22:08:16.283794+0000","last_active":"2024-03-11T22:09:17.466548+0000","last_peered":"2024-03-11T22:09:17.466548+0000","last_clean":"2024-03-11T22:09:17.466548+0000","last_became_active":"2024-03-11T22:08:16.282958+0000","last_became_peered":"2024-03-11T22:08:16.282958+0000","last_unstale":"2024-03-11T22:09:17.466548+0000","last_undegraded":"2024-03-11T22:09:17.466548+0000","last_fullsized":"2024-03-11T22:09:17.466548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:00:17.320415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429961+0000","last_change":"2024-03-11T22:08:18.315017+0000","last_active":"2024-03-11T22:09:17.429961+0000","last_peered":"2024-03-11T22:09:17.429961+0000","last_clean":"2024-03-11T22:09:17.429961+0000","last_became_active":"2024-03-11T22:08:18.313555+0000","last_became_peered":"2024-03-11T22:08:18.313555+0000","last_unstale":"2024-03-11T22:09:17.429961+0000","last_undegraded":"2024-03-11T22:09:17.429961+0000","last_fullsized":"2024-03-11T22:09:17.429961+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:06:13.618859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.340643+0000","last_change":"2024-03-11T22:08:22.360987+0000","last_active":"2024-03-11T22:09:17.340643+0000","last_peered":"2024-03-11T22:09:17.340643+0000","last_clean":"2024-03-11T22:09:17.340643+0000","last_became_active":"2024-03-11T22:08:22.360067+0000","last_became_peered":"2024-03-11T22:08:22.360067+0000","last_unstale":"2024-03-11T22:09:17.340643+0000","last_undegraded":"2024-03-11T22:09:17.340643+0000","last_fullsized":"2024-03-11T22:09:17.340643+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:40:09.950239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.477883+0000","last_change":"2024-03-11T22:08:20.320320+0000","last_active":"2024-03-11T22:11:01.477883+0000","last_peered":"2024-03-11T22:11:01.477883+0000","last_clean":"2024-03-11T22:11:01.477883+0000","last_became_active":"2024-03-11T22:08:20.319652+0000","last_became_peered":"2024-03-11T22:08:20.319652+0000","last_unstale":"2024-03-11T22:11:01.477883+0000","last_undegraded":"2024-03-11T22:11:01.477883+0000","last_fullsized":"2024-03-11T22:11:01.477883+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:14:23.643922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728669+0000","last_change":"2024-03-11T22:08:16.279912+0000","last_active":"2024-03-11T22:09:17.728669+0000","last_peered":"2024-03-11T22:09:17.728669+0000","last_clean":"2024-03-11T22:09:17.728669+0000","last_became_active":"2024-03-11T22:08:16.279285+0000","last_became_peered":"2024-03-11T22:08:16.279285+0000","last_unstale":"2024-03-11T22:09:17.728669+0000","last_undegraded":"2024-03-11T22:09:17.728669+0000","last_fullsized":"2024-03-11T22:09:17.728669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T10:07:43.266481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728061+0000","last_change":"2024-03-11T22:08:18.295690+0000","last_active":"2024-03-11T22:09:17.728061+0000","last_peered":"2024-03-11T22:09:17.728061+0000","last_clean":"2024-03-11T22:09:17.728061+0000","last_became_active":"2024-03-11T22:08:18.293814+0000","last_became_peered":"2024-03-11T22:08:18.293814+0000","last_unstale":"2024-03-11T22:09:17.728061+0000","last_undegraded":"2024-03-11T22:09:17.728061+0000","last_fullsized":"2024-03-11T22:09:17.728061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:40:29.839814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729300+0000","last_change":"2024-03-11T22:08:22.380378+0000","last_active":"2024-03-11T22:09:17.729300+0000","last_peered":"2024-03-11T22:09:17.729300+0000","last_clean":"2024-03-11T22:09:17.729300+0000","last_became_active":"2024-03-11T22:08:22.379411+0000","last_became_peered":"2024-03-11T22:08:22.379411+0000","last_unstale":"2024-03-11T22:09:17.729300+0000","last_undegraded":"2024-03-11T22:09:17.729300+0000","last_fullsized":"2024-03-11T22:09:17.729300+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:03:51.003760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'11","reported_seq":80,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.482233+0000","last_change":"2024-03-11T22:08:20.334563+0000","last_active":"2024-03-11T22:11:01.482233+0000","last_peered":"2024-03-11T22:11:01.482233+0000","last_clean":"2024-03-11T22:11:01.482233+0000","last_became_active":"2024-03-11T22:08:20.333518+0000","last_became_peered":"2024-03-11T22:08:20.333518+0000","last_unstale":"2024-03-11T22:11:01.482233+0000","last_undegraded":"2024-03-11T22:11:01.482233+0000","last_fullsized":"2024-03-11T22:11:01.482233+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:07:32.180072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555496+0000","last_change":"2024-03-11T22:09:08.100137+0000","last_active":"2024-03-11T22:09:17.555496+0000","last_peered":"2024-03-11T22:09:17.555496+0000","last_clean":"2024-03-11T22:09:17.555496+0000","last_became_active":"2024-03-11T22:09:08.099104+0000","last_became_peered":"2024-03-11T22:09:08.099104+0000","last_unstale":"2024-03-11T22:09:17.555496+0000","last_undegraded":"2024-03-11T22:09:17.555496+0000","last_fullsized":"2024-03-11T22:09:17.555496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:48:58.612304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428673+0000","last_change":"2024-03-11T22:08:18.321820+0000","last_active":"2024-03-11T22:09:17.428673+0000","last_peered":"2024-03-11T22:09:17.428673+0000","last_clean":"2024-03-11T22:09:17.428673+0000","last_became_active":"2024-03-11T22:08:18.320677+0000","last_became_peered":"2024-03-11T22:08:18.320677+0000","last_unstale":"2024-03-11T22:09:17.428673+0000","last_undegraded":"2024-03-11T22:09:17.428673+0000","last_fullsized":"2024-03-11T22:09:17.428673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:55:12.532058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429591+0000","last_change":"2024-03-11T22:08:22.573809+0000","last_active":"2024-03-11T22:09:17.429591+0000","last_peered":"2024-03-11T22:09:17.429591+0000","last_clean":"2024-03-11T22:09:17.429591+0000","last_became_active":"2024-03-11T22:08:22.572982+0000","last_became_peered":"2024-03-11T22:08:22.572982+0000","last_unstale":"2024-03-11T22:09:17.429591+0000","last_undegraded":"2024-03-11T22:09:17.429591+0000","last_fullsized":"2024-03-11T22:09:17.429591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:23:49.864237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479780+0000","last_change":"2024-03-11T22:08:20.338315+0000","last_active":"2024-03-11T22:09:17.479780+0000","last_peered":"2024-03-11T22:09:17.479780+0000","last_clean":"2024-03-11T22:09:17.479780+0000","last_became_active":"2024-03-11T22:08:20.335089+0000","last_became_peered":"2024-03-11T22:08:20.335089+0000","last_unstale":"2024-03-11T22:09:17.479780+0000","last_undegraded":"2024-03-11T22:09:17.479780+0000","last_fullsized":"2024-03-11T22:09:17.479780+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:14:16.178840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466266+0000","last_change":"2024-03-11T22:08:16.280051+0000","last_active":"2024-03-11T22:09:17.466266+0000","last_peered":"2024-03-11T22:09:17.466266+0000","last_clean":"2024-03-11T22:09:17.466266+0000","last_became_active":"2024-03-11T22:08:16.279127+0000","last_became_peered":"2024-03-11T22:08:16.279127+0000","last_unstale":"2024-03-11T22:09:17.466266+0000","last_undegraded":"2024-03-11T22:09:17.466266+0000","last_fullsized":"2024-03-11T22:09:17.466266+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:06:23.567515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.465749+0000","last_change":"2024-03-11T22:08:18.304445+0000","last_active":"2024-03-11T22:09:17.465749+0000","last_peered":"2024-03-11T22:09:17.465749+0000","last_clean":"2024-03-11T22:09:17.465749+0000","last_became_active":"2024-03-11T22:08:18.303591+0000","last_became_peered":"2024-03-11T22:08:18.303591+0000","last_unstale":"2024-03-11T22:09:17.465749+0000","last_undegraded":"2024-03-11T22:09:17.465749+0000","last_fullsized":"2024-03-11T22:09:17.465749+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:11:22.864906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336683+0000","last_change":"2024-03-11T22:08:22.362336+0000","last_active":"2024-03-11T22:09:17.336683+0000","last_peered":"2024-03-11T22:09:17.336683+0000","last_clean":"2024-03-11T22:09:17.336683+0000","last_became_active":"2024-03-11T22:08:22.361486+0000","last_became_peered":"2024-03-11T22:08:22.361486+0000","last_unstale":"2024-03-11T22:09:17.336683+0000","last_undegraded":"2024-03-11T22:09:17.336683+0000","last_fullsized":"2024-03-11T22:09:17.336683+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:50:42.160285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729172+0000","last_change":"2024-03-11T22:08:20.334221+0000","last_active":"2024-03-11T22:09:17.729172+0000","last_peered":"2024-03-11T22:09:17.729172+0000","last_clean":"2024-03-11T22:09:17.729172+0000","last_became_active":"2024-03-11T22:08:20.331494+0000","last_became_peered":"2024-03-11T22:08:20.331494+0000","last_unstale":"2024-03-11T22:09:17.729172+0000","last_undegraded":"2024-03-11T22:09:17.729172+0000","last_fullsized":"2024-03-11T22:09:17.729172+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:56:56.307416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.335674+0000","last_change":"2024-03-11T22:08:16.276759+0000","last_active":"2024-03-11T22:09:17.335674+0000","last_peered":"2024-03-11T22:09:17.335674+0000","last_clean":"2024-03-11T22:09:17.335674+0000","last_became_active":"2024-03-11T22:08:16.276363+0000","last_became_peered":"2024-03-11T22:08:16.276363+0000","last_unstale":"2024-03-11T22:09:17.335674+0000","last_undegraded":"2024-03-11T22:09:17.335674+0000","last_fullsized":"2024-03-11T22:09:17.335674+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:17:26.939355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428082+0000","last_change":"2024-03-11T22:08:18.312796+0000","last_active":"2024-03-11T22:09:17.428082+0000","last_peered":"2024-03-11T22:09:17.428082+0000","last_clean":"2024-03-11T22:09:17.428082+0000","last_became_active":"2024-03-11T22:08:18.312115+0000","last_became_peered":"2024-03-11T22:08:18.312115+0000","last_unstale":"2024-03-11T22:09:17.428082+0000","last_undegraded":"2024-03-11T22:09:17.428082+0000","last_fullsized":"2024-03-11T22:09:17.428082+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:16:58.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478340+0000","last_change":"2024-03-11T22:08:22.391687+0000","last_active":"2024-03-11T22:09:17.478340+0000","last_peered":"2024-03-11T22:09:17.478340+0000","last_clean":"2024-03-11T22:09:17.478340+0000","last_became_active":"2024-03-11T22:08:22.390886+0000","last_became_peered":"2024-03-11T22:08:22.390886+0000","last_unstale":"2024-03-11T22:09:17.478340+0000","last_undegraded":"2024-03-11T22:09:17.478340+0000","last_fullsized":"2024-03-11T22:09:17.478340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:52:56.131187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339832+0000","last_change":"2024-03-11T22:08:16.274582+0000","last_active":"2024-03-11T22:09:17.339832+0000","last_peered":"2024-03-11T22:09:17.339832+0000","last_clean":"2024-03-11T22:09:17.339832+0000","last_became_active":"2024-03-11T22:08:16.273660+0000","last_became_peered":"2024-03-11T22:08:16.273660+0000","last_unstale":"2024-03-11T22:09:17.339832+0000","last_undegraded":"2024-03-11T22:09:17.339832+0000","last_fullsized":"2024-03-11T22:09:17.339832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:12:48.732562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429222+0000","last_change":"2024-03-11T22:08:18.313184+0000","last_active":"2024-03-11T22:09:17.429222+0000","last_peered":"2024-03-11T22:09:17.429222+0000","last_clean":"2024-03-11T22:09:17.429222+0000","last_became_active":"2024-03-11T22:08:18.312348+0000","last_became_peered":"2024-03-11T22:08:18.312348+0000","last_unstale":"2024-03-11T22:09:17.429222+0000","last_undegraded":"2024-03-11T22:09:17.429222+0000","last_fullsized":"2024-03-11T22:09:17.429222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:19:58.504838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.478157+0000","last_change":"2024-03-11T22:08:20.328992+0000","last_active":"2024-03-11T22:11:01.478157+0000","last_peered":"2024-03-11T22:11:01.478157+0000","last_clean":"2024-03-11T22:11:01.478157+0000","last_became_active":"2024-03-11T22:08:20.328525+0000","last_became_peered":"2024-03-11T22:08:20.328525+0000","last_unstale":"2024-03-11T22:11:01.478157+0000","last_undegraded":"2024-03-11T22:11:01.478157+0000","last_fullsized":"2024-03-11T22:11:01.478157+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:05:04.167452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727015+0000","last_change":"2024-03-11T22:08:22.387739+0000","last_active":"2024-03-11T22:09:17.727015+0000","last_peered":"2024-03-11T22:09:17.727015+0000","last_clean":"2024-03-11T22:09:17.727015+0000","last_became_active":"2024-03-11T22:08:22.384026+0000","last_became_peered":"2024-03-11T22:08:22.384026+0000","last_unstale":"2024-03-11T22:09:17.727015+0000","last_undegraded":"2024-03-11T22:09:17.727015+0000","last_fullsized":"2024-03-11T22:09:17.727015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:26:08.880349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730426+0000","last_change":"2024-03-11T22:08:16.287176+0000","last_active":"2024-03-11T22:09:17.730426+0000","last_peered":"2024-03-11T22:09:17.730426+0000","last_clean":"2024-03-11T22:09:17.730426+0000","last_became_active":"2024-03-11T22:08:16.286446+0000","last_became_peered":"2024-03-11T22:08:16.286446+0000","last_unstale":"2024-03-11T22:09:17.730426+0000","last_undegraded":"2024-03-11T22:09:17.730426+0000","last_fullsized":"2024-03-11T22:09:17.730426+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:35:48.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.477906+0000","last_change":"2024-03-11T22:08:18.319296+0000","last_active":"2024-03-11T22:11:01.477906+0000","last_peered":"2024-03-11T22:11:01.477906+0000","last_clean":"2024-03-11T22:11:01.477906+0000","last_became_active":"2024-03-11T22:08:18.318461+0000","last_became_peered":"2024-03-11T22:08:18.318461+0000","last_unstale":"2024-03-11T22:11:01.477906+0000","last_undegraded":"2024-03-11T22:11:01.477906+0000","last_fullsized":"2024-03-11T22:11:01.477906+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:13:45.404865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728792+0000","last_change":"2024-03-11T22:08:20.348994+0000","last_active":"2024-03-11T22:09:17.728792+0000","last_peered":"2024-03-11T22:09:17.728792+0000","last_clean":"2024-03-11T22:09:17.728792+0000","last_became_active":"2024-03-11T22:08:20.345592+0000","last_became_peered":"2024-03-11T22:08:20.345592+0000","last_unstale":"2024-03-11T22:09:17.728792+0000","last_undegraded":"2024-03-11T22:09:17.728792+0000","last_fullsized":"2024-03-11T22:09:17.728792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:42:54.618385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478981+0000","last_change":"2024-03-11T22:08:22.385721+0000","last_active":"2024-03-11T22:09:17.478981+0000","last_peered":"2024-03-11T22:09:17.478981+0000","last_clean":"2024-03-11T22:09:17.478981+0000","last_became_active":"2024-03-11T22:08:22.383308+0000","last_became_peered":"2024-03-11T22:08:22.383308+0000","last_unstale":"2024-03-11T22:09:17.478981+0000","last_undegraded":"2024-03-11T22:09:17.478981+0000","last_fullsized":"2024-03-11T22:09:17.478981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:31:45.841535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555427+0000","last_change":"2024-03-11T22:08:16.285816+0000","last_active":"2024-03-11T22:09:17.555427+0000","last_peered":"2024-03-11T22:09:17.555427+0000","last_clean":"2024-03-11T22:09:17.555427+0000","last_became_active":"2024-03-11T22:08:16.284860+0000","last_became_peered":"2024-03-11T22:08:16.284860+0000","last_unstale":"2024-03-11T22:09:17.555427+0000","last_undegraded":"2024-03-11T22:09:17.555427+0000","last_fullsized":"2024-03-11T22:09:17.555427+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:25:13.405870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.338217+0000","last_change":"2024-03-11T22:08:18.321303+0000","last_active":"2024-03-11T22:09:17.338217+0000","last_peered":"2024-03-11T22:09:17.338217+0000","last_clean":"2024-03-11T22:09:17.338217+0000","last_became_active":"2024-03-11T22:08:18.320577+0000","last_became_peered":"2024-03-11T22:08:18.320577+0000","last_unstale":"2024-03-11T22:09:17.338217+0000","last_undegraded":"2024-03-11T22:09:17.338217+0000","last_fullsized":"2024-03-11T22:09:17.338217+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:03:00.266736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730677+0000","last_change":"2024-03-11T22:08:20.329807+0000","last_active":"2024-03-11T22:09:17.730677+0000","last_peered":"2024-03-11T22:09:17.730677+0000","last_clean":"2024-03-11T22:09:17.730677+0000","last_became_active":"2024-03-11T22:08:20.328161+0000","last_became_peered":"2024-03-11T22:08:20.328161+0000","last_unstale":"2024-03-11T22:09:17.730677+0000","last_undegraded":"2024-03-11T22:09:17.730677+0000","last_fullsized":"2024-03-11T22:09:17.730677+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:29:30.028631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428959+0000","last_change":"2024-03-11T22:08:22.566200+0000","last_active":"2024-03-11T22:09:17.428959+0000","last_peered":"2024-03-11T22:09:17.428959+0000","last_clean":"2024-03-11T22:09:17.428959+0000","last_became_active":"2024-03-11T22:08:22.565266+0000","last_became_peered":"2024-03-11T22:08:22.565266+0000","last_unstale":"2024-03-11T22:09:17.428959+0000","last_undegraded":"2024-03-11T22:09:17.428959+0000","last_fullsized":"2024-03-11T22:09:17.428959+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:20:50.378323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729525+0000","last_change":"2024-03-11T22:08:18.325664+0000","last_active":"2024-03-11T22:09:17.729525+0000","last_peered":"2024-03-11T22:09:17.729525+0000","last_clean":"2024-03-11T22:09:17.729525+0000","last_became_active":"2024-03-11T22:08:18.325081+0000","last_became_peered":"2024-03-11T22:08:18.325081+0000","last_unstale":"2024-03-11T22:09:17.729525+0000","last_undegraded":"2024-03-11T22:09:17.729525+0000","last_fullsized":"2024-03-11T22:09:17.729525+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:56:50.050824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336313+0000","last_change":"2024-03-11T22:08:16.273877+0000","last_active":"2024-03-11T22:09:17.336313+0000","last_peered":"2024-03-11T22:09:17.336313+0000","last_clean":"2024-03-11T22:09:17.336313+0000","last_became_active":"2024-03-11T22:08:16.273245+0000","last_became_peered":"2024-03-11T22:08:16.273245+0000","last_unstale":"2024-03-11T22:09:17.336313+0000","last_undegraded":"2024-03-11T22:09:17.336313+0000","last_fullsized":"2024-03-11T22:09:17.336313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:10:37.001060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.731182+0000","last_change":"2024-03-11T22:08:20.330699+0000","last_active":"2024-03-11T22:09:17.731182+0000","last_peered":"2024-03-11T22:09:17.731182+0000","last_clean":"2024-03-11T22:09:17.731182+0000","last_became_active":"2024-03-11T22:08:20.327783+0000","last_became_peered":"2024-03-11T22:08:20.327783+0000","last_unstale":"2024-03-11T22:09:17.731182+0000","last_undegraded":"2024-03-11T22:09:17.731182+0000","last_fullsized":"2024-03-11T22:09:17.731182+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:08:23.742566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556360+0000","last_change":"2024-03-11T22:08:22.375293+0000","last_active":"2024-03-11T22:09:17.556360+0000","last_peered":"2024-03-11T22:09:17.556360+0000","last_clean":"2024-03-11T22:09:17.556360+0000","last_became_active":"2024-03-11T22:08:22.374443+0000","last_became_peered":"2024-03-11T22:08:22.374443+0000","last_unstale":"2024-03-11T22:09:17.556360+0000","last_undegraded":"2024-03-11T22:09:17.556360+0000","last_fullsized":"2024-03-11T22:09:17.556360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:35:44.825145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478043+0000","last_change":"2024-03-11T22:08:18.298254+0000","last_active":"2024-03-11T22:09:17.478043+0000","last_peered":"2024-03-11T22:09:17.478043+0000","last_clean":"2024-03-11T22:09:17.478043+0000","last_became_active":"2024-03-11T22:08:18.297845+0000","last_became_peered":"2024-03-11T22:08:18.297845+0000","last_unstale":"2024-03-11T22:09:17.478043+0000","last_undegraded":"2024-03-11T22:09:17.478043+0000","last_fullsized":"2024-03-11T22:09:17.478043+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:34:44.030051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555477+0000","last_change":"2024-03-11T22:08:16.288937+0000","last_active":"2024-03-11T22:09:17.555477+0000","last_peered":"2024-03-11T22:09:17.555477+0000","last_clean":"2024-03-11T22:09:17.555477+0000","last_became_active":"2024-03-11T22:08:16.288302+0000","last_became_peered":"2024-03-11T22:08:16.288302+0000","last_unstale":"2024-03-11T22:09:17.555477+0000","last_undegraded":"2024-03-11T22:09:17.555477+0000","last_fullsized":"2024-03-11T22:09:17.555477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:17:34.799909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"74'128","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:19.497035+0000","last_change":"2024-03-11T22:07:40.767368+0000","last_active":"2024-03-11T22:09:19.497035+0000","last_peered":"2024-03-11T22:09:19.497035+0000","last_clean":"2024-03-11T22:09:19.497035+0000","last_became_active":"2024-03-11T22:07:40.766387+0000","last_became_peered":"2024-03-11T22:07:40.766387+0000","last_unstale":"2024-03-11T22:09:19.497035+0000","last_undegraded":"2024-03-11T22:09:19.497035+0000","last_fullsized":"2024-03-11T22:09:19.497035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:03:15.384548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:03:15.384548+0000","last_clean_scrub_stamp":"2024-03-11T22:03:15.384548+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:53:42.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466350+0000","last_change":"2024-03-11T22:08:20.313911+0000","last_active":"2024-03-11T22:09:17.466350+0000","last_peered":"2024-03-11T22:09:17.466350+0000","last_clean":"2024-03-11T22:09:17.466350+0000","last_became_active":"2024-03-11T22:08:20.313549+0000","last_became_peered":"2024-03-11T22:08:20.313549+0000","last_unstale":"2024-03-11T22:09:17.466350+0000","last_undegraded":"2024-03-11T22:09:17.466350+0000","last_fullsized":"2024-03-11T22:09:17.466350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:53:14.770982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730228+0000","last_change":"2024-03-11T22:08:22.387566+0000","last_active":"2024-03-11T22:09:17.730228+0000","last_peered":"2024-03-11T22:09:17.730228+0000","last_clean":"2024-03-11T22:09:17.730228+0000","last_became_active":"2024-03-11T22:08:22.386737+0000","last_became_peered":"2024-03-11T22:08:22.386737+0000","last_unstale":"2024-03-11T22:09:17.730228+0000","last_undegraded":"2024-03-11T22:09:17.730228+0000","last_fullsized":"2024-03-11T22:09:17.730228+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:42:29.653807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727476+0000","last_change":"2024-03-11T22:08:18.310119+0000","last_active":"2024-03-11T22:09:17.727476+0000","last_peered":"2024-03-11T22:09:17.727476+0000","last_clean":"2024-03-11T22:09:17.727476+0000","last_became_active":"2024-03-11T22:08:18.308894+0000","last_became_peered":"2024-03-11T22:08:18.308894+0000","last_unstale":"2024-03-11T22:09:17.727476+0000","last_undegraded":"2024-03-11T22:09:17.727476+0000","last_fullsized":"2024-03-11T22:09:17.727476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:56:56.345917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.427741+0000","last_change":"2024-03-11T22:08:16.290428+0000","last_active":"2024-03-11T22:09:17.427741+0000","last_peered":"2024-03-11T22:09:17.427741+0000","last_clean":"2024-03-11T22:09:17.427741+0000","last_became_active":"2024-03-11T22:08:16.288948+0000","last_became_peered":"2024-03-11T22:08:16.288948+0000","last_unstale":"2024-03-11T22:09:17.427741+0000","last_undegraded":"2024-03-11T22:09:17.427741+0000","last_fullsized":"2024-03-11T22:09:17.427741+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:12:44.021803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729420+0000","last_change":"2024-03-11T22:08:20.333540+0000","last_active":"2024-03-11T22:09:17.729420+0000","last_peered":"2024-03-11T22:09:17.729420+0000","last_clean":"2024-03-11T22:09:17.729420+0000","last_became_active":"2024-03-11T22:08:20.330136+0000","last_became_peered":"2024-03-11T22:08:20.330136+0000","last_unstale":"2024-03-11T22:09:17.729420+0000","last_undegraded":"2024-03-11T22:09:17.729420+0000","last_fullsized":"2024-03-11T22:09:17.729420+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:20:23.365777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727542+0000","last_change":"2024-03-11T22:08:22.569409+0000","last_active":"2024-03-11T22:09:17.727542+0000","last_peered":"2024-03-11T22:09:17.727542+0000","last_clean":"2024-03-11T22:09:17.727542+0000","last_became_active":"2024-03-11T22:08:22.568228+0000","last_became_peered":"2024-03-11T22:08:22.568228+0000","last_unstale":"2024-03-11T22:09:17.727542+0000","last_undegraded":"2024-03-11T22:09:17.727542+0000","last_fullsized":"2024-03-11T22:09:17.727542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:57:07.539354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"70'2","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466168+0000","last_change":"2024-03-11T22:08:31.395038+0000","last_active":"2024-03-11T22:09:17.466168+0000","last_peered":"2024-03-11T22:09:17.466168+0000","last_clean":"2024-03-11T22:09:17.466168+0000","last_became_active":"2024-03-11T22:08:21.348316+0000","last_became_peered":"2024-03-11T22:08:21.348316+0000","last_unstale":"2024-03-11T22:09:17.466168+0000","last_undegraded":"2024-03-11T22:09:17.466168+0000","last_fullsized":"2024-03-11T22:09:17.466168+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_clean_scrub_stamp":"2024-03-11T22:08:20.285852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:33:03.788845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021721599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429415+0000","last_change":"2024-03-11T22:08:16.288765+0000","last_active":"2024-03-11T22:09:17.429415+0000","last_peered":"2024-03-11T22:09:17.429415+0000","last_clean":"2024-03-11T22:09:17.429415+0000","last_became_active":"2024-03-11T22:08:16.286110+0000","last_became_peered":"2024-03-11T22:08:16.286110+0000","last_unstale":"2024-03-11T22:09:17.429415+0000","last_undegraded":"2024-03-11T22:09:17.429415+0000","last_fullsized":"2024-03-11T22:09:17.429415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:16:17.252239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":121,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.482513+0000","last_change":"2024-03-11T22:08:18.325976+0000","last_active":"2024-03-11T22:11:01.482513+0000","last_peered":"2024-03-11T22:11:01.482513+0000","last_clean":"2024-03-11T22:11:01.482513+0000","last_became_active":"2024-03-11T22:08:18.325403+0000","last_became_peered":"2024-03-11T22:08:18.325403+0000","last_unstale":"2024-03-11T22:11:01.482513+0000","last_undegraded":"2024-03-11T22:11:01.482513+0000","last_fullsized":"2024-03-11T22:11:01.482513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:11:35.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.482194+0000","last_change":"2024-03-11T22:08:20.319208+0000","last_active":"2024-03-11T22:11:01.482194+0000","last_peered":"2024-03-11T22:11:01.482194+0000","last_clean":"2024-03-11T22:11:01.482194+0000","last_became_active":"2024-03-11T22:08:20.318386+0000","last_became_peered":"2024-03-11T22:08:20.318386+0000","last_unstale":"2024-03-11T22:11:01.482194+0000","last_undegraded":"2024-03-11T22:11:01.482194+0000","last_fullsized":"2024-03-11T22:11:01.482194+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:26:26.898617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337568+0000","last_change":"2024-03-11T22:08:22.377348+0000","last_active":"2024-03-11T22:09:17.337568+0000","last_peered":"2024-03-11T22:09:17.337568+0000","last_clean":"2024-03-11T22:09:17.337568+0000","last_became_active":"2024-03-11T22:08:22.376621+0000","last_became_peered":"2024-03-11T22:08:22.376621+0000","last_unstale":"2024-03-11T22:09:17.337568+0000","last_undegraded":"2024-03-11T22:09:17.337568+0000","last_fullsized":"2024-03-11T22:09:17.337568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:15:45.472010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336727+0000","last_change":"2024-03-11T22:08:31.509690+0000","last_active":"2024-03-11T22:09:17.336727+0000","last_peered":"2024-03-11T22:09:17.336727+0000","last_clean":"2024-03-11T22:09:17.336727+0000","last_became_active":"2024-03-11T22:08:21.357627+0000","last_became_peered":"2024-03-11T22:08:21.357627+0000","last_unstale":"2024-03-11T22:09:17.336727+0000","last_undegraded":"2024-03-11T22:09:17.336727+0000","last_fullsized":"2024-03-11T22:09:17.336727+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_clean_scrub_stamp":"2024-03-11T22:08:20.285852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:46:34.709090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077561999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730659+0000","last_change":"2024-03-11T22:08:16.286772+0000","last_active":"2024-03-11T22:09:17.730659+0000","last_peered":"2024-03-11T22:09:17.730659+0000","last_clean":"2024-03-11T22:09:17.730659+0000","last_became_active":"2024-03-11T22:08:16.286159+0000","last_became_peered":"2024-03-11T22:08:16.286159+0000","last_unstale":"2024-03-11T22:09:17.730659+0000","last_undegraded":"2024-03-11T22:09:17.730659+0000","last_fullsized":"2024-03-11T22:09:17.730659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:51:12.133454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479602+0000","last_change":"2024-03-11T22:08:18.303062+0000","last_active":"2024-03-11T22:09:17.479602+0000","last_peered":"2024-03-11T22:09:17.479602+0000","last_clean":"2024-03-11T22:09:17.479602+0000","last_became_active":"2024-03-11T22:08:18.302170+0000","last_became_peered":"2024-03-11T22:08:18.302170+0000","last_unstale":"2024-03-11T22:09:17.479602+0000","last_undegraded":"2024-03-11T22:09:17.479602+0000","last_fullsized":"2024-03-11T22:09:17.479602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:00:12.504544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.482170+0000","last_change":"2024-03-11T22:08:20.339961+0000","last_active":"2024-03-11T22:11:01.482170+0000","last_peered":"2024-03-11T22:11:01.482170+0000","last_clean":"2024-03-11T22:11:01.482170+0000","last_became_active":"2024-03-11T22:08:20.339155+0000","last_became_peered":"2024-03-11T22:08:20.339155+0000","last_unstale":"2024-03-11T22:11:01.482170+0000","last_undegraded":"2024-03-11T22:11:01.482170+0000","last_fullsized":"2024-03-11T22:11:01.482170+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:35:52.887442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428274+0000","last_change":"2024-03-11T22:08:22.571742+0000","last_active":"2024-03-11T22:09:17.428274+0000","last_peered":"2024-03-11T22:09:17.428274+0000","last_clean":"2024-03-11T22:09:17.428274+0000","last_became_active":"2024-03-11T22:08:22.570776+0000","last_became_peered":"2024-03-11T22:08:22.570776+0000","last_unstale":"2024-03-11T22:09:17.428274+0000","last_undegraded":"2024-03-11T22:09:17.428274+0000","last_fullsized":"2024-03-11T22:09:17.428274+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:27:29.944082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"71'5","reported_seq":188,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:07.129232+0000","last_change":"2024-03-11T22:08:31.517441+0000","last_active":"2024-03-11T22:11:07.129232+0000","last_peered":"2024-03-11T22:11:07.129232+0000","last_clean":"2024-03-11T22:11:07.129232+0000","last_became_active":"2024-03-11T22:08:21.351828+0000","last_became_peered":"2024-03-11T22:08:21.351828+0000","last_unstale":"2024-03-11T22:11:07.129232+0000","last_undegraded":"2024-03-11T22:11:07.129232+0000","last_fullsized":"2024-03-11T22:11:07.129232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_clean_scrub_stamp":"2024-03-11T22:08:20.285852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:06:04.374264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027010950000000001,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":143,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466982+0000","last_change":"2024-03-11T22:08:16.272705+0000","last_active":"2024-03-11T22:09:17.466982+0000","last_peered":"2024-03-11T22:09:17.466982+0000","last_clean":"2024-03-11T22:09:17.466982+0000","last_became_active":"2024-03-11T22:08:16.271816+0000","last_became_peered":"2024-03-11T22:08:16.271816+0000","last_unstale":"2024-03-11T22:09:17.466982+0000","last_undegraded":"2024-03-11T22:09:17.466982+0000","last_fullsized":"2024-03-11T22:09:17.466982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:18:56.678516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729741+0000","last_change":"2024-03-11T22:08:18.310347+0000","last_active":"2024-03-11T22:09:17.729741+0000","last_peered":"2024-03-11T22:09:17.729741+0000","last_clean":"2024-03-11T22:09:17.729741+0000","last_became_active":"2024-03-11T22:08:18.308910+0000","last_became_peered":"2024-03-11T22:08:18.308910+0000","last_unstale":"2024-03-11T22:09:17.729741+0000","last_undegraded":"2024-03-11T22:09:17.729741+0000","last_fullsized":"2024-03-11T22:09:17.729741+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:19:35.951198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337388+0000","last_change":"2024-03-11T22:08:20.309203+0000","last_active":"2024-03-11T22:09:17.337388+0000","last_peered":"2024-03-11T22:09:17.337388+0000","last_clean":"2024-03-11T22:09:17.337388+0000","last_became_active":"2024-03-11T22:08:20.308894+0000","last_became_peered":"2024-03-11T22:08:20.308894+0000","last_unstale":"2024-03-11T22:09:17.337388+0000","last_undegraded":"2024-03-11T22:09:17.337388+0000","last_fullsized":"2024-03-11T22:09:17.337388+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:49:44.438805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478167+0000","last_change":"2024-03-11T22:08:22.568523+0000","last_active":"2024-03-11T22:09:17.478167+0000","last_peered":"2024-03-11T22:09:17.478167+0000","last_clean":"2024-03-11T22:09:17.478167+0000","last_became_active":"2024-03-11T22:08:22.567357+0000","last_became_peered":"2024-03-11T22:08:22.567357+0000","last_unstale":"2024-03-11T22:09:17.478167+0000","last_undegraded":"2024-03-11T22:09:17.478167+0000","last_fullsized":"2024-03-11T22:09:17.478167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:29:28.797210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.477832+0000","last_change":"2024-03-11T22:08:20.325990+0000","last_active":"2024-03-11T22:11:01.477832+0000","last_peered":"2024-03-11T22:11:01.477832+0000","last_clean":"2024-03-11T22:11:01.477832+0000","last_became_active":"2024-03-11T22:08:20.325560+0000","last_became_peered":"2024-03-11T22:08:20.325560+0000","last_unstale":"2024-03-11T22:11:01.477832+0000","last_undegraded":"2024-03-11T22:11:01.477832+0000","last_fullsized":"2024-03-11T22:11:01.477832+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:56:58.711820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428136+0000","last_change":"2024-03-11T22:08:16.283856+0000","last_active":"2024-03-11T22:09:17.428136+0000","last_peered":"2024-03-11T22:09:17.428136+0000","last_clean":"2024-03-11T22:09:17.428136+0000","last_became_active":"2024-03-11T22:08:16.283332+0000","last_became_peered":"2024-03-11T22:08:16.283332+0000","last_unstale":"2024-03-11T22:09:17.428136+0000","last_undegraded":"2024-03-11T22:09:17.428136+0000","last_fullsized":"2024-03-11T22:09:17.428136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:16:39.687172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337020+0000","last_change":"2024-03-11T22:08:18.327509+0000","last_active":"2024-03-11T22:09:17.337020+0000","last_peered":"2024-03-11T22:09:17.337020+0000","last_clean":"2024-03-11T22:09:17.337020+0000","last_became_active":"2024-03-11T22:08:18.326649+0000","last_became_peered":"2024-03-11T22:08:18.326649+0000","last_unstale":"2024-03-11T22:09:17.337020+0000","last_undegraded":"2024-03-11T22:09:17.337020+0000","last_fullsized":"2024-03-11T22:09:17.337020+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:31:17.533630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556290+0000","last_change":"2024-03-11T22:08:22.368338+0000","last_active":"2024-03-11T22:09:17.556290+0000","last_peered":"2024-03-11T22:09:17.556290+0000","last_clean":"2024-03-11T22:09:17.556290+0000","last_became_active":"2024-03-11T22:08:22.367760+0000","last_became_peered":"2024-03-11T22:08:22.367760+0000","last_unstale":"2024-03-11T22:09:17.556290+0000","last_undegraded":"2024-03-11T22:09:17.556290+0000","last_fullsized":"2024-03-11T22:09:17.556290+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:54:12.395459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.731439+0000","last_change":"2024-03-11T22:08:20.331377+0000","last_active":"2024-03-11T22:09:17.731439+0000","last_peered":"2024-03-11T22:09:17.731439+0000","last_clean":"2024-03-11T22:09:17.731439+0000","last_became_active":"2024-03-11T22:08:20.327770+0000","last_became_peered":"2024-03-11T22:08:20.327770+0000","last_unstale":"2024-03-11T22:09:17.731439+0000","last_undegraded":"2024-03-11T22:09:17.731439+0000","last_fullsized":"2024-03-11T22:09:17.731439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:12:59.160815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727962+0000","last_change":"2024-03-11T22:08:16.281805+0000","last_active":"2024-03-11T22:09:17.727962+0000","last_peered":"2024-03-11T22:09:17.727962+0000","last_clean":"2024-03-11T22:09:17.727962+0000","last_became_active":"2024-03-11T22:08:16.281488+0000","last_became_peered":"2024-03-11T22:08:16.281488+0000","last_unstale":"2024-03-11T22:09:17.727962+0000","last_undegraded":"2024-03-11T22:09:17.727962+0000","last_fullsized":"2024-03-11T22:09:17.727962+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:33:58.338357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477592+0000","last_change":"2024-03-11T22:08:18.303189+0000","last_active":"2024-03-11T22:09:17.477592+0000","last_peered":"2024-03-11T22:09:17.477592+0000","last_clean":"2024-03-11T22:09:17.477592+0000","last_became_active":"2024-03-11T22:08:18.302089+0000","last_became_peered":"2024-03-11T22:08:18.302089+0000","last_unstale":"2024-03-11T22:09:17.477592+0000","last_undegraded":"2024-03-11T22:09:17.477592+0000","last_fullsized":"2024-03-11T22:09:17.477592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:48:35.207793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339259+0000","last_change":"2024-03-11T22:08:22.371090+0000","last_active":"2024-03-11T22:09:17.339259+0000","last_peered":"2024-03-11T22:09:17.339259+0000","last_clean":"2024-03-11T22:09:17.339259+0000","last_became_active":"2024-03-11T22:08:22.370375+0000","last_became_peered":"2024-03-11T22:08:22.370375+0000","last_unstale":"2024-03-11T22:09:17.339259+0000","last_undegraded":"2024-03-11T22:09:17.339259+0000","last_fullsized":"2024-03-11T22:09:17.339259+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:00:24.414926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728382+0000","last_change":"2024-03-11T22:08:16.290969+0000","last_active":"2024-03-11T22:09:17.728382+0000","last_peered":"2024-03-11T22:09:17.728382+0000","last_clean":"2024-03-11T22:09:17.728382+0000","last_became_active":"2024-03-11T22:08:16.290276+0000","last_became_peered":"2024-03-11T22:08:16.290276+0000","last_unstale":"2024-03-11T22:09:17.728382+0000","last_undegraded":"2024-03-11T22:09:17.728382+0000","last_fullsized":"2024-03-11T22:09:17.728382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:41:04.854051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478242+0000","last_change":"2024-03-11T22:08:18.309386+0000","last_active":"2024-03-11T22:09:17.478242+0000","last_peered":"2024-03-11T22:09:17.478242+0000","last_clean":"2024-03-11T22:09:17.478242+0000","last_became_active":"2024-03-11T22:08:18.308063+0000","last_became_peered":"2024-03-11T22:08:18.308063+0000","last_unstale":"2024-03-11T22:09:17.478242+0000","last_undegraded":"2024-03-11T22:09:17.478242+0000","last_fullsized":"2024-03-11T22:09:17.478242+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:08:43.694874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337700+0000","last_change":"2024-03-11T22:08:20.312107+0000","last_active":"2024-03-11T22:09:17.337700+0000","last_peered":"2024-03-11T22:09:17.337700+0000","last_clean":"2024-03-11T22:09:17.337700+0000","last_became_active":"2024-03-11T22:08:20.311625+0000","last_became_peered":"2024-03-11T22:08:20.311625+0000","last_unstale":"2024-03-11T22:09:17.337700+0000","last_undegraded":"2024-03-11T22:09:17.337700+0000","last_fullsized":"2024-03-11T22:09:17.337700+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:46:54.458749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337279+0000","last_change":"2024-03-11T22:08:22.362673+0000","last_active":"2024-03-11T22:09:17.337279+0000","last_peered":"2024-03-11T22:09:17.337279+0000","last_clean":"2024-03-11T22:09:17.337279+0000","last_became_active":"2024-03-11T22:08:22.361352+0000","last_became_peered":"2024-03-11T22:08:22.361352+0000","last_unstale":"2024-03-11T22:09:17.337279+0000","last_undegraded":"2024-03-11T22:09:17.337279+0000","last_fullsized":"2024-03-11T22:09:17.337279+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:24:28.267537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:01.477966+0000","last_change":"2024-03-11T22:08:20.326656+0000","last_active":"2024-03-11T22:11:01.477966+0000","last_peered":"2024-03-11T22:11:01.477966+0000","last_clean":"2024-03-11T22:11:01.477966+0000","last_became_active":"2024-03-11T22:08:20.325803+0000","last_became_peered":"2024-03-11T22:08:20.325803+0000","last_unstale":"2024-03-11T22:11:01.477966+0000","last_undegraded":"2024-03-11T22:11:01.477966+0000","last_fullsized":"2024-03-11T22:11:01.477966+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:46:23.368097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428554+0000","last_change":"2024-03-11T22:08:16.289316+0000","last_active":"2024-03-11T22:09:17.428554+0000","last_peered":"2024-03-11T22:09:17.428554+0000","last_clean":"2024-03-11T22:09:17.428554+0000","last_became_active":"2024-03-11T22:08:16.287958+0000","last_became_peered":"2024-03-11T22:08:16.287958+0000","last_unstale":"2024-03-11T22:09:17.428554+0000","last_undegraded":"2024-03-11T22:09:17.428554+0000","last_fullsized":"2024-03-11T22:09:17.428554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:51:09.666167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466721+0000","last_change":"2024-03-11T22:08:18.325804+0000","last_active":"2024-03-11T22:09:17.466721+0000","last_peered":"2024-03-11T22:09:17.466721+0000","last_clean":"2024-03-11T22:09:17.466721+0000","last_became_active":"2024-03-11T22:08:18.321867+0000","last_became_peered":"2024-03-11T22:08:18.321867+0000","last_unstale":"2024-03-11T22:09:17.466721+0000","last_undegraded":"2024-03-11T22:09:17.466721+0000","last_fullsized":"2024-03-11T22:09:17.466721+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:25:33.820656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.427424+0000","last_change":"2024-03-11T22:08:22.389286+0000","last_active":"2024-03-11T22:09:17.427424+0000","last_peered":"2024-03-11T22:09:17.427424+0000","last_clean":"2024-03-11T22:09:17.427424+0000","last_became_active":"2024-03-11T22:08:22.388648+0000","last_became_peered":"2024-03-11T22:08:22.388648+0000","last_unstale":"2024-03-11T22:09:17.427424+0000","last_undegraded":"2024-03-11T22:09:17.427424+0000","last_fullsized":"2024-03-11T22:09:17.427424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:07:28.061438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336339+0000","last_change":"2024-03-11T22:08:16.277304+0000","last_active":"2024-03-11T22:09:17.336339+0000","last_peered":"2024-03-11T22:09:17.336339+0000","last_clean":"2024-03-11T22:09:17.336339+0000","last_became_active":"2024-03-11T22:08:16.276854+0000","last_became_peered":"2024-03-11T22:08:16.276854+0000","last_unstale":"2024-03-11T22:09:17.336339+0000","last_undegraded":"2024-03-11T22:09:17.336339+0000","last_fullsized":"2024-03-11T22:09:17.336339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:18:05.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429804+0000","last_change":"2024-03-11T22:08:18.315588+0000","last_active":"2024-03-11T22:09:17.429804+0000","last_peered":"2024-03-11T22:09:17.429804+0000","last_clean":"2024-03-11T22:09:17.429804+0000","last_became_active":"2024-03-11T22:08:18.314494+0000","last_became_peered":"2024-03-11T22:08:18.314494+0000","last_unstale":"2024-03-11T22:09:17.429804+0000","last_undegraded":"2024-03-11T22:09:17.429804+0000","last_fullsized":"2024-03-11T22:09:17.429804+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:46:32.891718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.465759+0000","last_change":"2024-03-11T22:08:20.343517+0000","last_active":"2024-03-11T22:09:17.465759+0000","last_peered":"2024-03-11T22:09:17.465759+0000","last_clean":"2024-03-11T22:09:17.465759+0000","last_became_active":"2024-03-11T22:08:20.343190+0000","last_became_peered":"2024-03-11T22:08:20.343190+0000","last_unstale":"2024-03-11T22:09:17.465759+0000","last_undegraded":"2024-03-11T22:09:17.465759+0000","last_fullsized":"2024-03-11T22:09:17.465759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:25:23.162143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727140+0000","last_change":"2024-03-11T22:08:22.359389+0000","last_active":"2024-03-11T22:09:17.727140+0000","last_peered":"2024-03-11T22:09:17.727140+0000","last_clean":"2024-03-11T22:09:17.727140+0000","last_became_active":"2024-03-11T22:08:22.358441+0000","last_became_peered":"2024-03-11T22:08:22.358441+0000","last_unstale":"2024-03-11T22:09:17.727140+0000","last_undegraded":"2024-03-11T22:09:17.727140+0000","last_fullsized":"2024-03-11T22:09:17.727140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:06:31.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730554+0000","last_change":"2024-03-11T22:08:16.284517+0000","last_active":"2024-03-11T22:09:17.730554+0000","last_peered":"2024-03-11T22:09:17.730554+0000","last_clean":"2024-03-11T22:09:17.730554+0000","last_became_active":"2024-03-11T22:08:16.284172+0000","last_became_peered":"2024-03-11T22:08:16.284172+0000","last_unstale":"2024-03-11T22:09:17.730554+0000","last_undegraded":"2024-03-11T22:09:17.730554+0000","last_fullsized":"2024-03-11T22:09:17.730554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:44:23.457649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555702+0000","last_change":"2024-03-11T22:08:18.317565+0000","last_active":"2024-03-11T22:09:17.555702+0000","last_peered":"2024-03-11T22:09:17.555702+0000","last_clean":"2024-03-11T22:09:17.555702+0000","last_became_active":"2024-03-11T22:08:18.316747+0000","last_became_peered":"2024-03-11T22:08:18.316747+0000","last_unstale":"2024-03-11T22:09:17.555702+0000","last_undegraded":"2024-03-11T22:09:17.555702+0000","last_fullsized":"2024-03-11T22:09:17.555702+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:09:31.046597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728526+0000","last_change":"2024-03-11T22:08:20.337360+0000","last_active":"2024-03-11T22:09:17.728526+0000","last_peered":"2024-03-11T22:09:17.728526+0000","last_clean":"2024-03-11T22:09:17.728526+0000","last_became_active":"2024-03-11T22:08:20.336053+0000","last_became_peered":"2024-03-11T22:08:20.336053+0000","last_unstale":"2024-03-11T22:09:17.728526+0000","last_undegraded":"2024-03-11T22:09:17.728526+0000","last_fullsized":"2024-03-11T22:09:17.728526+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:21:41.097509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555719+0000","last_change":"2024-03-11T22:08:22.566755+0000","last_active":"2024-03-11T22:09:17.555719+0000","last_peered":"2024-03-11T22:09:17.555719+0000","last_clean":"2024-03-11T22:09:17.555719+0000","last_became_active":"2024-03-11T22:08:22.565457+0000","last_became_peered":"2024-03-11T22:08:22.565457+0000","last_unstale":"2024-03-11T22:09:17.555719+0000","last_undegraded":"2024-03-11T22:09:17.555719+0000","last_fullsized":"2024-03-11T22:09:17.555719+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:44:20.940840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337997+0000","last_change":"2024-03-11T22:08:16.278515+0000","last_active":"2024-03-11T22:09:17.337997+0000","last_peered":"2024-03-11T22:09:17.337997+0000","last_clean":"2024-03-11T22:09:17.337997+0000","last_became_active":"2024-03-11T22:08:16.277924+0000","last_became_peered":"2024-03-11T22:08:16.277924+0000","last_unstale":"2024-03-11T22:09:17.337997+0000","last_undegraded":"2024-03-11T22:09:17.337997+0000","last_fullsized":"2024-03-11T22:09:17.337997+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:44:31.995285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429547+0000","last_change":"2024-03-11T22:08:18.313177+0000","last_active":"2024-03-11T22:09:17.429547+0000","last_peered":"2024-03-11T22:09:17.429547+0000","last_clean":"2024-03-11T22:09:17.429547+0000","last_became_active":"2024-03-11T22:08:18.312397+0000","last_became_peered":"2024-03-11T22:08:18.312397+0000","last_unstale":"2024-03-11T22:09:17.429547+0000","last_undegraded":"2024-03-11T22:09:17.429547+0000","last_fullsized":"2024-03-11T22:09:17.429547+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:58:50.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555132+0000","last_change":"2024-03-11T22:08:20.309096+0000","last_active":"2024-03-11T22:09:17.555132+0000","last_peered":"2024-03-11T22:09:17.555132+0000","last_clean":"2024-03-11T22:09:17.555132+0000","last_became_active":"2024-03-11T22:08:20.308669+0000","last_became_peered":"2024-03-11T22:08:20.308669+0000","last_unstale":"2024-03-11T22:09:17.555132+0000","last_undegraded":"2024-03-11T22:09:17.555132+0000","last_fullsized":"2024-03-11T22:09:17.555132+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:23:33.667816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":143,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234028,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32500,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712652,"statfs":{"total":95995035648,"available":95961755648,"internally_reserved":0,"allocated":1355776,"data_stored":885527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28316,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716836,"statfs":{"total":95995035648,"available":95966040064,"internally_reserved":0,"allocated":1331200,"data_stored":883368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717400,"statfs":{"total":95995035648,"available":95966617600,"internally_reserved":0,"allocated":749568,"data_stored":294067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738485,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36652,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708500,"statfs":{"total":95995035648,"available":95957504000,"internally_reserved":0,"allocated":1347584,"data_stored":884893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713256,"statfs":{"total":95995035648,"available":95962374144,"internally_reserved":0,"allocated":733184,"data_stored":293427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182486,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36052,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709100,"statfs":{"total":95995035648,"available":95958118400,"internally_reserved":0,"allocated":729088,"data_stored":293355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018955,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":778240,"data_stored":295170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717412,"statfs":{"total":95995035648,"available":95966629888,"internally_reserved":0,"allocated":737280,"data_stored":293349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-11T22:11:10.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph pg dump --format=json 2024-03-11T22:11:10.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:09 smithi187 bash[23415]: audit 2024-03-11T22:11:08.439340+0000 mgr.y (mgr.14601) 102 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:10.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:09 smithi049 bash[21434]: audit 2024-03-11T22:11:08.439340+0000 mgr.y (mgr.14601) 102 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:10.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:09 smithi049 bash[28804]: audit 2024-03-11T22:11:08.439340+0000 mgr.y (mgr.14601) 102 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:11.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:10 smithi187 bash[23415]: cluster 2024-03-11T22:11:09.404980+0000 mgr.y (mgr.14601) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:11.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:10 smithi187 bash[23415]: audit 2024-03-11T22:11:09.423995+0000 mgr.y (mgr.14601) 104 : audit 0 from='client.24650 v1:172.21.15.49:0/3582907105' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:11:11.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:11 smithi049 bash[28804]: cluster 2024-03-11T22:11:09.404980+0000 mgr.y (mgr.14601) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:11.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:11 smithi049 bash[28804]: audit 2024-03-11T22:11:09.423995+0000 mgr.y (mgr.14601) 104 : audit 0 from='client.24650 v1:172.21.15.49:0/3582907105' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:11:11.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:10 smithi049 bash[21434]: cluster 2024-03-11T22:11:09.404980+0000 mgr.y (mgr.14601) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:11.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:10 smithi049 bash[21434]: audit 2024-03-11T22:11:09.423995+0000 mgr.y (mgr.14601) 104 : audit 0 from='client.24650 v1:172.21.15.49:0/3582907105' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:11:12.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:12 smithi049 bash[21434]: cluster 2024-03-11T22:11:11.405619+0000 mgr.y (mgr.14601) 105 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:12.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:12 smithi049 bash[28804]: cluster 2024-03-11T22:11:11.405619+0000 mgr.y (mgr.14601) 105 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:12.487 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:12 smithi187 bash[23415]: cluster 2024-03-11T22:11:11.405619+0000 mgr.y (mgr.14601) 105 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:14.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:14 smithi049 bash[21434]: cluster 2024-03-11T22:11:13.407590+0000 mgr.y (mgr.14601) 106 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:14.516 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:14 smithi049 bash[28804]: cluster 2024-03-11T22:11:13.407590+0000 mgr.y (mgr.14601) 106 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:14.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:11:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:11:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:11:14.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:14 smithi187 bash[23415]: cluster 2024-03-11T22:11:13.407590+0000 mgr.y (mgr.14601) 106 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:14.927 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:11:16.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:16 smithi187 bash[23415]: cluster 2024-03-11T22:11:15.408366+0000 mgr.y (mgr.14601) 107 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:16.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:16 smithi049 bash[21434]: cluster 2024-03-11T22:11:15.408366+0000 mgr.y (mgr.14601) 107 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:16.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:16 smithi049 bash[28804]: cluster 2024-03-11T22:11:15.408366+0000 mgr.y (mgr.14601) 107 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:17.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.430+0000 7efd6ffff700 1 -- 172.21.15.49:0/1459496845 >> v1:172.21.15.49:6789/0 conn(0x7efd70106720 legacy=0x7efd70106b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:17.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.430+0000 7efd6ffff700 1 -- 172.21.15.49:0/1459496845 shutdown_connections 2024-03-11T22:11:17.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.430+0000 7efd6ffff700 1 -- 172.21.15.49:0/1459496845 >> 172.21.15.49:0/1459496845 conn(0x7efd700fc210 msgr2=0x7efd700fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:17.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.430+0000 7efd6ffff700 1 -- 172.21.15.49:0/1459496845 shutdown_connections 2024-03-11T22:11:17.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.430+0000 7efd6ffff700 1 -- 172.21.15.49:0/1459496845 wait complete. 2024-03-11T22:11:17.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.430+0000 7efd6ffff700 1 Processor -- start 2024-03-11T22:11:17.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.430+0000 7efd6ffff700 1 -- start start 2024-03-11T22:11:17.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6ffff700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efd701a8b50 con 0x7efd70106720 2024-03-11T22:11:17.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6ffff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efd701a9d30 con 0x7efd701095d0 2024-03-11T22:11:17.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6ffff700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efd701aaf30 con 0x7efd7010d1a0 2024-03-11T22:11:17.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6f7fe700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7efd7010d1a0 0x7efd701a7210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:59324/0 (socket says 172.21.15.49:59324) 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6f7fe700 1 -- 172.21.15.49:0/2642231581 learned_addr learned my addr 172.21.15.49:0/2642231581 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6effd700 1 --1- 172.21.15.49:0/2642231581 >> v1:172.21.15.49:6789/0 conn(0x7efd70106720 0x7efd7010c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46978/0 (socket says 172.21.15.49:46978) 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755978051 0 0) 0x7efd701aaf30 con 0x7efd7010d1a0 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd580037f0 con 0x7efd7010d1a0 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789029979 0 0) 0x7efd701a8b50 con 0x7efd70106720 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd701aaf30 con 0x7efd70106720 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933098650 0 0) 0x7efd701a9d30 con 0x7efd701095d0 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd701a8b50 con 0x7efd701095d0 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4244212536 0 0) 0x7efd580037f0 con 0x7efd7010d1a0 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd701a9d30 con 0x7efd7010d1a0 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1772221330 0 0) 0x7efd701aaf30 con 0x7efd70106720 2024-03-11T22:11:17.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd580037f0 con 0x7efd70106720 2024-03-11T22:11:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7efd68001c10 con 0x7efd7010d1a0 2024-03-11T22:11:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7efd60001880 con 0x7efd70106720 2024-03-11T22:11:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3096379445 0 0) 0x7efd701a9d30 con 0x7efd7010d1a0 2024-03-11T22:11:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 >> v1:172.21.15.187:6789/0 conn(0x7efd701095d0 legacy=0x7efd701a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 >> v1:172.21.15.49:6789/0 conn(0x7efd70106720 legacy=0x7efd7010c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd701ac130 con 0x7efd7010d1a0 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd701a8d40 con 0x7efd7010d1a0 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efd701a91c0 con 0x7efd7010d1a0 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7efd68003eb0 con 0x7efd7010d1a0 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7efd68005f40 con 0x7efd7010d1a0 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c005120 con 0x7efd7010d1a0 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.434+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7efd68003a20 con 0x7efd7010d1a0 2024-03-11T22:11:17.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.438+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7efd68088640 con 0x7efd7010d1a0 2024-03-11T22:11:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.442+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7efd68055b10 con 0x7efd7010d1a0 2024-03-11T22:11:17.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.650+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 --> v1:172.21.15.49:6800/915645872 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd5c000b90 con 0x7efd5806e760 2024-03-11T22:11:17.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.682+0000 7efd57fff700 1 -- 172.21.15.49:0/2642231581 <== mgr.14601 v1:172.21.15.49:6800/915645872 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+346507 (unknown 2965378022 0 3647674572) 0x7efd5c000b90 con 0x7efd5806e760 2024-03-11T22:11:17.673 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:11:17.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.686+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 >> v1:172.21.15.49:6800/915645872 conn(0x7efd5806e760 legacy=0x7efd58070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.686+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 >> v1:172.21.15.49:6790/0 conn(0x7efd7010d1a0 legacy=0x7efd701a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.686+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 shutdown_connections 2024-03-11T22:11:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.686+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 >> 172.21.15.49:0/2642231581 conn(0x7efd700fc210 msgr2=0x7efd701105c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.686+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 shutdown_connections 2024-03-11T22:11:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:17.686+0000 7efd6ffff700 1 -- 172.21.15.49:0/2642231581 wait complete. 2024-03-11T22:11:17.679 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-11T22:11:18.342 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-03-11T22:11:17.408599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596316,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1103,"num_read_kb":949,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":248688,"kb_used_data":7580,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":749712528,"statfs":{"total":767960285184,"available":767705628672,"internally_reserved":0,"allocated":7761920,"data_stored":4123156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006089"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478103+0000","last_change":"2024-03-11T22:08:22.573422+0000","last_active":"2024-03-11T22:09:17.478103+0000","last_peered":"2024-03-11T22:09:17.478103+0000","last_clean":"2024-03-11T22:09:17.478103+0000","last_became_active":"2024-03-11T22:08:22.572436+0000","last_became_peered":"2024-03-11T22:08:22.572436+0000","last_unstale":"2024-03-11T22:09:17.478103+0000","last_undegraded":"2024-03-11T22:09:17.478103+0000","last_fullsized":"2024-03-11T22:09:17.478103+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:55:55.569272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477743+0000","last_change":"2024-03-11T22:08:20.342372+0000","last_active":"2024-03-11T22:09:17.477743+0000","last_peered":"2024-03-11T22:09:17.477743+0000","last_clean":"2024-03-11T22:09:17.477743+0000","last_became_active":"2024-03-11T22:08:20.341191+0000","last_became_peered":"2024-03-11T22:08:20.341191+0000","last_unstale":"2024-03-11T22:09:17.477743+0000","last_undegraded":"2024-03-11T22:09:17.477743+0000","last_fullsized":"2024-03-11T22:09:17.477743+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:53:02.429730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729838+0000","last_change":"2024-03-11T22:08:16.277816+0000","last_active":"2024-03-11T22:09:17.729838+0000","last_peered":"2024-03-11T22:09:17.729838+0000","last_clean":"2024-03-11T22:09:17.729838+0000","last_became_active":"2024-03-11T22:08:16.276668+0000","last_became_peered":"2024-03-11T22:08:16.276668+0000","last_unstale":"2024-03-11T22:09:17.729838+0000","last_undegraded":"2024-03-11T22:09:17.729838+0000","last_fullsized":"2024-03-11T22:09:17.729838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:46:05.596898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479138+0000","last_change":"2024-03-11T22:08:18.321267+0000","last_active":"2024-03-11T22:09:17.479138+0000","last_peered":"2024-03-11T22:09:17.479138+0000","last_clean":"2024-03-11T22:09:17.479138+0000","last_became_active":"2024-03-11T22:08:18.320778+0000","last_became_peered":"2024-03-11T22:08:18.320778+0000","last_unstale":"2024-03-11T22:09:17.479138+0000","last_undegraded":"2024-03-11T22:09:17.479138+0000","last_fullsized":"2024-03-11T22:09:17.479138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:52:47.792085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337269+0000","last_change":"2024-03-11T22:08:22.371322+0000","last_active":"2024-03-11T22:09:17.337269+0000","last_peered":"2024-03-11T22:09:17.337269+0000","last_clean":"2024-03-11T22:09:17.337269+0000","last_became_active":"2024-03-11T22:08:22.370505+0000","last_became_peered":"2024-03-11T22:08:22.370505+0000","last_unstale":"2024-03-11T22:09:17.337269+0000","last_undegraded":"2024-03-11T22:09:17.337269+0000","last_fullsized":"2024-03-11T22:09:17.337269+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:05:41.406179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336733+0000","last_change":"2024-03-11T22:08:20.325865+0000","last_active":"2024-03-11T22:09:17.336733+0000","last_peered":"2024-03-11T22:09:17.336733+0000","last_clean":"2024-03-11T22:09:17.336733+0000","last_became_active":"2024-03-11T22:08:20.325453+0000","last_became_peered":"2024-03-11T22:08:20.325453+0000","last_unstale":"2024-03-11T22:09:17.336733+0000","last_undegraded":"2024-03-11T22:09:17.336733+0000","last_fullsized":"2024-03-11T22:09:17.336733+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:24:45.227790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478882+0000","last_change":"2024-03-11T22:08:16.272075+0000","last_active":"2024-03-11T22:09:17.478882+0000","last_peered":"2024-03-11T22:09:17.478882+0000","last_clean":"2024-03-11T22:09:17.478882+0000","last_became_active":"2024-03-11T22:08:16.271395+0000","last_became_peered":"2024-03-11T22:08:16.271395+0000","last_unstale":"2024-03-11T22:09:17.478882+0000","last_undegraded":"2024-03-11T22:09:17.478882+0000","last_fullsized":"2024-03-11T22:09:17.478882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:22:53.774040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729593+0000","last_change":"2024-03-11T22:08:18.320646+0000","last_active":"2024-03-11T22:09:17.729593+0000","last_peered":"2024-03-11T22:09:17.729593+0000","last_clean":"2024-03-11T22:09:17.729593+0000","last_became_active":"2024-03-11T22:08:18.320065+0000","last_became_peered":"2024-03-11T22:08:18.320065+0000","last_unstale":"2024-03-11T22:09:17.729593+0000","last_undegraded":"2024-03-11T22:09:17.729593+0000","last_fullsized":"2024-03-11T22:09:17.729593+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:54:28.414234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555143+0000","last_change":"2024-03-11T22:08:22.375119+0000","last_active":"2024-03-11T22:09:17.555143+0000","last_peered":"2024-03-11T22:09:17.555143+0000","last_clean":"2024-03-11T22:09:17.555143+0000","last_became_active":"2024-03-11T22:08:22.374364+0000","last_became_peered":"2024-03-11T22:08:22.374364+0000","last_unstale":"2024-03-11T22:09:17.555143+0000","last_undegraded":"2024-03-11T22:09:17.555143+0000","last_fullsized":"2024-03-11T22:09:17.555143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:19:22.587500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337146+0000","last_change":"2024-03-11T22:09:08.100466+0000","last_active":"2024-03-11T22:09:17.337146+0000","last_peered":"2024-03-11T22:09:17.337146+0000","last_clean":"2024-03-11T22:09:17.337146+0000","last_became_active":"2024-03-11T22:09:08.099298+0000","last_became_peered":"2024-03-11T22:09:08.099298+0000","last_unstale":"2024-03-11T22:09:17.337146+0000","last_undegraded":"2024-03-11T22:09:17.337146+0000","last_fullsized":"2024-03-11T22:09:17.337146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:04:22.764310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429706+0000","last_change":"2024-03-11T22:08:16.286240+0000","last_active":"2024-03-11T22:09:17.429706+0000","last_peered":"2024-03-11T22:09:17.429706+0000","last_clean":"2024-03-11T22:09:17.429706+0000","last_became_active":"2024-03-11T22:08:16.284961+0000","last_became_peered":"2024-03-11T22:08:16.284961+0000","last_unstale":"2024-03-11T22:09:17.429706+0000","last_undegraded":"2024-03-11T22:09:17.429706+0000","last_fullsized":"2024-03-11T22:09:17.429706+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:07:17.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555933+0000","last_change":"2024-03-11T22:08:18.323994+0000","last_active":"2024-03-11T22:09:17.555933+0000","last_peered":"2024-03-11T22:09:17.555933+0000","last_clean":"2024-03-11T22:09:17.555933+0000","last_became_active":"2024-03-11T22:08:18.323056+0000","last_became_peered":"2024-03-11T22:08:18.323056+0000","last_unstale":"2024-03-11T22:09:17.555933+0000","last_undegraded":"2024-03-11T22:09:17.555933+0000","last_fullsized":"2024-03-11T22:09:17.555933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:30:52.079550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.726756+0000","last_change":"2024-03-11T22:08:22.387057+0000","last_active":"2024-03-11T22:09:17.726756+0000","last_peered":"2024-03-11T22:09:17.726756+0000","last_clean":"2024-03-11T22:09:17.726756+0000","last_became_active":"2024-03-11T22:08:22.382798+0000","last_became_peered":"2024-03-11T22:08:22.382798+0000","last_unstale":"2024-03-11T22:09:17.726756+0000","last_undegraded":"2024-03-11T22:09:17.726756+0000","last_fullsized":"2024-03-11T22:09:17.726756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:18:33.108051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.338239+0000","last_change":"2024-03-11T22:08:20.302187+0000","last_active":"2024-03-11T22:09:17.338239+0000","last_peered":"2024-03-11T22:09:17.338239+0000","last_clean":"2024-03-11T22:09:17.338239+0000","last_became_active":"2024-03-11T22:08:20.301708+0000","last_became_peered":"2024-03-11T22:08:20.301708+0000","last_unstale":"2024-03-11T22:09:17.338239+0000","last_undegraded":"2024-03-11T22:09:17.338239+0000","last_fullsized":"2024-03-11T22:09:17.338239+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:04:38.122798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429253+0000","last_change":"2024-03-11T22:08:16.287091+0000","last_active":"2024-03-11T22:09:17.429253+0000","last_peered":"2024-03-11T22:09:17.429253+0000","last_clean":"2024-03-11T22:09:17.429253+0000","last_became_active":"2024-03-11T22:08:16.286652+0000","last_became_peered":"2024-03-11T22:08:16.286652+0000","last_unstale":"2024-03-11T22:09:17.429253+0000","last_undegraded":"2024-03-11T22:09:17.429253+0000","last_fullsized":"2024-03-11T22:09:17.429253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:01:35.675383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555890+0000","last_change":"2024-03-11T22:08:18.322527+0000","last_active":"2024-03-11T22:09:17.555890+0000","last_peered":"2024-03-11T22:09:17.555890+0000","last_clean":"2024-03-11T22:09:17.555890+0000","last_became_active":"2024-03-11T22:08:18.321337+0000","last_became_peered":"2024-03-11T22:08:18.321337+0000","last_unstale":"2024-03-11T22:09:17.555890+0000","last_undegraded":"2024-03-11T22:09:17.555890+0000","last_fullsized":"2024-03-11T22:09:17.555890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:56:02.681152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479725+0000","last_change":"2024-03-11T22:08:22.569349+0000","last_active":"2024-03-11T22:09:17.479725+0000","last_peered":"2024-03-11T22:09:17.479725+0000","last_clean":"2024-03-11T22:09:17.479725+0000","last_became_active":"2024-03-11T22:08:22.568107+0000","last_became_peered":"2024-03-11T22:08:22.568107+0000","last_unstale":"2024-03-11T22:09:17.479725+0000","last_undegraded":"2024-03-11T22:09:17.479725+0000","last_fullsized":"2024-03-11T22:09:17.479725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:08:25.597091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478716+0000","last_change":"2024-03-11T22:08:20.331372+0000","last_active":"2024-03-11T22:09:17.478716+0000","last_peered":"2024-03-11T22:09:17.478716+0000","last_clean":"2024-03-11T22:09:17.478716+0000","last_became_active":"2024-03-11T22:08:20.330537+0000","last_became_peered":"2024-03-11T22:08:20.330537+0000","last_unstale":"2024-03-11T22:09:17.478716+0000","last_undegraded":"2024-03-11T22:09:17.478716+0000","last_fullsized":"2024-03-11T22:09:17.478716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:11:50.649025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478209+0000","last_change":"2024-03-11T22:08:16.271549+0000","last_active":"2024-03-11T22:09:17.478209+0000","last_peered":"2024-03-11T22:09:17.478209+0000","last_clean":"2024-03-11T22:09:17.478209+0000","last_became_active":"2024-03-11T22:08:16.271134+0000","last_became_peered":"2024-03-11T22:08:16.271134+0000","last_unstale":"2024-03-11T22:09:17.478209+0000","last_undegraded":"2024-03-11T22:09:17.478209+0000","last_fullsized":"2024-03-11T22:09:17.478209+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:03:35.183006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337384+0000","last_change":"2024-03-11T22:08:18.327414+0000","last_active":"2024-03-11T22:09:17.337384+0000","last_peered":"2024-03-11T22:09:17.337384+0000","last_clean":"2024-03-11T22:09:17.337384+0000","last_became_active":"2024-03-11T22:08:18.326612+0000","last_became_peered":"2024-03-11T22:08:18.326612+0000","last_unstale":"2024-03-11T22:09:17.337384+0000","last_undegraded":"2024-03-11T22:09:17.337384+0000","last_fullsized":"2024-03-11T22:09:17.337384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:56:35.602415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339119+0000","last_change":"2024-03-11T22:08:22.572971+0000","last_active":"2024-03-11T22:09:17.339119+0000","last_peered":"2024-03-11T22:09:17.339119+0000","last_clean":"2024-03-11T22:09:17.339119+0000","last_became_active":"2024-03-11T22:08:22.569412+0000","last_became_peered":"2024-03-11T22:08:22.569412+0000","last_unstale":"2024-03-11T22:09:17.339119+0000","last_undegraded":"2024-03-11T22:09:17.339119+0000","last_fullsized":"2024-03-11T22:09:17.339119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:17:35.971428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336577+0000","last_change":"2024-03-11T22:09:08.103217+0000","last_active":"2024-03-11T22:09:17.336577+0000","last_peered":"2024-03-11T22:09:17.336577+0000","last_clean":"2024-03-11T22:09:17.336577+0000","last_became_active":"2024-03-11T22:09:08.102024+0000","last_became_peered":"2024-03-11T22:09:08.102024+0000","last_unstale":"2024-03-11T22:09:17.336577+0000","last_undegraded":"2024-03-11T22:09:17.336577+0000","last_fullsized":"2024-03-11T22:09:17.336577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:55:41.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466039+0000","last_change":"2024-03-11T22:08:16.267425+0000","last_active":"2024-03-11T22:09:17.466039+0000","last_peered":"2024-03-11T22:09:17.466039+0000","last_clean":"2024-03-11T22:09:17.466039+0000","last_became_active":"2024-03-11T22:08:16.266326+0000","last_became_peered":"2024-03-11T22:08:16.266326+0000","last_unstale":"2024-03-11T22:09:17.466039+0000","last_undegraded":"2024-03-11T22:09:17.466039+0000","last_fullsized":"2024-03-11T22:09:17.466039+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:25:23.309706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728935+0000","last_change":"2024-03-11T22:08:18.311022+0000","last_active":"2024-03-11T22:09:17.728935+0000","last_peered":"2024-03-11T22:09:17.728935+0000","last_clean":"2024-03-11T22:09:17.728935+0000","last_became_active":"2024-03-11T22:08:18.309933+0000","last_became_peered":"2024-03-11T22:08:18.309933+0000","last_unstale":"2024-03-11T22:09:17.728935+0000","last_undegraded":"2024-03-11T22:09:17.728935+0000","last_fullsized":"2024-03-11T22:09:17.728935+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:22:38.187974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730218+0000","last_change":"2024-03-11T22:08:22.378257+0000","last_active":"2024-03-11T22:09:17.730218+0000","last_peered":"2024-03-11T22:09:17.730218+0000","last_clean":"2024-03-11T22:09:17.730218+0000","last_became_active":"2024-03-11T22:08:22.377525+0000","last_became_peered":"2024-03-11T22:08:22.377525+0000","last_unstale":"2024-03-11T22:09:17.730218+0000","last_undegraded":"2024-03-11T22:09:17.730218+0000","last_fullsized":"2024-03-11T22:09:17.730218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:21:07.776217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"67'11","reported_seq":81,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.481916+0000","last_change":"2024-03-11T22:08:20.327676+0000","last_active":"2024-03-11T22:11:06.481916+0000","last_peered":"2024-03-11T22:11:06.481916+0000","last_clean":"2024-03-11T22:11:06.481916+0000","last_became_active":"2024-03-11T22:08:20.327241+0000","last_became_peered":"2024-03-11T22:08:20.327241+0000","last_unstale":"2024-03-11T22:11:06.481916+0000","last_undegraded":"2024-03-11T22:11:06.481916+0000","last_fullsized":"2024-03-11T22:11:06.481916+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:55:46.714531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477907+0000","last_change":"2024-03-11T22:08:16.274325+0000","last_active":"2024-03-11T22:09:17.477907+0000","last_peered":"2024-03-11T22:09:17.477907+0000","last_clean":"2024-03-11T22:09:17.477907+0000","last_became_active":"2024-03-11T22:08:16.273533+0000","last_became_peered":"2024-03-11T22:08:16.273533+0000","last_unstale":"2024-03-11T22:09:17.477907+0000","last_undegraded":"2024-03-11T22:09:17.477907+0000","last_fullsized":"2024-03-11T22:09:17.477907+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:02:23.735419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477417+0000","last_change":"2024-03-11T22:08:18.295565+0000","last_active":"2024-03-11T22:09:17.477417+0000","last_peered":"2024-03-11T22:09:17.477417+0000","last_clean":"2024-03-11T22:09:17.477417+0000","last_became_active":"2024-03-11T22:08:18.295073+0000","last_became_peered":"2024-03-11T22:08:18.295073+0000","last_unstale":"2024-03-11T22:09:17.477417+0000","last_undegraded":"2024-03-11T22:09:17.477417+0000","last_fullsized":"2024-03-11T22:09:17.477417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:01:27.928498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428717+0000","last_change":"2024-03-11T22:08:22.357772+0000","last_active":"2024-03-11T22:09:17.428717+0000","last_peered":"2024-03-11T22:09:17.428717+0000","last_clean":"2024-03-11T22:09:17.428717+0000","last_became_active":"2024-03-11T22:08:22.356871+0000","last_became_peered":"2024-03-11T22:08:22.356871+0000","last_unstale":"2024-03-11T22:09:17.428717+0000","last_undegraded":"2024-03-11T22:09:17.428717+0000","last_fullsized":"2024-03-11T22:09:17.428717+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:12:48.155794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729605+0000","last_change":"2024-03-11T22:08:20.335022+0000","last_active":"2024-03-11T22:09:17.729605+0000","last_peered":"2024-03-11T22:09:17.729605+0000","last_clean":"2024-03-11T22:09:17.729605+0000","last_became_active":"2024-03-11T22:08:20.332633+0000","last_became_peered":"2024-03-11T22:08:20.332633+0000","last_unstale":"2024-03-11T22:09:17.729605+0000","last_undegraded":"2024-03-11T22:09:17.729605+0000","last_fullsized":"2024-03-11T22:09:17.729605+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:13:18.408394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555155+0000","last_change":"2024-03-11T22:08:16.287152+0000","last_active":"2024-03-11T22:09:17.555155+0000","last_peered":"2024-03-11T22:09:17.555155+0000","last_clean":"2024-03-11T22:09:17.555155+0000","last_became_active":"2024-03-11T22:08:16.286709+0000","last_became_peered":"2024-03-11T22:08:16.286709+0000","last_unstale":"2024-03-11T22:09:17.555155+0000","last_undegraded":"2024-03-11T22:09:17.555155+0000","last_fullsized":"2024-03-11T22:09:17.555155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:14:02.309733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727733+0000","last_change":"2024-03-11T22:08:18.323373+0000","last_active":"2024-03-11T22:09:17.727733+0000","last_peered":"2024-03-11T22:09:17.727733+0000","last_clean":"2024-03-11T22:09:17.727733+0000","last_became_active":"2024-03-11T22:08:18.321466+0000","last_became_peered":"2024-03-11T22:08:18.321466+0000","last_unstale":"2024-03-11T22:09:17.727733+0000","last_undegraded":"2024-03-11T22:09:17.727733+0000","last_fullsized":"2024-03-11T22:09:17.727733+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:14:36.581051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478374+0000","last_change":"2024-03-11T22:08:22.573294+0000","last_active":"2024-03-11T22:09:17.478374+0000","last_peered":"2024-03-11T22:09:17.478374+0000","last_clean":"2024-03-11T22:09:17.478374+0000","last_became_active":"2024-03-11T22:08:22.572198+0000","last_became_peered":"2024-03-11T22:08:22.572198+0000","last_unstale":"2024-03-11T22:09:17.478374+0000","last_undegraded":"2024-03-11T22:09:17.478374+0000","last_fullsized":"2024-03-11T22:09:17.478374+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:23:41.088071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478356+0000","last_change":"2024-03-11T22:08:20.319010+0000","last_active":"2024-03-11T22:09:17.478356+0000","last_peered":"2024-03-11T22:09:17.478356+0000","last_clean":"2024-03-11T22:09:17.478356+0000","last_became_active":"2024-03-11T22:08:20.318083+0000","last_became_peered":"2024-03-11T22:08:20.318083+0000","last_unstale":"2024-03-11T22:09:17.478356+0000","last_undegraded":"2024-03-11T22:09:17.478356+0000","last_fullsized":"2024-03-11T22:09:17.478356+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:19:20.169669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.467121+0000","last_change":"2024-03-11T22:08:16.287826+0000","last_active":"2024-03-11T22:09:17.467121+0000","last_peered":"2024-03-11T22:09:17.467121+0000","last_clean":"2024-03-11T22:09:17.467121+0000","last_became_active":"2024-03-11T22:08:16.286973+0000","last_became_peered":"2024-03-11T22:08:16.286973+0000","last_unstale":"2024-03-11T22:09:17.467121+0000","last_undegraded":"2024-03-11T22:09:17.467121+0000","last_fullsized":"2024-03-11T22:09:17.467121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:21:05.715825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556343+0000","last_change":"2024-03-11T22:08:18.304030+0000","last_active":"2024-03-11T22:09:17.556343+0000","last_peered":"2024-03-11T22:09:17.556343+0000","last_clean":"2024-03-11T22:09:17.556343+0000","last_became_active":"2024-03-11T22:08:18.303071+0000","last_became_peered":"2024-03-11T22:08:18.303071+0000","last_unstale":"2024-03-11T22:09:17.556343+0000","last_undegraded":"2024-03-11T22:09:17.556343+0000","last_fullsized":"2024-03-11T22:09:17.556343+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:56:42.548071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.427927+0000","last_change":"2024-03-11T22:08:22.361251+0000","last_active":"2024-03-11T22:09:17.427927+0000","last_peered":"2024-03-11T22:09:17.427927+0000","last_clean":"2024-03-11T22:09:17.427927+0000","last_became_active":"2024-03-11T22:08:22.359368+0000","last_became_peered":"2024-03-11T22:08:22.359368+0000","last_unstale":"2024-03-11T22:09:17.427927+0000","last_undegraded":"2024-03-11T22:09:17.427927+0000","last_fullsized":"2024-03-11T22:09:17.427927+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:27:32.394412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477454+0000","last_change":"2024-03-11T22:08:20.331346+0000","last_active":"2024-03-11T22:09:17.477454+0000","last_peered":"2024-03-11T22:09:17.477454+0000","last_clean":"2024-03-11T22:09:17.477454+0000","last_became_active":"2024-03-11T22:08:20.330456+0000","last_became_peered":"2024-03-11T22:08:20.330456+0000","last_unstale":"2024-03-11T22:09:17.477454+0000","last_undegraded":"2024-03-11T22:09:17.477454+0000","last_fullsized":"2024-03-11T22:09:17.477454+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:07:05.407514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556195+0000","last_change":"2024-03-11T22:08:16.281611+0000","last_active":"2024-03-11T22:09:17.556195+0000","last_peered":"2024-03-11T22:09:17.556195+0000","last_clean":"2024-03-11T22:09:17.556195+0000","last_became_active":"2024-03-11T22:08:16.281041+0000","last_became_peered":"2024-03-11T22:08:16.281041+0000","last_unstale":"2024-03-11T22:09:17.556195+0000","last_undegraded":"2024-03-11T22:09:17.556195+0000","last_fullsized":"2024-03-11T22:09:17.556195+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:13:21.092121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729408+0000","last_change":"2024-03-11T22:08:18.304995+0000","last_active":"2024-03-11T22:09:17.729408+0000","last_peered":"2024-03-11T22:09:17.729408+0000","last_clean":"2024-03-11T22:09:17.729408+0000","last_became_active":"2024-03-11T22:08:18.304383+0000","last_became_peered":"2024-03-11T22:08:18.304383+0000","last_unstale":"2024-03-11T22:09:17.729408+0000","last_undegraded":"2024-03-11T22:09:17.729408+0000","last_fullsized":"2024-03-11T22:09:17.729408+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:56:32.771846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477475+0000","last_change":"2024-03-11T22:08:22.384368+0000","last_active":"2024-03-11T22:09:17.477475+0000","last_peered":"2024-03-11T22:09:17.477475+0000","last_clean":"2024-03-11T22:09:17.477475+0000","last_became_active":"2024-03-11T22:08:22.383829+0000","last_became_peered":"2024-03-11T22:08:22.383829+0000","last_unstale":"2024-03-11T22:09:17.477475+0000","last_undegraded":"2024-03-11T22:09:17.477475+0000","last_fullsized":"2024-03-11T22:09:17.477475+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:31:19.404651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339486+0000","last_change":"2024-03-11T22:08:20.326234+0000","last_active":"2024-03-11T22:09:17.339486+0000","last_peered":"2024-03-11T22:09:17.339486+0000","last_clean":"2024-03-11T22:09:17.339486+0000","last_became_active":"2024-03-11T22:08:20.325018+0000","last_became_peered":"2024-03-11T22:08:20.325018+0000","last_unstale":"2024-03-11T22:09:17.339486+0000","last_undegraded":"2024-03-11T22:09:17.339486+0000","last_fullsized":"2024-03-11T22:09:17.339486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:10:22.998363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730655+0000","last_change":"2024-03-11T22:08:16.285657+0000","last_active":"2024-03-11T22:09:17.730655+0000","last_peered":"2024-03-11T22:09:17.730655+0000","last_clean":"2024-03-11T22:09:17.730655+0000","last_became_active":"2024-03-11T22:08:16.285313+0000","last_became_peered":"2024-03-11T22:08:16.285313+0000","last_unstale":"2024-03-11T22:09:17.730655+0000","last_undegraded":"2024-03-11T22:09:17.730655+0000","last_fullsized":"2024-03-11T22:09:17.730655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:06:54.396958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.338024+0000","last_change":"2024-03-11T22:08:18.323514+0000","last_active":"2024-03-11T22:09:17.338024+0000","last_peered":"2024-03-11T22:09:17.338024+0000","last_clean":"2024-03-11T22:09:17.338024+0000","last_became_active":"2024-03-11T22:08:18.322821+0000","last_became_peered":"2024-03-11T22:08:18.322821+0000","last_unstale":"2024-03-11T22:09:17.338024+0000","last_undegraded":"2024-03-11T22:09:17.338024+0000","last_fullsized":"2024-03-11T22:09:17.338024+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:09:04.210354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.726893+0000","last_change":"2024-03-11T22:08:22.384932+0000","last_active":"2024-03-11T22:09:17.726893+0000","last_peered":"2024-03-11T22:09:17.726893+0000","last_clean":"2024-03-11T22:09:17.726893+0000","last_became_active":"2024-03-11T22:08:22.370204+0000","last_became_peered":"2024-03-11T22:08:22.370204+0000","last_unstale":"2024-03-11T22:09:17.726893+0000","last_undegraded":"2024-03-11T22:09:17.726893+0000","last_fullsized":"2024-03-11T22:09:17.726893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:02:29.597396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555148+0000","last_change":"2024-03-11T22:09:07.874407+0000","last_active":"2024-03-11T22:09:17.555148+0000","last_peered":"2024-03-11T22:09:17.555148+0000","last_clean":"2024-03-11T22:09:17.555148+0000","last_became_active":"2024-03-11T22:09:07.873901+0000","last_became_peered":"2024-03-11T22:09:07.873901+0000","last_unstale":"2024-03-11T22:09:17.555148+0000","last_undegraded":"2024-03-11T22:09:17.555148+0000","last_fullsized":"2024-03-11T22:09:17.555148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:53:29.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466548+0000","last_change":"2024-03-11T22:08:16.283794+0000","last_active":"2024-03-11T22:09:17.466548+0000","last_peered":"2024-03-11T22:09:17.466548+0000","last_clean":"2024-03-11T22:09:17.466548+0000","last_became_active":"2024-03-11T22:08:16.282958+0000","last_became_peered":"2024-03-11T22:08:16.282958+0000","last_unstale":"2024-03-11T22:09:17.466548+0000","last_undegraded":"2024-03-11T22:09:17.466548+0000","last_fullsized":"2024-03-11T22:09:17.466548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:00:17.320415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429961+0000","last_change":"2024-03-11T22:08:18.315017+0000","last_active":"2024-03-11T22:09:17.429961+0000","last_peered":"2024-03-11T22:09:17.429961+0000","last_clean":"2024-03-11T22:09:17.429961+0000","last_became_active":"2024-03-11T22:08:18.313555+0000","last_became_peered":"2024-03-11T22:08:18.313555+0000","last_unstale":"2024-03-11T22:09:17.429961+0000","last_undegraded":"2024-03-11T22:09:17.429961+0000","last_fullsized":"2024-03-11T22:09:17.429961+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:06:13.618859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.340643+0000","last_change":"2024-03-11T22:08:22.360987+0000","last_active":"2024-03-11T22:09:17.340643+0000","last_peered":"2024-03-11T22:09:17.340643+0000","last_clean":"2024-03-11T22:09:17.340643+0000","last_became_active":"2024-03-11T22:08:22.360067+0000","last_became_peered":"2024-03-11T22:08:22.360067+0000","last_unstale":"2024-03-11T22:09:17.340643+0000","last_undegraded":"2024-03-11T22:09:17.340643+0000","last_fullsized":"2024-03-11T22:09:17.340643+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:40:09.950239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.481898+0000","last_change":"2024-03-11T22:08:20.320320+0000","last_active":"2024-03-11T22:11:06.481898+0000","last_peered":"2024-03-11T22:11:06.481898+0000","last_clean":"2024-03-11T22:11:06.481898+0000","last_became_active":"2024-03-11T22:08:20.319652+0000","last_became_peered":"2024-03-11T22:08:20.319652+0000","last_unstale":"2024-03-11T22:11:06.481898+0000","last_undegraded":"2024-03-11T22:11:06.481898+0000","last_fullsized":"2024-03-11T22:11:06.481898+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:14:23.643922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728669+0000","last_change":"2024-03-11T22:08:16.279912+0000","last_active":"2024-03-11T22:09:17.728669+0000","last_peered":"2024-03-11T22:09:17.728669+0000","last_clean":"2024-03-11T22:09:17.728669+0000","last_became_active":"2024-03-11T22:08:16.279285+0000","last_became_peered":"2024-03-11T22:08:16.279285+0000","last_unstale":"2024-03-11T22:09:17.728669+0000","last_undegraded":"2024-03-11T22:09:17.728669+0000","last_fullsized":"2024-03-11T22:09:17.728669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T10:07:43.266481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728061+0000","last_change":"2024-03-11T22:08:18.295690+0000","last_active":"2024-03-11T22:09:17.728061+0000","last_peered":"2024-03-11T22:09:17.728061+0000","last_clean":"2024-03-11T22:09:17.728061+0000","last_became_active":"2024-03-11T22:08:18.293814+0000","last_became_peered":"2024-03-11T22:08:18.293814+0000","last_unstale":"2024-03-11T22:09:17.728061+0000","last_undegraded":"2024-03-11T22:09:17.728061+0000","last_fullsized":"2024-03-11T22:09:17.728061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:40:29.839814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729300+0000","last_change":"2024-03-11T22:08:22.380378+0000","last_active":"2024-03-11T22:09:17.729300+0000","last_peered":"2024-03-11T22:09:17.729300+0000","last_clean":"2024-03-11T22:09:17.729300+0000","last_became_active":"2024-03-11T22:08:22.379411+0000","last_became_peered":"2024-03-11T22:08:22.379411+0000","last_unstale":"2024-03-11T22:09:17.729300+0000","last_undegraded":"2024-03-11T22:09:17.729300+0000","last_fullsized":"2024-03-11T22:09:17.729300+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:03:51.003760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'11","reported_seq":81,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.486540+0000","last_change":"2024-03-11T22:08:20.334563+0000","last_active":"2024-03-11T22:11:06.486540+0000","last_peered":"2024-03-11T22:11:06.486540+0000","last_clean":"2024-03-11T22:11:06.486540+0000","last_became_active":"2024-03-11T22:08:20.333518+0000","last_became_peered":"2024-03-11T22:08:20.333518+0000","last_unstale":"2024-03-11T22:11:06.486540+0000","last_undegraded":"2024-03-11T22:11:06.486540+0000","last_fullsized":"2024-03-11T22:11:06.486540+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:07:32.180072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555496+0000","last_change":"2024-03-11T22:09:08.100137+0000","last_active":"2024-03-11T22:09:17.555496+0000","last_peered":"2024-03-11T22:09:17.555496+0000","last_clean":"2024-03-11T22:09:17.555496+0000","last_became_active":"2024-03-11T22:09:08.099104+0000","last_became_peered":"2024-03-11T22:09:08.099104+0000","last_unstale":"2024-03-11T22:09:17.555496+0000","last_undegraded":"2024-03-11T22:09:17.555496+0000","last_fullsized":"2024-03-11T22:09:17.555496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:48:58.612304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428673+0000","last_change":"2024-03-11T22:08:18.321820+0000","last_active":"2024-03-11T22:09:17.428673+0000","last_peered":"2024-03-11T22:09:17.428673+0000","last_clean":"2024-03-11T22:09:17.428673+0000","last_became_active":"2024-03-11T22:08:18.320677+0000","last_became_peered":"2024-03-11T22:08:18.320677+0000","last_unstale":"2024-03-11T22:09:17.428673+0000","last_undegraded":"2024-03-11T22:09:17.428673+0000","last_fullsized":"2024-03-11T22:09:17.428673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:55:12.532058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429591+0000","last_change":"2024-03-11T22:08:22.573809+0000","last_active":"2024-03-11T22:09:17.429591+0000","last_peered":"2024-03-11T22:09:17.429591+0000","last_clean":"2024-03-11T22:09:17.429591+0000","last_became_active":"2024-03-11T22:08:22.572982+0000","last_became_peered":"2024-03-11T22:08:22.572982+0000","last_unstale":"2024-03-11T22:09:17.429591+0000","last_undegraded":"2024-03-11T22:09:17.429591+0000","last_fullsized":"2024-03-11T22:09:17.429591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:23:49.864237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479780+0000","last_change":"2024-03-11T22:08:20.338315+0000","last_active":"2024-03-11T22:09:17.479780+0000","last_peered":"2024-03-11T22:09:17.479780+0000","last_clean":"2024-03-11T22:09:17.479780+0000","last_became_active":"2024-03-11T22:08:20.335089+0000","last_became_peered":"2024-03-11T22:08:20.335089+0000","last_unstale":"2024-03-11T22:09:17.479780+0000","last_undegraded":"2024-03-11T22:09:17.479780+0000","last_fullsized":"2024-03-11T22:09:17.479780+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:14:16.178840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466266+0000","last_change":"2024-03-11T22:08:16.280051+0000","last_active":"2024-03-11T22:09:17.466266+0000","last_peered":"2024-03-11T22:09:17.466266+0000","last_clean":"2024-03-11T22:09:17.466266+0000","last_became_active":"2024-03-11T22:08:16.279127+0000","last_became_peered":"2024-03-11T22:08:16.279127+0000","last_unstale":"2024-03-11T22:09:17.466266+0000","last_undegraded":"2024-03-11T22:09:17.466266+0000","last_fullsized":"2024-03-11T22:09:17.466266+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:06:23.567515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.465749+0000","last_change":"2024-03-11T22:08:18.304445+0000","last_active":"2024-03-11T22:09:17.465749+0000","last_peered":"2024-03-11T22:09:17.465749+0000","last_clean":"2024-03-11T22:09:17.465749+0000","last_became_active":"2024-03-11T22:08:18.303591+0000","last_became_peered":"2024-03-11T22:08:18.303591+0000","last_unstale":"2024-03-11T22:09:17.465749+0000","last_undegraded":"2024-03-11T22:09:17.465749+0000","last_fullsized":"2024-03-11T22:09:17.465749+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:11:22.864906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336683+0000","last_change":"2024-03-11T22:08:22.362336+0000","last_active":"2024-03-11T22:09:17.336683+0000","last_peered":"2024-03-11T22:09:17.336683+0000","last_clean":"2024-03-11T22:09:17.336683+0000","last_became_active":"2024-03-11T22:08:22.361486+0000","last_became_peered":"2024-03-11T22:08:22.361486+0000","last_unstale":"2024-03-11T22:09:17.336683+0000","last_undegraded":"2024-03-11T22:09:17.336683+0000","last_fullsized":"2024-03-11T22:09:17.336683+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:50:42.160285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729172+0000","last_change":"2024-03-11T22:08:20.334221+0000","last_active":"2024-03-11T22:09:17.729172+0000","last_peered":"2024-03-11T22:09:17.729172+0000","last_clean":"2024-03-11T22:09:17.729172+0000","last_became_active":"2024-03-11T22:08:20.331494+0000","last_became_peered":"2024-03-11T22:08:20.331494+0000","last_unstale":"2024-03-11T22:09:17.729172+0000","last_undegraded":"2024-03-11T22:09:17.729172+0000","last_fullsized":"2024-03-11T22:09:17.729172+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:56:56.307416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.335674+0000","last_change":"2024-03-11T22:08:16.276759+0000","last_active":"2024-03-11T22:09:17.335674+0000","last_peered":"2024-03-11T22:09:17.335674+0000","last_clean":"2024-03-11T22:09:17.335674+0000","last_became_active":"2024-03-11T22:08:16.276363+0000","last_became_peered":"2024-03-11T22:08:16.276363+0000","last_unstale":"2024-03-11T22:09:17.335674+0000","last_undegraded":"2024-03-11T22:09:17.335674+0000","last_fullsized":"2024-03-11T22:09:17.335674+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:17:26.939355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428082+0000","last_change":"2024-03-11T22:08:18.312796+0000","last_active":"2024-03-11T22:09:17.428082+0000","last_peered":"2024-03-11T22:09:17.428082+0000","last_clean":"2024-03-11T22:09:17.428082+0000","last_became_active":"2024-03-11T22:08:18.312115+0000","last_became_peered":"2024-03-11T22:08:18.312115+0000","last_unstale":"2024-03-11T22:09:17.428082+0000","last_undegraded":"2024-03-11T22:09:17.428082+0000","last_fullsized":"2024-03-11T22:09:17.428082+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:16:58.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478340+0000","last_change":"2024-03-11T22:08:22.391687+0000","last_active":"2024-03-11T22:09:17.478340+0000","last_peered":"2024-03-11T22:09:17.478340+0000","last_clean":"2024-03-11T22:09:17.478340+0000","last_became_active":"2024-03-11T22:08:22.390886+0000","last_became_peered":"2024-03-11T22:08:22.390886+0000","last_unstale":"2024-03-11T22:09:17.478340+0000","last_undegraded":"2024-03-11T22:09:17.478340+0000","last_fullsized":"2024-03-11T22:09:17.478340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:52:56.131187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339832+0000","last_change":"2024-03-11T22:08:16.274582+0000","last_active":"2024-03-11T22:09:17.339832+0000","last_peered":"2024-03-11T22:09:17.339832+0000","last_clean":"2024-03-11T22:09:17.339832+0000","last_became_active":"2024-03-11T22:08:16.273660+0000","last_became_peered":"2024-03-11T22:08:16.273660+0000","last_unstale":"2024-03-11T22:09:17.339832+0000","last_undegraded":"2024-03-11T22:09:17.339832+0000","last_fullsized":"2024-03-11T22:09:17.339832+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:12:48.732562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429222+0000","last_change":"2024-03-11T22:08:18.313184+0000","last_active":"2024-03-11T22:09:17.429222+0000","last_peered":"2024-03-11T22:09:17.429222+0000","last_clean":"2024-03-11T22:09:17.429222+0000","last_became_active":"2024-03-11T22:08:18.312348+0000","last_became_peered":"2024-03-11T22:08:18.312348+0000","last_unstale":"2024-03-11T22:09:17.429222+0000","last_undegraded":"2024-03-11T22:09:17.429222+0000","last_fullsized":"2024-03-11T22:09:17.429222+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:19:58.504838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.481926+0000","last_change":"2024-03-11T22:08:20.328992+0000","last_active":"2024-03-11T22:11:06.481926+0000","last_peered":"2024-03-11T22:11:06.481926+0000","last_clean":"2024-03-11T22:11:06.481926+0000","last_became_active":"2024-03-11T22:08:20.328525+0000","last_became_peered":"2024-03-11T22:08:20.328525+0000","last_unstale":"2024-03-11T22:11:06.481926+0000","last_undegraded":"2024-03-11T22:11:06.481926+0000","last_fullsized":"2024-03-11T22:11:06.481926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:05:04.167452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727015+0000","last_change":"2024-03-11T22:08:22.387739+0000","last_active":"2024-03-11T22:09:17.727015+0000","last_peered":"2024-03-11T22:09:17.727015+0000","last_clean":"2024-03-11T22:09:17.727015+0000","last_became_active":"2024-03-11T22:08:22.384026+0000","last_became_peered":"2024-03-11T22:08:22.384026+0000","last_unstale":"2024-03-11T22:09:17.727015+0000","last_undegraded":"2024-03-11T22:09:17.727015+0000","last_fullsized":"2024-03-11T22:09:17.727015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:26:08.880349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730426+0000","last_change":"2024-03-11T22:08:16.287176+0000","last_active":"2024-03-11T22:09:17.730426+0000","last_peered":"2024-03-11T22:09:17.730426+0000","last_clean":"2024-03-11T22:09:17.730426+0000","last_became_active":"2024-03-11T22:08:16.286446+0000","last_became_peered":"2024-03-11T22:08:16.286446+0000","last_unstale":"2024-03-11T22:09:17.730426+0000","last_undegraded":"2024-03-11T22:09:17.730426+0000","last_fullsized":"2024-03-11T22:09:17.730426+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:35:48.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":94,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.482115+0000","last_change":"2024-03-11T22:08:18.319296+0000","last_active":"2024-03-11T22:11:06.482115+0000","last_peered":"2024-03-11T22:11:06.482115+0000","last_clean":"2024-03-11T22:11:06.482115+0000","last_became_active":"2024-03-11T22:08:18.318461+0000","last_became_peered":"2024-03-11T22:08:18.318461+0000","last_unstale":"2024-03-11T22:11:06.482115+0000","last_undegraded":"2024-03-11T22:11:06.482115+0000","last_fullsized":"2024-03-11T22:11:06.482115+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:13:45.404865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728792+0000","last_change":"2024-03-11T22:08:20.348994+0000","last_active":"2024-03-11T22:09:17.728792+0000","last_peered":"2024-03-11T22:09:17.728792+0000","last_clean":"2024-03-11T22:09:17.728792+0000","last_became_active":"2024-03-11T22:08:20.345592+0000","last_became_peered":"2024-03-11T22:08:20.345592+0000","last_unstale":"2024-03-11T22:09:17.728792+0000","last_undegraded":"2024-03-11T22:09:17.728792+0000","last_fullsized":"2024-03-11T22:09:17.728792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:42:54.618385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478981+0000","last_change":"2024-03-11T22:08:22.385721+0000","last_active":"2024-03-11T22:09:17.478981+0000","last_peered":"2024-03-11T22:09:17.478981+0000","last_clean":"2024-03-11T22:09:17.478981+0000","last_became_active":"2024-03-11T22:08:22.383308+0000","last_became_peered":"2024-03-11T22:08:22.383308+0000","last_unstale":"2024-03-11T22:09:17.478981+0000","last_undegraded":"2024-03-11T22:09:17.478981+0000","last_fullsized":"2024-03-11T22:09:17.478981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:31:45.841535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555427+0000","last_change":"2024-03-11T22:08:16.285816+0000","last_active":"2024-03-11T22:09:17.555427+0000","last_peered":"2024-03-11T22:09:17.555427+0000","last_clean":"2024-03-11T22:09:17.555427+0000","last_became_active":"2024-03-11T22:08:16.284860+0000","last_became_peered":"2024-03-11T22:08:16.284860+0000","last_unstale":"2024-03-11T22:09:17.555427+0000","last_undegraded":"2024-03-11T22:09:17.555427+0000","last_fullsized":"2024-03-11T22:09:17.555427+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:25:13.405870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.338217+0000","last_change":"2024-03-11T22:08:18.321303+0000","last_active":"2024-03-11T22:09:17.338217+0000","last_peered":"2024-03-11T22:09:17.338217+0000","last_clean":"2024-03-11T22:09:17.338217+0000","last_became_active":"2024-03-11T22:08:18.320577+0000","last_became_peered":"2024-03-11T22:08:18.320577+0000","last_unstale":"2024-03-11T22:09:17.338217+0000","last_undegraded":"2024-03-11T22:09:17.338217+0000","last_fullsized":"2024-03-11T22:09:17.338217+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:03:00.266736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730677+0000","last_change":"2024-03-11T22:08:20.329807+0000","last_active":"2024-03-11T22:09:17.730677+0000","last_peered":"2024-03-11T22:09:17.730677+0000","last_clean":"2024-03-11T22:09:17.730677+0000","last_became_active":"2024-03-11T22:08:20.328161+0000","last_became_peered":"2024-03-11T22:08:20.328161+0000","last_unstale":"2024-03-11T22:09:17.730677+0000","last_undegraded":"2024-03-11T22:09:17.730677+0000","last_fullsized":"2024-03-11T22:09:17.730677+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:29:30.028631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428959+0000","last_change":"2024-03-11T22:08:22.566200+0000","last_active":"2024-03-11T22:09:17.428959+0000","last_peered":"2024-03-11T22:09:17.428959+0000","last_clean":"2024-03-11T22:09:17.428959+0000","last_became_active":"2024-03-11T22:08:22.565266+0000","last_became_peered":"2024-03-11T22:08:22.565266+0000","last_unstale":"2024-03-11T22:09:17.428959+0000","last_undegraded":"2024-03-11T22:09:17.428959+0000","last_fullsized":"2024-03-11T22:09:17.428959+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:20:50.378323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729525+0000","last_change":"2024-03-11T22:08:18.325664+0000","last_active":"2024-03-11T22:09:17.729525+0000","last_peered":"2024-03-11T22:09:17.729525+0000","last_clean":"2024-03-11T22:09:17.729525+0000","last_became_active":"2024-03-11T22:08:18.325081+0000","last_became_peered":"2024-03-11T22:08:18.325081+0000","last_unstale":"2024-03-11T22:09:17.729525+0000","last_undegraded":"2024-03-11T22:09:17.729525+0000","last_fullsized":"2024-03-11T22:09:17.729525+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:56:50.050824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336313+0000","last_change":"2024-03-11T22:08:16.273877+0000","last_active":"2024-03-11T22:09:17.336313+0000","last_peered":"2024-03-11T22:09:17.336313+0000","last_clean":"2024-03-11T22:09:17.336313+0000","last_became_active":"2024-03-11T22:08:16.273245+0000","last_became_peered":"2024-03-11T22:08:16.273245+0000","last_unstale":"2024-03-11T22:09:17.336313+0000","last_undegraded":"2024-03-11T22:09:17.336313+0000","last_fullsized":"2024-03-11T22:09:17.336313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:10:37.001060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.731182+0000","last_change":"2024-03-11T22:08:20.330699+0000","last_active":"2024-03-11T22:09:17.731182+0000","last_peered":"2024-03-11T22:09:17.731182+0000","last_clean":"2024-03-11T22:09:17.731182+0000","last_became_active":"2024-03-11T22:08:20.327783+0000","last_became_peered":"2024-03-11T22:08:20.327783+0000","last_unstale":"2024-03-11T22:09:17.731182+0000","last_undegraded":"2024-03-11T22:09:17.731182+0000","last_fullsized":"2024-03-11T22:09:17.731182+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:08:23.742566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556360+0000","last_change":"2024-03-11T22:08:22.375293+0000","last_active":"2024-03-11T22:09:17.556360+0000","last_peered":"2024-03-11T22:09:17.556360+0000","last_clean":"2024-03-11T22:09:17.556360+0000","last_became_active":"2024-03-11T22:08:22.374443+0000","last_became_peered":"2024-03-11T22:08:22.374443+0000","last_unstale":"2024-03-11T22:09:17.556360+0000","last_undegraded":"2024-03-11T22:09:17.556360+0000","last_fullsized":"2024-03-11T22:09:17.556360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:35:44.825145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478043+0000","last_change":"2024-03-11T22:08:18.298254+0000","last_active":"2024-03-11T22:09:17.478043+0000","last_peered":"2024-03-11T22:09:17.478043+0000","last_clean":"2024-03-11T22:09:17.478043+0000","last_became_active":"2024-03-11T22:08:18.297845+0000","last_became_peered":"2024-03-11T22:08:18.297845+0000","last_unstale":"2024-03-11T22:09:17.478043+0000","last_undegraded":"2024-03-11T22:09:17.478043+0000","last_fullsized":"2024-03-11T22:09:17.478043+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:34:44.030051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555477+0000","last_change":"2024-03-11T22:08:16.288937+0000","last_active":"2024-03-11T22:09:17.555477+0000","last_peered":"2024-03-11T22:09:17.555477+0000","last_clean":"2024-03-11T22:09:17.555477+0000","last_became_active":"2024-03-11T22:08:16.288302+0000","last_became_peered":"2024-03-11T22:08:16.288302+0000","last_unstale":"2024-03-11T22:09:17.555477+0000","last_undegraded":"2024-03-11T22:09:17.555477+0000","last_fullsized":"2024-03-11T22:09:17.555477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:17:34.799909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"74'128","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:19.497035+0000","last_change":"2024-03-11T22:07:40.767368+0000","last_active":"2024-03-11T22:09:19.497035+0000","last_peered":"2024-03-11T22:09:19.497035+0000","last_clean":"2024-03-11T22:09:19.497035+0000","last_became_active":"2024-03-11T22:07:40.766387+0000","last_became_peered":"2024-03-11T22:07:40.766387+0000","last_unstale":"2024-03-11T22:09:19.497035+0000","last_undegraded":"2024-03-11T22:09:19.497035+0000","last_fullsized":"2024-03-11T22:09:19.497035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:03:15.384548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:03:15.384548+0000","last_clean_scrub_stamp":"2024-03-11T22:03:15.384548+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:53:42.135977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466350+0000","last_change":"2024-03-11T22:08:20.313911+0000","last_active":"2024-03-11T22:09:17.466350+0000","last_peered":"2024-03-11T22:09:17.466350+0000","last_clean":"2024-03-11T22:09:17.466350+0000","last_became_active":"2024-03-11T22:08:20.313549+0000","last_became_peered":"2024-03-11T22:08:20.313549+0000","last_unstale":"2024-03-11T22:09:17.466350+0000","last_undegraded":"2024-03-11T22:09:17.466350+0000","last_fullsized":"2024-03-11T22:09:17.466350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:53:14.770982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730228+0000","last_change":"2024-03-11T22:08:22.387566+0000","last_active":"2024-03-11T22:09:17.730228+0000","last_peered":"2024-03-11T22:09:17.730228+0000","last_clean":"2024-03-11T22:09:17.730228+0000","last_became_active":"2024-03-11T22:08:22.386737+0000","last_became_peered":"2024-03-11T22:08:22.386737+0000","last_unstale":"2024-03-11T22:09:17.730228+0000","last_undegraded":"2024-03-11T22:09:17.730228+0000","last_fullsized":"2024-03-11T22:09:17.730228+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:42:29.653807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727476+0000","last_change":"2024-03-11T22:08:18.310119+0000","last_active":"2024-03-11T22:09:17.727476+0000","last_peered":"2024-03-11T22:09:17.727476+0000","last_clean":"2024-03-11T22:09:17.727476+0000","last_became_active":"2024-03-11T22:08:18.308894+0000","last_became_peered":"2024-03-11T22:08:18.308894+0000","last_unstale":"2024-03-11T22:09:17.727476+0000","last_undegraded":"2024-03-11T22:09:17.727476+0000","last_fullsized":"2024-03-11T22:09:17.727476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:56:56.345917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.427741+0000","last_change":"2024-03-11T22:08:16.290428+0000","last_active":"2024-03-11T22:09:17.427741+0000","last_peered":"2024-03-11T22:09:17.427741+0000","last_clean":"2024-03-11T22:09:17.427741+0000","last_became_active":"2024-03-11T22:08:16.288948+0000","last_became_peered":"2024-03-11T22:08:16.288948+0000","last_unstale":"2024-03-11T22:09:17.427741+0000","last_undegraded":"2024-03-11T22:09:17.427741+0000","last_fullsized":"2024-03-11T22:09:17.427741+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:12:44.021803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729420+0000","last_change":"2024-03-11T22:08:20.333540+0000","last_active":"2024-03-11T22:09:17.729420+0000","last_peered":"2024-03-11T22:09:17.729420+0000","last_clean":"2024-03-11T22:09:17.729420+0000","last_became_active":"2024-03-11T22:08:20.330136+0000","last_became_peered":"2024-03-11T22:08:20.330136+0000","last_unstale":"2024-03-11T22:09:17.729420+0000","last_undegraded":"2024-03-11T22:09:17.729420+0000","last_fullsized":"2024-03-11T22:09:17.729420+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:20:23.365777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727542+0000","last_change":"2024-03-11T22:08:22.569409+0000","last_active":"2024-03-11T22:09:17.727542+0000","last_peered":"2024-03-11T22:09:17.727542+0000","last_clean":"2024-03-11T22:09:17.727542+0000","last_became_active":"2024-03-11T22:08:22.568228+0000","last_became_peered":"2024-03-11T22:08:22.568228+0000","last_unstale":"2024-03-11T22:09:17.727542+0000","last_undegraded":"2024-03-11T22:09:17.727542+0000","last_fullsized":"2024-03-11T22:09:17.727542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:57:07.539354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"70'2","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466168+0000","last_change":"2024-03-11T22:08:31.395038+0000","last_active":"2024-03-11T22:09:17.466168+0000","last_peered":"2024-03-11T22:09:17.466168+0000","last_clean":"2024-03-11T22:09:17.466168+0000","last_became_active":"2024-03-11T22:08:21.348316+0000","last_became_peered":"2024-03-11T22:08:21.348316+0000","last_unstale":"2024-03-11T22:09:17.466168+0000","last_undegraded":"2024-03-11T22:09:17.466168+0000","last_fullsized":"2024-03-11T22:09:17.466168+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_clean_scrub_stamp":"2024-03-11T22:08:20.285852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:33:03.788845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021721599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429415+0000","last_change":"2024-03-11T22:08:16.288765+0000","last_active":"2024-03-11T22:09:17.429415+0000","last_peered":"2024-03-11T22:09:17.429415+0000","last_clean":"2024-03-11T22:09:17.429415+0000","last_became_active":"2024-03-11T22:08:16.286110+0000","last_became_peered":"2024-03-11T22:08:16.286110+0000","last_unstale":"2024-03-11T22:09:17.429415+0000","last_undegraded":"2024-03-11T22:09:17.429415+0000","last_fullsized":"2024-03-11T22:09:17.429415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:16:17.252239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":122,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.486349+0000","last_change":"2024-03-11T22:08:18.325976+0000","last_active":"2024-03-11T22:11:06.486349+0000","last_peered":"2024-03-11T22:11:06.486349+0000","last_clean":"2024-03-11T22:11:06.486349+0000","last_became_active":"2024-03-11T22:08:18.325403+0000","last_became_peered":"2024-03-11T22:08:18.325403+0000","last_unstale":"2024-03-11T22:11:06.486349+0000","last_undegraded":"2024-03-11T22:11:06.486349+0000","last_fullsized":"2024-03-11T22:11:06.486349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T04:11:35.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.486289+0000","last_change":"2024-03-11T22:08:20.319208+0000","last_active":"2024-03-11T22:11:06.486289+0000","last_peered":"2024-03-11T22:11:06.486289+0000","last_clean":"2024-03-11T22:11:06.486289+0000","last_became_active":"2024-03-11T22:08:20.318386+0000","last_became_peered":"2024-03-11T22:08:20.318386+0000","last_unstale":"2024-03-11T22:11:06.486289+0000","last_undegraded":"2024-03-11T22:11:06.486289+0000","last_fullsized":"2024-03-11T22:11:06.486289+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:26:26.898617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337568+0000","last_change":"2024-03-11T22:08:22.377348+0000","last_active":"2024-03-11T22:09:17.337568+0000","last_peered":"2024-03-11T22:09:17.337568+0000","last_clean":"2024-03-11T22:09:17.337568+0000","last_became_active":"2024-03-11T22:08:22.376621+0000","last_became_peered":"2024-03-11T22:08:22.376621+0000","last_unstale":"2024-03-11T22:09:17.337568+0000","last_undegraded":"2024-03-11T22:09:17.337568+0000","last_fullsized":"2024-03-11T22:09:17.337568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:15:45.472010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336727+0000","last_change":"2024-03-11T22:08:31.509690+0000","last_active":"2024-03-11T22:09:17.336727+0000","last_peered":"2024-03-11T22:09:17.336727+0000","last_clean":"2024-03-11T22:09:17.336727+0000","last_became_active":"2024-03-11T22:08:21.357627+0000","last_became_peered":"2024-03-11T22:08:21.357627+0000","last_unstale":"2024-03-11T22:09:17.336727+0000","last_undegraded":"2024-03-11T22:09:17.336727+0000","last_fullsized":"2024-03-11T22:09:17.336727+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_clean_scrub_stamp":"2024-03-11T22:08:20.285852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:46:34.709090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077561999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730659+0000","last_change":"2024-03-11T22:08:16.286772+0000","last_active":"2024-03-11T22:09:17.730659+0000","last_peered":"2024-03-11T22:09:17.730659+0000","last_clean":"2024-03-11T22:09:17.730659+0000","last_became_active":"2024-03-11T22:08:16.286159+0000","last_became_peered":"2024-03-11T22:08:16.286159+0000","last_unstale":"2024-03-11T22:09:17.730659+0000","last_undegraded":"2024-03-11T22:09:17.730659+0000","last_fullsized":"2024-03-11T22:09:17.730659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:51:12.133454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.479602+0000","last_change":"2024-03-11T22:08:18.303062+0000","last_active":"2024-03-11T22:09:17.479602+0000","last_peered":"2024-03-11T22:09:17.479602+0000","last_clean":"2024-03-11T22:09:17.479602+0000","last_became_active":"2024-03-11T22:08:18.302170+0000","last_became_peered":"2024-03-11T22:08:18.302170+0000","last_unstale":"2024-03-11T22:09:17.479602+0000","last_undegraded":"2024-03-11T22:09:17.479602+0000","last_fullsized":"2024-03-11T22:09:17.479602+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:00:12.504544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.486346+0000","last_change":"2024-03-11T22:08:20.339961+0000","last_active":"2024-03-11T22:11:06.486346+0000","last_peered":"2024-03-11T22:11:06.486346+0000","last_clean":"2024-03-11T22:11:06.486346+0000","last_became_active":"2024-03-11T22:08:20.339155+0000","last_became_peered":"2024-03-11T22:08:20.339155+0000","last_unstale":"2024-03-11T22:11:06.486346+0000","last_undegraded":"2024-03-11T22:11:06.486346+0000","last_fullsized":"2024-03-11T22:11:06.486346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:35:52.887442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428274+0000","last_change":"2024-03-11T22:08:22.571742+0000","last_active":"2024-03-11T22:09:17.428274+0000","last_peered":"2024-03-11T22:09:17.428274+0000","last_clean":"2024-03-11T22:09:17.428274+0000","last_became_active":"2024-03-11T22:08:22.570776+0000","last_became_peered":"2024-03-11T22:08:22.570776+0000","last_unstale":"2024-03-11T22:09:17.428274+0000","last_undegraded":"2024-03-11T22:09:17.428274+0000","last_fullsized":"2024-03-11T22:09:17.428274+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:27:29.944082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"71'5","reported_seq":193,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:12.138987+0000","last_change":"2024-03-11T22:08:31.517441+0000","last_active":"2024-03-11T22:11:12.138987+0000","last_peered":"2024-03-11T22:11:12.138987+0000","last_clean":"2024-03-11T22:11:12.138987+0000","last_became_active":"2024-03-11T22:08:21.351828+0000","last_became_peered":"2024-03-11T22:08:21.351828+0000","last_unstale":"2024-03-11T22:11:12.138987+0000","last_undegraded":"2024-03-11T22:11:12.138987+0000","last_fullsized":"2024-03-11T22:11:12.138987+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:20.285852+0000","last_clean_scrub_stamp":"2024-03-11T22:08:20.285852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:06:04.374264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027010950000000001,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":148,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466982+0000","last_change":"2024-03-11T22:08:16.272705+0000","last_active":"2024-03-11T22:09:17.466982+0000","last_peered":"2024-03-11T22:09:17.466982+0000","last_clean":"2024-03-11T22:09:17.466982+0000","last_became_active":"2024-03-11T22:08:16.271816+0000","last_became_peered":"2024-03-11T22:08:16.271816+0000","last_unstale":"2024-03-11T22:09:17.466982+0000","last_undegraded":"2024-03-11T22:09:17.466982+0000","last_fullsized":"2024-03-11T22:09:17.466982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:18:56.678516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.729741+0000","last_change":"2024-03-11T22:08:18.310347+0000","last_active":"2024-03-11T22:09:17.729741+0000","last_peered":"2024-03-11T22:09:17.729741+0000","last_clean":"2024-03-11T22:09:17.729741+0000","last_became_active":"2024-03-11T22:08:18.308910+0000","last_became_peered":"2024-03-11T22:08:18.308910+0000","last_unstale":"2024-03-11T22:09:17.729741+0000","last_undegraded":"2024-03-11T22:09:17.729741+0000","last_fullsized":"2024-03-11T22:09:17.729741+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:19:35.951198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337388+0000","last_change":"2024-03-11T22:08:20.309203+0000","last_active":"2024-03-11T22:09:17.337388+0000","last_peered":"2024-03-11T22:09:17.337388+0000","last_clean":"2024-03-11T22:09:17.337388+0000","last_became_active":"2024-03-11T22:08:20.308894+0000","last_became_peered":"2024-03-11T22:08:20.308894+0000","last_unstale":"2024-03-11T22:09:17.337388+0000","last_undegraded":"2024-03-11T22:09:17.337388+0000","last_fullsized":"2024-03-11T22:09:17.337388+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:49:44.438805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478167+0000","last_change":"2024-03-11T22:08:22.568523+0000","last_active":"2024-03-11T22:09:17.478167+0000","last_peered":"2024-03-11T22:09:17.478167+0000","last_clean":"2024-03-11T22:09:17.478167+0000","last_became_active":"2024-03-11T22:08:22.567357+0000","last_became_peered":"2024-03-11T22:08:22.567357+0000","last_unstale":"2024-03-11T22:09:17.478167+0000","last_undegraded":"2024-03-11T22:09:17.478167+0000","last_fullsized":"2024-03-11T22:09:17.478167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T05:29:28.797210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.481922+0000","last_change":"2024-03-11T22:08:20.325990+0000","last_active":"2024-03-11T22:11:06.481922+0000","last_peered":"2024-03-11T22:11:06.481922+0000","last_clean":"2024-03-11T22:11:06.481922+0000","last_became_active":"2024-03-11T22:08:20.325560+0000","last_became_peered":"2024-03-11T22:08:20.325560+0000","last_unstale":"2024-03-11T22:11:06.481922+0000","last_undegraded":"2024-03-11T22:11:06.481922+0000","last_fullsized":"2024-03-11T22:11:06.481922+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:56:58.711820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428136+0000","last_change":"2024-03-11T22:08:16.283856+0000","last_active":"2024-03-11T22:09:17.428136+0000","last_peered":"2024-03-11T22:09:17.428136+0000","last_clean":"2024-03-11T22:09:17.428136+0000","last_became_active":"2024-03-11T22:08:16.283332+0000","last_became_peered":"2024-03-11T22:08:16.283332+0000","last_unstale":"2024-03-11T22:09:17.428136+0000","last_undegraded":"2024-03-11T22:09:17.428136+0000","last_fullsized":"2024-03-11T22:09:17.428136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:16:39.687172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337020+0000","last_change":"2024-03-11T22:08:18.327509+0000","last_active":"2024-03-11T22:09:17.337020+0000","last_peered":"2024-03-11T22:09:17.337020+0000","last_clean":"2024-03-11T22:09:17.337020+0000","last_became_active":"2024-03-11T22:08:18.326649+0000","last_became_peered":"2024-03-11T22:08:18.326649+0000","last_unstale":"2024-03-11T22:09:17.337020+0000","last_undegraded":"2024-03-11T22:09:17.337020+0000","last_fullsized":"2024-03-11T22:09:17.337020+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:31:17.533630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.556290+0000","last_change":"2024-03-11T22:08:22.368338+0000","last_active":"2024-03-11T22:09:17.556290+0000","last_peered":"2024-03-11T22:09:17.556290+0000","last_clean":"2024-03-11T22:09:17.556290+0000","last_became_active":"2024-03-11T22:08:22.367760+0000","last_became_peered":"2024-03-11T22:08:22.367760+0000","last_unstale":"2024-03-11T22:09:17.556290+0000","last_undegraded":"2024-03-11T22:09:17.556290+0000","last_fullsized":"2024-03-11T22:09:17.556290+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:54:12.395459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.731439+0000","last_change":"2024-03-11T22:08:20.331377+0000","last_active":"2024-03-11T22:09:17.731439+0000","last_peered":"2024-03-11T22:09:17.731439+0000","last_clean":"2024-03-11T22:09:17.731439+0000","last_became_active":"2024-03-11T22:08:20.327770+0000","last_became_peered":"2024-03-11T22:08:20.327770+0000","last_unstale":"2024-03-11T22:09:17.731439+0000","last_undegraded":"2024-03-11T22:09:17.731439+0000","last_fullsized":"2024-03-11T22:09:17.731439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:12:59.160815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727962+0000","last_change":"2024-03-11T22:08:16.281805+0000","last_active":"2024-03-11T22:09:17.727962+0000","last_peered":"2024-03-11T22:09:17.727962+0000","last_clean":"2024-03-11T22:09:17.727962+0000","last_became_active":"2024-03-11T22:08:16.281488+0000","last_became_peered":"2024-03-11T22:08:16.281488+0000","last_unstale":"2024-03-11T22:09:17.727962+0000","last_undegraded":"2024-03-11T22:09:17.727962+0000","last_fullsized":"2024-03-11T22:09:17.727962+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:33:58.338357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.477592+0000","last_change":"2024-03-11T22:08:18.303189+0000","last_active":"2024-03-11T22:09:17.477592+0000","last_peered":"2024-03-11T22:09:17.477592+0000","last_clean":"2024-03-11T22:09:17.477592+0000","last_became_active":"2024-03-11T22:08:18.302089+0000","last_became_peered":"2024-03-11T22:08:18.302089+0000","last_unstale":"2024-03-11T22:09:17.477592+0000","last_undegraded":"2024-03-11T22:09:17.477592+0000","last_fullsized":"2024-03-11T22:09:17.477592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:48:35.207793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.339259+0000","last_change":"2024-03-11T22:08:22.371090+0000","last_active":"2024-03-11T22:09:17.339259+0000","last_peered":"2024-03-11T22:09:17.339259+0000","last_clean":"2024-03-11T22:09:17.339259+0000","last_became_active":"2024-03-11T22:08:22.370375+0000","last_became_peered":"2024-03-11T22:08:22.370375+0000","last_unstale":"2024-03-11T22:09:17.339259+0000","last_undegraded":"2024-03-11T22:09:17.339259+0000","last_fullsized":"2024-03-11T22:09:17.339259+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:00:24.414926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728382+0000","last_change":"2024-03-11T22:08:16.290969+0000","last_active":"2024-03-11T22:09:17.728382+0000","last_peered":"2024-03-11T22:09:17.728382+0000","last_clean":"2024-03-11T22:09:17.728382+0000","last_became_active":"2024-03-11T22:08:16.290276+0000","last_became_peered":"2024-03-11T22:08:16.290276+0000","last_unstale":"2024-03-11T22:09:17.728382+0000","last_undegraded":"2024-03-11T22:09:17.728382+0000","last_fullsized":"2024-03-11T22:09:17.728382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:41:04.854051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.478242+0000","last_change":"2024-03-11T22:08:18.309386+0000","last_active":"2024-03-11T22:09:17.478242+0000","last_peered":"2024-03-11T22:09:17.478242+0000","last_clean":"2024-03-11T22:09:17.478242+0000","last_became_active":"2024-03-11T22:08:18.308063+0000","last_became_peered":"2024-03-11T22:08:18.308063+0000","last_unstale":"2024-03-11T22:09:17.478242+0000","last_undegraded":"2024-03-11T22:09:17.478242+0000","last_fullsized":"2024-03-11T22:09:17.478242+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:08:43.694874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337700+0000","last_change":"2024-03-11T22:08:20.312107+0000","last_active":"2024-03-11T22:09:17.337700+0000","last_peered":"2024-03-11T22:09:17.337700+0000","last_clean":"2024-03-11T22:09:17.337700+0000","last_became_active":"2024-03-11T22:08:20.311625+0000","last_became_peered":"2024-03-11T22:08:20.311625+0000","last_unstale":"2024-03-11T22:09:17.337700+0000","last_undegraded":"2024-03-11T22:09:17.337700+0000","last_fullsized":"2024-03-11T22:09:17.337700+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:46:54.458749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337279+0000","last_change":"2024-03-11T22:08:22.362673+0000","last_active":"2024-03-11T22:09:17.337279+0000","last_peered":"2024-03-11T22:09:17.337279+0000","last_clean":"2024-03-11T22:09:17.337279+0000","last_became_active":"2024-03-11T22:08:22.361352+0000","last_became_peered":"2024-03-11T22:08:22.361352+0000","last_unstale":"2024-03-11T22:09:17.337279+0000","last_undegraded":"2024-03-11T22:09:17.337279+0000","last_fullsized":"2024-03-11T22:09:17.337279+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:24:28.267537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:11:06.481996+0000","last_change":"2024-03-11T22:08:20.326656+0000","last_active":"2024-03-11T22:11:06.481996+0000","last_peered":"2024-03-11T22:11:06.481996+0000","last_clean":"2024-03-11T22:11:06.481996+0000","last_became_active":"2024-03-11T22:08:20.325803+0000","last_became_peered":"2024-03-11T22:08:20.325803+0000","last_unstale":"2024-03-11T22:11:06.481996+0000","last_undegraded":"2024-03-11T22:11:06.481996+0000","last_fullsized":"2024-03-11T22:11:06.481996+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:46:23.368097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.428554+0000","last_change":"2024-03-11T22:08:16.289316+0000","last_active":"2024-03-11T22:09:17.428554+0000","last_peered":"2024-03-11T22:09:17.428554+0000","last_clean":"2024-03-11T22:09:17.428554+0000","last_became_active":"2024-03-11T22:08:16.287958+0000","last_became_peered":"2024-03-11T22:08:16.287958+0000","last_unstale":"2024-03-11T22:09:17.428554+0000","last_undegraded":"2024-03-11T22:09:17.428554+0000","last_fullsized":"2024-03-11T22:09:17.428554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T03:51:09.666167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.466721+0000","last_change":"2024-03-11T22:08:18.325804+0000","last_active":"2024-03-11T22:09:17.466721+0000","last_peered":"2024-03-11T22:09:17.466721+0000","last_clean":"2024-03-11T22:09:17.466721+0000","last_became_active":"2024-03-11T22:08:18.321867+0000","last_became_peered":"2024-03-11T22:08:18.321867+0000","last_unstale":"2024-03-11T22:09:17.466721+0000","last_undegraded":"2024-03-11T22:09:17.466721+0000","last_fullsized":"2024-03-11T22:09:17.466721+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T02:25:33.820656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.427424+0000","last_change":"2024-03-11T22:08:22.389286+0000","last_active":"2024-03-11T22:09:17.427424+0000","last_peered":"2024-03-11T22:09:17.427424+0000","last_clean":"2024-03-11T22:09:17.427424+0000","last_became_active":"2024-03-11T22:08:22.388648+0000","last_became_peered":"2024-03-11T22:08:22.388648+0000","last_unstale":"2024-03-11T22:09:17.427424+0000","last_undegraded":"2024-03-11T22:09:17.427424+0000","last_fullsized":"2024-03-11T22:09:17.427424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:07:28.061438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.336339+0000","last_change":"2024-03-11T22:08:16.277304+0000","last_active":"2024-03-11T22:09:17.336339+0000","last_peered":"2024-03-11T22:09:17.336339+0000","last_clean":"2024-03-11T22:09:17.336339+0000","last_became_active":"2024-03-11T22:08:16.276854+0000","last_became_peered":"2024-03-11T22:08:16.276854+0000","last_unstale":"2024-03-11T22:09:17.336339+0000","last_undegraded":"2024-03-11T22:09:17.336339+0000","last_fullsized":"2024-03-11T22:09:17.336339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:18:05.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429804+0000","last_change":"2024-03-11T22:08:18.315588+0000","last_active":"2024-03-11T22:09:17.429804+0000","last_peered":"2024-03-11T22:09:17.429804+0000","last_clean":"2024-03-11T22:09:17.429804+0000","last_became_active":"2024-03-11T22:08:18.314494+0000","last_became_peered":"2024-03-11T22:08:18.314494+0000","last_unstale":"2024-03-11T22:09:17.429804+0000","last_undegraded":"2024-03-11T22:09:17.429804+0000","last_fullsized":"2024-03-11T22:09:17.429804+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:46:32.891718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.465759+0000","last_change":"2024-03-11T22:08:20.343517+0000","last_active":"2024-03-11T22:09:17.465759+0000","last_peered":"2024-03-11T22:09:17.465759+0000","last_clean":"2024-03-11T22:09:17.465759+0000","last_became_active":"2024-03-11T22:08:20.343190+0000","last_became_peered":"2024-03-11T22:08:20.343190+0000","last_unstale":"2024-03-11T22:09:17.465759+0000","last_undegraded":"2024-03-11T22:09:17.465759+0000","last_fullsized":"2024-03-11T22:09:17.465759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T00:25:23.162143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.727140+0000","last_change":"2024-03-11T22:08:22.359389+0000","last_active":"2024-03-11T22:09:17.727140+0000","last_peered":"2024-03-11T22:09:17.727140+0000","last_clean":"2024-03-11T22:09:17.727140+0000","last_became_active":"2024-03-11T22:08:22.358441+0000","last_became_peered":"2024-03-11T22:08:22.358441+0000","last_unstale":"2024-03-11T22:09:17.727140+0000","last_undegraded":"2024-03-11T22:09:17.727140+0000","last_fullsized":"2024-03-11T22:09:17.727140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T07:06:31.254065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.730554+0000","last_change":"2024-03-11T22:08:16.284517+0000","last_active":"2024-03-11T22:09:17.730554+0000","last_peered":"2024-03-11T22:09:17.730554+0000","last_clean":"2024-03-11T22:09:17.730554+0000","last_became_active":"2024-03-11T22:08:16.284172+0000","last_became_peered":"2024-03-11T22:08:16.284172+0000","last_unstale":"2024-03-11T22:09:17.730554+0000","last_undegraded":"2024-03-11T22:09:17.730554+0000","last_fullsized":"2024-03-11T22:09:17.730554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T08:44:23.457649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555702+0000","last_change":"2024-03-11T22:08:18.317565+0000","last_active":"2024-03-11T22:09:17.555702+0000","last_peered":"2024-03-11T22:09:17.555702+0000","last_clean":"2024-03-11T22:09:17.555702+0000","last_became_active":"2024-03-11T22:08:18.316747+0000","last_became_peered":"2024-03-11T22:08:18.316747+0000","last_unstale":"2024-03-11T22:09:17.555702+0000","last_undegraded":"2024-03-11T22:09:17.555702+0000","last_fullsized":"2024-03-11T22:09:17.555702+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T09:09:31.046597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.728526+0000","last_change":"2024-03-11T22:08:20.337360+0000","last_active":"2024-03-11T22:09:17.728526+0000","last_peered":"2024-03-11T22:09:17.728526+0000","last_clean":"2024-03-11T22:09:17.728526+0000","last_became_active":"2024-03-11T22:08:20.336053+0000","last_became_peered":"2024-03-11T22:08:20.336053+0000","last_unstale":"2024-03-11T22:09:17.728526+0000","last_undegraded":"2024-03-11T22:09:17.728526+0000","last_fullsized":"2024-03-11T22:09:17.728526+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T22:21:41.097509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555719+0000","last_change":"2024-03-11T22:08:22.566755+0000","last_active":"2024-03-11T22:09:17.555719+0000","last_peered":"2024-03-11T22:09:17.555719+0000","last_clean":"2024-03-11T22:09:17.555719+0000","last_became_active":"2024-03-11T22:08:22.565457+0000","last_became_peered":"2024-03-11T22:08:22.565457+0000","last_unstale":"2024-03-11T22:09:17.555719+0000","last_undegraded":"2024-03-11T22:09:17.555719+0000","last_fullsized":"2024-03-11T22:09:17.555719+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:21.328347+0000","last_clean_scrub_stamp":"2024-03-11T22:08:21.328347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T01:44:20.940840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.337997+0000","last_change":"2024-03-11T22:08:16.278515+0000","last_active":"2024-03-11T22:09:17.337997+0000","last_peered":"2024-03-11T22:09:17.337997+0000","last_clean":"2024-03-11T22:09:17.337997+0000","last_became_active":"2024-03-11T22:08:16.277924+0000","last_became_peered":"2024-03-11T22:08:16.277924+0000","last_unstale":"2024-03-11T22:09:17.337997+0000","last_undegraded":"2024-03-11T22:09:17.337997+0000","last_fullsized":"2024-03-11T22:09:17.337997+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:15.241142+0000","last_clean_scrub_stamp":"2024-03-11T22:08:15.241142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:44:31.995285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.429547+0000","last_change":"2024-03-11T22:08:18.313177+0000","last_active":"2024-03-11T22:09:17.429547+0000","last_peered":"2024-03-11T22:09:17.429547+0000","last_clean":"2024-03-11T22:09:17.429547+0000","last_became_active":"2024-03-11T22:08:18.312397+0000","last_became_peered":"2024-03-11T22:08:18.312397+0000","last_unstale":"2024-03-11T22:09:17.429547+0000","last_undegraded":"2024-03-11T22:09:17.429547+0000","last_fullsized":"2024-03-11T22:09:17.429547+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:17.257989+0000","last_clean_scrub_stamp":"2024-03-11T22:08:17.257989+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-12T23:58:50.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-11T22:09:17.555132+0000","last_change":"2024-03-11T22:08:20.309096+0000","last_active":"2024-03-11T22:09:17.555132+0000","last_peered":"2024-03-11T22:09:17.555132+0000","last_clean":"2024-03-11T22:09:17.555132+0000","last_became_active":"2024-03-11T22:08:20.308669+0000","last_became_peered":"2024-03-11T22:08:20.308669+0000","last_unstale":"2024-03-11T22:09:17.555132+0000","last_undegraded":"2024-03-11T22:09:17.555132+0000","last_fullsized":"2024-03-11T22:09:17.555132+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-11T22:08:19.277174+0000","last_clean_scrub_stamp":"2024-03-11T22:08:19.277174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T06:23:33.667816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":153,"num_read_kb":148,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234029,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32500,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712652,"statfs":{"total":95995035648,"available":95961755648,"internally_reserved":0,"allocated":1355776,"data_stored":885527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495672,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28316,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716836,"statfs":{"total":95995035648,"available":95966040064,"internally_reserved":0,"allocated":1331200,"data_stored":883368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717400,"statfs":{"total":95995035648,"available":95966617600,"internally_reserved":0,"allocated":749568,"data_stored":294067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738486,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36652,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708500,"statfs":{"total":95995035648,"available":95957504000,"internally_reserved":0,"allocated":1347584,"data_stored":884893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713256,"statfs":{"total":95995035648,"available":95962374144,"internally_reserved":0,"allocated":733184,"data_stored":293427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182487,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36052,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709100,"statfs":{"total":95995035648,"available":95958118400,"internally_reserved":0,"allocated":729088,"data_stored":293355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018956,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":778240,"data_stored":295170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717412,"statfs":{"total":95995035648,"available":95966629888,"internally_reserved":0,"allocated":737280,"data_stored":293349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-11T22:11:18.348 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-11T22:11:18.348 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-11T22:11:18.348 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-11T22:11:18.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:94a539707733325322964c6a187c6a1b41be1daf shell --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 -- ceph health --format=json 2024-03-11T22:11:18.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:11:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:11:18.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:18 smithi187 bash[23415]: cluster 2024-03-11T22:11:17.408796+0000 mgr.y (mgr.14601) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:18.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:18 smithi187 bash[23415]: audit 2024-03-11T22:11:17.654177+0000 mgr.y (mgr.14601) 109 : audit 0 from='client.24656 v1:172.21.15.49:0/2642231581' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:11:18.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:18 smithi187 bash[23415]: audit 2024-03-11T22:11:17.998381+0000 mon.c (mon.2) 80 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:18.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:18 smithi049 bash[21434]: cluster 2024-03-11T22:11:17.408796+0000 mgr.y (mgr.14601) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:18.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:18 smithi049 bash[21434]: audit 2024-03-11T22:11:17.654177+0000 mgr.y (mgr.14601) 109 : audit 0 from='client.24656 v1:172.21.15.49:0/2642231581' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:11:18.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:18 smithi049 bash[21434]: audit 2024-03-11T22:11:17.998381+0000 mon.c (mon.2) 80 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:18.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:18 smithi049 bash[28804]: cluster 2024-03-11T22:11:17.408796+0000 mgr.y (mgr.14601) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:18.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:18 smithi049 bash[28804]: audit 2024-03-11T22:11:17.654177+0000 mgr.y (mgr.14601) 109 : audit 0 from='client.24656 v1:172.21.15.49:0/2642231581' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-11T22:11:18.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:18 smithi049 bash[28804]: audit 2024-03-11T22:11:17.998381+0000 mon.c (mon.2) 80 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:19.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:19 smithi187 bash[23415]: audit 2024-03-11T22:11:18.450801+0000 mgr.y (mgr.14601) 110 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:19.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:19 smithi049 bash[21434]: audit 2024-03-11T22:11:18.450801+0000 mgr.y (mgr.14601) 110 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:19.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:19 smithi049 bash[28804]: audit 2024-03-11T22:11:18.450801+0000 mgr.y (mgr.14601) 110 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:20.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:20 smithi187 bash[23415]: cluster 2024-03-11T22:11:19.410096+0000 mgr.y (mgr.14601) 111 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:20.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:20 smithi049 bash[21434]: cluster 2024-03-11T22:11:19.410096+0000 mgr.y (mgr.14601) 111 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:20.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:20 smithi049 bash[28804]: cluster 2024-03-11T22:11:19.410096+0000 mgr.y (mgr.14601) 111 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:22.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:22 smithi187 bash[23415]: cluster 2024-03-11T22:11:21.410717+0000 mgr.y (mgr.14601) 112 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:22.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:22 smithi049 bash[21434]: cluster 2024-03-11T22:11:21.410717+0000 mgr.y (mgr.14601) 112 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:22.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:22 smithi049 bash[28804]: cluster 2024-03-11T22:11:21.410717+0000 mgr.y (mgr.14601) 112 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:23.175 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/mon.a/config 2024-03-11T22:11:24.386 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:11:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:11:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:11:24.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:24 smithi187 bash[23415]: cluster 2024-03-11T22:11:23.412115+0000 mgr.y (mgr.14601) 113 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:24.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:24 smithi049 bash[28804]: cluster 2024-03-11T22:11:23.412115+0000 mgr.y (mgr.14601) 113 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:24.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:24 smithi049 bash[21434]: cluster 2024-03-11T22:11:23.412115+0000 mgr.y (mgr.14601) 113 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- 172.21.15.49:0/333265903 >> v1:172.21.15.49:6789/0 conn(0x7ff764110690 legacy=0x7ff764112b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- 172.21.15.49:0/333265903 shutdown_connections 2024-03-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- 172.21.15.49:0/333265903 >> 172.21.15.49:0/333265903 conn(0x7ff7640fc420 msgr2=0x7ff7640fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- 172.21.15.49:0/333265903 shutdown_connections 2024-03-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- 172.21.15.49:0/333265903 wait complete. 2024-03-11T22:11:25.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 Processor -- start 2024-03-11T22:11:25.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- start start 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff7641a8b70 con 0x7ff764100760 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff7641a9d50 con 0x7ff764110690 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff76a45f700 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff7641aaf50 con 0x7ff764101340 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7637fe700 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7ff764101340 0x7ff7641a3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:35870/0 (socket says 172.21.15.49:35870) 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff763fff700 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff764100760 0x7ff76410ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:44848/0 (socket says 172.21.15.49:44848) 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7637fe700 1 -- 172.21.15.49:0/3224925695 learned_addr learned my addr 172.21.15.49:0/3224925695 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843315974 0 0) 0x7ff7641aaf50 con 0x7ff764101340 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7500035b0 con 0x7ff764101340 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057946580 0 0) 0x7ff7641a8b70 con 0x7ff764100760 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7641aaf50 con 0x7ff764100760 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579259575 0 0) 0x7ff7641a9d50 con 0x7ff764110690 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7641a8b70 con 0x7ff764110690 2024-03-11T22:11:25.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1790681617 0 0) 0x7ff7500035b0 con 0x7ff764101340 2024-03-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff7641a9d50 con 0x7ff764101340 2024-03-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ff74c0019a0 con 0x7ff764101340 2024-03-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4226182802 0 0) 0x7ff7641aaf50 con 0x7ff764100760 2024-03-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff7500035b0 con 0x7ff764100760 2024-03-11T22:11:25.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.870+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ff754001830 con 0x7ff764100760 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1436241077 0 0) 0x7ff7641a9d50 con 0x7ff764101340 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 >> v1:172.21.15.187:6789/0 conn(0x7ff764110690 legacy=0x7ff7641a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 >> v1:172.21.15.49:6789/0 conn(0x7ff764100760 legacy=0x7ff76410ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7641ac150 con 0x7ff764101340 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7641ab140 con 0x7ff764101340 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7641ab5c0 con 0x7ff764101340 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7ff74c003b10 con 0x7ff764101340 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ff74c005b80 con 0x7ff764101340 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff744005120 con 0x7ff764101340 2024-03-11T22:11:25.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7ff74c003680 con 0x7ff764101340 2024-03-11T22:11:25.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.874+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6288+0+0 (unknown 1876407447 0 0) 0x7ff74c0882d0 con 0x7ff764101340 2024-03-11T22:11:25.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:25.878+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ff74c0557a0 con 0x7ff764101340 2024-03-11T22:11:26.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.130+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff744005950 con 0x7ff764101340 2024-03-11T22:11:26.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.130+0000 7ff7617fa700 1 -- 172.21.15.49:0/3224925695 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7ff74c053b10 con 0x7ff764101340 2024-03-11T22:11:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-11T22:11:26.120 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-11T22:11:26.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.130+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 >> v1:172.21.15.49:6800/915645872 conn(0x7ff75006e530 legacy=0x7ff7500709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:26.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.130+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 >> v1:172.21.15.49:6790/0 conn(0x7ff764101340 legacy=0x7ff7641a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:11:26.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.134+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 shutdown_connections 2024-03-11T22:11:26.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.134+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 >> 172.21.15.49:0/3224925695 conn(0x7ff7640fc420 msgr2=0x7ff7640feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:11:26.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.134+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 shutdown_connections 2024-03-11T22:11:26.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-11T22:11:26.134+0000 7ff76a45f700 1 -- 172.21.15.49:0/3224925695 wait complete. 2024-03-11T22:11:26.737 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:26 smithi187 bash[23415]: cluster 2024-03-11T22:11:25.412802+0000 mgr.y (mgr.14601) 114 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:26.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:26 smithi187 bash[23415]: audit 2024-03-11T22:11:26.134374+0000 mon.c (mon.2) 81 : audit 0 from='client.? v1:172.21.15.49:0/3224925695' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-11T22:11:26.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:26 smithi049 bash[21434]: cluster 2024-03-11T22:11:25.412802+0000 mgr.y (mgr.14601) 114 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:26.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:26 smithi049 bash[21434]: audit 2024-03-11T22:11:26.134374+0000 mon.c (mon.2) 81 : audit 0 from='client.? v1:172.21.15.49:0/3224925695' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-11T22:11:26.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:26 smithi049 bash[28804]: cluster 2024-03-11T22:11:25.412802+0000 mgr.y (mgr.14601) 114 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:26.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:26 smithi049 bash[28804]: audit 2024-03-11T22:11:26.134374+0000 mon.c (mon.2) 81 : audit 0 from='client.? v1:172.21.15.49:0/3224925695' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-11T22:11:26.841 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-11T22:11:26.842 INFO:tasks.cephadm:Setup complete, yielding 2024-03-11T22:11:26.842 INFO:teuthology.run_tasks:Running task workunit... 2024-03-11T22:11:26.856 INFO:tasks.workunit:Pulling workunits from ref fbcdfe674e56d1ea7a0810744e5915bb07961be5 2024-03-11T22:11:26.857 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-11T22:11:26.857 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-11T22:11:26.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-11T22:11:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-11T22:11:26.864 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-11T22:11:26.911 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-11T22:11:26.918 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-11T22:11:26.959 INFO:tasks.workunit:timeout=3h 2024-03-11T22:11:26.959 INFO:tasks.workunit:cleanup=True 2024-03-11T22:11:26.960 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout fbcdfe674e56d1ea7a0810744e5915bb07961be5 2024-03-11T22:11:27.013 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-11T22:11:28.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:11:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:11:28.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:28 smithi187 bash[23415]: cluster 2024-03-11T22:11:27.413519+0000 mgr.y (mgr.14601) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:28.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:28 smithi049 bash[21434]: cluster 2024-03-11T22:11:27.413519+0000 mgr.y (mgr.14601) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:28.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:28 smithi049 bash[28804]: cluster 2024-03-11T22:11:27.413519+0000 mgr.y (mgr.14601) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:29.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:29 smithi049 bash[28804]: audit 2024-03-11T22:11:28.458889+0000 mgr.y (mgr.14601) 116 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:29.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:29 smithi049 bash[21434]: audit 2024-03-11T22:11:28.458889+0000 mgr.y (mgr.14601) 116 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:29.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:29 smithi187 bash[23415]: audit 2024-03-11T22:11:28.458889+0000 mgr.y (mgr.14601) 116 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:30.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:30 smithi049 bash[28804]: cluster 2024-03-11T22:11:29.414985+0000 mgr.y (mgr.14601) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:30.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:30 smithi049 bash[21434]: cluster 2024-03-11T22:11:29.414985+0000 mgr.y (mgr.14601) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:30.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:30 smithi187 bash[23415]: cluster 2024-03-11T22:11:29.414985+0000 mgr.y (mgr.14601) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:32.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:32 smithi049 bash[28804]: cluster 2024-03-11T22:11:31.415678+0000 mgr.y (mgr.14601) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:32.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:32 smithi049 bash[21434]: cluster 2024-03-11T22:11:31.415678+0000 mgr.y (mgr.14601) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:32.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:32 smithi187 bash[23415]: cluster 2024-03-11T22:11:31.415678+0000 mgr.y (mgr.14601) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:33.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:33 smithi049 bash[28804]: audit 2024-03-11T22:11:33.029351+0000 mon.c (mon.2) 82 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:33.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:33 smithi049 bash[21434]: audit 2024-03-11T22:11:33.029351+0000 mon.c (mon.2) 82 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:33.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:33 smithi187 bash[23415]: audit 2024-03-11T22:11:33.029351+0000 mon.c (mon.2) 82 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:34.512 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:11:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:11:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:11:34.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:34 smithi049 bash[21434]: cluster 2024-03-11T22:11:33.417058+0000 mgr.y (mgr.14601) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:34.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:34 smithi049 bash[28804]: cluster 2024-03-11T22:11:33.417058+0000 mgr.y (mgr.14601) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:34.987 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:34 smithi187 bash[23415]: cluster 2024-03-11T22:11:33.417058+0000 mgr.y (mgr.14601) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:36.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:36 smithi049 bash[21434]: cluster 2024-03-11T22:11:35.417696+0000 mgr.y (mgr.14601) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:36.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:36 smithi049 bash[28804]: cluster 2024-03-11T22:11:35.417696+0000 mgr.y (mgr.14601) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:36.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:36 smithi187 bash[23415]: cluster 2024-03-11T22:11:35.417696+0000 mgr.y (mgr.14601) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:38.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:11:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:11:38.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:38 smithi187 bash[23415]: cluster 2024-03-11T22:11:37.418386+0000 mgr.y (mgr.14601) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:39.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:38 smithi049 bash[21434]: cluster 2024-03-11T22:11:37.418386+0000 mgr.y (mgr.14601) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:39.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:38 smithi049 bash[28804]: cluster 2024-03-11T22:11:37.418386+0000 mgr.y (mgr.14601) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:39.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:39 smithi187 bash[23415]: audit 2024-03-11T22:11:38.470273+0000 mgr.y (mgr.14601) 122 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:40.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:39 smithi049 bash[21434]: audit 2024-03-11T22:11:38.470273+0000 mgr.y (mgr.14601) 122 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:40.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:39 smithi049 bash[28804]: audit 2024-03-11T22:11:38.470273+0000 mgr.y (mgr.14601) 122 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:40.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:40 smithi187 bash[23415]: cluster 2024-03-11T22:11:39.419494+0000 mgr.y (mgr.14601) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:41.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:40 smithi049 bash[21434]: cluster 2024-03-11T22:11:39.419494+0000 mgr.y (mgr.14601) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:41.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:40 smithi049 bash[28804]: cluster 2024-03-11T22:11:39.419494+0000 mgr.y (mgr.14601) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:42.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:42 smithi187 bash[23415]: cluster 2024-03-11T22:11:41.420166+0000 mgr.y (mgr.14601) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:43.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:42 smithi049 bash[21434]: cluster 2024-03-11T22:11:41.420166+0000 mgr.y (mgr.14601) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:43.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:42 smithi049 bash[28804]: cluster 2024-03-11T22:11:41.420166+0000 mgr.y (mgr.14601) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:44.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:11:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:11:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:11:44.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:44 smithi187 bash[23415]: cluster 2024-03-11T22:11:43.421567+0000 mgr.y (mgr.14601) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:45.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:44 smithi049 bash[21434]: cluster 2024-03-11T22:11:43.421567+0000 mgr.y (mgr.14601) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:45.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:44 smithi049 bash[28804]: cluster 2024-03-11T22:11:43.421567+0000 mgr.y (mgr.14601) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:46.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:46 smithi187 bash[23415]: cluster 2024-03-11T22:11:45.422347+0000 mgr.y (mgr.14601) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:47.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:46 smithi049 bash[28804]: cluster 2024-03-11T22:11:45.422347+0000 mgr.y (mgr.14601) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:47.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:46 smithi049 bash[21434]: cluster 2024-03-11T22:11:45.422347+0000 mgr.y (mgr.14601) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:48.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:11:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:11:48.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:48 smithi187 bash[23415]: cluster 2024-03-11T22:11:47.423035+0000 mgr.y (mgr.14601) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:48.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:48 smithi187 bash[23415]: audit 2024-03-11T22:11:48.060398+0000 mon.c (mon.2) 83 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:49.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:48 smithi049 bash[21434]: cluster 2024-03-11T22:11:47.423035+0000 mgr.y (mgr.14601) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:49.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:48 smithi049 bash[21434]: audit 2024-03-11T22:11:48.060398+0000 mon.c (mon.2) 83 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:49.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:48 smithi049 bash[28804]: cluster 2024-03-11T22:11:47.423035+0000 mgr.y (mgr.14601) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:49.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:48 smithi049 bash[28804]: audit 2024-03-11T22:11:48.060398+0000 mon.c (mon.2) 83 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:11:49.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:49 smithi187 bash[23415]: audit 2024-03-11T22:11:48.471633+0000 mgr.y (mgr.14601) 128 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:50.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:49 smithi049 bash[21434]: audit 2024-03-11T22:11:48.471633+0000 mgr.y (mgr.14601) 128 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:50.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:49 smithi049 bash[28804]: audit 2024-03-11T22:11:48.471633+0000 mgr.y (mgr.14601) 128 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:11:50.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:50 smithi187 bash[23415]: cluster 2024-03-11T22:11:49.424476+0000 mgr.y (mgr.14601) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:51.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:50 smithi049 bash[21434]: cluster 2024-03-11T22:11:49.424476+0000 mgr.y (mgr.14601) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:51.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:50 smithi049 bash[28804]: cluster 2024-03-11T22:11:49.424476+0000 mgr.y (mgr.14601) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:52.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:52 smithi187 bash[23415]: cluster 2024-03-11T22:11:51.425291+0000 mgr.y (mgr.14601) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:53.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:52 smithi049 bash[21434]: cluster 2024-03-11T22:11:51.425291+0000 mgr.y (mgr.14601) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:53.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:52 smithi049 bash[28804]: cluster 2024-03-11T22:11:51.425291+0000 mgr.y (mgr.14601) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:54.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:11:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:11:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:11:54.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:54 smithi187 bash[23415]: cluster 2024-03-11T22:11:53.426704+0000 mgr.y (mgr.14601) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:55.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:54 smithi049 bash[21434]: cluster 2024-03-11T22:11:53.426704+0000 mgr.y (mgr.14601) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:55.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:54 smithi049 bash[28804]: cluster 2024-03-11T22:11:53.426704+0000 mgr.y (mgr.14601) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:11:56.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:56 smithi187 bash[23415]: cluster 2024-03-11T22:11:55.427173+0000 mgr.y (mgr.14601) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:57.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:56 smithi049 bash[21434]: cluster 2024-03-11T22:11:55.427173+0000 mgr.y (mgr.14601) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:57.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:56 smithi049 bash[28804]: cluster 2024-03-11T22:11:55.427173+0000 mgr.y (mgr.14601) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:58.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:58 smithi187 bash[23415]: cluster 2024-03-11T22:11:57.427868+0000 mgr.y (mgr.14601) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:58.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:11:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:11:59.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:58 smithi049 bash[21434]: cluster 2024-03-11T22:11:57.427868+0000 mgr.y (mgr.14601) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:59.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:58 smithi049 bash[28804]: cluster 2024-03-11T22:11:57.427868+0000 mgr.y (mgr.14601) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:11:59.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:11:59 smithi187 bash[23415]: audit 2024-03-11T22:11:58.479119+0000 mgr.y (mgr.14601) 134 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:00.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:11:59 smithi049 bash[21434]: audit 2024-03-11T22:11:58.479119+0000 mgr.y (mgr.14601) 134 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:00.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:11:59 smithi049 bash[28804]: audit 2024-03-11T22:11:58.479119+0000 mgr.y (mgr.14601) 134 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:00.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:00 smithi187 bash[23415]: cluster 2024-03-11T22:11:59.429491+0000 mgr.y (mgr.14601) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:01.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:00 smithi049 bash[28804]: cluster 2024-03-11T22:11:59.429491+0000 mgr.y (mgr.14601) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:01.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:00 smithi049 bash[21434]: cluster 2024-03-11T22:11:59.429491+0000 mgr.y (mgr.14601) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:01.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:01 smithi187 bash[23415]: audit 2024-03-11T22:12:00.843964+0000 mon.c (mon.2) 84 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:12:01.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:01 smithi187 bash[23415]: audit 2024-03-11T22:12:01.573558+0000 mon.c (mon.2) 85 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:12:01.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:01 smithi187 bash[23415]: audit 2024-03-11T22:12:01.574544+0000 mon.c (mon.2) 86 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:12:01.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:01 smithi187 bash[23415]: audit 2024-03-11T22:12:01.582661+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:12:02.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[21434]: audit 2024-03-11T22:12:00.843964+0000 mon.c (mon.2) 84 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:12:02.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[21434]: audit 2024-03-11T22:12:01.573558+0000 mon.c (mon.2) 85 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:12:02.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[21434]: audit 2024-03-11T22:12:01.574544+0000 mon.c (mon.2) 86 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:12:02.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[21434]: audit 2024-03-11T22:12:01.582661+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:12:02.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[28804]: audit 2024-03-11T22:12:00.843964+0000 mon.c (mon.2) 84 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:12:02.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[28804]: audit 2024-03-11T22:12:01.573558+0000 mon.c (mon.2) 85 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:12:02.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[28804]: audit 2024-03-11T22:12:01.574544+0000 mon.c (mon.2) 86 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:12:02.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:01 smithi049 bash[28804]: audit 2024-03-11T22:12:01.582661+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:12:02.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:02 smithi187 bash[23415]: cluster 2024-03-11T22:12:01.429984+0000 mgr.y (mgr.14601) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:03.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:02 smithi049 bash[21434]: cluster 2024-03-11T22:12:01.429984+0000 mgr.y (mgr.14601) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:03.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:02 smithi049 bash[28804]: cluster 2024-03-11T22:12:01.429984+0000 mgr.y (mgr.14601) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:03.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:03 smithi187 bash[23415]: audit 2024-03-11T22:12:03.090866+0000 mon.c (mon.2) 87 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:04.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:03 smithi049 bash[28804]: audit 2024-03-11T22:12:03.090866+0000 mon.c (mon.2) 87 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:03 smithi049 bash[21434]: audit 2024-03-11T22:12:03.090866+0000 mon.c (mon.2) 87 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:04.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:12:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:12:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:12:04.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:04 smithi187 bash[23415]: cluster 2024-03-11T22:12:03.431280+0000 mgr.y (mgr.14601) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:05.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:04 smithi049 bash[21434]: cluster 2024-03-11T22:12:03.431280+0000 mgr.y (mgr.14601) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:05.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:04 smithi049 bash[28804]: cluster 2024-03-11T22:12:03.431280+0000 mgr.y (mgr.14601) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:06.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:06 smithi187 bash[23415]: cluster 2024-03-11T22:12:05.431752+0000 mgr.y (mgr.14601) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:07.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:06 smithi049 bash[21434]: cluster 2024-03-11T22:12:05.431752+0000 mgr.y (mgr.14601) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:07.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:06 smithi049 bash[28804]: cluster 2024-03-11T22:12:05.431752+0000 mgr.y (mgr.14601) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:08.738 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:08 smithi187 bash[23415]: cluster 2024-03-11T22:12:07.432164+0000 mgr.y (mgr.14601) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:08.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:12:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:12:09.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:08 smithi049 bash[21434]: cluster 2024-03-11T22:12:07.432164+0000 mgr.y (mgr.14601) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:09.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:08 smithi049 bash[28804]: cluster 2024-03-11T22:12:07.432164+0000 mgr.y (mgr.14601) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:09.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:09 smithi187 bash[23415]: audit 2024-03-11T22:12:08.490446+0000 mgr.y (mgr.14601) 140 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:10.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:09 smithi049 bash[21434]: audit 2024-03-11T22:12:08.490446+0000 mgr.y (mgr.14601) 140 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:10.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:09 smithi049 bash[28804]: audit 2024-03-11T22:12:08.490446+0000 mgr.y (mgr.14601) 140 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:10.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:10 smithi187 bash[23415]: cluster 2024-03-11T22:12:09.432959+0000 mgr.y (mgr.14601) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:11.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:10 smithi049 bash[21434]: cluster 2024-03-11T22:12:09.432959+0000 mgr.y (mgr.14601) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:11.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:10 smithi049 bash[28804]: cluster 2024-03-11T22:12:09.432959+0000 mgr.y (mgr.14601) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:12.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:12 smithi187 bash[23415]: cluster 2024-03-11T22:12:11.433335+0000 mgr.y (mgr.14601) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:13.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:12 smithi049 bash[21434]: cluster 2024-03-11T22:12:11.433335+0000 mgr.y (mgr.14601) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:13.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:12 smithi049 bash[28804]: cluster 2024-03-11T22:12:11.433335+0000 mgr.y (mgr.14601) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:12:14.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:12:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:12:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:12:14.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:14 smithi187 bash[23415]: cluster 2024-03-11T22:12:13.434084+0000 mgr.y (mgr.14601) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:15.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:14 smithi049 bash[21434]: cluster 2024-03-11T22:12:13.434084+0000 mgr.y (mgr.14601) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:15.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:14 smithi049 bash[28804]: cluster 2024-03-11T22:12:13.434084+0000 mgr.y (mgr.14601) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:16.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:16 smithi187 bash[23415]: cluster 2024-03-11T22:12:15.434509+0000 mgr.y (mgr.14601) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:17.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:16 smithi049 bash[21434]: cluster 2024-03-11T22:12:15.434509+0000 mgr.y (mgr.14601) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:17.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:16 smithi049 bash[28804]: cluster 2024-03-11T22:12:15.434509+0000 mgr.y (mgr.14601) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:18.988 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:12:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:12:18.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:18 smithi187 bash[23415]: cluster 2024-03-11T22:12:17.434922+0000 mgr.y (mgr.14601) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:18.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:18 smithi187 bash[23415]: audit 2024-03-11T22:12:18.124260+0000 mon.c (mon.2) 88 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:19.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:18 smithi049 bash[21434]: cluster 2024-03-11T22:12:17.434922+0000 mgr.y (mgr.14601) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:19.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:18 smithi049 bash[21434]: audit 2024-03-11T22:12:18.124260+0000 mon.c (mon.2) 88 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:19.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:18 smithi049 bash[28804]: cluster 2024-03-11T22:12:17.434922+0000 mgr.y (mgr.14601) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:19.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:18 smithi049 bash[28804]: audit 2024-03-11T22:12:18.124260+0000 mon.c (mon.2) 88 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:19.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:19 smithi187 bash[23415]: audit 2024-03-11T22:12:18.501645+0000 mgr.y (mgr.14601) 146 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:20.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:19 smithi049 bash[21434]: audit 2024-03-11T22:12:18.501645+0000 mgr.y (mgr.14601) 146 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:20.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:19 smithi049 bash[28804]: audit 2024-03-11T22:12:18.501645+0000 mgr.y (mgr.14601) 146 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:20.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:20 smithi187 bash[23415]: cluster 2024-03-11T22:12:19.435708+0000 mgr.y (mgr.14601) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:21.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:20 smithi049 bash[21434]: cluster 2024-03-11T22:12:19.435708+0000 mgr.y (mgr.14601) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:21.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:20 smithi049 bash[28804]: cluster 2024-03-11T22:12:19.435708+0000 mgr.y (mgr.14601) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:22.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:22 smithi187 bash[23415]: cluster 2024-03-11T22:12:21.436129+0000 mgr.y (mgr.14601) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:23.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:22 smithi049 bash[21434]: cluster 2024-03-11T22:12:21.436129+0000 mgr.y (mgr.14601) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:23.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:22 smithi049 bash[28804]: cluster 2024-03-11T22:12:21.436129+0000 mgr.y (mgr.14601) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:24.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:12:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:12:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:12:24.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:24 smithi187 bash[23415]: cluster 2024-03-11T22:12:23.436904+0000 mgr.y (mgr.14601) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:25.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:24 smithi049 bash[21434]: cluster 2024-03-11T22:12:23.436904+0000 mgr.y (mgr.14601) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:25.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:24 smithi049 bash[28804]: cluster 2024-03-11T22:12:23.436904+0000 mgr.y (mgr.14601) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:26.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:26 smithi187 bash[23415]: cluster 2024-03-11T22:12:25.437330+0000 mgr.y (mgr.14601) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:27.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:26 smithi049 bash[21434]: cluster 2024-03-11T22:12:25.437330+0000 mgr.y (mgr.14601) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:27.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:26 smithi049 bash[28804]: cluster 2024-03-11T22:12:25.437330+0000 mgr.y (mgr.14601) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:28.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:28 smithi187 bash[23415]: cluster 2024-03-11T22:12:27.437739+0000 mgr.y (mgr.14601) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:28.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:12:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:12:29.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:28 smithi049 bash[21434]: cluster 2024-03-11T22:12:27.437739+0000 mgr.y (mgr.14601) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:29.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:28 smithi049 bash[28804]: cluster 2024-03-11T22:12:27.437739+0000 mgr.y (mgr.14601) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:29.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:29 smithi187 bash[23415]: audit 2024-03-11T22:12:28.505974+0000 mgr.y (mgr.14601) 152 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:30.016 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:29 smithi049 bash[21434]: audit 2024-03-11T22:12:28.505974+0000 mgr.y (mgr.14601) 152 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:30.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:29 smithi049 bash[28804]: audit 2024-03-11T22:12:28.505974+0000 mgr.y (mgr.14601) 152 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:30.969 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to 'fbcdfe674e56d1ea7a0810744e5915bb07961be5'. 2024-03-11T22:12:30.969 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-03-11T22:12:30.969 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-11T22:12:30.969 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-11T22:12:30.969 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-03-11T22:12:30.970 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at fbcdfe674e5 Merge pull request #55941 from galsalomon66/wip-64694-squid 2024-03-11T22:12:30.973 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-11T22:12:30.988 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:30 smithi187 bash[23415]: cluster 2024-03-11T22:12:29.438757+0000 mgr.y (mgr.14601) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:31.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:30 smithi049 bash[21434]: cluster 2024-03-11T22:12:29.438757+0000 mgr.y (mgr.14601) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:31.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:30 smithi049 bash[28804]: cluster 2024-03-11T22:12:29.438757+0000 mgr.y (mgr.14601) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:31.019 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-11T22:12:31.023 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-11T22:12:31.023 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-11T22:12:31.837 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-11T22:12:31.924 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-11T22:12:31.976 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-11T22:12:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-11T22:12:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-11T22:12:32.031 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-11T22:12:32.035 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-11T22:12:32.035 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-11T22:12:32.084 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-03-11T22:12:32.085 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-03-11T22:12:32.085 DEBUG:teuthology.orchestra.run.smithi049:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fbcdfe674e56d1ea7a0810744e5915bb07961be5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-03-11T22:12:32.138 INFO:tasks.workunit.client.0.smithi049.stderr:+ parallel=1 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' '' = --serial ']' 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ crimson=0 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' '' = --crimson ']' 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ color= 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -t 1 ']' 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-03-11T22:12:32.139 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-03-11T22:12:32.140 INFO:tasks.workunit.client.0.smithi049.stderr:+ declare -A pids 2024-03-11T22:12:32.140 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.140 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.140 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_aio 2024-03-11T22:12:32.140 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_aio' 2024-03-11T22:12:32.141 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_aio 2024-03-11T22:12:32.141 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.143 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_aio 2024-03-11T22:12:32.144 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64050 2024-03-11T22:12:32.144 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_aio on pid 64050' 2024-03-11T22:12:32.144 INFO:tasks.workunit.client.0.smithi049.stdout:test api_aio on pid 64050 2024-03-11T22:12:32.145 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64050 2024-03-11T22:12:32.145 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.145 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.145 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-03-11T22:12:32.145 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_aio_pp 2024-03-11T22:12:32.145 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_aio_pp' 2024-03-11T22:12:32.145 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_aio_pp 2024-03-11T22:12:32.146 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.146 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.146 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.146 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.146 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.147 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-03-11T22:12:32.147 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_aio.log 2024-03-11T22:12:32.147 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_aio: /' 2024-03-11T22:12:32.148 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_aio_pp 2024-03-11T22:12:32.148 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64058 2024-03-11T22:12:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:test api_aio_pp on pid 64058 2024-03-11T22:12:32.149 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_aio_pp on pid 64058' 2024-03-11T22:12:32.149 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64058 2024-03-11T22:12:32.149 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.149 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.150 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-03-11T22:12:32.150 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_io 2024-03-11T22:12:32.150 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_io' 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_io 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-03-11T22:12:32.151 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_aio_pp: /' 2024-03-11T22:12:32.152 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_io 2024-03-11T22:12:32.152 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64066 2024-03-11T22:12:32.152 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_io on pid 64066' 2024-03-11T22:12:32.152 INFO:tasks.workunit.client.0.smithi049.stdout:test api_io on pid 64066 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64066 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_io_pp 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_io_pp' 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_io_pp 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-03-11T22:12:32.154 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_io.log 2024-03-11T22:12:32.155 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_io: /' 2024-03-11T22:12:32.156 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_io_pp 2024-03-11T22:12:32.156 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64074 2024-03-11T22:12:32.156 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_io_pp on pid 64074' 2024-03-11T22:12:32.156 INFO:tasks.workunit.client.0.smithi049.stdout:test api_io_pp on pid 64074 2024-03-11T22:12:32.157 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64074 2024-03-11T22:12:32.157 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_asio 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_asio' 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_asio 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.158 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-03-11T22:12:32.159 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-03-11T22:12:32.159 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_io_pp: /' 2024-03-11T22:12:32.159 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_asio 2024-03-11T22:12:32.160 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64082 2024-03-11T22:12:32.160 INFO:tasks.workunit.client.0.smithi049.stdout:test api_asio on pid 64082 2024-03-11T22:12:32.161 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_asio on pid 64082' 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64082 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_list 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_list' 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_list 2024-03-11T22:12:32.162 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.163 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-03-11T22:12:32.163 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_asio: /' 2024-03-11T22:12:32.163 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_asio.log 2024-03-11T22:12:32.164 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_list 2024-03-11T22:12:32.165 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64090 2024-03-11T22:12:32.165 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_list on pid 64090' 2024-03-11T22:12:32.165 INFO:tasks.workunit.client.0.smithi049.stdout:test api_list on pid 64090 2024-03-11T22:12:32.166 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64090 2024-03-11T22:12:32.166 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.166 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.166 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-03-11T22:12:32.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-03-11T22:12:32.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_list.log 2024-03-11T22:12:32.167 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_list: /' 2024-03-11T22:12:32.168 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_lock 2024-03-11T22:12:32.168 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_lock' 2024-03-11T22:12:32.169 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_lock 2024-03-11T22:12:32.169 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.172 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_lock 2024-03-11T22:12:32.172 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64098 2024-03-11T22:12:32.172 INFO:tasks.workunit.client.0.smithi049.stdout:test api_lock on pid 64098 2024-03-11T22:12:32.173 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_lock on pid 64098' 2024-03-11T22:12:32.173 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64098 2024-03-11T22:12:32.173 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.173 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.173 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_lock_pp 2024-03-11T22:12:32.173 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_lock_pp' 2024-03-11T22:12:32.173 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_lock_pp 2024-03-11T22:12:32.176 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.179 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_lock_pp 2024-03-11T22:12:32.179 INFO:tasks.workunit.client.0.smithi049.stdout:test api_lock_pp on pid 64104 2024-03-11T22:12:32.179 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64104 2024-03-11T22:12:32.179 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_lock_pp on pid 64104' 2024-03-11T22:12:32.179 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64104 2024-03-11T22:12:32.179 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.180 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-03-11T22:12:32.180 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.180 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.181 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.181 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.181 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.181 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-03-11T22:12:32.181 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-03-11T22:12:32.182 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-03-11T22:12:32.184 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.184 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.184 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.184 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.184 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_lock: /' 2024-03-11T22:12:32.185 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_lock_pp: /' 2024-03-11T22:12:32.186 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-03-11T22:12:32.189 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_misc 2024-03-11T22:12:32.189 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_lock.log 2024-03-11T22:12:32.189 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_misc' 2024-03-11T22:12:32.205 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_misc 2024-03-11T22:12:32.206 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.211 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_misc 2024-03-11T22:12:32.211 INFO:tasks.workunit.client.0.smithi049.stdout:test api_misc on pid 64188 2024-03-11T22:12:32.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64188 2024-03-11T22:12:32.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_misc on pid 64188' 2024-03-11T22:12:32.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64188 2024-03-11T22:12:32.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.212 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_misc_pp 2024-03-11T22:12:32.212 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_misc_pp' 2024-03-11T22:12:32.213 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_misc_pp 2024-03-11T22:12:32.214 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-03-11T22:12:32.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.219 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_misc.log 2024-03-11T22:12:32.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-03-11T22:12:32.221 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_misc: /' 2024-03-11T22:12:32.222 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_misc_pp 2024-03-11T22:12:32.222 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64218 2024-03-11T22:12:32.222 INFO:tasks.workunit.client.0.smithi049.stdout:test api_misc_pp on pid 64218 2024-03-11T22:12:32.223 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_misc_pp on pid 64218' 2024-03-11T22:12:32.223 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64218 2024-03-11T22:12:32.223 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.223 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.223 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-03-11T22:12:32.223 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_tier_pp 2024-03-11T22:12:32.223 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_tier_pp' 2024-03-11T22:12:32.224 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_tier_pp 2024-03-11T22:12:32.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-03-11T22:12:32.224 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-03-11T22:12:32.225 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_misc_pp: /' 2024-03-11T22:12:32.226 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.230 INFO:tasks.workunit.client.0.smithi049.stdout:test api_tier_pp on pid 64242 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_tier_pp 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64242 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_tier_pp on pid 64242' 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64242 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_pool 2024-03-11T22:12:32.231 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_pool' 2024-03-11T22:12:32.232 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-03-11T22:12:32.232 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.232 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_pool 2024-03-11T22:12:32.233 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.233 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.233 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.234 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.234 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-03-11T22:12:32.234 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-03-11T22:12:32.234 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_pool 2024-03-11T22:12:32.234 INFO:tasks.workunit.client.0.smithi049.stdout:test api_pool on pid 64250 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64250 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_pool on pid 64250' 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64250 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_tier_pp: /' 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.235 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.236 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.236 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-03-11T22:12:32.236 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_pool.log 2024-03-11T22:12:32.236 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_pool: /' 2024-03-11T22:12:32.238 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_snapshots 2024-03-11T22:12:32.239 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_snapshots' 2024-03-11T22:12:32.239 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_snapshots 2024-03-11T22:12:32.240 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.242 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_snapshots 2024-03-11T22:12:32.242 INFO:tasks.workunit.client.0.smithi049.stdout:test api_snapshots on pid 64258 2024-03-11T22:12:32.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64258 2024-03-11T22:12:32.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_snapshots on pid 64258' 2024-03-11T22:12:32.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64258 2024-03-11T22:12:32.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.243 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-03-11T22:12:32.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.244 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_snapshots_pp 2024-03-11T22:12:32.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_snapshots: /' 2024-03-11T22:12:32.244 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_snapshots_pp' 2024-03-11T22:12:32.245 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-03-11T22:12:32.246 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_snapshots_pp 2024-03-11T22:12:32.246 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.248 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-03-11T22:12:32.249 INFO:tasks.workunit.client.0.smithi049.stdout:test api_snapshots_pp on pid 64270 2024-03-11T22:12:32.249 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_snapshots_pp 2024-03-11T22:12:32.249 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64270 2024-03-11T22:12:32.249 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_snapshots_pp on pid 64270' 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64270 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.250 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.251 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_stat 2024-03-11T22:12:32.251 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-03-11T22:12:32.251 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_stat' 2024-03-11T22:12:32.252 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-03-11T22:12:32.253 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-03-11T22:12:32.256 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.259 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_stat 2024-03-11T22:12:32.261 INFO:tasks.workunit.client.0.smithi049.stdout:test api_stat on pid 64282 2024-03-11T22:12:32.261 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_stat 2024-03-11T22:12:32.261 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64282 2024-03-11T22:12:32.262 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_stat on pid 64282' 2024-03-11T22:12:32.262 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64282 2024-03-11T22:12:32.262 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.262 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.262 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_stat_pp 2024-03-11T22:12:32.262 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_stat_pp' 2024-03-11T22:12:32.263 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-03-11T22:12:32.266 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.266 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.266 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.266 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.267 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-03-11T22:12:32.273 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_stat: /' 2024-03-11T22:12:32.274 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_stat.log 2024-03-11T22:12:32.282 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.283 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_stat_pp 2024-03-11T22:12:32.285 INFO:tasks.workunit.client.0.smithi049.stdout:test api_stat_pp on pid 64325 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_stat_pp 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64325 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_stat_pp on pid 64325' 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64325 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_watch_notify 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-03-11T22:12:32.286 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_watch_notify' 2024-03-11T22:12:32.287 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.287 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.287 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.287 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.288 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-03-11T22:12:32.289 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_watch_notify 2024-03-11T22:12:32.290 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-03-11T22:12:32.293 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_stat_pp: /' 2024-03-11T22:12:32.295 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.298 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_watch_notify 2024-03-11T22:12:32.298 INFO:tasks.workunit.client.0.smithi049.stdout:test api_watch_notify on pid 64373 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64373 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_watch_notify on pid 64373' 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64373 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_watch_notify_pp 2024-03-11T22:12:32.299 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_watch_notify_pp' 2024-03-11T22:12:32.300 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.300 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.300 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.300 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.301 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-03-11T22:12:32.301 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_watch_notify: /' 2024-03-11T22:12:32.303 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.303 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-03-11T22:12:32.304 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_watch_notify_pp 2024-03-11T22:12:32.309 INFO:tasks.workunit.client.0.smithi049.stdout:test api_watch_notify_pp on pid 64407 2024-03-11T22:12:32.310 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_watch_notify_pp 2024-03-11T22:12:32.310 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64407 2024-03-11T22:12:32.310 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_watch_notify_pp on pid 64407' 2024-03-11T22:12:32.310 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64407 2024-03-11T22:12:32.310 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.310 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.310 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-03-11T22:12:32.311 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_cmd 2024-03-11T22:12:32.311 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_cmd' 2024-03-11T22:12:32.312 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.312 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.312 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.312 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.313 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-03-11T22:12:32.314 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.314 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_cmd 2024-03-11T22:12:32.314 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-03-11T22:12:32.317 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_cmd 2024-03-11T22:12:32.317 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64417 2024-03-11T22:12:32.317 INFO:tasks.workunit.client.0.smithi049.stdout:test api_cmd on pid 64417 2024-03-11T22:12:32.318 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_cmd on pid 64417' 2024-03-11T22:12:32.318 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64417 2024-03-11T22:12:32.318 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.318 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.319 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_cmd_pp 2024-03-11T22:12:32.319 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_cmd_pp' 2024-03-11T22:12:32.319 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.319 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-03-11T22:12:32.320 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.320 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.320 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.320 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.321 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_cmd.log 2024-03-11T22:12:32.323 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_cmd: /' 2024-03-11T22:12:32.325 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_cmd_pp 2024-03-11T22:12:32.326 INFO:tasks.workunit.client.0.smithi049.stdout:test api_cmd_pp on pid 64433 2024-03-11T22:12:32.327 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_cmd_pp 2024-03-11T22:12:32.327 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-03-11T22:12:32.327 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64433 2024-03-11T22:12:32.327 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_cmd_pp on pid 64433' 2024-03-11T22:12:32.327 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64433 2024-03-11T22:12:32.327 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.328 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.328 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-03-11T22:12:32.328 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_service 2024-03-11T22:12:32.328 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_service' 2024-03-11T22:12:32.329 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.329 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.329 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.329 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.329 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_service 2024-03-11T22:12:32.329 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.329 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-03-11T22:12:32.330 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-03-11T22:12:32.331 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-03-11T22:12:32.333 INFO:tasks.workunit.client.0.smithi049.stdout:test api_service on pid 64453 2024-03-11T22:12:32.337 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_service 2024-03-11T22:12:32.337 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64453 2024-03-11T22:12:32.337 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_service on pid 64453' 2024-03-11T22:12:32.337 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64453 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_service_pp 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_service_pp' 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_service.log 2024-03-11T22:12:32.338 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_service_pp 2024-03-11T22:12:32.339 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.339 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-03-11T22:12:32.339 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_service: /' 2024-03-11T22:12:32.340 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_service_pp 2024-03-11T22:12:32.340 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64461 2024-03-11T22:12:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:test api_service_pp on pid 64461 2024-03-11T22:12:32.341 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_service_pp on pid 64461' 2024-03-11T22:12:32.341 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64461 2024-03-11T22:12:32.341 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.341 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.341 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_c_write_operations 2024-03-11T22:12:32.342 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_c_write_operations' 2024-03-11T22:12:32.342 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_c_write_operations 2024-03-11T22:12:32.342 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.345 INFO:tasks.workunit.client.0.smithi049.stdout:test api_c_write_operations on pid 64469 2024-03-11T22:12:32.345 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_c_write_operations 2024-03-11T22:12:32.345 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64469 2024-03-11T22:12:32.345 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_c_write_operations on pid 64469' 2024-03-11T22:12:32.345 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64469 2024-03-11T22:12:32.346 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.346 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.346 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_c_read_operations 2024-03-11T22:12:32.346 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_c_read_operations' 2024-03-11T22:12:32.347 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-03-11T22:12:32.348 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.348 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.349 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.349 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.349 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-03-11T22:12:32.349 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-03-11T22:12:32.349 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-03-11T22:12:32.350 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-03-11T22:12:32.354 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_c_read_operations 2024-03-11T22:12:32.354 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.354 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.354 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.354 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.354 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.355 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_service_pp: /' 2024-03-11T22:12:32.359 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-03-11T22:12:32.359 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-03-11T22:12:32.360 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_c_read_operations 2024-03-11T22:12:32.361 INFO:tasks.workunit.client.0.smithi049.stdout:test api_c_read_operations on pid 64516 2024-03-11T22:12:32.361 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64516 2024-03-11T22:12:32.361 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_c_read_operations on pid 64516' 2024-03-11T22:12:32.361 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-03-11T22:12:32.361 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64516 2024-03-11T22:12:32.361 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.361 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.362 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.362 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.362 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.362 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.364 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-03-11T22:12:32.364 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-03-11T22:12:32.365 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-03-11T22:12:32.370 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s api_cls_remote_reads 2024-03-11T22:12:32.370 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' api_cls_remote_reads' 2024-03-11T22:12:32.371 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo api_cls_remote_reads 2024-03-11T22:12:32.371 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.374 INFO:tasks.workunit.client.0.smithi049.stdout:test api_cls_remote_reads on pid 64528 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=api_cls_remote_reads 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64528 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test api_cls_remote_reads on pid 64528' 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64528 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s list_parallel 2024-03-11T22:12:32.375 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' list_parallel' 2024-03-11T22:12:32.376 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-03-11T22:12:32.377 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.377 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.377 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.377 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo list_parallel 2024-03-11T22:12:32.377 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.378 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2024-03-11T22:12:32.378 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.381 INFO:tasks.workunit.client.0.smithi049.stdout:test list_parallel on pid 64550 2024-03-11T22:12:32.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=list_parallel 2024-03-11T22:12:32.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64550 2024-03-11T22:12:32.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test list_parallel on pid 64550' 2024-03-11T22:12:32.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64550 2024-03-11T22:12:32.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.382 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s open_pools_parallel 2024-03-11T22:12:32.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' open_pools_parallel' 2024-03-11T22:12:32.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-03-11T22:12:32.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-03-11T22:12:32.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.387 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_list_parallel.log 2024-03-11T22:12:32.388 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-03-11T22:12:32.391 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ list_parallel: /' 2024-03-11T22:12:32.394 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-03-11T22:12:32.395 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo open_pools_parallel 2024-03-11T22:12:32.395 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.400 INFO:tasks.workunit.client.0.smithi049.stdout:test open_pools_parallel on pid 64574 2024-03-11T22:12:32.400 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=open_pools_parallel 2024-03-11T22:12:32.401 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64574 2024-03-11T22:12:32.401 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test open_pools_parallel on pid 64574' 2024-03-11T22:12:32.401 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64574 2024-03-11T22:12:32.401 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-11T22:12:32.401 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.403 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-03-11T22:12:32.404 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.405 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.405 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.405 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.408 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s delete_pools_parallel 2024-03-11T22:12:32.410 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' delete_pools_parallel' 2024-03-11T22:12:32.413 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-03-11T22:12:32.416 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-03-11T22:12:32.416 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo delete_pools_parallel 2024-03-11T22:12:32.416 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-03-11T22:12:32.424 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.427 INFO:tasks.workunit.client.0.smithi049.stdout:test delete_pools_parallel on pid 64616 2024-03-11T22:12:32.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=delete_pools_parallel 2024-03-11T22:12:32.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64616 2024-03-11T22:12:32.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test delete_pools_parallel on pid 64616' 2024-03-11T22:12:32.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64616 2024-03-11T22:12:32.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.428 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s cls 2024-03-11T22:12:32.428 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' cls' 2024-03-11T22:12:32.433 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo cls 2024-03-11T22:12:32.434 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-03-11T22:12:32.436 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.436 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.436 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.436 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.436 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-03-11T22:12:32.446 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.449 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:test cls on pid 64713 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=cls 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64713 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test cls on pid 64713' 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64713 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.451 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-03-11T22:12:32.452 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.452 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.452 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.452 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.453 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_cls 2024-03-11T22:12:32.454 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-03-11T22:12:32.454 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ cls: /' 2024-03-11T22:12:32.456 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s cmd 2024-03-11T22:12:32.456 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' cmd' 2024-03-11T22:12:32.457 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo cmd 2024-03-11T22:12:32.457 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.459 INFO:tasks.workunit.client.0.smithi049.stdout:test cmd on pid 64722 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=cmd 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64722 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test cmd on pid 64722' 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64722 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s handler_error 2024-03-11T22:12:32.460 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' handler_error' 2024-03-11T22:12:32.461 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo handler_error 2024-03-11T22:12:32.461 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.463 INFO:tasks.workunit.client.0.smithi049.stdout:test handler_error on pid 64727 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=handler_error 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64727 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test handler_error on pid 64727' 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64727 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s io 2024-03-11T22:12:32.464 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' io' 2024-03-11T22:12:32.465 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.466 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo io 2024-03-11T22:12:32.468 INFO:tasks.workunit.client.0.smithi049.stdout:test io on pid 64734 2024-03-11T22:12:32.468 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=io 2024-03-11T22:12:32.468 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64734 2024-03-11T22:12:32.468 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test io on pid 64734' 2024-03-11T22:12:32.468 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64734 2024-03-11T22:12:32.469 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.469 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.469 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-03-11T22:12:32.469 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-03-11T22:12:32.469 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_cls.log 2024-03-11T22:12:32.470 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.470 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.470 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.470 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.470 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.471 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_io.log 2024-03-11T22:12:32.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.472 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s ec_io 2024-03-11T22:12:32.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' ec_io' 2024-03-11T22:12:32.472 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ cmd: /' 2024-03-11T22:12:32.474 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_cmd.log 2024-03-11T22:12:32.474 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ io: /' 2024-03-11T22:12:32.475 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo ec_io 2024-03-11T22:12:32.476 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-03-11T22:12:32.476 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.477 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.477 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.477 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.477 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.478 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ handler_error: /' 2024-03-11T22:12:32.479 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_handler_error.log 2024-03-11T22:12:32.479 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_handler_error 2024-03-11T22:12:32.480 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=ec_io 2024-03-11T22:12:32.480 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_cmd 2024-03-11T22:12:32.480 INFO:tasks.workunit.client.0.smithi049.stdout:test ec_io on pid 64776 2024-03-11T22:12:32.480 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64776 2024-03-11T22:12:32.480 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test ec_io on pid 64776' 2024-03-11T22:12:32.481 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64776 2024-03-11T22:12:32.481 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.481 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.481 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_io 2024-03-11T22:12:32.483 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s list 2024-03-11T22:12:32.484 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' list' 2024-03-11T22:12:32.485 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.485 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-03-11T22:12:32.487 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo list 2024-03-11T22:12:32.488 INFO:tasks.workunit.client.0.smithi049.stdout:test list on pid 64805 2024-03-11T22:12:32.488 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=list 2024-03-11T22:12:32.488 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64805 2024-03-11T22:12:32.489 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test list on pid 64805' 2024-03-11T22:12:32.489 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64805 2024-03-11T22:12:32.489 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.489 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.490 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s ec_list 2024-03-11T22:12:32.490 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-03-11T22:12:32.490 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.491 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.491 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.491 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.492 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ list: /' 2024-03-11T22:12:32.492 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' ec_list' 2024-03-11T22:12:32.492 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_list.log 2024-03-11T22:12:32.493 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_list 2024-03-11T22:12:32.494 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.494 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo ec_list 2024-03-11T22:12:32.498 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.498 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.498 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.499 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.501 INFO:tasks.workunit.client.0.smithi049.stdout:test ec_list on pid 64832 2024-03-11T22:12:32.501 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=ec_list 2024-03-11T22:12:32.501 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64832 2024-03-11T22:12:32.501 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test ec_list on pid 64832' 2024-03-11T22:12:32.502 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64832 2024-03-11T22:12:32.502 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.502 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.505 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s misc 2024-03-11T22:12:32.505 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' misc' 2024-03-11T22:12:32.506 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo misc 2024-03-11T22:12:32.506 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ ec_io: /' 2024-03-11T22:12:32.506 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_ec_io.log 2024-03-11T22:12:32.508 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_ec_io 2024-03-11T22:12:32.508 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.509 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-03-11T22:12:32.510 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.510 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.510 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.510 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.511 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=misc 2024-03-11T22:12:32.511 INFO:tasks.workunit.client.0.smithi049.stdout:test misc on pid 64862 2024-03-11T22:12:32.511 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64862 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test misc on pid 64862' 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64862 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_ec_list 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s pool 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' pool' 2024-03-11T22:12:32.512 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_ec_list.log 2024-03-11T22:12:32.513 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.513 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo pool 2024-03-11T22:12:32.514 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ ec_list: /' 2024-03-11T22:12:32.514 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-03-11T22:12:32.516 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.516 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.517 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.517 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.517 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_misc 2024-03-11T22:12:32.520 INFO:tasks.workunit.client.0.smithi049.stdout:test pool on pid 64888 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=pool 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64888 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test pool on pid 64888' 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64888 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s read_operations 2024-03-11T22:12:32.521 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' read_operations' 2024-03-11T22:12:32.522 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-03-11T22:12:32.524 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.524 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.524 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.524 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.524 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_pool 2024-03-11T22:12:32.527 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.529 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo read_operations 2024-03-11T22:12:32.530 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_pool.log 2024-03-11T22:12:32.530 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ pool: /' 2024-03-11T22:12:32.531 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_misc.log 2024-03-11T22:12:32.531 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ misc: /' 2024-03-11T22:12:32.532 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=read_operations 2024-03-11T22:12:32.532 INFO:tasks.workunit.client.0.smithi049.stdout:test read_operations on pid 64922 2024-03-11T22:12:32.533 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64922 2024-03-11T22:12:32.533 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test read_operations on pid 64922' 2024-03-11T22:12:32.533 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64922 2024-03-11T22:12:32.533 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.533 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.534 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-03-11T22:12:32.535 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s snapshots 2024-03-11T22:12:32.535 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' snapshots' 2024-03-11T22:12:32.536 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.541 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.541 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.541 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.541 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.542 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo snapshots 2024-03-11T22:12:32.543 INFO:tasks.workunit.client.0.smithi049.stdout:test snapshots on pid 64937 2024-03-11T22:12:32.543 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=snapshots 2024-03-11T22:12:32.544 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64937 2024-03-11T22:12:32.544 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test snapshots on pid 64937' 2024-03-11T22:12:32.544 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=64937 2024-03-11T22:12:32.544 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.544 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.546 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_read_operations 2024-03-11T22:12:32.547 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_read_operations.log 2024-03-11T22:12:32.548 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ read_operations: /' 2024-03-11T22:12:32.551 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-03-11T22:12:32.552 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s watch_notify 2024-03-11T22:12:32.552 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' watch_notify' 2024-03-11T22:12:32.554 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.554 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.554 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.554 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.555 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_snapshots.log 2024-03-11T22:12:32.555 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ snapshots: /' 2024-03-11T22:12:32.555 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_snapshots 2024-03-11T22:12:32.560 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo watch_notify 2024-03-11T22:12:32.561 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.565 INFO:tasks.workunit.client.0.smithi049.stdout:test watch_notify on pid 65018 2024-03-11T22:12:32.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=watch_notify 2024-03-11T22:12:32.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=65018 2024-03-11T22:12:32.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test watch_notify on pid 65018' 2024-03-11T22:12:32.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=65018 2024-03-11T22:12:32.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-03-11T22:12:32.566 INFO:tasks.workunit.client.0.smithi049.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-11T22:12:32.567 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.567 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.567 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.568 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.568 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.568 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ watch_notify: /' 2024-03-11T22:12:32.568 INFO:tasks.workunit.client.0.smithi049.stderr:++ printf %25s write_operations 2024-03-11T22:12:32.569 INFO:tasks.workunit.client.0.smithi049.stderr:+ r=' write_operations' 2024-03-11T22:12:32.572 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_watch_notify 2024-03-11T22:12:32.572 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-03-11T22:12:32.573 INFO:tasks.workunit.client.0.smithi049.stderr:++ echo write_operations 2024-03-11T22:12:32.573 INFO:tasks.workunit.client.0.smithi049.stderr:++ awk '{print $1}' 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stdout:test write_operations on pid 65045 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stderr:+ ff=write_operations 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=65045 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo 'test write_operations on pid 65045' 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stderr:+ pids[$f]=65045 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stderr:+ ret=0 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-03-11T22:12:32.577 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' 1 -eq 1 ']' 2024-03-11T22:12:32.578 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:12:32.578 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64242 2024-03-11T22:12:32.578 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64242 2024-03-11T22:12:32.581 INFO:tasks.workunit.client.0.smithi049.stderr:+ '[' -z '' ']' 2024-03-11T22:12:32.581 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.581 INFO:tasks.workunit.client.0.smithi049.stderr:+ case $- in 2024-03-11T22:12:32.581 INFO:tasks.workunit.client.0.smithi049.stderr:+ return 2024-03-11T22:12:32.581 INFO:tasks.workunit.client.0.smithi049.stderr:+ tee ceph_test_neorados_write_operations.log 2024-03-11T22:12:32.581 INFO:tasks.workunit.client.0.smithi049.stderr:+ sed 's/^/ write_operations: /' 2024-03-11T22:12:32.582 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph_test_neorados_write_operations 2024-03-11T22:12:33.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:33 smithi187 bash[23415]: cluster 2024-03-11T22:12:31.439425+0000 mgr.y (mgr.14601) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:33 smithi049 bash[28804]: cluster 2024-03-11T22:12:31.439425+0000 mgr.y (mgr.14601) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:33.541 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:33 smithi049 bash[21434]: cluster 2024-03-11T22:12:31.439425+0000 mgr.y (mgr.14601) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-11T22:12:34.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:12:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:12:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:12:36.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:36 smithi187 bash[23415]: audit 2024-03-11T22:12:32.372481+0000 mon.b (mon.1) 35 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:36.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:36 smithi187 bash[23415]: audit 2024-03-11T22:12:32.429817+0000 mon.c (mon.2) 89 : audit 0 from='client.? v1:172.21.15.49:0/2228187406' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-03-11T22:12:36.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:36 smithi187 bash[23415]: audit 2024-03-11T22:12:32.579697+0000 mon.c (mon.2) 90 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:36.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:36 smithi187 bash[23415]: audit 2024-03-11T22:12:32.597712+0000 mon.c (mon.2) 91 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:36.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:36 smithi187 bash[23415]: audit 2024-03-11T22:12:33.141005+0000 mon.c (mon.2) 92 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:36.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:36 smithi187 bash[23415]: audit 2024-03-11T22:12:33.168867+0000 mon.a (mon.0) 821 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:37.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[28804]: audit 2024-03-11T22:12:32.372481+0000 mon.b (mon.1) 35 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[28804]: audit 2024-03-11T22:12:32.429817+0000 mon.c (mon.2) 89 : audit 0 from='client.? v1:172.21.15.49:0/2228187406' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[28804]: audit 2024-03-11T22:12:32.579697+0000 mon.c (mon.2) 90 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[28804]: audit 2024-03-11T22:12:32.597712+0000 mon.c (mon.2) 91 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[28804]: audit 2024-03-11T22:12:33.141005+0000 mon.c (mon.2) 92 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[28804]: audit 2024-03-11T22:12:33.168867+0000 mon.a (mon.0) 821 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[21434]: audit 2024-03-11T22:12:32.372481+0000 mon.b (mon.1) 35 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[21434]: audit 2024-03-11T22:12:32.429817+0000 mon.c (mon.2) 89 : audit 0 from='client.? v1:172.21.15.49:0/2228187406' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[21434]: audit 2024-03-11T22:12:32.579697+0000 mon.c (mon.2) 90 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[21434]: audit 2024-03-11T22:12:32.597712+0000 mon.c (mon.2) 91 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[21434]: audit 2024-03-11T22:12:33.141005+0000 mon.c (mon.2) 92 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:36 smithi049 bash[21434]: audit 2024-03-11T22:12:33.168867+0000 mon.a (mon.0) 821 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:38.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:12:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:12:42.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: audit 2024-03-11T22:12:33.175791+0000 mon.b (mon.1) 36 : audit 1 from='client.? v1:172.21.15.49:0/2407628098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: audit 2024-03-11T22:12:36.648809+0000 mon.b (mon.1) 37 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: cluster 2024-03-11T22:12:36.652931+0000 mon.a (mon.0) 822 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: audit 2024-03-11T22:12:36.669824+0000 mon.a (mon.0) 823 : audit 1 from='client.? v1:172.21.15.49:0/1270484929' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi049-64063-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: audit 2024-03-11T22:12:36.670478+0000 mon.a (mon.0) 824 : audit 1 from='client.24676 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: audit 2024-03-11T22:12:36.671189+0000 mon.a (mon.0) 825 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: audit 2024-03-11T22:12:36.678712+0000 mon.a (mon.0) 826 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[21434]: audit 2024-03-11T22:12:36.679499+0000 mon.a (mon.0) 827 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: audit 2024-03-11T22:12:33.175791+0000 mon.b (mon.1) 36 : audit 1 from='client.? v1:172.21.15.49:0/2407628098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: audit 2024-03-11T22:12:36.648809+0000 mon.b (mon.1) 37 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:42.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: cluster 2024-03-11T22:12:36.652931+0000 mon.a (mon.0) 822 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-03-11T22:12:42.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: audit 2024-03-11T22:12:36.669824+0000 mon.a (mon.0) 823 : audit 1 from='client.? v1:172.21.15.49:0/1270484929' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi049-64063-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: audit 2024-03-11T22:12:36.670478+0000 mon.a (mon.0) 824 : audit 1 from='client.24676 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: audit 2024-03-11T22:12:36.671189+0000 mon.a (mon.0) 825 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:42.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: audit 2024-03-11T22:12:36.678712+0000 mon.a (mon.0) 826 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:42.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:42 smithi049 bash[28804]: audit 2024-03-11T22:12:36.679499+0000 mon.a (mon.0) 827 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:42.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: audit 2024-03-11T22:12:33.175791+0000 mon.b (mon.1) 36 : audit 1 from='client.? v1:172.21.15.49:0/2407628098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: audit 2024-03-11T22:12:36.648809+0000 mon.b (mon.1) 37 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:42.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: cluster 2024-03-11T22:12:36.652931+0000 mon.a (mon.0) 822 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-03-11T22:12:42.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: audit 2024-03-11T22:12:36.669824+0000 mon.a (mon.0) 823 : audit 1 from='client.? v1:172.21.15.49:0/1270484929' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi049-64063-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: audit 2024-03-11T22:12:36.670478+0000 mon.a (mon.0) 824 : audit 1 from='client.24676 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:42.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: audit 2024-03-11T22:12:36.671189+0000 mon.a (mon.0) 825 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:42.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: audit 2024-03-11T22:12:36.678712+0000 mon.a (mon.0) 826 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:42 smithi187 bash[23415]: audit 2024-03-11T22:12:36.679499+0000 mon.a (mon.0) 827 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:44.069 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [----------] Global test environment set-up. 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [----------] 4 tests from LibRadosService 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5068 ms) 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ OK ] LibRadosService.RegisterLate (46 ms) 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: cluster: 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: id: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: health: HEALTH_OK 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: services: 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-11T22:12:44.070 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: data: 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pools: 6 pools, 132 pgs 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: objects: 198 objects, 582 KiB 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: usage: 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pgs: 132 active+clean 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: io: 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: cluster: 2024-03-11T22:12:44.071 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: id: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: health: HEALTH_OK 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: services: 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: data: 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pools: 6 pools, 132 pgs 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: objects: 198 objects, 582 KiB 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: usage: 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pgs: 132 active+clean 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: io: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: cluster: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: id: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: health: HEALTH_OK 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: services: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: data: 2024-03-11T22:12:44.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pools: 6 pools, 132 pgs 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: objects: 198 objects, 582 KiB 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: usage: 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pgs: 132 active+clean 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: io: 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: cluster: 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: id: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: health: HEALTH_OK 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: services: 2024-03-11T22:12:44.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-11T22:12:44.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-11T22:12:44.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:12:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:12:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:12:47.590 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: osd: 8 osds: 8 up (since 5m), api_asio: [==========] Running 12 tests from 1 test suite. 2024-03-11T22:12:47.590 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [----------] Global test environment set-up. 2024-03-11T22:12:47.590 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [----------] 12 tests from AsioRados 2024-03-11T22:12:47.590 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-03-11T22:12:47.590 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-03-11T22:12:47.590 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (1 ms) 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1 ms) 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1 ms) 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-03-11T22:12:47.591 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1 ms) 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1 ms) 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [----------] 12 tests from AsioRados (9 ms total) 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [----------] Global test environment tear-down 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (15368 ms total) 2024-03-11T22:12:47.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_asio: [ PASSED ] 12 tests. 2024-03-11T22:12:47.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: cluster 2024-03-11T22:12:33.441085+0000 mgr.y (mgr.14601) 155 : cluster 0 pgmap v102: 196 pgs: 31 creating+peering, 132 active+clean, 33 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:12:47.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: cluster 2024-03-11T22:12:35.441929+0000 mgr.y (mgr.14601) 156 : cluster 0 pgmap v103: 196 pgs: 31 creating+peering, 132 active+clean, 33 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:12:47.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:36.685177+0000 mon.b (mon.1) 38 : audit 1 from='client.? v1:172.21.15.49:0/1552516963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:36.686014+0000 mon.b (mon.1) 39 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:36.686922+0000 mon.b (mon.1) 40 : audit 1 from='client.? v1:172.21.15.49:0/2782035195' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:36.687756+0000 mon.b (mon.1) 41 : audit 1 from='client.? v1:172.21.15.49:0/2359615327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:36.691110+0000 mon.c (mon.2) 93 : audit 1 from='client.? v1:172.21.15.49:0/53572600' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:36.691478+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:36.691700+0000 mon.c (mon.2) 95 : audit 1 from='client.? v1:172.21.15.49:0/1350172512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: cluster 2024-03-11T22:12:37.443156+0000 mgr.y (mgr.14601) 157 : cluster 0 pgmap v105: 452 pgs: 31 creating+peering, 132 active+clean, 289 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:37.723301+0000 mon.c (mon.2) 96 : audit 0 from='client.? v1:172.21.15.49:0/3354943899' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:38.515500+0000 mgr.y (mgr.14601) 158 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: cluster 2024-03-11T22:12:39.446115+0000 mgr.y (mgr.14601) 159 : cluster 0 pgmap v106: 452 pgs: 192 creating+peering, 132 active+clean, 128 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:39.759749+0000 mon.c (mon.2) 97 : audit 0 from='client.? v1:172.21.15.49:0/4024778593' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: cluster 2024-03-11T22:12:41.447305+0000 mgr.y (mgr.14601) 160 : cluster 0 pgmap v107: 452 pgs: 192 creating+peering, 132 active+clean, 128 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: cluster 2024-03-11T22:12:41.996267+0000 mon.a (mon.0) 828 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-03-11T22:12:47.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.022800+0000 mon.a (mon.0) 829 : audit 1 from='client.24679 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.023065+0000 mon.a (mon.0) 830 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.023354+0000 mon.a (mon.0) 831 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.023685+0000 mon.a (mon.0) 832 : audit 1 from='client.24691 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.023992+0000 mon.a (mon.0) 833 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.024123+0000 mon.a (mon.0) 834 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.024241+0000 mon.a (mon.0) 835 : audit 1 from='client.24704 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:47 smithi187 bash[23415]: audit 2024-03-11T22:12:42.039395+0000 mon.c (mon.2) 98 : audit 0 from='client.? v1:172.21.15.49:0/1736385925' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: cluster 2024-03-11T22:12:33.441085+0000 mgr.y (mgr.14601) 155 : cluster 0 pgmap v102: 196 pgs: 31 creating+peering, 132 active+clean, 33 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: cluster 2024-03-11T22:12:35.441929+0000 mgr.y (mgr.14601) 156 : cluster 0 pgmap v103: 196 pgs: 31 creating+peering, 132 active+clean, 33 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:36.685177+0000 mon.b (mon.1) 38 : audit 1 from='client.? v1:172.21.15.49:0/1552516963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:36.686014+0000 mon.b (mon.1) 39 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:36.686922+0000 mon.b (mon.1) 40 : audit 1 from='client.? v1:172.21.15.49:0/2782035195' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:36.687756+0000 mon.b (mon.1) 41 : audit 1 from='client.? v1:172.21.15.49:0/2359615327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:36.691110+0000 mon.c (mon.2) 93 : audit 1 from='client.? v1:172.21.15.49:0/53572600' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:36.691478+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:36.691700+0000 mon.c (mon.2) 95 : audit 1 from='client.? v1:172.21.15.49:0/1350172512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: cluster 2024-03-11T22:12:37.443156+0000 mgr.y (mgr.14601) 157 : cluster 0 pgmap v105: 452 pgs: 31 creating+peering, 132 active+clean, 289 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:37.723301+0000 mon.c (mon.2) 96 : audit 0 from='client.? v1:172.21.15.49:0/3354943899' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:38.515500+0000 mgr.y (mgr.14601) 158 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: cluster 2024-03-11T22:12:39.446115+0000 mgr.y (mgr.14601) 159 : cluster 0 pgmap v106: 452 pgs: 192 creating+peering, 132 active+clean, 128 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:39.759749+0000 mon.c (mon.2) 97 : audit 0 from='client.? v1:172.21.15.49:0/4024778593' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: cluster 2024-03-11T22:12:33.441085+0000 mgr.y (mgr.14601) 155 : cluster 0 pgmap v102: 196 pgs: 31 creating+peering, 132 active+clean, 33 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: cluster 2024-03-11T22:12:35.441929+0000 mgr.y (mgr.14601) 156 : cluster 0 pgmap v103: 196 pgs: 31 creating+peering, 132 active+clean, 33 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:36.685177+0000 mon.b (mon.1) 38 : audit 1 from='client.? v1:172.21.15.49:0/1552516963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:36.686014+0000 mon.b (mon.1) 39 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:36.686922+0000 mon.b (mon.1) 40 : audit 1 from='client.? v1:172.21.15.49:0/2782035195' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:36.687756+0000 mon.b (mon.1) 41 : audit 1 from='client.? v1:172.21.15.49:0/2359615327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:36.691110+0000 mon.c (mon.2) 93 : audit 1 from='client.? v1:172.21.15.49:0/53572600' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:36.691478+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:36.691700+0000 mon.c (mon.2) 95 : audit 1 from='client.? v1:172.21.15.49:0/1350172512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: cluster 2024-03-11T22:12:37.443156+0000 mgr.y (mgr.14601) 157 : cluster 0 pgmap v105: 452 pgs: 31 creating+peering, 132 active+clean, 289 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:37.723301+0000 mon.c (mon.2) 96 : audit 0 from='client.? v1:172.21.15.49:0/3354943899' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:38.515500+0000 mgr.y (mgr.14601) 158 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: cluster 2024-03-11T22:12:39.446115+0000 mgr.y (mgr.14601) 159 : cluster 0 pgmap v106: 452 pgs: 192 creating+peering, 132 active+clean, 128 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:39.759749+0000 mon.c (mon.2) 97 : audit 0 from='client.? v1:172.21.15.49:0/4024778593' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: cluster 2024-03-11T22:12:41.447305+0000 mgr.y (mgr.14601) 160 : cluster 0 pgmap v107: 452 pgs: 192 creating+peering, 132 active+clean, 128 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: cluster 2024-03-11T22:12:41.996267+0000 mon.a (mon.0) 828 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-03-11T22:12:47.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.022800+0000 mon.a (mon.0) 829 : audit 1 from='client.24679 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.023065+0000 mon.a (mon.0) 830 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.023354+0000 mon.a (mon.0) 831 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.023685+0000 mon.a (mon.0) 832 : audit 1 from='client.24691 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.023992+0000 mon.a (mon.0) 833 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.024123+0000 mon.a (mon.0) 834 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.024241+0000 mon.a (mon.0) 835 : audit 1 from='client.24704 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[21434]: audit 2024-03-11T22:12:42.039395+0000 mon.c (mon.2) 98 : audit 0 from='client.? v1:172.21.15.49:0/1736385925' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: cluster 2024-03-11T22:12:41.447305+0000 mgr.y (mgr.14601) 160 : cluster 0 pgmap v107: 452 pgs: 192 creating+peering, 132 active+clean, 128 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: cluster 2024-03-11T22:12:41.996267+0000 mon.a (mon.0) 828 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.022800+0000 mon.a (mon.0) 829 : audit 1 from='client.24679 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.023065+0000 mon.a (mon.0) 830 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.023354+0000 mon.a (mon.0) 831 : audit 1 from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.023685+0000 mon.a (mon.0) 832 : audit 1 from='client.24691 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.023992+0000 mon.a (mon.0) 833 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.024123+0000 mon.a (mon.0) 834 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.024241+0000 mon.a (mon.0) 835 : audit 1 from='client.24704 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:47 smithi049 bash[28804]: audit 2024-03-11T22:12:42.039395+0000 mon.c (mon.2) 98 : audit 0 from='client.? v1:172.21.15.49:0/1736385925' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:48.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.052082+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.49:0/775279221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.054699+0000 mon.b (mon.1) 42 : audit 1 from='client.? v1:172.21.15.49:0/2691327741' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.054766+0000 mon.c (mon.2) 100 : audit 1 from='client.? v1:172.21.15.49:0/1103485206' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.055479+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.49:0/2619837524' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.055818+0000 mon.c (mon.2) 102 : audit 1 from='client.? v1:172.21.15.49:0/70346236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.056138+0000 mon.c (mon.2) 103 : audit 1 from='client.? v1:172.21.15.49:0/2612767362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.056280+0000 mon.b (mon.1) 43 : audit 1 from='client.? v1:172.21.15.49:0/1278887296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:42.056464+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.49:0/1310869716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: cluster 2024-03-11T22:12:43.452449+0000 mgr.y (mgr.14601) 161 : cluster 0 pgmap v109: 836 pgs: 488 creating+peering, 147 active+clean, 201 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:44.082285+0000 mon.c (mon.2) 105 : audit 0 from='client.? v1:172.21.15.49:0/1891927661' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: cluster 2024-03-11T22:12:45.454061+0000 mgr.y (mgr.14601) 162 : cluster 0 pgmap v110: 836 pgs: 488 creating+peering, 147 active+clean, 201 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:46.120294+0000 mon.c (mon.2) 106 : audit 0 from='client.? v1:172.21.15.49:0/4208594136' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: cluster 2024-03-11T22:12:47.322390+0000 mon.a (mon.0) 836 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: cluster 2024-03-11T22:12:47.323842+0000 mon.a (mon.0) 837 : cluster 3 Health check failed: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.338028+0000 mon.a (mon.0) 838 : audit 1 from='client.24719 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.338609+0000 mon.a (mon.0) 839 : audit 1 from='client.24829 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.339284+0000 mon.a (mon.0) 840 : audit 1 from='client.24728 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.343561+0000 mon.a (mon.0) 841 : audit 1 from='client.24746 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.344727+0000 mon.a (mon.0) 842 : audit 1 from='client.24856 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.345110+0000 mon.a (mon.0) 843 : audit 1 from='client.24752 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.388768+0000 mon.a (mon.0) 844 : audit 1 from='client.24758 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.389310+0000 mon.a (mon.0) 845 : audit 1 from='client.24770 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.393982+0000 mon.a (mon.0) 846 : audit 1 from='client.24679 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.394205+0000 mon.a (mon.0) 847 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.394371+0000 mon.a (mon.0) 848 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.394506+0000 mon.a (mon.0) 849 : audit 1 from='client.24691 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.394694+0000 mon.a (mon.0) 850 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.394870+0000 mon.a (mon.0) 851 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.394992+0000 mon.a (mon.0) 852 : audit 1 from='client.24704 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.395133+0000 mon.a (mon.0) 853 : audit 1 from='client.? v1:172.21.15.49:0/1270484929' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi049-64063-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.395540+0000 mon.a (mon.0) 854 : audit 1 from='client.24676 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.395780+0000 mon.a (mon.0) 855 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.405808+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.413449+0000 mon.c (mon.2) 108 : audit 1 from='client.? v1:172.21.15.49:0/4093183574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.413836+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.49:0/4077978089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.414188+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.49:0/1623479321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:47.424567+0000 mon.b (mon.1) 44 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:48.158182+0000 mon.c (mon.2) 111 : audit 0 from='client.? v1:172.21.15.49:0/215576077' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: cluster 2024-03-11T22:12:48.339521+0000 mon.a (mon.0) 856 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-03-11T22:12:49.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:48.342092+0000 mon.a (mon.0) 857 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:12:49.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:48 smithi187 bash[23415]: audit 2024-03-11T22:12:48.342679+0000 mon.a (mon.0) 858 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:49.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.052082+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.49:0/775279221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.054699+0000 mon.b (mon.1) 42 : audit 1 from='client.? v1:172.21.15.49:0/2691327741' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.054766+0000 mon.c (mon.2) 100 : audit 1 from='client.? v1:172.21.15.49:0/1103485206' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.055479+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.49:0/2619837524' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.055818+0000 mon.c (mon.2) 102 : audit 1 from='client.? v1:172.21.15.49:0/70346236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.056138+0000 mon.c (mon.2) 103 : audit 1 from='client.? v1:172.21.15.49:0/2612767362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.056280+0000 mon.b (mon.1) 43 : audit 1 from='client.? v1:172.21.15.49:0/1278887296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:42.056464+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.49:0/1310869716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: cluster 2024-03-11T22:12:43.452449+0000 mgr.y (mgr.14601) 161 : cluster 0 pgmap v109: 836 pgs: 488 creating+peering, 147 active+clean, 201 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:44.082285+0000 mon.c (mon.2) 105 : audit 0 from='client.? v1:172.21.15.49:0/1891927661' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: cluster 2024-03-11T22:12:45.454061+0000 mgr.y (mgr.14601) 162 : cluster 0 pgmap v110: 836 pgs: 488 creating+peering, 147 active+clean, 201 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:12:49.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:46.120294+0000 mon.c (mon.2) 106 : audit 0 from='client.? v1:172.21.15.49:0/4208594136' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: cluster 2024-03-11T22:12:47.322390+0000 mon.a (mon.0) 836 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: cluster 2024-03-11T22:12:47.323842+0000 mon.a (mon.0) 837 : cluster 3 Health check failed: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.338028+0000 mon.a (mon.0) 838 : audit 1 from='client.24719 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.338609+0000 mon.a (mon.0) 839 : audit 1 from='client.24829 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.339284+0000 mon.a (mon.0) 840 : audit 1 from='client.24728 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.343561+0000 mon.a (mon.0) 841 : audit 1 from='client.24746 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.344727+0000 mon.a (mon.0) 842 : audit 1 from='client.24856 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.345110+0000 mon.a (mon.0) 843 : audit 1 from='client.24752 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.388768+0000 mon.a (mon.0) 844 : audit 1 from='client.24758 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.389310+0000 mon.a (mon.0) 845 : audit 1 from='client.24770 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.393982+0000 mon.a (mon.0) 846 : audit 1 from='client.24679 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.394205+0000 mon.a (mon.0) 847 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.394371+0000 mon.a (mon.0) 848 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.394506+0000 mon.a (mon.0) 849 : audit 1 from='client.24691 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.394694+0000 mon.a (mon.0) 850 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.394870+0000 mon.a (mon.0) 851 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.052082+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.49:0/775279221' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.054699+0000 mon.b (mon.1) 42 : audit 1 from='client.? v1:172.21.15.49:0/2691327741' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.054766+0000 mon.c (mon.2) 100 : audit 1 from='client.? v1:172.21.15.49:0/1103485206' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.055479+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.49:0/2619837524' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.055818+0000 mon.c (mon.2) 102 : audit 1 from='client.? v1:172.21.15.49:0/70346236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.056138+0000 mon.c (mon.2) 103 : audit 1 from='client.? v1:172.21.15.49:0/2612767362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.056280+0000 mon.b (mon.1) 43 : audit 1 from='client.? v1:172.21.15.49:0/1278887296' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:42.056464+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.49:0/1310869716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: cluster 2024-03-11T22:12:43.452449+0000 mgr.y (mgr.14601) 161 : cluster 0 pgmap v109: 836 pgs: 488 creating+peering, 147 active+clean, 201 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:44.082285+0000 mon.c (mon.2) 105 : audit 0 from='client.? v1:172.21.15.49:0/1891927661' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: cluster 2024-03-11T22:12:45.454061+0000 mgr.y (mgr.14601) 162 : cluster 0 pgmap v110: 836 pgs: 488 creating+peering, 147 active+clean, 201 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:46.120294+0000 mon.c (mon.2) 106 : audit 0 from='client.? v1:172.21.15.49:0/4208594136' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: cluster 2024-03-11T22:12:47.322390+0000 mon.a (mon.0) 836 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: cluster 2024-03-11T22:12:47.323842+0000 mon.a (mon.0) 837 : cluster 3 Health check failed: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:49.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.394992+0000 mon.a (mon.0) 852 : audit 1 from='client.24704 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.395133+0000 mon.a (mon.0) 853 : audit 1 from='client.? v1:172.21.15.49:0/1270484929' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi049-64063-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.395540+0000 mon.a (mon.0) 854 : audit 1 from='client.24676 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.395780+0000 mon.a (mon.0) 855 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.405808+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.413449+0000 mon.c (mon.2) 108 : audit 1 from='client.? v1:172.21.15.49:0/4093183574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.413836+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.49:0/4077978089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.414188+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.49:0/1623479321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:47.424567+0000 mon.b (mon.1) 44 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:48.158182+0000 mon.c (mon.2) 111 : audit 0 from='client.? v1:172.21.15.49:0/215576077' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: cluster 2024-03-11T22:12:48.339521+0000 mon.a (mon.0) 856 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:48.342092+0000 mon.a (mon.0) 857 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:12:49.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[28804]: audit 2024-03-11T22:12:48.342679+0000 mon.a (mon.0) 858 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.338028+0000 mon.a (mon.0) 838 : audit 1 from='client.24719 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.338609+0000 mon.a (mon.0) 839 : audit 1 from='client.24829 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.339284+0000 mon.a (mon.0) 840 : audit 1 from='client.24728 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.343561+0000 mon.a (mon.0) 841 : audit 1 from='client.24746 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.344727+0000 mon.a (mon.0) 842 : audit 1 from='client.24856 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.345110+0000 mon.a (mon.0) 843 : audit 1 from='client.24752 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.388768+0000 mon.a (mon.0) 844 : audit 1 from='client.24758 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.389310+0000 mon.a (mon.0) 845 : audit 1 from='client.24770 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.393982+0000 mon.a (mon.0) 846 : audit 1 from='client.24679 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi049-64071-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.394205+0000 mon.a (mon.0) 847 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.394371+0000 mon.a (mon.0) 848 : audit 1 from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi049-64247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.394506+0000 mon.a (mon.0) 849 : audit 1 from='client.24691 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi049-64079-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.394694+0000 mon.a (mon.0) 850 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi049-64109-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.394870+0000 mon.a (mon.0) 851 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi049-64092-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.394992+0000 mon.a (mon.0) 852 : audit 1 from='client.24704 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi049-64115-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.395133+0000 mon.a (mon.0) 853 : audit 1 from='client.? v1:172.21.15.49:0/1270484929' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi049-64063-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.395540+0000 mon.a (mon.0) 854 : audit 1 from='client.24676 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi049-64055-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.395780+0000 mon.a (mon.0) 855 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi049-64859-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.405808+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.413449+0000 mon.c (mon.2) 108 : audit 1 from='client.? v1:172.21.15.49:0/4093183574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.413836+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.49:0/4077978089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.414188+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.49:0/1623479321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:47.424567+0000 mon.b (mon.1) 44 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:48.158182+0000 mon.c (mon.2) 111 : audit 0 from='client.? v1:172.21.15.49:0/215576077' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-11T22:12:49.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: cluster 2024-03-11T22:12:48.339521+0000 mon.a (mon.0) 856 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-03-11T22:12:49.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:48.342092+0000 mon.a (mon.0) 857 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:12:49.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:48 smithi049 bash[21434]: audit 2024-03-11T22:12:48.342679+0000 mon.a (mon.0) 858 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:49.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-03-11T22:12:49.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] Global test environment set-up. 2024-03-11T22:12:49.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] 7 tests from LibRadosList 2024-03-11T22:12:49.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-03-11T22:12:49.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosList.ListObjects (1716 ms) 2024-03-11T22:12:49.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (42 ms) 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset foo1,foo2,foo3 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo1 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo2 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo3 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset foo1,foo4,foo5 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo4 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo5 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo1 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset foo6,foo7 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo7 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo6 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-03-11T22:12:49.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns1:foo4 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns1:foo5 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns2:foo7 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns2:foo6 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns1:foo1 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: :foo1 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: :foo2 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: :foo3 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (94 ms) 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 1 0 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 10 0 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 13 0 2024-03-11T22:12:49.462 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 7 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 14 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 0 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 15 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 11 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 5 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 8 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 6 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 3 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 4 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 12 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 9 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 2 0 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (116 ms) 2024-03-11T22:12:49.463 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: x cursor=MIN 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=1 cursor=16:02547ec2:::1:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=10 cursor=16:52ea6a34:::10:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=13 cursor=16:566253c9:::13:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=7 cursor=16:5c6b0b28:::7:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=14 cursor=16:62a1935d:::14:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=0 cursor=16:6cac518f:::0:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=15 cursor=16:863748b0:::15:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=11 cursor=16:89d3ae78:::11:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=5 cursor=16:b29083e3:::5:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=8 cursor=16:bd63b0f1:::8:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=6 cursor=16:c4fdafeb:::6:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=3 cursor=16:cfc208b3:::3:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=4 cursor=16:d83876eb:::4:head 2024-03-11T22:12:49.464 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=12 cursor=16:de5d7c5f:::12:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=9 cursor=16:e960b815:::9:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > oid=2 cursor=16:f905c69b:::2:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: FIRST> seek to MIN oid=1 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=1 cursor=16:02547ec2:::1:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:02547ec2:::1:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:02547ec2:::1:head -> 1 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=10 cursor=16:52ea6a34:::10:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:52ea6a34:::10:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:52ea6a34:::10:head -> 10 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=13 cursor=16:566253c9:::13:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:566253c9:::13:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:566253c9:::13:head -> 13 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=7 cursor=16:5c6b0b28:::7:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:5c6b0b28:::7:head 2024-03-11T22:12:49.465 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:5c6b0b28:::7:head -> 7 2024-03-11T22:12:49.544 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=14 cursor=16:62a1935d:::14:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:62a1935d:::14:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:62a1935d:::14:head -> 14 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=0 cursor=16:6cac518f:::0:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:6cac518f:::0:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:6cac518f:::0:head -> 0 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=15 cursor=16:863748b0:::15:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:863748b0:::15:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:863748b0:::15:head -> 15 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=11 cursor=16:89d3ae78:::11:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:89d3ae78:::11:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:89d3ae78:::11:head -> 11 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=5 cursor=16:b29083e3:::5:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:b29083e3:::5:head 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:b29083e3:::5:head -> 5 2024-03-11T22:12:49.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=8 cursor=16:bd63b0f1:::8:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:bd63b0f1:::8:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:bd63b0f1:::8:head -> 8 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=6 cursor=16:c4fdafeb:::6:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:c4fdafeb:::6:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:c4fdafeb:::6:head -> 6 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=3 cursor=16:cfc208b3:::3:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:cfc208b3:::3:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:cfc208b3:::3:head -> 3 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=4 cursor=16:d83876eb:::4:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:d83876eb:::4:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:d83876eb:::4:head -> 4 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=12 cursor=16:de5d7c5f:::12:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:de5d7c5f:::12:head 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:de5d7c5f:::12:head -> 12 2024-03-11T22:12:49.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=9 cursor=16:e960b815:::9:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:e960b815:::9:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:e960b815:::9:head -> 9 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : oid=2 cursor=16:f905c69b:::2:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:f905c69b:::2:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:f905c69b:::2:head -> 2 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:e960b815:::9:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:e960b815:::9:head expected=16:e960b815:::9:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:e960b815:::9:head -> 9 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=9 expected=9 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:cfc208b3:::3:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:cfc208b3:::3:head expected=16:cfc208b3:::3:head 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:cfc208b3:::3:head -> 3 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=3 expected=3 2024-03-11T22:12:49.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:d83876eb:::4:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:d83876eb:::4:head expected=16:d83876eb:::4:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:d83876eb:::4:head -> 4 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=4 expected=4 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:6cac518f:::0:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:6cac518f:::0:head expected=16:6cac518f:::0:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:6cac518f:::0:head -> 0 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=0 expected=0 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:62a1935d:::14:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:62a1935d:::14:head expected=16:62a1935d:::14:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:62a1935d:::14:head -> 14 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=14 expected=14 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:5c6b0b28:::7:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:5c6b0b28:::7:head expected=16:5c6b0b28:::7:head 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:5c6b0b28:::7:head -> 7 2024-03-11T22:12:49.548 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=7 expected=7 2024-03-11T22:12:49.549 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:566253c9:::13:head 2024-03-11T22:12:49.549 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:566253c9:::13:head expected=16:566253c9:::13:head 2024-03-11T22:12:49.549 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:566253c9:::13:head -> 13 2024-03-11T22:12:49.549 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=13 expected=13 2024-03-11T22:12:49.549 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:f905c69b:::2:head 2024-03-11T22:12:49.549 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:f905c69b:::2:head expected=16:f905c69b:::2:head 2024-03-11T22:12:49.549 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:f905c69b:::2:head -> 2 2024-03-11T22:12:49.747 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry= list_parallel: process_1_[64581]: starting. 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_1_[64581]: creating pool ceph_test_rados_list_parallel.smithi049-64567 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_1_[64581]: created object 0... 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_1_[64581]: created object 25... 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_1_[64581]: created object 49... 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_1_[64581]: finishing. 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_1_[64581]: shutting down. 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_2_[64582]: starting. 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_2_[64582]: listing objects. 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_2_[64582]: listed object 0... 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_2_[64582]: listed object 25... 2024-03-11T22:12:49.748 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_2_[64582]: saw 50 objects 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_2_[64582]: shutting down. 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_3_[65685]: starting. 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_3_[65685]: creating pool ceph_test_rados_list_parallel.smithi049-64567 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_3_[65685]: created object 0... 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_3_[65685]: created object 25... 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_3_[65685]: created object 49... 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_3_[65685]: finishing. 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_3_[65685]: shutting down. 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_4_[65686]: starting. 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_4_[65686]: listing objects. 2024-03-11T22:12:49.749 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_4_[65686]: listed object 0... 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_4_[65686]: listed object 25... 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_4_[65686]: saw 44 objects 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_4_[65686]: shutting down. 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_5_[65687]: starting. 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_5_[65687]: removed 25 objects... 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_5_[65687]: removed half of the objects 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_5_[65687]: removed 50 objects... 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_5_[65687]: removed 50 objects 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_5_[65687]: shutting down. 2024-03-11T22:12:49.750 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_6_[65735]: starting. 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_6_[65735]: creating pool ceph_test_rados_list_parallel.smithi049-64567 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_6_[65735]: created object 0... 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_6_[65735]: created object 25... 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_6_[65735]: created object 49... 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_6_[65735]: finishing. 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_6_[65735]: shutting down. 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_7_[65736]: starting. 2024-03-11T22:12:49.751 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_7_[65736]: listing objects. 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_7_[65736]: listed object 0... 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_7_[65736]: listed object 25... 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_7_[65736]: listed object 50... 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_7_[65736]: saw 56 objects 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_7_[65736]: shutting down. 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_8_[65737]: starting. 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_8_[65737]: added 25 objects... 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_8_[65737]: added half of the objects 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_8_[65737]: added 50 objects... 2024-03-11T22:12:49.752 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_8_[65737]: added 50 objects 2024-03-11T22:12:49.753 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_8_[65737]: shutting down. 2024-03-11T22:12:49.753 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.753 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: cluster 2024-03-11T22:12:47.455937+0000 mgr.y (mgr.14601) 163 : cluster 0 pgmap v112: 1220 pgs: 488 creating+peering, 147 active+clean, 585 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.525956+0000 mgr.y (mgr.14601) 164 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.805755+0000 mon.a (mon.0) 859 : audit 1 from='client.24815 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.806383+0000 mon.a (mon.0) 860 : audit 1 from='client.24818 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.806980+0000 mon.a (mon.0) 861 : audit 1 from='client.24824 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.808593+0000 mon.a (mon.0) 862 : audit 1 from='client.24719 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.808748+0000 mon.a (mon.0) 863 : audit 1 from='client.24829 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.808896+0000 mon.a (mon.0) 864 : audit 1 from='client.24728 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.809013+0000 mon.a (mon.0) 865 : audit 1 from='client.24746 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.809180+0000 mon.a (mon.0) 866 : audit 1 from='client.24856 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.809302+0000 mon.a (mon.0) 867 : audit 1 from='client.24752 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.809410+0000 mon.a (mon.0) 868 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.809569+0000 mon.a (mon.0) 869 : audit 1 from='client.24758 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.809674+0000 mon.a (mon.0) 870 : audit 1 from='client.24770 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.809789+0000 mon.a (mon.0) 871 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.814283+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:48.818298+0000 mon.b (mon.1) 45 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: cluster 2024-03-11T22:12:49.344318+0000 mon.a (mon.0) 872 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:49.352509+0000 mon.a (mon.0) 873 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:49.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:49.356908+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_9_[65783]: starting. 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_9_[65783]: creating pool ceph_test_rados_list_parallel.smithi049-64567 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_9_[65783]: created object 0... 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_9_[65783]: created object 25... 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_9_[65783]: created object 49... 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_9_[65783]: finishing. 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_9_[65783]: shutting down. 2024-03-11T22:12:50.118 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: starting. 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: listing objects. 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: listed object 0... 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: listed object 25... 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: listed object 50... 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: listed object 75... 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: saw 98 objects 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_10_[65784]: shutting down. 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_11_[65785]: starting. 2024-03-11T22:12:50.119 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_11_[65785]: added 25 objects... 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_11_[65785]: added half of the objects 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_11_[65785]: added 50 objects... 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_11_[65785]: added 50 objects 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_11_[65785]: shutting down. 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_12_[65786]: starting. 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_12_[65786]: added 25 objects... 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_12_[65786]: added half of the objects 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_12_[65786]: added 50 objects... 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_12_[65786]: added 50 objects 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_12_[65786]: shutting down. 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.120 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_13_[65787]: starting. 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_13_[65787]: removed 25 objects... 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_13_[65787]: removed half of the objects 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_13_[65787]: removed 50 objects... 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_13_[65787]: removed 50 objects 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_13_[65787]: shutting down. 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_14_[65863]: starting. 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_14_[65863]: creating pool ceph_test_rados_list_parallel.smithi049-64567 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_14_[65863]: created object 0... 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_14_[65863]: created object 25... 2024-03-11T22:12:50.121 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_14_[65863]: created object 49... 2024-03-11T22:12:50.122 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_14_[65863]: finishing. 2024-03-11T22:12:50.122 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_14_[65863]: shutting down. 2024-03-11T22:12:50.122 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.122 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.122 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.122 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:50.122 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: starting. 2024-03-11T22:12:50.123 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: listing objects. 2024-03-11T22:12:50.123 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: listed object 0... 2024-03-11T22:12:50.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:49.360226+0000 mon.c (mon.2) 113 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:50.238 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:49 smithi187 bash[23415]: audit 2024-03-11T22:12:49.683495+0000 mon.c (mon.2) 114 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:50.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: cluster 2024-03-11T22:12:47.455937+0000 mgr.y (mgr.14601) 163 : cluster 0 pgmap v112: 1220 pgs: 488 creating+peering, 147 active+clean, 585 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.525956+0000 mgr.y (mgr.14601) 164 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.805755+0000 mon.a (mon.0) 859 : audit 1 from='client.24815 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.806383+0000 mon.a (mon.0) 860 : audit 1 from='client.24818 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.806980+0000 mon.a (mon.0) 861 : audit 1 from='client.24824 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.808593+0000 mon.a (mon.0) 862 : audit 1 from='client.24719 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.808748+0000 mon.a (mon.0) 863 : audit 1 from='client.24829 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.808896+0000 mon.a (mon.0) 864 : audit 1 from='client.24728 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.809013+0000 mon.a (mon.0) 865 : audit 1 from='client.24746 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.809180+0000 mon.a (mon.0) 866 : audit 1 from='client.24856 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.809302+0000 mon.a (mon.0) 867 : audit 1 from='client.24752 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.809410+0000 mon.a (mon.0) 868 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:50.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.809569+0000 mon.a (mon.0) 869 : audit 1 from='client.24758 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.809674+0000 mon.a (mon.0) 870 : audit 1 from='client.24770 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.809789+0000 mon.a (mon.0) 871 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.814283+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:48.818298+0000 mon.b (mon.1) 45 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: cluster 2024-03-11T22:12:49.344318+0000 mon.a (mon.0) 872 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:49.352509+0000 mon.a (mon.0) 873 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:49.356908+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:49.360226+0000 mon.c (mon.2) 113 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[28804]: audit 2024-03-11T22:12:49.683495+0000 mon.c (mon.2) 114 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:50.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: cluster 2024-03-11T22:12:47.455937+0000 mgr.y (mgr.14601) 163 : cluster 0 pgmap v112: 1220 pgs: 488 creating+peering, 147 active+clean, 585 unknown; 582 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.525956+0000 mgr.y (mgr.14601) 164 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.805755+0000 mon.a (mon.0) 859 : audit 1 from='client.24815 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.806383+0000 mon.a (mon.0) 860 : audit 1 from='client.24818 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.806980+0000 mon.a (mon.0) 861 : audit 1 from='client.24824 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.808593+0000 mon.a (mon.0) 862 : audit 1 from='client.24719 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.808748+0000 mon.a (mon.0) 863 : audit 1 from='client.24829 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64437-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.808896+0000 mon.a (mon.0) 864 : audit 1 from='client.24728 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi049-64261-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.809013+0000 mon.a (mon.0) 865 : audit 1 from='client.24746 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi049-64272-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.809180+0000 mon.a (mon.0) 866 : audit 1 from='client.24856 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64422-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.809302+0000 mon.a (mon.0) 867 : audit 1 from='client.24752 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi049-64290-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.809410+0000 mon.a (mon.0) 868 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi049-64825-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.809569+0000 mon.a (mon.0) 869 : audit 1 from='client.24758 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi049-64334-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.809674+0000 mon.a (mon.0) 870 : audit 1 from='client.24770 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi049-64379-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:50.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.809789+0000 mon.a (mon.0) 871 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:50.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.814283+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:50.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:48.818298+0000 mon.b (mon.1) 45 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:50.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: cluster 2024-03-11T22:12:49.344318+0000 mon.a (mon.0) 872 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-03-11T22:12:50.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:49.352509+0000 mon.a (mon.0) 873 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:50.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:49.356908+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:12:50.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:49.360226+0000 mon.c (mon.2) 113 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:12:50.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:49 smithi049 bash[21434]: audit 2024-03-11T22:12:49.683495+0000 mon.c (mon.2) 114 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: listed object 25... 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: listed object 50... 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: listed object 75... 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: listed object 100... 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: listed object 125... 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: saw 150 objects 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_15_[65864]: shutting down. 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.295 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_16_[65865]: starting. 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_16_[65865]: added 25 objects... 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_16_[65865]: added half of the objects 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_16_[65865]: added 50 objects... 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_16_[65865]: added 50 objects 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: process_16_[65865]: shutting down. 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******************************* 2024-03-11T22:12:51.296 INFO:tasks.workunit.client.0.smithi049.stdout: list_parallel: ******* SUCCESS ********** 2024-03-11T22:12:51.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: cluster 2024-03-11T22:12:49.462085+0000 mgr.y (mgr.14601) 165 : cluster 0 pgmap v114: 1252 pgs: 619 creating+peering, 362 active+clean, 271 unknown; 583 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-11T22:12:51.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: audit 2024-03-11T22:12:49.885461+0000 mon.a (mon.0) 875 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:12:51.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: audit 2024-03-11T22:12:49.885579+0000 mon.a (mon.0) 876 : audit 1 from='client.24815 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: audit 2024-03-11T22:12:49.885654+0000 mon.a (mon.0) 877 : audit 1 from='client.24818 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: audit 2024-03-11T22:12:49.885728+0000 mon.a (mon.0) 878 : audit 1 from='client.24824 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: audit 2024-03-11T22:12:50.387359+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.49:0/3835434724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:51.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: audit 2024-03-11T22:12:50.685838+0000 mon.c (mon.2) 116 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:51.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: cluster 2024-03-11T22:12:50.828809+0000 mon.a (mon.0) 879 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-03-11T22:12:51.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:51 smithi187 bash[23415]: audit 2024-03-11T22:12:50.831894+0000 mon.a (mon.0) 880 : audit 1 from='client.25100 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:51.766 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: cluster 2024-03-11T22:12:49.462085+0000 mgr.y (mgr.14601) 165 : cluster 0 pgmap v114: 1252 pgs: 619 creating+peering, 362 active+clean, 271 unknown; 583 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: audit 2024-03-11T22:12:49.885461+0000 mon.a (mon.0) 875 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: audit 2024-03-11T22:12:49.885579+0000 mon.a (mon.0) 876 : audit 1 from='client.24815 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: audit 2024-03-11T22:12:49.885654+0000 mon.a (mon.0) 877 : audit 1 from='client.24818 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: audit 2024-03-11T22:12:49.885728+0000 mon.a (mon.0) 878 : audit 1 from='client.24824 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: audit 2024-03-11T22:12:50.387359+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.49:0/3835434724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: audit 2024-03-11T22:12:50.685838+0000 mon.c (mon.2) 116 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: cluster 2024-03-11T22:12:50.828809+0000 mon.a (mon.0) 879 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[28804]: audit 2024-03-11T22:12:50.831894+0000 mon.a (mon.0) 880 : audit 1 from='client.25100 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: cluster 2024-03-11T22:12:49.462085+0000 mgr.y (mgr.14601) 165 : cluster 0 pgmap v114: 1252 pgs: 619 creating+peering, 362 active+clean, 271 unknown; 583 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-11T22:12:51.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: audit 2024-03-11T22:12:49.885461+0000 mon.a (mon.0) 875 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi049-64859-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:12:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: audit 2024-03-11T22:12:49.885579+0000 mon.a (mon.0) 876 : audit 1 from='client.24815 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: audit 2024-03-11T22:12:49.885654+0000 mon.a (mon.0) 877 : audit 1 from='client.24818 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: audit 2024-03-11T22:12:49.885728+0000 mon.a (mon.0) 878 : audit 1 from='client.24824 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi049-64520-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: audit 2024-03-11T22:12:50.387359+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.49:0/3835434724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: audit 2024-03-11T22:12:50.685838+0000 mon.c (mon.2) 116 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: cluster 2024-03-11T22:12:50.828809+0000 mon.a (mon.0) 879 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-03-11T22:12:51.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:51 smithi049 bash[21434]: audit 2024-03-11T22:12:50.831894+0000 mon.a (mon.0) 880 : audit 1 from='client.25100 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.288621+0000 mon.a (mon.0) 881 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.288727+0000 mon.a (mon.0) 882 : audit 1 from='client.25100 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.299857+0000 mon.c (mon.2) 117 : audit 1 from='client.? v1:172.21.15.49:0/670959379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.303281+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.344230+0000 mon.b (mon.1) 46 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.347638+0000 mon.b (mon.1) 47 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.385965+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: cluster 2024-03-11T22:12:51.463148+0000 mgr.y (mgr.14601) 166 : cluster 0 pgmap v117: 1108 pgs: 466 creating+peering, 303 active+clean, 339 unknown; 583 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.687305+0000 mon.c (mon.2) 120 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: cluster 2024-03-11T22:12:51.783061+0000 mon.a (mon.0) 883 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.785533+0000 mon.a (mon.0) 884 : audit 1 from='client.25196 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.786498+0000 mon.a (mon.0) 885 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.790272+0000 mon.a (mon.0) 886 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.791215+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.806460+0000 mon.a (mon.0) 887 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.807493+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.808772+0000 mon.a (mon.0) 888 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:53.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:52 smithi187 bash[23415]: audit 2024-03-11T22:12:51.831996+0000 mon.a (mon.0) 889 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:53.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.288621+0000 mon.a (mon.0) 881 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:53.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.288727+0000 mon.a (mon.0) 882 : audit 1 from='client.25100 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:53.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.299857+0000 mon.c (mon.2) 117 : audit 1 from='client.? v1:172.21.15.49:0/670959379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.303281+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.344230+0000 mon.b (mon.1) 46 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.347638+0000 mon.b (mon.1) 47 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.385965+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: cluster 2024-03-11T22:12:51.463148+0000 mgr.y (mgr.14601) 166 : cluster 0 pgmap v117: 1108 pgs: 466 creating+peering, 303 active+clean, 339 unknown; 583 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.687305+0000 mon.c (mon.2) 120 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: cluster 2024-03-11T22:12:51.783061+0000 mon.a (mon.0) 883 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.785533+0000 mon.a (mon.0) 884 : audit 1 from='client.25196 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.786498+0000 mon.a (mon.0) 885 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.790272+0000 mon.a (mon.0) 886 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.791215+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.288621+0000 mon.a (mon.0) 881 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi049-64825-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:53.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.288727+0000 mon.a (mon.0) 882 : audit 1 from='client.25100 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi049-64055-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.299857+0000 mon.c (mon.2) 117 : audit 1 from='client.? v1:172.21.15.49:0/670959379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.303281+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.344230+0000 mon.b (mon.1) 46 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.347638+0000 mon.b (mon.1) 47 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.385965+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: cluster 2024-03-11T22:12:51.463148+0000 mgr.y (mgr.14601) 166 : cluster 0 pgmap v117: 1108 pgs: 466 creating+peering, 303 active+clean, 339 unknown; 583 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.687305+0000 mon.c (mon.2) 120 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: cluster 2024-03-11T22:12:51.783061+0000 mon.a (mon.0) 883 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.785533+0000 mon.a (mon.0) 884 : audit 1 from='client.25196 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.786498+0000 mon.a (mon.0) 885 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.790272+0000 mon.a (mon.0) 886 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.791215+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.806460+0000 mon.a (mon.0) 887 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.807493+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:53.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.808772+0000 mon.a (mon.0) 888 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:53.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[28804]: audit 2024-03-11T22:12:51.831996+0000 mon.a (mon.0) 889 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:53.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.806460+0000 mon.a (mon.0) 887 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:53.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.807493+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:53.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.808772+0000 mon.a (mon.0) 888 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:53.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:52 smithi049 bash[21434]: audit 2024-03-11T22:12:51.831996+0000 mon.a (mon.0) 889 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:12:54.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.302047+0000 mon.a (mon.0) 890 : audit 1 from='client.25196 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.302286+0000 mon.a (mon.0) 891 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.302500+0000 mon.a (mon.0) 892 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.310402+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.318650+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.320270+0000 mon.c (mon.2) 125 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.377879+0000 mon.c (mon.2) 126 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.431989+0000 mon.b (mon.1) 48 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.437587+0000 mon.b (mon.1) 49 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.438847+0000 mon.b (mon.1) 50 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.441890+0000 mon.b (mon.1) 51 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.442673+0000 mon.b (mon.1) 52 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.444152+0000 mon.b (mon.1) 53 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.445039+0000 mon.b (mon.1) 54 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:12:54.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.447656+0000 mon.b (mon.1) 55 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.450731+0000 mon.b (mon.1) 56 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.452255+0000 mon.b (mon.1) 57 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.689265+0000 mon.c (mon.2) 127 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.817287+0000 mon.a (mon.0) 893 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.819134+0000 mon.a (mon.0) 894 : cluster 3 Health check update: 19 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.831665+0000 mon.a (mon.0) 895 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.841010+0000 mon.a (mon.0) 896 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:52.842095+0000 mon.a (mon.0) 897 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:53.690999+0000 mon.c (mon.2) 128 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:54 smithi187 bash[23415]: audit 2024-03-11T22:12:53.745202+0000 mon.a (mon.0) 898 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:54.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:12:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:12:54.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.302047+0000 mon.a (mon.0) 890 : audit 1 from='client.25196 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:54.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.302286+0000 mon.a (mon.0) 891 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:54.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.302500+0000 mon.a (mon.0) 892 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:54.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.310402+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:54.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.318650+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:54.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.320270+0000 mon.c (mon.2) 125 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:54.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.377879+0000 mon.c (mon.2) 126 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.431989+0000 mon.b (mon.1) 48 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.437587+0000 mon.b (mon.1) 49 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.438847+0000 mon.b (mon.1) 50 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.441890+0000 mon.b (mon.1) 51 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.442673+0000 mon.b (mon.1) 52 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.444152+0000 mon.b (mon.1) 53 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.445039+0000 mon.b (mon.1) 54 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.447656+0000 mon.b (mon.1) 55 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:12:54.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.302047+0000 mon.a (mon.0) 890 : audit 1 from='client.25196 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.302286+0000 mon.a (mon.0) 891 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.302500+0000 mon.a (mon.0) 892 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.310402+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.318650+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.320270+0000 mon.c (mon.2) 125 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.377879+0000 mon.c (mon.2) 126 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.431989+0000 mon.b (mon.1) 48 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.437587+0000 mon.b (mon.1) 49 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:12:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.438847+0000 mon.b (mon.1) 50 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.441890+0000 mon.b (mon.1) 51 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.442673+0000 mon.b (mon.1) 52 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.444152+0000 mon.b (mon.1) 53 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.445039+0000 mon.b (mon.1) 54 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.447656+0000 mon.b (mon.1) 55 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.450731+0000 mon.b (mon.1) 56 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.452255+0000 mon.b (mon.1) 57 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.689265+0000 mon.c (mon.2) 127 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.817287+0000 mon.a (mon.0) 893 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.819134+0000 mon.a (mon.0) 894 : cluster 3 Health check update: 19 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.831665+0000 mon.a (mon.0) 895 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.841010+0000 mon.a (mon.0) 896 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:52.842095+0000 mon.a (mon.0) 897 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:53.690999+0000 mon.c (mon.2) 128 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[28804]: audit 2024-03-11T22:12:53.745202+0000 mon.a (mon.0) 898 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.450731+0000 mon.b (mon.1) 56 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.452255+0000 mon.b (mon.1) 57 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.689265+0000 mon.c (mon.2) 127 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.817287+0000 mon.a (mon.0) 893 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-03-11T22:12:54.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.819134+0000 mon.a (mon.0) 894 : cluster 3 Health check update: 19 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.831665+0000 mon.a (mon.0) 895 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:12:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.841010+0000 mon.a (mon.0) 896 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:52.842095+0000 mon.a (mon.0) 897 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:53.690999+0000 mon.c (mon.2) 128 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:54 smithi049 bash[21434]: audit 2024-03-11T22:12:53.745202+0000 mon.a (mon.0) 898 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:55.133 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: Running main() from gmock_main.cc 2024-03-11T22:12:55.133 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-03-11T22:12:55.133 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [----------] Global test environment set-up. 2024-03-11T22:12:55.133 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-03-11T22:12:55.133 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (22612 ms) 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [----------] 1 test from neocls_handler_error (22612 ms total) 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [----------] Global test environment tear-down 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [==========] 1 test from 1 test suite ran. (22612 ms total) 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: handler_error: [ PASSED ] 1 test. 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (132 ms) 2024-03-11T22:12:55.134 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (2449 ms) 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (21 ms) 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (15 ms) 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (7 ms) 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (4 ms) 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (4 ms) 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (4 ms) 2024-03-11T22:12:55.135 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (3 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (3 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (4 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (3 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (9 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (11 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (6 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (3 ms) 2024-03-11T22:12:55.136 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (2678 ms total) 2024-03-11T22:12:55.137 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: 2024-03-11T22:12:55.137 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-03-11T22:12:55.137 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (22740 ms total) 2024-03-11T22:12:55.137 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-03-11T22:12:55.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (22729 ms) 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (22729 ms total) 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (22730 ms total) 2024-03-11T22:12:55.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (49 ms) 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (53 ms) 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-03-11T22:12:56.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (24098 ms) 2024-03-11T22:12:56.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (24200 ms total) 2024-03-11T22:12:56.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: 2024-03-11T22:12:56.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-03-11T22:12:56.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (24200 ms total) 2024-03-11T22:12:56.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-03-11T22:12:56.641 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: Running main() from gmock_main.cc 2024-03-11T22:12:56.641 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-03-11T22:12:56.641 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [----------] Global test environment set-up. 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (76 ms) 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (110 ms) 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (24027 ms) 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:53.747473+0000 mon.a [INF] from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:53.747801+0000 mon.a [INF] from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:53.748059+0000 mon.a [INF] from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:53.764203+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.221161+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.642 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.221974+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.643 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.222392+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/814097020' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.643 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.249367+0000 mon.a [INF] from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.643 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.680633+0000 mon.a [INF] from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.643 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.681761+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:56.643 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.681908+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.643 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:54.682737+0000 mon.a [INF] from='client.25226 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.437840+0000 mgr.y (mgr.14601) 167 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.443457+0000 mgr.y (mgr.14601) 168 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.444661+0000 mgr.y (mgr.14601) 169 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.447704+0000 mgr.y (mgr.14601) 170 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.448440+0000 mgr.y (mgr.14601) 171 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.450140+0000 mgr.y (mgr.14601) 172 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.450888+0000 mgr.y (mgr.14601) 173 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.453464+0000 mgr.y (mgr.14601) 174 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.456525+0000 mgr.y (mgr.14601) 175 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:12:56.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:52.458620+0000 mgr.y (mgr.14601) 176 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.278292+0000 osd.0 (osd.0) 3 : cluster 0 13.3 deep-scrub starts 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.326688+0000 osd.0 (osd.0) 4 : cluster 0 13.3 deep-scrub ok 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.461588+0000 osd.2 (osd.2) 3 : cluster 0 13.8 deep-scrub starts 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.465569+0000 osd.2 (osd.2) 4 : cluster 0 13.8 deep-scrub ok 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.471394+0000 mgr.y (mgr.14601) 177 : cluster 0 pgmap v119: 1100 pgs: 168 creating+peering, 932 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 32 MiB/s wr, 537 op/s 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:53.747473+0000 mon.a (mon.0) 899 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:53.747801+0000 mon.a (mon.0) 900 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:53.748059+0000 mon.a (mon.0) 901 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.437840+0000 mgr.y (mgr.14601) 167 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.443457+0000 mgr.y (mgr.14601) 168 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.444661+0000 mgr.y (mgr.14601) 169 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.447704+0000 mgr.y (mgr.14601) 170 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.448440+0000 mgr.y (mgr.14601) 171 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.450140+0000 mgr.y (mgr.14601) 172 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.450888+0000 mgr.y (mgr.14601) 173 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.453464+0000 mgr.y (mgr.14601) 174 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.456525+0000 mgr.y (mgr.14601) 175 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:52.458620+0000 mgr.y (mgr.14601) 176 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.278292+0000 osd.0 (osd.0) 3 : cluster 0 13.3 deep-scrub starts 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.326688+0000 osd.0 (osd.0) 4 : cluster 0 13.3 deep-scrub ok 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.461588+0000 osd.2 (osd.2) 3 : cluster 0 13.8 deep-scrub starts 2024-03-11T22:12:56.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.465569+0000 osd.2 (osd.2) 4 : cluster 0 13.8 deep-scrub ok 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.471394+0000 mgr.y (mgr.14601) 177 : cluster 0 pgmap v119: 1100 pgs: 168 creating+peering, 932 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 32 MiB/s wr, 537 op/s 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:53.747473+0000 mon.a (mon.0) 899 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:53.747801+0000 mon.a (mon.0) 900 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:53.748059+0000 mon.a (mon.0) 901 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:53.764203+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: cluster 2024-03-11T22:12:54.220400+0000 mon.a (mon.0) 902 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.221161+0000 mon.c (mon.2) 130 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.221974+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.222392+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.49:0/814097020' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.249367+0000 mon.a (mon.0) 903 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.680633+0000 mon.a (mon.0) 904 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.681761+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.681908+0000 mon.a (mon.0) 905 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.682737+0000 mon.a (mon.0) 906 : audit 1 from='client.25226 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:54.692394+0000 mon.c (mon.2) 134 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.113623+0000 mon.a (mon.0) 907 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.115518+0000 mon.a (mon.0) 908 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.115800+0000 mon.a (mon.0) 909 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.115999+0000 mon.a (mon.0) 910 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.116191+0000 mon.a (mon.0) 911 : audit 1 from='client.25226 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: cluster 2024-03-11T22:12:55.128952+0000 mon.a (mon.0) 912 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.132750+0000 mon.c (mon.2) 135 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.133610+0000 mon.c (mon.2) 136 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.136758+0000 mon.a (mon.0) 913 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.137095+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.49:0/1534179747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.137159+0000 mon.a (mon.0) 914 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[28804]: audit 2024-03-11T22:12:55.140352+0000 mon.a (mon.0) 915 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:53.764203+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: cluster 2024-03-11T22:12:54.220400+0000 mon.a (mon.0) 902 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.221161+0000 mon.c (mon.2) 130 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.221974+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.222392+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.49:0/814097020' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.249367+0000 mon.a (mon.0) 903 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.680633+0000 mon.a (mon.0) 904 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.681761+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.681908+0000 mon.a (mon.0) 905 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.682737+0000 mon.a (mon.0) 906 : audit 1 from='client.25226 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:54.692394+0000 mon.c (mon.2) 134 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.113623+0000 mon.a (mon.0) 907 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.115518+0000 mon.a (mon.0) 908 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.115800+0000 mon.a (mon.0) 909 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.115999+0000 mon.a (mon.0) 910 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.116191+0000 mon.a (mon.0) 911 : audit 1 from='client.25226 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: cluster 2024-03-11T22:12:55.128952+0000 mon.a (mon.0) 912 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.132750+0000 mon.c (mon.2) 135 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.133610+0000 mon.c (mon.2) 136 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.136758+0000 mon.a (mon.0) 913 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.137095+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.49:0/1534179747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.137159+0000 mon.a (mon.0) 914 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:56 smithi049 bash[21434]: audit 2024-03-11T22:12:55.140352+0000 mon.a (mon.0) 915 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.437840+0000 mgr.y (mgr.14601) 167 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:12:56.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.443457+0000 mgr.y (mgr.14601) 168 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:12:56.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.444661+0000 mgr.y (mgr.14601) 169 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:12:56.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.447704+0000 mgr.y (mgr.14601) 170 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:12:56.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.448440+0000 mgr.y (mgr.14601) 171 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:12:56.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.450140+0000 mgr.y (mgr.14601) 172 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.450888+0000 mgr.y (mgr.14601) 173 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.453464+0000 mgr.y (mgr.14601) 174 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.456525+0000 mgr.y (mgr.14601) 175 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:52.458620+0000 mgr.y (mgr.14601) 176 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.278292+0000 osd.0 (osd.0) 3 : cluster 0 13.3 deep-scrub starts 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.326688+0000 osd.0 (osd.0) 4 : cluster 0 13.3 deep-scrub ok 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.461588+0000 osd.2 (osd.2) 3 : cluster 0 13.8 deep-scrub starts 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.465569+0000 osd.2 (osd.2) 4 : cluster 0 13.8 deep-scrub ok 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.471394+0000 mgr.y (mgr.14601) 177 : cluster 0 pgmap v119: 1100 pgs: 168 creating+peering, 932 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 32 MiB/s wr, 537 op/s 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:53.747473+0000 mon.a (mon.0) 899 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi049-64412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:53.747801+0000 mon.a (mon.0) 900 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:53.748059+0000 mon.a (mon.0) 901 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:53.764203+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.49:0/2747905225' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: cluster 2024-03-11T22:12:54.220400+0000 mon.a (mon.0) 902 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.221161+0000 mon.c (mon.2) 130 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.221974+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.222392+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.49:0/814097020' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.249367+0000 mon.a (mon.0) 903 : audit 1 from='client.24899 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]: dispatch 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.680633+0000 mon.a (mon.0) 904 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.681761+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.681908+0000 mon.a (mon.0) 905 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.682737+0000 mon.a (mon.0) 906 : audit 1 from='client.25226 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:54.692394+0000 mon.c (mon.2) 134 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.113623+0000 mon.a (mon.0) 907 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.115518+0000 mon.a (mon.0) 908 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.115800+0000 mon.a (mon.0) 909 : audit 1 from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.115999+0000 mon.a (mon.0) 910 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.116191+0000 mon.a (mon.0) 911 : audit 1 from='client.25226 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: cluster 2024-03-11T22:12:55.128952+0000 mon.a (mon.0) 912 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.132750+0000 mon.c (mon.2) 135 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.133610+0000 mon.c (mon.2) 136 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.136758+0000 mon.a (mon.0) 913 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.137095+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.49:0/1534179747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.137159+0000 mon.a (mon.0) 914 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:56.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:56 smithi187 bash[23415]: audit 2024-03-11T22:12:55.140352+0000 mon.a (mon.0) 915 : audit 1 from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.113623+0000 mon.a [INF] from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.115518+0000 mon.a [INF] from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi049-64109-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.115800+0000 mon.a [INF] from='client.24899 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi049-64825-1"}]': finished 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.115999+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.116191+0000 mon.a [INF] from='client.25226 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.132750+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.133610+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.136758+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.137095+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/1534179747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:57.926 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.137159+0000 mon.a [INF] from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:57.927 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.140352+0000 mon.a [INF] from='client.25238 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:57.927 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.209438+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:57.927 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:55.648103+0000 mon.a [INF] from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:57.927 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.547170+0000 mon.a [INF] from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:57.927 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.547333+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:58.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:55.209438+0000 mon.c (mon.2) 138 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: cluster 2024-03-11T22:12:55.472818+0000 mgr.y (mgr.14601) 178 : cluster 0 pgmap v122: 988 pgs: 144 unknown, 118 creating+peering, 726 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 556 op/s 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:55.648103+0000 mon.a (mon.0) 916 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:55.693619+0000 mon.c (mon.2) 139 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.547170+0000 mon.a (mon.0) 917 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.547333+0000 mon.a (mon.0) 918 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.547449+0000 mon.a (mon.0) 919 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.547556+0000 mon.a (mon.0) 920 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.547681+0000 mon.a (mon.0) 921 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.554286+0000 mon.c (mon.2) 140 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.554778+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.555405+0000 mon.c (mon.2) 142 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.557681+0000 mon.c (mon.2) 143 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:58.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.628704+0000 mon.b (mon.1) 58 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.650301+0000 mon.c (mon.2) 144 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.686894+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:56.699703+0000 mon.c (mon.2) 146 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: cluster 2024-03-11T22:12:57.471225+0000 mon.a (mon.0) 922 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:57.477605+0000 mon.a (mon.0) 923 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:57.480622+0000 mon.a (mon.0) 924 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:57.481343+0000 mon.a (mon.0) 925 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:58.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:57 smithi187 bash[23415]: audit 2024-03-11T22:12:57.482302+0000 mon.a (mon.0) 926 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:55.209438+0000 mon.c (mon.2) 138 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: cluster 2024-03-11T22:12:55.472818+0000 mgr.y (mgr.14601) 178 : cluster 0 pgmap v122: 988 pgs: 144 unknown, 118 creating+peering, 726 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 556 op/s 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:55.648103+0000 mon.a (mon.0) 916 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:55.693619+0000 mon.c (mon.2) 139 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.547170+0000 mon.a (mon.0) 917 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.547333+0000 mon.a (mon.0) 918 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.547449+0000 mon.a (mon.0) 919 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.547556+0000 mon.a (mon.0) 920 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.547681+0000 mon.a (mon.0) 921 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:58.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.554286+0000 mon.c (mon.2) 140 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.554778+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.555405+0000 mon.c (mon.2) 142 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.557681+0000 mon.c (mon.2) 143 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:55.209438+0000 mon.c (mon.2) 138 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: cluster 2024-03-11T22:12:55.472818+0000 mgr.y (mgr.14601) 178 : cluster 0 pgmap v122: 988 pgs: 144 unknown, 118 creating+peering, 726 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 556 op/s 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:55.648103+0000 mon.a (mon.0) 916 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:55.693619+0000 mon.c (mon.2) 139 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.547170+0000 mon.a (mon.0) 917 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi049-64115-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.547333+0000 mon.a (mon.0) 918 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:58.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.547449+0000 mon.a (mon.0) 919 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.547556+0000 mon.a (mon.0) 920 : audit 1 from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.547681+0000 mon.a (mon.0) 921 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.554286+0000 mon.c (mon.2) 140 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.554778+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.555405+0000 mon.c (mon.2) 142 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.557681+0000 mon.c (mon.2) 143 : audit 1 from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.628704+0000 mon.b (mon.1) 58 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.650301+0000 mon.c (mon.2) 144 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.686894+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:58.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:56.699703+0000 mon.c (mon.2) 146 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: cluster 2024-03-11T22:12:57.471225+0000 mon.a (mon.0) 922 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:57.477605+0000 mon.a (mon.0) 923 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:57.480622+0000 mon.a (mon.0) 924 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:57.481343+0000 mon.a (mon.0) 925 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[28804]: audit 2024-03-11T22:12:57.482302+0000 mon.a (mon.0) 926 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.628704+0000 mon.b (mon.1) 58 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.650301+0000 mon.c (mon.2) 144 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.686894+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:56.699703+0000 mon.c (mon.2) 146 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: cluster 2024-03-11T22:12:57.471225+0000 mon.a (mon.0) 922 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-03-11T22:12:58.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:57.477605+0000 mon.a (mon.0) 923 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:58.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:57.480622+0000 mon.a (mon.0) 924 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:58.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:57.481343+0000 mon.a (mon.0) 925 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:58.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:57 smithi049 bash[21434]: audit 2024-03-11T22:12:57.482302+0000 mon.a (mon.0) 926 : audit 1 from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:58.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:12:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:12:59.350 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.547449+0000 mon.a [INF] from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi049-64063-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:59.350 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.547556+0000 mon.a [INF] from='client.25238 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:12:59.350 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.547681+0000 mon.a [INF] from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi049-64825-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:12:59.350 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.554286+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.554778+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.555405+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.557681+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2377146869' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.628704+0000 mon.b [INF] from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.650301+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.686894+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.477605+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.480622+0000 mon.a [INF] from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.481343+0000 mon.a [INF] from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.482302+0000 mon.a [INF] from='client.25202 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:56.650866+0000 client.admin [INF] onexx 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.931783+0000 mon.a [WRN] Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:59.351 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.943692+0000 mon.a [INF] from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.944089+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.947429+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.947543+0000 mon.a [INF] from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]': finished 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.959935+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:57.960449+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.862329+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.870098+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.870815+0000 mon.a [INF] from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.873338+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.878307+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.882174+0000 mon.b [INF] from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.882189+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.882766+0000 mon.b [INF] from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.882974+0000 mon.a [INF] from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.352 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.883499+0000 mon.a [INF] from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.572097+0000 osd.5 (osd.5) 3 : cluster 0 13.2 deep-scrub starts 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.576142+0000 osd.5 (osd.5) 4 : cluster 0 13.2 deep-scrub ok 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.662094+0000 osd.7 (osd.7) 3 : cluster 0 13.7 deep-scrub starts 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.664606+0000 osd.7 (osd.7) 4 : cluster 0 13.7 deep-scrub ok 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.714297+0000 osd.4 (osd.4) 3 : cluster 0 13.6 deep-scrub starts 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:52.718409+0000 osd.4 (osd.4) 4 : cluster 0 13.6 deep-scrub ok 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.001732+0000 osd.6 (osd.6) 3 : cluster 0 13.1 deep-scrub starts 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.004993+0000 osd.6 (osd.6) 4 : cluster 0 13.1 deep-scrub ok 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.541522+0000 osd.5 (osd.5) 5 : cluster 0 13.9 deep-scrub starts 2024-03-11T22:12:59.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.547188+0000 osd.5 (osd.5) 6 : cluster 0 13.9 deep-scrub ok 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.692192+0000 osd.7 (osd.7) 5 : cluster 0 13.0 deep-scrub starts 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.694846+0000 osd.7 (osd.7) 6 : cluster 0 13.0 deep-scrub ok 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.734275+0000 osd.4 (osd.4) 5 : cluster 0 13.5 deep-scrub starts 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.736742+0000 osd.4 (osd.4) 6 : cluster 0 13.5 deep-scrub ok 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.976346+0000 osd.6 (osd.6) 5 : cluster 0 13.4 deep-scrub starts 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:53.978765+0000 osd.6 (osd.6) 6 : cluster 0 13.4 deep-scrub ok 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:56.650866+0000 client.admin (client.25289) 0 : cluster 1 onexx 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:57.473876+0000 mgr.y (mgr.14601) 179 : cluster 0 pgmap v124: 892 pgs: 240 unknown, 118 creating+peering, 534 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 9.3 MiB/s rd, 29 MiB/s wr, 419 op/s 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:57.708284+0000 mon.c (mon.2) 147 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:57.931783+0000 mon.a (mon.0) 927 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:57.943692+0000 mon.a (mon.0) 928 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:57.944089+0000 mon.a (mon.0) 929 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:57.947429+0000 mon.a (mon.0) 930 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:57.947543+0000 mon.a (mon.0) 931 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]': finished 2024-03-11T22:12:59.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:57.959935+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:57.960449+0000 mon.c (mon.2) 149 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.709970+0000 mon.c (mon.2) 150 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.862329+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: cluster 2024-03-11T22:12:58.867651+0000 mon.a (mon.0) 932 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.870098+0000 mon.a (mon.0) 933 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.870815+0000 mon.a (mon.0) 934 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.873338+0000 mon.a (mon.0) 935 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.878307+0000 mon.c (mon.2) 152 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.882174+0000 mon.b (mon.1) 59 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.882189+0000 mon.a (mon.0) 936 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.882766+0000 mon.b (mon.1) 60 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.882974+0000 mon.a (mon.0) 937 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.883499+0000 mon.a (mon.0) 938 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:12:59 smithi187 bash[23415]: audit 2024-03-11T22:12:58.900057+0000 mon.a (mon.0) 939 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:12:59.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.572097+0000 osd.5 (osd.5) 3 : cluster 0 13.2 deep-scrub starts 2024-03-11T22:12:59.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.576142+0000 osd.5 (osd.5) 4 : cluster 0 13.2 deep-scrub ok 2024-03-11T22:12:59.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.662094+0000 osd.7 (osd.7) 3 : cluster 0 13.7 deep-scrub starts 2024-03-11T22:12:59.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.664606+0000 osd.7 (osd.7) 4 : cluster 0 13.7 deep-scrub ok 2024-03-11T22:12:59.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.714297+0000 osd.4 (osd.4) 3 : cluster 0 13.6 deep-scrub starts 2024-03-11T22:12:59.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:52.718409+0000 osd.4 (osd.4) 4 : cluster 0 13.6 deep-scrub ok 2024-03-11T22:12:59.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.001732+0000 osd.6 (osd.6) 3 : cluster 0 13.1 deep-scrub starts 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.004993+0000 osd.6 (osd.6) 4 : cluster 0 13.1 deep-scrub ok 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.541522+0000 osd.5 (osd.5) 5 : cluster 0 13.9 deep-scrub starts 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.547188+0000 osd.5 (osd.5) 6 : cluster 0 13.9 deep-scrub ok 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.692192+0000 osd.7 (osd.7) 5 : cluster 0 13.0 deep-scrub starts 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.694846+0000 osd.7 (osd.7) 6 : cluster 0 13.0 deep-scrub ok 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.734275+0000 osd.4 (osd.4) 5 : cluster 0 13.5 deep-scrub starts 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.736742+0000 osd.4 (osd.4) 6 : cluster 0 13.5 deep-scrub ok 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.976346+0000 osd.6 (osd.6) 5 : cluster 0 13.4 deep-scrub starts 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:53.978765+0000 osd.6 (osd.6) 6 : cluster 0 13.4 deep-scrub ok 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:56.650866+0000 client.admin (client.25289) 0 : cluster 1 onexx 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:57.473876+0000 mgr.y (mgr.14601) 179 : cluster 0 pgmap v124: 892 pgs: 240 unknown, 118 creating+peering, 534 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 9.3 MiB/s rd, 29 MiB/s wr, 419 op/s 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:57.708284+0000 mon.c (mon.2) 147 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:57.931783+0000 mon.a (mon.0) 927 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:57.943692+0000 mon.a (mon.0) 928 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:59.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:57.944089+0000 mon.a (mon.0) 929 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:57.947429+0000 mon.a (mon.0) 930 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:57.947543+0000 mon.a (mon.0) 931 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]': finished 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.572097+0000 osd.5 (osd.5) 3 : cluster 0 13.2 deep-scrub starts 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.576142+0000 osd.5 (osd.5) 4 : cluster 0 13.2 deep-scrub ok 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.662094+0000 osd.7 (osd.7) 3 : cluster 0 13.7 deep-scrub starts 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.664606+0000 osd.7 (osd.7) 4 : cluster 0 13.7 deep-scrub ok 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.714297+0000 osd.4 (osd.4) 3 : cluster 0 13.6 deep-scrub starts 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:52.718409+0000 osd.4 (osd.4) 4 : cluster 0 13.6 deep-scrub ok 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.001732+0000 osd.6 (osd.6) 3 : cluster 0 13.1 deep-scrub starts 2024-03-11T22:12:59.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.004993+0000 osd.6 (osd.6) 4 : cluster 0 13.1 deep-scrub ok 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.541522+0000 osd.5 (osd.5) 5 : cluster 0 13.9 deep-scrub starts 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.547188+0000 osd.5 (osd.5) 6 : cluster 0 13.9 deep-scrub ok 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.692192+0000 osd.7 (osd.7) 5 : cluster 0 13.0 deep-scrub starts 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.694846+0000 osd.7 (osd.7) 6 : cluster 0 13.0 deep-scrub ok 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.734275+0000 osd.4 (osd.4) 5 : cluster 0 13.5 deep-scrub starts 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.736742+0000 osd.4 (osd.4) 6 : cluster 0 13.5 deep-scrub ok 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.976346+0000 osd.6 (osd.6) 5 : cluster 0 13.4 deep-scrub starts 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:53.978765+0000 osd.6 (osd.6) 6 : cluster 0 13.4 deep-scrub ok 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:56.650866+0000 client.admin (client.25289) 0 : cluster 1 onexx 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:57.473876+0000 mgr.y (mgr.14601) 179 : cluster 0 pgmap v124: 892 pgs: 240 unknown, 118 creating+peering, 534 active+clean; 145 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 9.3 MiB/s rd, 29 MiB/s wr, 419 op/s 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:57.708284+0000 mon.c (mon.2) 147 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:57.931783+0000 mon.a (mon.0) 927 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:57.943692+0000 mon.a (mon.0) 928 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:57.944089+0000 mon.a (mon.0) 929 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:57.947429+0000 mon.a (mon.0) 930 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-4", "overlaypool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:57.947543+0000 mon.a (mon.0) 931 : audit 1 from='client.25202 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi049-64063-3", "field": "max_bytes", "val": "4096"}]': finished 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:57.959935+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:57.960449+0000 mon.c (mon.2) 149 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.709970+0000 mon.c (mon.2) 150 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.862329+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: cluster 2024-03-11T22:12:58.867651+0000 mon.a (mon.0) 932 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.870098+0000 mon.a (mon.0) 933 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.870815+0000 mon.a (mon.0) 934 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.873338+0000 mon.a (mon.0) 935 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.878307+0000 mon.c (mon.2) 152 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.882174+0000 mon.b (mon.1) 59 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.882189+0000 mon.a (mon.0) 936 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.882766+0000 mon.b (mon.1) 60 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.882974+0000 mon.a (mon.0) 937 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.883499+0000 mon.a (mon.0) 938 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[21434]: audit 2024-03-11T22:12:58.900057+0000 mon.a (mon.0) 939 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:57.959935+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:57.960449+0000 mon.c (mon.2) 149 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.709970+0000 mon.c (mon.2) 150 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:12:59.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.862329+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: cluster 2024-03-11T22:12:58.867651+0000 mon.a (mon.0) 932 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.870098+0000 mon.a (mon.0) 933 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.870815+0000 mon.a (mon.0) 934 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.873338+0000 mon.a (mon.0) 935 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.878307+0000 mon.c (mon.2) 152 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.882174+0000 mon.b (mon.1) 59 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.882189+0000 mon.a (mon.0) 936 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.882766+0000 mon.b (mon.1) 60 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.882974+0000 mon.a (mon.0) 937 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.883499+0000 mon.a (mon.0) 938 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:12:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:12:59 smithi049 bash[28804]: audit 2024-03-11T22:12:58.900057+0000 mon.a (mon.0) 939 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:01.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:58.537355+0000 mgr.y (mgr.14601) 180 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:01.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:58.895241+0000 mon.b (mon.1) 61 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: cluster 2024-03-11T22:12:59.355003+0000 mon.a (mon.0) 940 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.356831+0000 mon.a (mon.0) 941 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.368387+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: cluster 2024-03-11T22:12:59.370440+0000 client.admin (client.25289) 0 : cluster 1 twoxx 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.372164+0000 mon.a (mon.0) 942 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.374864+0000 mon.a (mon.0) 943 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.375126+0000 mon.a (mon.0) 944 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.375341+0000 mon.a (mon.0) 945 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]': finished 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.375517+0000 mon.a (mon.0) 946 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.375708+0000 mon.a (mon.0) 947 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.384035+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.393566+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.579742+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]: dispatch 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:58.537355+0000 mgr.y (mgr.14601) 180 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:58.895241+0000 mon.b (mon.1) 61 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: cluster 2024-03-11T22:12:59.355003+0000 mon.a (mon.0) 940 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.356831+0000 mon.a (mon.0) 941 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.368387+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: cluster 2024-03-11T22:12:59.370440+0000 client.admin (client.25289) 0 : cluster 1 twoxx 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.372164+0000 mon.a (mon.0) 942 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.374864+0000 mon.a (mon.0) 943 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.375126+0000 mon.a (mon.0) 944 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.375341+0000 mon.a (mon.0) 945 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]': finished 2024-03-11T22:13:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.375517+0000 mon.a (mon.0) 946 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.375708+0000 mon.a (mon.0) 947 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.384035+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.393566+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.579742+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]: dispatch 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.711483+0000 mon.c (mon.2) 157 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.876589+0000 mon.b (mon.1) 62 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: cluster 2024-03-11T22:12:59.880397+0000 mon.a (mon.0) 948 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.880967+0000 mon.a (mon.0) 949 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.883528+0000 mon.b (mon.1) 63 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.884253+0000 mon.b (mon.1) 64 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.885337+0000 mon.a (mon.0) 950 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.886129+0000 mon.a (mon.0) 951 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.887859+0000 mon.a (mon.0) 952 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[28804]: audit 2024-03-11T22:12:59.888958+0000 mon.a (mon.0) 953 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.711483+0000 mon.c (mon.2) 157 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.876589+0000 mon.b (mon.1) 62 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: cluster 2024-03-11T22:12:59.880397+0000 mon.a (mon.0) 948 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.880967+0000 mon.a (mon.0) 949 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.883528+0000 mon.b (mon.1) 63 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.884253+0000 mon.b (mon.1) 64 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.885337+0000 mon.a (mon.0) 950 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.886129+0000 mon.a (mon.0) 951 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:01.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.887859+0000 mon.a (mon.0) 952 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:01.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:00 smithi049 bash[21434]: audit 2024-03-11T22:12:59.888958+0000 mon.a (mon.0) 953 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:01.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:58.537355+0000 mgr.y (mgr.14601) 180 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:58.895241+0000 mon.b (mon.1) 61 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: cluster 2024-03-11T22:12:59.355003+0000 mon.a (mon.0) 940 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.356831+0000 mon.a (mon.0) 941 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.368387+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: cluster 2024-03-11T22:12:59.370440+0000 client.admin (client.25289) 0 : cluster 1 twoxx 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.372164+0000 mon.a (mon.0) 942 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.374864+0000 mon.a (mon.0) 943 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi049-64825-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.375126+0000 mon.a (mon.0) 944 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi049-64115-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.375341+0000 mon.a (mon.0) 945 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-4-cache", "mode": "writeback"}]': finished 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.375517+0000 mon.a (mon.0) 946 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.375708+0000 mon.a (mon.0) 947 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.384035+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.393566+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:01.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.579742+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.711483+0000 mon.c (mon.2) 157 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.876589+0000 mon.b (mon.1) 62 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: cluster 2024-03-11T22:12:59.880397+0000 mon.a (mon.0) 948 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.880967+0000 mon.a (mon.0) 949 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.883528+0000 mon.b (mon.1) 63 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.884253+0000 mon.b (mon.1) 64 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.885337+0000 mon.a (mon.0) 950 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.886129+0000 mon.a (mon.0) 951 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.887859+0000 mon.a (mon.0) 952 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:01.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:00 smithi187 bash[23415]: audit 2024-03-11T22:12:59.888958+0000 mon.a (mon.0) 953 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:02.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:02 smithi187 bash[23415]: audit 2024-03-11T22:13:00.713066+0000 mon.c (mon.2) 158 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:02.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:02 smithi187 bash[23415]: audit 2024-03-11T22:13:00.774382+0000 mon.a (mon.0) 954 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-11T22:13:02.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:02 smithi049 bash[21434]: audit 2024-03-11T22:13:00.713066+0000 mon.c (mon.2) 158 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:02.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:02 smithi049 bash[21434]: audit 2024-03-11T22:13:00.774382+0000 mon.a (mon.0) 954 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-11T22:13:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:02 smithi049 bash[28804]: audit 2024-03-11T22:13:00.713066+0000 mon.c (mon.2) 158 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:02 smithi049 bash[28804]: audit 2024-03-11T22:13:00.774382+0000 mon.a (mon.0) 954 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-11T22:13:02.656 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:12:58.900057+0000 mon.a [INF] from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRado api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-03-11T22:13:02.656 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [----------] Global test environment set-up. 2024-03-11T22:13:02.656 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5080 ms) 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (66 ms) 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20021 ms) 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: attempt 0 of 20 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: failed to deregister: 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: { 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "epoch": 19, 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "modified": "2024-03-11T22:12:59.474130+0000", 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "services": { 2024-03-11T22:13:02.657 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "laundry": { 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "daemons": { 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "summary": "", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "close-test-pid64496": { 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "start_epoch": 19, 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "start_stamp": "2024-03-11T22:12:57.634102+0000", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "gid": 25304, 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "addr": "172.21.15.49:0/2872950758", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "metadata": { 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "arch": "x86_64", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_release": "squid", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev)", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_version_short": "19.0.0-1607-g94a53970", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-03-11T22:13:02.658 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro": "ubuntu", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro_description": "Ubuntu 22.04.1 LTS", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro_version": "22.04", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "foo": "bar", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "hostname": "smithi049", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "kernel_description": "#110-Ubuntu SMP Wed Feb 7 13:27:48 UTC 2024", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "kernel_version": "5.15.0-100-generic", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "mem_total_kb": "32746800", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "os": "Linux", 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "this": "that" 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: }, 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "task_status": {} 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: }, 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "pid64456": { 2024-03-11T22:13:02.659 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "start_epoch": 18, 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "start_stamp": "2024-03-11T22:12:48.218100+0000", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "gid": 25088, 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "addr": "172.21.15.49:0/2323285983", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "metadata": { 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "arch": "x86_64", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_release": "squid", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev)", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_version_short": "19.0.0-1607-g94a53970", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro": "ubuntu", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro_description": "Ubuntu 22.04.1 LTS", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro_version": "22.04", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "foo": "bar", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "hostname": "smithi049", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "kernel_description": "#110-Ubuntu SMP Wed Feb 7 13:27:48 UTC 2024", 2024-03-11T22:13:02.660 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "kernel_version": "5.15.0-100-generic", 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "mem_total_kb": "32746800", 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "os": "Linux", 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "this": "that" 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: }, 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "task_status": {} 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: } 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: } 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: }, 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "rgw": { 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "daemons": { 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "summary": "", 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "24362": { 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "start_epoch": 13, 2024-03-11T22:13:02.661 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "start_stamp": "2024-03-11T22:08:23.534752+0000", 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "gid": 24362, 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "addr": "172.21.15.49:0/1576994088", 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "metadata": { 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "arch": "x86_64", 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_release": "squid", 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-1607-g94a53970 (94a539707733325322964c6a187c6a1b41be1daf) squid (dev)", 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "ceph_version_short": "19.0.0-1607-g94a53970", 2024-03-11T22:13:02.662 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "container_hostname": "smithi049", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "container_image": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bbe755e768640cafd345af8384e9f3b099ff2fb85ebf0601e0883dbf412b887b", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro": "centos", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro_description": "CentOS Stream 8", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "distro_version": "8", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "frontend_config#0": "beast port=80", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "frontend_type#0": "beast", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "hostname": "smithi049", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "id": "foo.a", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "kernel_description": "#110-Ubuntu SMP Wed Feb 7 13:27:48 UTC 2024", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "kernel_version": "5.15.0-100-generic", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "mem_total_kb": "32746800", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "num_handles": "1", 2024-03-11T22:13:02.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "os": "Linux", 2024-03-11T22:13:02.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "pid": "7", 2024-03-11T22:13:02.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "realm_id": "", 2024-03-11T22:13:02.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "realm_name": "", 2024-03-11T22:13:02.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "zone_id": "086a64d5-0bde-426f-8e18-069f9abf8900", 2024-03-11T22:13:02.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "zone_name": "default", 2024-03-11T22:13:02.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "zonegroup_id": "4808725a-9c51-45ca-baae-c8f5fa7983d5", 2024-03-11T22:13:03.057 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "zonegroup_name": "defaul cls: Running main() from gmock_main.cc 2024-03-11T22:13:03.057 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-03-11T22:13:03.057 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [----------] Global test environment set-up. 2024-03-11T22:13:03.057 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-03-11T22:13:03.057 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-03-11T22:13:03.057 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [ OK ] NeoRadosCls.DNE (24081 ms) 2024-03-11T22:13:03.057 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-03-11T22:13:03.058 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (6503 ms) 2024-03-11T22:13:03.058 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [----------] 2 tests from NeoRadosCls (30584 ms total) 2024-03-11T22:13:03.058 INFO:tasks.workunit.client.0.smithi049.stdout: cls: 2024-03-11T22:13:03.058 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [----------] Global test environment tear-down 2024-03-11T22:13:03.058 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [==========] 2 tests from 1 test suite ran. (30584 ms total) 2024-03-11T22:13:03.058 INFO:tasks.workunit.client.0.smithi049.stdout: cls: [ PASSED ] 2 tests. 2024-03-11T22:13:03.074 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_1_[64747]: starting. 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_1_[64747]: creating pool ceph_test_rados_delete_pools_parallel.smithi049-64650 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_1_[64747]: created object 0... 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_1_[64747]: created object 25... 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_1_[64747]: created object 49... 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_1_[64747]: finishing. 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_1_[64747]: shutting down. 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_2_[64749]: starting. 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_2_[64749]: deleting pool ceph_test_rados_delete_pools_parallel.smithi049-64650 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_2_[64749]: shutting down. 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: ******************************* 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_3_[66107]: starting. 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_3_[66107]: creating pool ceph_test_rados_delete_pools_parallel.smithi049-64650 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_3_[66107]: created object 0... 2024-03-11T22:13:03.075 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_3_[66107]: created object 25... 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_3_[66107]: created object 49... 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_3_[66107]: finishing. 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_3_[66107]: shutting down. 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: ******************************* 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_5_[66109]: starting. 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_5_[66109]: listing objects. 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_5_[66109]: listed object 0... 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_5_[66109]: listed object 25... 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_5_[66109]: saw 50 objects 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_5_[66109]: shutting down. 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: ******************************* 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_4_[66108]: starting. 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_4_[66108]: deleting pool ceph_test_rados_delete_pools_parallel.smithi049-64650 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: process_4_[66108]: shutting down. 2024-03-11T22:13:03.076 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: ******************************* 2024-03-11T22:13:03.077 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: ******************************* 2024-03-11T22:13:03.077 INFO:tasks.workunit.client.0.smithi049.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-03-11T22:13:03.592 INFO:tasks.workunit.client.0.smithi049.stdout:sIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:03.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:00.774382+0000 mon.a [INF] from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-11T22:13:03.592 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:00.787693+0000 mon.a [INF] from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:00.793850+0000 mon.b [INF] from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:00.797562+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:00.798429+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2513359389' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:00.927886+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.098576+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.100172+0000 mon.a [INF] from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.101870+0000 mon.a [INF] from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.102457+0000 mon.a [INF] from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.122634+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.136587+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/2826335817' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.627487+0000 mon.c [INF] from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.784090+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:02.784301+0000 client.admin [INF] threexx 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.027945+0000 mon.a [WRN] Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:03.593 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.028634+0000 mon.a [WRN] pool 'PoolQuotaPP_smithi049-64063-3' is full (reached quota's max_bytes: 4 KiB) 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.037281+0000 mon.a [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.041688+0000 mon.a [INF] from='client.25349 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.045929+0000 mon.a [INF] from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.047102+0000 mon.a [INF] from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.047354+0000 mon.a [INF] from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.047600+0000 mon.a [INF] from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.047832+0000 mon.a [INF] from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.055131+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]': finished 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.055330+0000 mon.a [INF] from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.055779+0000 mon.a [INF] from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.055994+0000 mon.a [INF] from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.060866+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.071446+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2"}]: dispatch 2024-03-11T22:13:03.594 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.071961+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:03.595 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.072204+0000 mon.c [INF] from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.595 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.092328+0000 mon.a [INF] from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:03.595 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.099824+0000 mon.a [INF] from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:03.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:12:59.474822+0000 mgr.y (mgr.14601) 181 : cluster 0 pgmap v127: 804 pgs: 96 unknown, 164 creating+peering, 544 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:00.787693+0000 mon.a (mon.0) 955 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:00.793850+0000 mon.b (mon.1) 65 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:00.797562+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:00.798429+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.49:0/2513359389' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:00.922380+0000 mon.c (mon.2) 161 : audit 0 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:00.927886+0000 mon.c (mon.2) 162 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:01.476280+0000 mgr.y (mgr.14601) 182 : cluster 0 pgmap v129: 892 pgs: 192 unknown, 161 creating+peering, 539 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:01.714586+0000 mon.c (mon.2) 163 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:01.845192+0000 mon.c (mon.2) 164 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:02.083899+0000 mon.a (mon.0) 956 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-03-11T22:13:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.098576+0000 mon.a (mon.0) 957 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]: dispatch 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.100172+0000 mon.a (mon.0) 958 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.101870+0000 mon.a (mon.0) 959 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.102457+0000 mon.a (mon.0) 960 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.122634+0000 mon.a (mon.0) 961 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.136587+0000 mon.c (mon.2) 165 : audit 1 from='client.? v1:172.21.15.49:0/2826335817' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.625702+0000 mon.c (mon.2) 166 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.627487+0000 mon.c (mon.2) 167 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:13:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:02.631794+0000 mgr.y (mgr.14601) 183 : cluster 0 pgmap v131: 964 pgs: 264 unknown, 161 creating+peering, 539 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.668585+0000 mon.c (mon.2) 168 : audit 0 from='client.? v1:172.21.15.49:0/1717205457' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.668763+0000 mgr.y (mgr.14601) 184 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.715982+0000 mon.c (mon.2) 169 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:02.784090+0000 mon.c (mon.2) 170 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:02.784301+0000 client.admin (client.25289) 0 : cluster 1 threexx 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:03.027397+0000 mon.a (mon.0) 962 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:03.027945+0000 mon.a (mon.0) 963 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:03.028634+0000 mon.a (mon.0) 964 : cluster 3 pool 'PoolQuotaPP_smithi049-64063-3' is full (reached quota's max_bytes: 4 KiB) 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:03.037281+0000 mon.a (mon.0) 965 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.041688+0000 mon.a (mon.0) 966 : audit 1 from='client.25349 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.045929+0000 mon.a (mon.0) 967 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.047102+0000 mon.a (mon.0) 968 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.047354+0000 mon.a (mon.0) 969 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:03.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.047600+0000 mon.a (mon.0) 970 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.047832+0000 mon.a (mon.0) 971 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.055131+0000 mon.a (mon.0) 972 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]': finished 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.055330+0000 mon.a (mon.0) 973 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.055779+0000 mon.a (mon.0) 974 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.055994+0000 mon.a (mon.0) 975 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.060866+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.071446+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2"}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.071961+0000 mon.c (mon.2) 173 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.072204+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:03.083099+0000 mon.a (mon.0) 976 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.092328+0000 mon.a (mon.0) 977 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.099824+0000 mon.a (mon.0) 978 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.100335+0000 mon.a (mon.0) 979 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: audit 2024-03-11T22:13:03.105640+0000 mon.a (mon.0) 980 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:03.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:03 smithi187 bash[23415]: cluster 2024-03-11T22:13:03.112288+0000 mon.a (mon.0) 981 : cluster 3 Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-11T22:13:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:12:59.474822+0000 mgr.y (mgr.14601) 181 : cluster 0 pgmap v127: 804 pgs: 96 unknown, 164 creating+peering, 544 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:00.787693+0000 mon.a (mon.0) 955 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:00.793850+0000 mon.b (mon.1) 65 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:00.797562+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:00.798429+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.49:0/2513359389' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:00.922380+0000 mon.c (mon.2) 161 : audit 0 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:00.927886+0000 mon.c (mon.2) 162 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:01.476280+0000 mgr.y (mgr.14601) 182 : cluster 0 pgmap v129: 892 pgs: 192 unknown, 161 creating+peering, 539 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:01.714586+0000 mon.c (mon.2) 163 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:01.845192+0000 mon.c (mon.2) 164 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:02.083899+0000 mon.a (mon.0) 956 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.098576+0000 mon.a (mon.0) 957 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.100172+0000 mon.a (mon.0) 958 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.101870+0000 mon.a (mon.0) 959 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.102457+0000 mon.a (mon.0) 960 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:12:59.474822+0000 mgr.y (mgr.14601) 181 : cluster 0 pgmap v127: 804 pgs: 96 unknown, 164 creating+peering, 544 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:00.787693+0000 mon.a (mon.0) 955 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:00.793850+0000 mon.b (mon.1) 65 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:00.797562+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.49:0/1282210769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:00.798429+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.49:0/2513359389' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:00.922380+0000 mon.c (mon.2) 161 : audit 0 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:00.927886+0000 mon.c (mon.2) 162 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:01.476280+0000 mgr.y (mgr.14601) 182 : cluster 0 pgmap v129: 892 pgs: 192 unknown, 161 creating+peering, 539 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:01.714586+0000 mon.c (mon.2) 163 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:01.845192+0000 mon.c (mon.2) 164 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:02.083899+0000 mon.a (mon.0) 956 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.098576+0000 mon.a (mon.0) 957 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]: dispatch 2024-03-11T22:13:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.100172+0000 mon.a (mon.0) 958 : audit 1 from='client.24881 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.101870+0000 mon.a (mon.0) 959 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.102457+0000 mon.a (mon.0) 960 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.122634+0000 mon.a (mon.0) 961 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.136587+0000 mon.c (mon.2) 165 : audit 1 from='client.? v1:172.21.15.49:0/2826335817' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.625702+0000 mon.c (mon.2) 166 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.627487+0000 mon.c (mon.2) 167 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:02.631794+0000 mgr.y (mgr.14601) 183 : cluster 0 pgmap v131: 964 pgs: 264 unknown, 161 creating+peering, 539 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.668585+0000 mon.c (mon.2) 168 : audit 0 from='client.? v1:172.21.15.49:0/1717205457' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.668763+0000 mgr.y (mgr.14601) 184 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:04.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.715982+0000 mon.c (mon.2) 169 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:02.784090+0000 mon.c (mon.2) 170 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:02.784301+0000 client.admin (client.25289) 0 : cluster 1 threexx 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:03.027397+0000 mon.a (mon.0) 962 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:03.027945+0000 mon.a (mon.0) 963 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:03.028634+0000 mon.a (mon.0) 964 : cluster 3 pool 'PoolQuotaPP_smithi049-64063-3' is full (reached quota's max_bytes: 4 KiB) 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:03.037281+0000 mon.a (mon.0) 965 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.041688+0000 mon.a (mon.0) 966 : audit 1 from='client.25349 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.045929+0000 mon.a (mon.0) 967 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.047102+0000 mon.a (mon.0) 968 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.047354+0000 mon.a (mon.0) 969 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:04.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.122634+0000 mon.a (mon.0) 961 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi049-64079-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.136587+0000 mon.c (mon.2) 165 : audit 1 from='client.? v1:172.21.15.49:0/2826335817' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.625702+0000 mon.c (mon.2) 166 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.627487+0000 mon.c (mon.2) 167 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:02.631794+0000 mgr.y (mgr.14601) 183 : cluster 0 pgmap v131: 964 pgs: 264 unknown, 161 creating+peering, 539 active+clean; 145 MiB data, 729 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.668585+0000 mon.c (mon.2) 168 : audit 0 from='client.? v1:172.21.15.49:0/1717205457' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.668763+0000 mgr.y (mgr.14601) 184 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.715982+0000 mon.c (mon.2) 169 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:02.784090+0000 mon.c (mon.2) 170 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:02.784301+0000 client.admin (client.25289) 0 : cluster 1 threexx 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:03.027397+0000 mon.a (mon.0) 962 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:03.027945+0000 mon.a (mon.0) 963 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:03.028634+0000 mon.a (mon.0) 964 : cluster 3 pool 'PoolQuotaPP_smithi049-64063-3' is full (reached quota's max_bytes: 4 KiB) 2024-03-11T22:13:04.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:03.037281+0000 mon.a (mon.0) 965 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:13:04.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.041688+0000 mon.a (mon.0) 966 : audit 1 from='client.25349 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.045929+0000 mon.a (mon.0) 967 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-11T22:13:04.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.047102+0000 mon.a (mon.0) 968 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:04.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.047354+0000 mon.a (mon.0) 969 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:04.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.047600+0000 mon.a (mon.0) 970 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:04.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.047832+0000 mon.a (mon.0) 971 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.055131+0000 mon.a (mon.0) 972 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]': finished 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.055330+0000 mon.a (mon.0) 973 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.055779+0000 mon.a (mon.0) 974 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.055994+0000 mon.a (mon.0) 975 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.060866+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.071446+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2"}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.071961+0000 mon.c (mon.2) 173 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.072204+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:03.083099+0000 mon.a (mon.0) 976 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.092328+0000 mon.a (mon.0) 977 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.099824+0000 mon.a (mon.0) 978 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.100335+0000 mon.a (mon.0) 979 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: audit 2024-03-11T22:13:03.105640+0000 mon.a (mon.0) 980 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[21434]: cluster 2024-03-11T22:13:03.112288+0000 mon.a (mon.0) 981 : cluster 3 Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.047600+0000 mon.a (mon.0) 970 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.047832+0000 mon.a (mon.0) 971 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.055131+0000 mon.a (mon.0) 972 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-4"}]': finished 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.055330+0000 mon.a (mon.0) 973 : audit 1 from='client.24881 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi049-64859-1"}]': finished 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.055779+0000 mon.a (mon.0) 974 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.055994+0000 mon.a (mon.0) 975 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.060866+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.49:0/749305094' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.071446+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2"}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.071961+0000 mon.c (mon.2) 173 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.072204+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:03.083099+0000 mon.a (mon.0) 976 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.092328+0000 mon.a (mon.0) 977 : audit 1 from='client.25106 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.099824+0000 mon.a (mon.0) 978 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.100335+0000 mon.a (mon.0) 979 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:04.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: audit 2024-03-11T22:13:03.105640+0000 mon.a (mon.0) 980 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:04.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:03 smithi049 bash[28804]: cluster 2024-03-11T22:13:03.112288+0000 mon.a (mon.0) 981 : cluster 3 Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-11T22:13:04.090 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.100335+0000 mon.a [INF] from='clie watch_notify: Running main() from gmock_main.cc 2024-03-11T22:13:04.090 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-03-11T22:13:04.090 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [----------] Global test environment set-up. 2024-03-11T22:13:04.090 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-03-11T22:13:04.090 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: handle_notify cookie 94246706379680 notify_id 352187318272 notifier_gid 24914 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (22551 ms) 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: Trying... 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: handle_notify cookie 94246718249008 notify_id 373662154753 notifier_gid 25259 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: Waiting for 3.000000000s 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: Timed out. 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: Flushing... 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: Flushed... 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (8951 ms) 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (31502 ms total) 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [----------] Global test environment tear-down 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (31502 ms total) 2024-03-11T22:13:04.091 INFO:tasks.workunit.client.0.smithi049.stdout: watch_notify: [ PASSED ] 2 tests. 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_1_[64677]: starting. 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_1_[64677]: creating pool ceph_test_rados_open_pools_parallel.smithi049-64578 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_1_[64677]: created object 0... 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_1_[64677]: created object 25... 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_1_[64677]: created object 49... 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_1_[64677]: finishing. 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_1_[64677]: shutting down. 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_2_[64678]: starting. 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_2_[64678]: rados_pool_create. 2024-03-11T22:13:04.094 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_2_[64678]: rados_ioctx_create. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_2_[64678]: shutting down. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: ******************************* 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_3_[66203]: starting. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_3_[66203]: creating pool ceph_test_rados_open_pools_parallel.smithi049-64578 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_3_[66203]: created object 0... 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_3_[66203]: created object 25... 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_3_[66203]: created object 49... 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_3_[66203]: finishing. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_3_[66203]: shutting down. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: ******************************* 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_4_[66204]: starting. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_4_[66204]: rados_pool_create. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_4_[66204]: rados_ioctx_create. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: process_4_[66204]: shutting down. 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: ******************************* 2024-03-11T22:13:04.095 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: ******************************* 2024-03-11T22:13:04.096 INFO:tasks.workunit.client.0.smithi049.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-03-11T22:13:04.266 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: Running main() from gmock_main.cc 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [----------] Global test environment set-up. 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: seed 64079 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (1668 ms) 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (17 ms) 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5 ms) 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-03-11T22:13:04.267 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (5 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (2 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (7 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (2 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (6 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (5 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (2 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (6 ms) 2024-03-11T22:13:04.268 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (7 ms) 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (4 ms) 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (5 ms) 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (14 ms) 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (8 ms) 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (5 ms) 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (4 ms) 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-03-11T22:13:04.269 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (6 ms) 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (1779 ms total) 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (2123 ms) 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (15 ms) 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (4 ms) 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (3 ms) 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-03-11T22:13:04.270 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (3 ms) 2024-03-11T22:13:04.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:13:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:13:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:13:05.484 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN api_lock_pp: Running main() from gmock_main.cc 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: seed 64109 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (57 ms) 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (75 ms) 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1021 ms) 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1011 ms) 2024-03-11T22:13:05.485 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (5 ms) 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (5 ms) 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (6 ms) 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (7 ms) 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2187 ms total) 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1640 ms) 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (2803 ms) 2024-03-11T22:13:05.486 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1008 ms) 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1011 ms) 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (9 ms) 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (9 ms) 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (11 ms) 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (8 ms) 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (6499 ms total) 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-03-11T22:13:05.487 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (33282 ms total) 2024-03-11T22:13:05.488 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-03-11T22:13:05.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:03.132867+0000 mon.a (mon.0) 982 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi049-64859-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:03.603081+0000 mon.a (mon.0) 983 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:03.611997+0000 mon.a (mon.0) 984 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:03.613468+0000 mon.c (mon.2) 175 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: cluster 2024-03-11T22:13:03.613781+0000 client.admin (client.25289) 0 : cluster 1 fourxx 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:03.615109+0000 mon.a (mon.0) 985 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:03.616145+0000 mon.a (mon.0) 986 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:03.716991+0000 mon.c (mon.2) 176 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: cluster 2024-03-11T22:13:04.071285+0000 mon.a (mon.0) 987 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.072532+0000 mon.a (mon.0) 988 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.073851+0000 mon.a (mon.0) 989 : audit 1 from='client.25349 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.073929+0000 mon.a (mon.0) 990 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.074005+0000 mon.a (mon.0) 991 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.074064+0000 mon.a (mon.0) 992 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.074123+0000 mon.a (mon.0) 993 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.074162+0000 mon.a (mon.0) 994 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.074217+0000 mon.a (mon.0) 995 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.074284+0000 mon.a (mon.0) 996 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.074373+0000 mon.a (mon.0) 997 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi049-64859-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: cluster 2024-03-11T22:13:04.079455+0000 mon.a (mon.0) 998 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.081556+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.082148+0000 mon.b (mon.1) 67 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.083264+0000 mon.b (mon.1) 68 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.084161+0000 mon.b (mon.1) 69 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.095111+0000 mon.a (mon.0) 999 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi049-64859-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.096089+0000 mon.a (mon.0) 1000 : audit 1 from='client.? v1:172.21.15.49:0/3461498788' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi049-64261-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.096613+0000 mon.a (mon.0) 1001 : audit 1 from='client.? v1:172.21.15.49:0/3347086904' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.098542+0000 mon.c (mon.2) 177 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.100054+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.109157+0000 mon.a (mon.0) 1002 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.109502+0000 mon.a (mon.0) 1003 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.109960+0000 mon.c (mon.2) 179 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.112206+0000 mon.a (mon.0) 1004 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.112937+0000 mon.a (mon.0) 1005 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.113322+0000 mon.a (mon.0) 1006 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.113603+0000 mon.a (mon.0) 1007 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.115300+0000 mon.c (mon.2) 180 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:05.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:05 smithi187 bash[23415]: audit 2024-03-11T22:13:04.116331+0000 mon.a (mon.0) 1008 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:03.132867+0000 mon.a (mon.0) 982 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi049-64859-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:03.603081+0000 mon.a (mon.0) 983 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:03.611997+0000 mon.a (mon.0) 984 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:03.613468+0000 mon.c (mon.2) 175 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: cluster 2024-03-11T22:13:03.613781+0000 client.admin (client.25289) 0 : cluster 1 fourxx 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:03.615109+0000 mon.a (mon.0) 985 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:03.616145+0000 mon.a (mon.0) 986 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:03.716991+0000 mon.c (mon.2) 176 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:05.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: cluster 2024-03-11T22:13:04.071285+0000 mon.a (mon.0) 987 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.072532+0000 mon.a (mon.0) 988 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.073851+0000 mon.a (mon.0) 989 : audit 1 from='client.25349 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.073929+0000 mon.a (mon.0) 990 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.074005+0000 mon.a (mon.0) 991 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.074064+0000 mon.a (mon.0) 992 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.074123+0000 mon.a (mon.0) 993 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:03.132867+0000 mon.a (mon.0) 982 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi049-64859-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:03.603081+0000 mon.a (mon.0) 983 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:03.611997+0000 mon.a (mon.0) 984 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:05.768 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:03.613468+0000 mon.c (mon.2) 175 : audit 1 from='client.? v1:172.21.15.49:0/916256749' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: cluster 2024-03-11T22:13:03.613781+0000 client.admin (client.25289) 0 : cluster 1 fourxx 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:03.615109+0000 mon.a (mon.0) 985 : audit 1 from='client.25289 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:03.616145+0000 mon.a (mon.0) 986 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:03.716991+0000 mon.c (mon.2) 176 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: cluster 2024-03-11T22:13:04.071285+0000 mon.a (mon.0) 987 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.072532+0000 mon.a (mon.0) 988 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.073851+0000 mon.a (mon.0) 989 : audit 1 from='client.25349 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi049-64055-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.073929+0000 mon.a (mon.0) 990 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.074005+0000 mon.a (mon.0) 991 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi049-64290-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.074064+0000 mon.a (mon.0) 992 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi049-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.074123+0000 mon.a (mon.0) 993 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.074162+0000 mon.a (mon.0) 994 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.074217+0000 mon.a (mon.0) 995 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.074284+0000 mon.a (mon.0) 996 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.074373+0000 mon.a (mon.0) 997 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi049-64859-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: cluster 2024-03-11T22:13:04.079455+0000 mon.a (mon.0) 998 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.081556+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.082148+0000 mon.b (mon.1) 67 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.083264+0000 mon.b (mon.1) 68 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.084161+0000 mon.b (mon.1) 69 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.095111+0000 mon.a (mon.0) 999 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi049-64859-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.096089+0000 mon.a (mon.0) 1000 : audit 1 from='client.? v1:172.21.15.49:0/3461498788' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi049-64261-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:05.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.096613+0000 mon.a (mon.0) 1001 : audit 1 from='client.? v1:172.21.15.49:0/3347086904' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.098542+0000 mon.c (mon.2) 177 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.074162+0000 mon.a (mon.0) 994 : audit 1 from='client.25106 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-4", "tierpool": "test-rados-api-smithi049-64247-4-cache"}]': finished 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.074217+0000 mon.a (mon.0) 995 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.074284+0000 mon.a (mon.0) 996 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.074373+0000 mon.a (mon.0) 997 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi049-64859-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: cluster 2024-03-11T22:13:04.079455+0000 mon.a (mon.0) 998 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.081556+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.082148+0000 mon.b (mon.1) 67 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.083264+0000 mon.b (mon.1) 68 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.084161+0000 mon.b (mon.1) 69 : audit 1 from='client.? v1:172.21.15.49:0/3229314914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.095111+0000 mon.a (mon.0) 999 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi049-64859-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.096089+0000 mon.a (mon.0) 1000 : audit 1 from='client.? v1:172.21.15.49:0/3461498788' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi049-64261-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.096613+0000 mon.a (mon.0) 1001 : audit 1 from='client.? v1:172.21.15.49:0/3347086904' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.098542+0000 mon.c (mon.2) 177 : audit 1 from='client.? v1:172.21.15.49:0/1270720052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.100054+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.109157+0000 mon.a (mon.0) 1002 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.109502+0000 mon.a (mon.0) 1003 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.109960+0000 mon.c (mon.2) 179 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.112206+0000 mon.a (mon.0) 1004 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.112937+0000 mon.a (mon.0) 1005 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.113322+0000 mon.a (mon.0) 1006 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.113603+0000 mon.a (mon.0) 1007 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.115300+0000 mon.c (mon.2) 180 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[28804]: audit 2024-03-11T22:13:04.116331+0000 mon.a (mon.0) 1008 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.100054+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.109157+0000 mon.a (mon.0) 1002 : audit 1 from='client.25220 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.109502+0000 mon.a (mon.0) 1003 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.109960+0000 mon.c (mon.2) 179 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.112206+0000 mon.a (mon.0) 1004 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.112937+0000 mon.a (mon.0) 1005 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.113322+0000 mon.a (mon.0) 1006 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.113603+0000 mon.a (mon.0) 1007 : audit 1 from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.115300+0000 mon.c (mon.2) 180 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:05 smithi049 bash[21434]: audit 2024-03-11T22:13:04.116331+0000 mon.a (mon.0) 1008 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:07.460 INFO:tasks.workunit.client.0.smithi049.stdout:nt.25271 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi049-64208-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:07.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.105640+0000 mon.a [INF] from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:07.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: got: 2024-03-11T22:13:03.112288+0000 mon.a [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-11T22:13:07.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (10901 ms) 2024-03-11T22:13:07.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (35114 ms total) 2024-03-11T22:13:07.460 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: 2024-03-11T22:13:07.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [----------] Global test environment tear-down 2024-03-11T22:13:07.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (35114 ms total) 2024-03-11T22:13:07.461 INFO:tasks.workunit.client.0.smithi049.stdout: api_cmd: [ PASSED ] 4 tests. 2024-03-11T22:13:07.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:07 smithi187 bash[23415]: audit 2024-03-11T22:13:04.718549+0000 mon.c (mon.2) 181 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:07.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:07 smithi187 bash[23415]: audit 2024-03-11T22:13:05.463835+0000 mon.a (mon.0) 1009 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-03-11T22:13:07.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:07 smithi049 bash[21434]: audit 2024-03-11T22:13:04.718549+0000 mon.c (mon.2) 181 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:07.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:07 smithi049 bash[21434]: audit 2024-03-11T22:13:05.463835+0000 mon.a (mon.0) 1009 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-03-11T22:13:07.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:07 smithi049 bash[28804]: audit 2024-03-11T22:13:04.718549+0000 mon.c (mon.2) 181 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:07.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:07 smithi049 bash[28804]: audit 2024-03-11T22:13:05.463835+0000 mon.a (mon.0) 1009 : audit 1 from='client.25289 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-03-11T22:13:07.771 INFO:tasks.workunit.client.0.smithi049.stdout:t" 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: }, 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: "task_status": {} 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: } 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: } 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: } 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: } 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: } 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: attempt 1 of 20 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10199 ms) 2024-03-11T22:13:07.772 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35366 ms total) 2024-03-11T22:13:07.773 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: 2024-03-11T22:13:07.773 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [----------] Global test environment tear-down 2024-03-11T22:13:07.773 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35366 ms total) 2024-03-11T22:13:07.773 INFO:tasks.workunit.client.0.smithi049.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-03-11T22:13:08.223 INFO:tasks.workunit.client.0.smithi049.stdout:8 in (since 5m) 2024-03-11T22:13:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-11T22:13:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: data: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pools: 6 pools, 132 pgs 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: objects: 198 objects, 582 KiB 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: usage: 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pgs: 132 active+clean 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: io: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: cluster: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: id: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: health: HEALTH_OK 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: services: 2024-03-11T22:13:08.224 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: data: 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pools: 6 pools, 132 pgs 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: objects: 198 objects, 582 KiB 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: usage: 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pgs: 132 active+clean 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: io: 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.225 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: cluster: 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: id: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: health: HEALTH_WARN 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 10 pool(s) do not have an application enabled 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: services: 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: data: 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pools: 16 pools, 452 pgs 2024-03-11T22:13:08.226 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: objects: 198 objects, 582 KiB 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: usage: 243 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: pgs: 28.319% pgs unknown 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 42.478% pgs not active 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 192 creating+peering 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 132 active+clean 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 128 unknown 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: io: 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ OK ] LibRadosService.StatusFormat (10688 ms) 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ RUN ] LibRadosService.Status 2024-03-11T22:13:08.227 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ OK ] LibRadosService.Status (20044 ms) 2024-03-11T22:13:08.228 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [----------] 4 tests from LibRadosService (35846 ms total) 2024-03-11T22:13:08.228 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: 2024-03-11T22:13:08.228 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [----------] Global test environment tear-down 2024-03-11T22:13:08.228 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [==========] 4 tests from 1 test suite ran. (35846 ms total) 2024-03-11T22:13:08.228 INFO:tasks.workunit.client.0.smithi049.stdout: api_service: [ PASSED ] 4 tests. 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: Running main() from gmock_main.cc 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [----------] Global test environment set-up. 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (22577 ms) 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (13570 ms) 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (36147 ms total) 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [----------] Global test environment tear-down 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (36147 ms total) 2024-03-11T22:13:08.679 INFO:tasks.workunit.client.0.smithi049.stdout: ec_io: [ PASSED ] 2 tests. 2024-03-11T22:13:08.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:13:08.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: cluster 2024-03-11T22:13:04.633065+0000 mgr.y (mgr.14601) 185 : cluster 0 pgmap v134: 724 pgs: 64 unknown, 119 creating+peering, 541 active+clean; 145 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-03-11T22:13:08.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.479003+0000 mon.a (mon.0) 1010 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:08.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.479221+0000 mon.a (mon.0) 1011 : audit 1 from='client.? v1:172.21.15.49:0/3461498788' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi049-64261-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.479433+0000 mon.a (mon.0) 1012 : audit 1 from='client.? v1:172.21.15.49:0/3347086904' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.479622+0000 mon.a (mon.0) 1013 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.479829+0000 mon.a (mon.0) 1014 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.480026+0000 mon.a (mon.0) 1015 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.480260+0000 mon.a (mon.0) 1016 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.486069+0000 mon.c (mon.2) 182 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.498638+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:05.720160+0000 mon.c (mon.2) 184 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: cluster 2024-03-11T22:13:06.634477+0000 mgr.y (mgr.14601) 186 : cluster 0 pgmap v136: 788 pgs: 160 unknown, 119 creating+peering, 509 active+clean; 145 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:06.721322+0000 mon.c (mon.2) 185 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.283928+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.49:0/1070473812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:08.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: cluster 2024-03-11T22:13:07.284396+0000 mon.a (mon.0) 1017 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.307469+0000 mon.a (mon.0) 1018 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi049-64379-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.309214+0000 mon.a (mon.0) 1019 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi049-64859-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.309401+0000 mon.a (mon.0) 1020 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.309539+0000 mon.a (mon.0) 1021 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.309669+0000 mon.a (mon.0) 1022 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: cluster 2024-03-11T22:13:07.317265+0000 mon.a (mon.0) 1023 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.722876+0000 mon.c (mon.2) 187 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.768418+0000 mon.a (mon.0) 1024 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.768988+0000 mon.a (mon.0) 1025 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.769926+0000 mon.a (mon.0) 1026 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.773175+0000 mon.c (mon.2) 188 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:08.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:07.780371+0000 mon.c (mon.2) 189 : audit 0 from='client.? v1:172.21.15.49:0/1025360593' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:08.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: cluster 2024-03-11T22:13:08.194357+0000 mon.a (mon.0) 1027 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:08.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:08 smithi187 bash[23415]: audit 2024-03-11T22:13:08.198942+0000 mon.a (mon.0) 1028 : audit 1 from='client.25400 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:09.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: cluster 2024-03-11T22:13:04.633065+0000 mgr.y (mgr.14601) 185 : cluster 0 pgmap v134: 724 pgs: 64 unknown, 119 creating+peering, 541 active+clean; 145 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-03-11T22:13:09.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.479003+0000 mon.a (mon.0) 1010 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:09.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.479221+0000 mon.a (mon.0) 1011 : audit 1 from='client.? v1:172.21.15.49:0/3461498788' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi049-64261-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:09.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.479433+0000 mon.a (mon.0) 1012 : audit 1 from='client.? v1:172.21.15.49:0/3347086904' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:09.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.479622+0000 mon.a (mon.0) 1013 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:13:09.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.479829+0000 mon.a (mon.0) 1014 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.480026+0000 mon.a (mon.0) 1015 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.480260+0000 mon.a (mon.0) 1016 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.486069+0000 mon.c (mon.2) 182 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.498638+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:05.720160+0000 mon.c (mon.2) 184 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: cluster 2024-03-11T22:13:06.634477+0000 mgr.y (mgr.14601) 186 : cluster 0 pgmap v136: 788 pgs: 160 unknown, 119 creating+peering, 509 active+clean; 145 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:06.721322+0000 mon.c (mon.2) 185 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.283928+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.49:0/1070473812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: cluster 2024-03-11T22:13:07.284396+0000 mon.a (mon.0) 1017 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: cluster 2024-03-11T22:13:04.633065+0000 mgr.y (mgr.14601) 185 : cluster 0 pgmap v134: 724 pgs: 64 unknown, 119 creating+peering, 541 active+clean; 145 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 3.6 KiB/s wr, 2 op/s 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.479003+0000 mon.a (mon.0) 1010 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.479221+0000 mon.a (mon.0) 1011 : audit 1 from='client.? v1:172.21.15.49:0/3461498788' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi049-64261-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.479433+0000 mon.a (mon.0) 1012 : audit 1 from='client.? v1:172.21.15.49:0/3347086904' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.479622+0000 mon.a (mon.0) 1013 : audit 1 from='client.25220 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi049-64109-10"}]': finished 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.479829+0000 mon.a (mon.0) 1014 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.480026+0000 mon.a (mon.0) 1015 : audit 1 from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi049-64412-1"}]': finished 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.480260+0000 mon.a (mon.0) 1016 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.486069+0000 mon.c (mon.2) 182 : audit 1 from='client.? v1:172.21.15.49:0/3992070996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.498638+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:05.720160+0000 mon.c (mon.2) 184 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: cluster 2024-03-11T22:13:06.634477+0000 mgr.y (mgr.14601) 186 : cluster 0 pgmap v136: 788 pgs: 160 unknown, 119 creating+peering, 509 active+clean; 145 MiB data, 727 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:06.721322+0000 mon.c (mon.2) 185 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.283928+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.49:0/1070473812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: cluster 2024-03-11T22:13:07.284396+0000 mon.a (mon.0) 1017 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.307469+0000 mon.a (mon.0) 1018 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi049-64379-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.309214+0000 mon.a (mon.0) 1019 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi049-64859-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.309401+0000 mon.a (mon.0) 1020 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.309539+0000 mon.a (mon.0) 1021 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.309669+0000 mon.a (mon.0) 1022 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:09.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: cluster 2024-03-11T22:13:07.317265+0000 mon.a (mon.0) 1023 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.722876+0000 mon.c (mon.2) 187 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.768418+0000 mon.a (mon.0) 1024 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.768988+0000 mon.a (mon.0) 1025 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.769926+0000 mon.a (mon.0) 1026 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.773175+0000 mon.c (mon.2) 188 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:07.780371+0000 mon.c (mon.2) 189 : audit 0 from='client.? v1:172.21.15.49:0/1025360593' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: cluster 2024-03-11T22:13:08.194357+0000 mon.a (mon.0) 1027 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[21434]: audit 2024-03-11T22:13:08.198942+0000 mon.a (mon.0) 1028 : audit 1 from='client.25400 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.307469+0000 mon.a (mon.0) 1018 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi049-64379-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.309214+0000 mon.a (mon.0) 1019 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi049-64859-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.309401+0000 mon.a (mon.0) 1020 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi049-64290-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.309539+0000 mon.a (mon.0) 1021 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi049-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:09.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.309669+0000 mon.a (mon.0) 1022 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi049-64334-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: cluster 2024-03-11T22:13:07.317265+0000 mon.a (mon.0) 1023 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.722876+0000 mon.c (mon.2) 187 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.768418+0000 mon.a (mon.0) 1024 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.768988+0000 mon.a (mon.0) 1025 : audit 1 from='client.25244 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]: dispatch 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.769926+0000 mon.a (mon.0) 1026 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.773175+0000 mon.c (mon.2) 188 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:07.780371+0000 mon.c (mon.2) 189 : audit 0 from='client.? v1:172.21.15.49:0/1025360593' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: cluster 2024-03-11T22:13:08.194357+0000 mon.a (mon.0) 1027 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:09.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:08 smithi049 bash[28804]: audit 2024-03-11T22:13:08.198942+0000 mon.a (mon.0) 1028 : audit 1 from='client.25400 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:09.142 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: Running main() from gmock_main.cc 2024-03-11T22:13:09.142 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-03-11T22:13:09.142 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [----------] Global test environment set-up. 2024-03-11T22:13:09.142 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-03-11T22:13:09.142 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-03-11T22:13:09.142 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (17391 ms) 2024-03-11T22:13:09.142 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (9497 ms) 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (9752 ms) 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [----------] 3 tests from NeoRadosCmd (36640 ms total) 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [----------] Global test environment tear-down 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [==========] 3 tests from 1 test suite ran. (36645 ms total) 2024-03-11T22:13:09.143 INFO:tasks.workunit.client.0.smithi049.stdout: cmd: [ PASSED ] 3 tests. 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:07.780868+0000 mgr.y (mgr.14601) 187 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:08.548770+0000 mgr.y (mgr.14601) 188 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: cluster 2024-03-11T22:13:08.640138+0000 mgr.y (mgr.14601) 189 : cluster 0 pgmap v138: 756 pgs: 128 creating+peering, 628 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 KiB/s wr, 22 op/s 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:08.669535+0000 mon.a (mon.0) 1029 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:08.669696+0000 mon.a (mon.0) 1030 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:08.669838+0000 mon.a (mon.0) 1031 : audit 1 from='client.25400 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:08.697666+0000 mon.c (mon.2) 190 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:08.724185+0000 mon.c (mon.2) 191 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:09.152956+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:09.153260+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:09.153496+0000 mon.c (mon.2) 194 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: cluster 2024-03-11T22:13:09.585647+0000 mon.a (mon.0) 1032 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-03-11T22:13:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:09.587292+0000 mon.a (mon.0) 1033 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:09.588265+0000 mon.a (mon.0) 1034 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:09.588540+0000 mon.a (mon.0) 1035 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:10 smithi187 bash[23415]: audit 2024-03-11T22:13:09.588860+0000 mon.a (mon.0) 1036 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:10.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:07.780868+0000 mgr.y (mgr.14601) 187 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:08.548770+0000 mgr.y (mgr.14601) 188 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: cluster 2024-03-11T22:13:08.640138+0000 mgr.y (mgr.14601) 189 : cluster 0 pgmap v138: 756 pgs: 128 creating+peering, 628 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 KiB/s wr, 22 op/s 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:08.669535+0000 mon.a (mon.0) 1029 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:08.669696+0000 mon.a (mon.0) 1030 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:08.669838+0000 mon.a (mon.0) 1031 : audit 1 from='client.25400 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:08.697666+0000 mon.c (mon.2) 190 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:08.724185+0000 mon.c (mon.2) 191 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:09.152956+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:09.153260+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:09.153496+0000 mon.c (mon.2) 194 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: cluster 2024-03-11T22:13:09.585647+0000 mon.a (mon.0) 1032 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:09.587292+0000 mon.a (mon.0) 1033 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:09.588265+0000 mon.a (mon.0) 1034 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:09.588540+0000 mon.a (mon.0) 1035 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[21434]: audit 2024-03-11T22:13:09.588860+0000 mon.a (mon.0) 1036 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:07.780868+0000 mgr.y (mgr.14601) 187 : audit 0 from='mon.? v1:172.21.15.49:0/3416869300' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:08.548770+0000 mgr.y (mgr.14601) 188 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: cluster 2024-03-11T22:13:08.640138+0000 mgr.y (mgr.14601) 189 : cluster 0 pgmap v138: 756 pgs: 128 creating+peering, 628 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 14 KiB/s wr, 22 op/s 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:08.669535+0000 mon.a (mon.0) 1029 : audit 1 from='client.25244 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi049-64825-2"}]': finished 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:08.669696+0000 mon.a (mon.0) 1030 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:08.669838+0000 mon.a (mon.0) 1031 : audit 1 from='client.25400 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:08.697666+0000 mon.c (mon.2) 190 : audit 1 from='client.? v1:172.21.15.49:0/3520392938' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:08.724185+0000 mon.c (mon.2) 191 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:09.152956+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:09.153260+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:09.153496+0000 mon.c (mon.2) 194 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: cluster 2024-03-11T22:13:09.585647+0000 mon.a (mon.0) 1032 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:09.587292+0000 mon.a (mon.0) 1033 : audit 1 from='client.25271 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:09.588265+0000 mon.a (mon.0) 1034 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:09.588540+0000 mon.a (mon.0) 1035 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:10 smithi049 bash[28804]: audit 2024-03-11T22:13:09.588860+0000 mon.a (mon.0) 1036 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:11.148 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: Running main() from gmock_main.cc 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [----------] Global test environment set-up. 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (163 ms) 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.LockShared (1523 ms) 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1042 ms) 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1007 ms) 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (5 ms) 2024-03-11T22:13:11.149 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.Unlock (6 ms) 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (6 ms) 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (6 ms) 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [----------] 8 tests from LibRadosLock (3758 ms total) 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (3848 ms) 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (6 ms) 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1082 ms) 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-03-11T22:13:11.150 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1009 ms) 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (8 ms) 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (9 ms) 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (11 ms) 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (8 ms) 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (5981 ms total) 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [----------] Global test environment tear-down 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (38939 ms total) 2024-03-11T22:13:11.151 INFO:tasks.workunit.client.0.smithi049.stdout: api_lock: [ PASSED ] 16 tests. 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (9 ms) 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (4 ms) 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5 ms) 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (3 ms) 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-03-11T22:13:11.152 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (3 ms) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (4 ms) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (11 ms) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (5 ms) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (9 ms) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (6 ms) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (7 ms) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (2218 ms total) 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [----------] Global test environment tear-down 2024-03-11T22:13:11.153 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (38970 ms total) 2024-03-11T22:13:11.154 INFO:tasks.workunit.client.0.smithi049.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-03-11T22:13:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:09.725452+0000 mon.c (mon.2) 195 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: cluster 2024-03-11T22:13:10.035626+0000 mon.a (mon.0) 1037 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:13:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.047825+0000 mon.a (mon.0) 1038 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi049-64379-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.047942+0000 mon.a (mon.0) 1039 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]': finished 2024-03-11T22:13:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.048007+0000 mon.a (mon.0) 1040 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.048085+0000 mon.a (mon.0) 1041 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:11.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.048165+0000 mon.a (mon.0) 1042 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.087425+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.089080+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.089855+0000 mon.c (mon.2) 198 : audit 1 from='client.? v1:172.21.15.49:0/798235603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: cluster 2024-03-11T22:13:10.563719+0000 mon.a (mon.0) 1043 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-03-11T22:13:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.573576+0000 mon.a (mon.0) 1044 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.574363+0000 mon.a (mon.0) 1045 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:11 smithi187 bash[23415]: audit 2024-03-11T22:13:10.575263+0000 mon.a (mon.0) 1046 : audit 1 from='client.25412 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:09.725452+0000 mon.c (mon.2) 195 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: cluster 2024-03-11T22:13:10.035626+0000 mon.a (mon.0) 1037 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.047825+0000 mon.a (mon.0) 1038 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi049-64379-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.047942+0000 mon.a (mon.0) 1039 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]': finished 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.048007+0000 mon.a (mon.0) 1040 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.048085+0000 mon.a (mon.0) 1041 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.048165+0000 mon.a (mon.0) 1042 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.087425+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.089080+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.089855+0000 mon.c (mon.2) 198 : audit 1 from='client.? v1:172.21.15.49:0/798235603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: cluster 2024-03-11T22:13:10.563719+0000 mon.a (mon.0) 1043 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.573576+0000 mon.a (mon.0) 1044 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.574363+0000 mon.a (mon.0) 1045 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[28804]: audit 2024-03-11T22:13:10.575263+0000 mon.a (mon.0) 1046 : audit 1 from='client.25412 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:09.725452+0000 mon.c (mon.2) 195 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: cluster 2024-03-11T22:13:10.035626+0000 mon.a (mon.0) 1037 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.047825+0000 mon.a (mon.0) 1038 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi049-64379-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.047942+0000 mon.a (mon.0) 1039 : audit 1 from='client.25271 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi049-64208-1","app":"app1","key":"key1"}]': finished 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.048007+0000 mon.a (mon.0) 1040 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.048085+0000 mon.a (mon.0) 1041 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.048165+0000 mon.a (mon.0) 1042 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.087425+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.49:0/2560134291' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.089080+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.49:0/3072205469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.089855+0000 mon.c (mon.2) 198 : audit 1 from='client.? v1:172.21.15.49:0/798235603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: cluster 2024-03-11T22:13:10.563719+0000 mon.a (mon.0) 1043 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-03-11T22:13:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.573576+0000 mon.a (mon.0) 1044 : audit 1 from='client.25232 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]: dispatch 2024-03-11T22:13:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.574363+0000 mon.a (mon.0) 1045 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]: dispatch 2024-03-11T22:13:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:11 smithi049 bash[21434]: audit 2024-03-11T22:13:10.575263+0000 mon.a (mon.0) 1046 : audit 1 from='client.25412 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: cluster 2024-03-11T22:13:10.641011+0000 mgr.y (mgr.14601) 190 : cluster 0 pgmap v141: 716 pgs: 168 unknown, 64 creating+peering, 484 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 0 op/s 2024-03-11T22:13:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:10.726844+0000 mon.c (mon.2) 199 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.082189+0000 mon.a (mon.0) 1047 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.082260+0000 mon.a (mon.0) 1048 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.082319+0000 mon.a (mon.0) 1049 : audit 1 from='client.25412 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:12.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: cluster 2024-03-11T22:13:11.089076+0000 mon.a (mon.0) 1050 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-03-11T22:13:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.096249+0000 mon.b (mon.1) 70 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.110813+0000 mon.a (mon.0) 1051 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.134188+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.49:0/8200056' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.150337+0000 mon.a (mon.0) 1052 : audit 1 from='client.25421 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.151405+0000 mon.c (mon.2) 201 : audit 1 from='client.? v1:172.21.15.49:0/1238370853' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.151946+0000 mon.a (mon.0) 1053 : audit 1 from='client.25427 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:12 smithi187 bash[23415]: audit 2024-03-11T22:13:11.263468+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]: dispatch 2024-03-11T22:13:12.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: cluster 2024-03-11T22:13:10.641011+0000 mgr.y (mgr.14601) 190 : cluster 0 pgmap v141: 716 pgs: 168 unknown, 64 creating+peering, 484 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 0 op/s 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:10.726844+0000 mon.c (mon.2) 199 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.082189+0000 mon.a (mon.0) 1047 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.082260+0000 mon.a (mon.0) 1048 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.082319+0000 mon.a (mon.0) 1049 : audit 1 from='client.25412 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: cluster 2024-03-11T22:13:11.089076+0000 mon.a (mon.0) 1050 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.096249+0000 mon.b (mon.1) 70 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.110813+0000 mon.a (mon.0) 1051 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.134188+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.49:0/8200056' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.150337+0000 mon.a (mon.0) 1052 : audit 1 from='client.25421 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.151405+0000 mon.c (mon.2) 201 : audit 1 from='client.? v1:172.21.15.49:0/1238370853' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.151946+0000 mon.a (mon.0) 1053 : audit 1 from='client.25427 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[21434]: audit 2024-03-11T22:13:11.263468+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]: dispatch 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: cluster 2024-03-11T22:13:10.641011+0000 mgr.y (mgr.14601) 190 : cluster 0 pgmap v141: 716 pgs: 168 unknown, 64 creating+peering, 484 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 0 op/s 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:10.726844+0000 mon.c (mon.2) 199 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.082189+0000 mon.a (mon.0) 1047 : audit 1 from='client.25232 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi049-64115-10"}]': finished 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.082260+0000 mon.a (mon.0) 1048 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi049-64079-22"}]': finished 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.082319+0000 mon.a (mon.0) 1049 : audit 1 from='client.25412 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi049-64055-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: cluster 2024-03-11T22:13:11.089076+0000 mon.a (mon.0) 1050 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.096249+0000 mon.b (mon.1) 70 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.110813+0000 mon.a (mon.0) 1051 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.134188+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.49:0/8200056' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.150337+0000 mon.a (mon.0) 1052 : audit 1 from='client.25421 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.151405+0000 mon.c (mon.2) 201 : audit 1 from='client.? v1:172.21.15.49:0/1238370853' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.151946+0000 mon.a (mon.0) 1053 : audit 1 from='client.25427 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:12 smithi049 bash[28804]: audit 2024-03-11T22:13:11.263468+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]: dispatch 2024-03-11T22:13:14.476 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:13:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:13:14.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: audit 2024-03-11T22:13:11.727756+0000 mon.c (mon.2) 203 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:14.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: audit 2024-03-11T22:13:12.232735+0000 mon.a (mon.0) 1054 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]: dispatch 2024-03-11T22:13:14.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: audit 2024-03-11T22:13:12.239556+0000 mon.a (mon.0) 1055 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:14.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: audit 2024-03-11T22:13:12.239677+0000 mon.a (mon.0) 1056 : audit 1 from='client.25421 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:14.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: audit 2024-03-11T22:13:12.239758+0000 mon.a (mon.0) 1057 : audit 1 from='client.25427 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:14.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: audit 2024-03-11T22:13:12.262432+0000 mon.b (mon.1) 71 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:14.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: cluster 2024-03-11T22:13:12.641941+0000 mgr.y (mgr.14601) 191 : cluster 0 pgmap v144: 676 pgs: 264 unknown, 24 creating+peering, 388 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:14.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: audit 2024-03-11T22:13:12.728644+0000 mon.c (mon.2) 204 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:14.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[21434]: cluster 2024-03-11T22:13:13.328730+0000 mon.a (mon.0) 1058 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-03-11T22:13:14.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-03-11T22:13:14.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-03-11T22:13:14.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-03-11T22:13:14.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-03-11T22:13:14.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: seed 64334 2024-03-11T22:13:14.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-03-11T22:13:14.545 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (223 ms) 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (29 ms) 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (1 ms) 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (8 ms) 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (13 ms) 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (274 ms total) 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (2839 ms) 2024-03-11T22:13:14.546 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (2 ms) 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (10 ms) 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (2851 ms total) 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (42232 ms total) 2024-03-11T22:13:14.547 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: audit 2024-03-11T22:13:11.727756+0000 mon.c (mon.2) 203 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: audit 2024-03-11T22:13:12.232735+0000 mon.a (mon.0) 1054 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]: dispatch 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: audit 2024-03-11T22:13:12.239556+0000 mon.a (mon.0) 1055 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: audit 2024-03-11T22:13:12.239677+0000 mon.a (mon.0) 1056 : audit 1 from='client.25421 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: audit 2024-03-11T22:13:12.239758+0000 mon.a (mon.0) 1057 : audit 1 from='client.25427 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: audit 2024-03-11T22:13:12.262432+0000 mon.b (mon.1) 71 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: cluster 2024-03-11T22:13:12.641941+0000 mgr.y (mgr.14601) 191 : cluster 0 pgmap v144: 676 pgs: 264 unknown, 24 creating+peering, 388 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: audit 2024-03-11T22:13:12.728644+0000 mon.c (mon.2) 204 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:14.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:14 smithi187 bash[23415]: cluster 2024-03-11T22:13:13.328730+0000 mon.a (mon.0) 1058 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: audit 2024-03-11T22:13:11.727756+0000 mon.c (mon.2) 203 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: audit 2024-03-11T22:13:12.232735+0000 mon.a (mon.0) 1054 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]: dispatch 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: audit 2024-03-11T22:13:12.239556+0000 mon.a (mon.0) 1055 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: audit 2024-03-11T22:13:12.239677+0000 mon.a (mon.0) 1056 : audit 1 from='client.25421 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: audit 2024-03-11T22:13:12.239758+0000 mon.a (mon.0) 1057 : audit 1 from='client.25427 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: audit 2024-03-11T22:13:12.262432+0000 mon.b (mon.1) 71 : audit 1 from='client.? v1:172.21.15.49:0/2395296355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: cluster 2024-03-11T22:13:12.641941+0000 mgr.y (mgr.14601) 191 : cluster 0 pgmap v144: 676 pgs: 264 unknown, 24 creating+peering, 388 active+clean; 145 MiB data, 735 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: audit 2024-03-11T22:13:12.728644+0000 mon.c (mon.2) 204 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:14.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:14 smithi049 bash[28804]: cluster 2024-03-11T22:13:13.328730+0000 mon.a (mon.0) 1058 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-03-11T22:13:16.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: cluster 2024-03-11T22:13:13.353133+0000 mon.a (mon.0) 1059 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:16.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:13.363773+0000 mon.a (mon.0) 1060 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:16.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:13.371394+0000 mon.a (mon.0) 1061 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]': finished 2024-03-11T22:13:16.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:13.423663+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:16.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:13.731247+0000 mon.c (mon.2) 206 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:16.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: cluster 2024-03-11T22:13:14.478575+0000 mon.a (mon.0) 1062 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-03-11T22:13:16.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:14.487516+0000 mon.a (mon.0) 1063 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:16.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:14.488546+0000 mon.a (mon.0) 1064 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:16.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:14.495047+0000 mon.a (mon.0) 1065 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:16.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:16 smithi187 bash[23415]: audit 2024-03-11T22:13:14.501032+0000 mon.a (mon.0) 1066 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: cluster 2024-03-11T22:13:13.353133+0000 mon.a (mon.0) 1059 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:13.363773+0000 mon.a (mon.0) 1060 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:13.371394+0000 mon.a (mon.0) 1061 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]': finished 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:13.423663+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:13.731247+0000 mon.c (mon.2) 206 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: cluster 2024-03-11T22:13:14.478575+0000 mon.a (mon.0) 1062 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:14.487516+0000 mon.a (mon.0) 1063 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:14.488546+0000 mon.a (mon.0) 1064 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:17.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:14.495047+0000 mon.a (mon.0) 1065 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[21434]: audit 2024-03-11T22:13:14.501032+0000 mon.a (mon.0) 1066 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: cluster 2024-03-11T22:13:13.353133+0000 mon.a (mon.0) 1059 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:13.363773+0000 mon.a (mon.0) 1060 : audit 1 from='client.25168 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]: dispatch 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:13.371394+0000 mon.a (mon.0) 1061 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64412-6", "pg_num": 4}]': finished 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:13.423663+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:13.731247+0000 mon.c (mon.2) 206 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: cluster 2024-03-11T22:13:14.478575+0000 mon.a (mon.0) 1062 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:14.487516+0000 mon.a (mon.0) 1063 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:14.488546+0000 mon.a (mon.0) 1064 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:14.495047+0000 mon.a (mon.0) 1065 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:17.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:16 smithi049 bash[28804]: audit 2024-03-11T22:13:14.501032+0000 mon.a (mon.0) 1066 : audit 1 from='client.25168 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi049-64334-7"}]': finished 2024-03-11T22:13:17.797 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify_test_cb 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (244 ms) 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94766781958928 err -107 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1018 ms) 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94766781960176 err -107 2024-03-11T22:13:17.798 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1007 ms) 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 343597383680 cookie 94766781981632 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (6 ms) 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 343597383680 cookie 94766782002944 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (11 ms) 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 343597383681 cookie 94766782006240 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (6 ms) 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 343597383680 cookie 94766782006240 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 343597383680 cookie 94766782030496 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (13 ms) 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-03-11T22:13:17.799 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 343597383681 cookie 94766782030496 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 347892350978 cookie 94766782030496 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3010 ms) 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94766782051904 err -107 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_cb from 24770 notify_id 369367187458 cookie 94766782051904 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5019 ms) 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94766782051904 err -107 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1010 ms) 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11344 ms total) 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-03-11T22:13:17.800 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: watch_notify_test_cb 2024-03-11T22:13:17.801 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1791 ms) 2024-03-11T22:13:17.801 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1791 ms total) 2024-03-11T22:13:17.801 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: 2024-03-11T22:13:17.801 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-03-11T22:13:17.801 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (45471 ms total) 2024-03-11T22:13:17.801 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-03-11T22:13:17.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:14.510484+0000 mon.b (mon.1) 72 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:17.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:14.513303+0000 mon.b (mon.1) 73 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:17.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:14.522679+0000 mon.b (mon.1) 74 : audit 1 from='client.? v1:172.21.15.49:0/4090639525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:14.535093+0000 mon.b (mon.1) 75 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: cluster 2024-03-11T22:13:14.643742+0000 mgr.y (mgr.14601) 192 : cluster 0 pgmap v147: 584 pgs: 453 active+clean, 1 active, 1 creating+activating, 44 creating+peering, 83 unknown, 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim; 145 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:14.736803+0000 mon.c (mon.2) 207 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:15.743390+0000 mon.c (mon.2) 208 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: cluster 2024-03-11T22:13:16.644479+0000 mgr.y (mgr.14601) 193 : cluster 0 pgmap v148: 584 pgs: 453 active+clean, 1 active, 1 creating+activating, 44 creating+peering, 83 unknown, 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim; 145 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 553 B/s wr, 2 op/s 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: cluster 2024-03-11T22:13:16.700757+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.711499+0000 mon.a (mon.0) 1068 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.724043+0000 mon.a (mon.0) 1069 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.727319+0000 mon.a (mon.0) 1070 : audit 1 from='client.25957 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.728762+0000 mon.a (mon.0) 1071 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.731188+0000 mon.a (mon.0) 1072 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.731297+0000 mon.a (mon.0) 1073 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:17.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.731373+0000 mon.a (mon.0) 1074 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: cluster 2024-03-11T22:13:16.737139+0000 mon.a (mon.0) 1075 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.744128+0000 mon.a (mon.0) 1076 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.745270+0000 mon.a (mon.0) 1077 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.755933+0000 mon.c (mon.2) 209 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.767386+0000 mon.c (mon.2) 210 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.768152+0000 mon.b (mon.1) 76 : audit 1 from='client.? v1:172.21.15.49:0/3006504836' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:16.769647+0000 mon.b (mon.1) 77 : audit 1 from='client.? v1:172.21.15.49:0/1284792770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:17.343113+0000 mon.a (mon.0) 1078 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:17.344901+0000 mon.a (mon.0) 1079 : audit 1 from='client.28048 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:17.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:17 smithi187 bash[23415]: audit 2024-03-11T22:13:17.345403+0000 mon.a (mon.0) 1080 : audit 1 from='client.28051 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:14.510484+0000 mon.b (mon.1) 72 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:14.513303+0000 mon.b (mon.1) 73 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:14.522679+0000 mon.b (mon.1) 74 : audit 1 from='client.? v1:172.21.15.49:0/4090639525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:14.535093+0000 mon.b (mon.1) 75 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: cluster 2024-03-11T22:13:14.643742+0000 mgr.y (mgr.14601) 192 : cluster 0 pgmap v147: 584 pgs: 453 active+clean, 1 active, 1 creating+activating, 44 creating+peering, 83 unknown, 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim; 145 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:14.736803+0000 mon.c (mon.2) 207 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:15.743390+0000 mon.c (mon.2) 208 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: cluster 2024-03-11T22:13:16.644479+0000 mgr.y (mgr.14601) 193 : cluster 0 pgmap v148: 584 pgs: 453 active+clean, 1 active, 1 creating+activating, 44 creating+peering, 83 unknown, 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim; 145 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 553 B/s wr, 2 op/s 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: cluster 2024-03-11T22:13:16.700757+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.711499+0000 mon.a (mon.0) 1068 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:18.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.724043+0000 mon.a (mon.0) 1069 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.727319+0000 mon.a (mon.0) 1070 : audit 1 from='client.25957 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.728762+0000 mon.a (mon.0) 1071 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.731188+0000 mon.a (mon.0) 1072 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.731297+0000 mon.a (mon.0) 1073 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.731373+0000 mon.a (mon.0) 1074 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: cluster 2024-03-11T22:13:16.737139+0000 mon.a (mon.0) 1075 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.744128+0000 mon.a (mon.0) 1076 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.745270+0000 mon.a (mon.0) 1077 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.755933+0000 mon.c (mon.2) 209 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.767386+0000 mon.c (mon.2) 210 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.768152+0000 mon.b (mon.1) 76 : audit 1 from='client.? v1:172.21.15.49:0/3006504836' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:16.769647+0000 mon.b (mon.1) 77 : audit 1 from='client.? v1:172.21.15.49:0/1284792770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:17.343113+0000 mon.a (mon.0) 1078 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:18.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:17.344901+0000 mon.a (mon.0) 1079 : audit 1 from='client.28048 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[21434]: audit 2024-03-11T22:13:17.345403+0000 mon.a (mon.0) 1080 : audit 1 from='client.28051 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:14.510484+0000 mon.b (mon.1) 72 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:18.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:14.513303+0000 mon.b (mon.1) 73 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:14.522679+0000 mon.b (mon.1) 74 : audit 1 from='client.? v1:172.21.15.49:0/4090639525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:14.535093+0000 mon.b (mon.1) 75 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:18.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: cluster 2024-03-11T22:13:14.643742+0000 mgr.y (mgr.14601) 192 : cluster 0 pgmap v147: 584 pgs: 453 active+clean, 1 active, 1 creating+activating, 44 creating+peering, 83 unknown, 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim; 145 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:13:18.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:14.736803+0000 mon.c (mon.2) 207 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:18.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:15.743390+0000 mon.c (mon.2) 208 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: cluster 2024-03-11T22:13:16.644479+0000 mgr.y (mgr.14601) 193 : cluster 0 pgmap v148: 584 pgs: 453 active+clean, 1 active, 1 creating+activating, 44 creating+peering, 83 unknown, 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim; 145 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 553 B/s wr, 2 op/s 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: cluster 2024-03-11T22:13:16.700757+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.711499+0000 mon.a (mon.0) 1068 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.724043+0000 mon.a (mon.0) 1069 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.727319+0000 mon.a (mon.0) 1070 : audit 1 from='client.25957 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.728762+0000 mon.a (mon.0) 1071 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.731188+0000 mon.a (mon.0) 1072 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.731297+0000 mon.a (mon.0) 1073 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.731373+0000 mon.a (mon.0) 1074 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: cluster 2024-03-11T22:13:16.737139+0000 mon.a (mon.0) 1075 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.744128+0000 mon.a (mon.0) 1076 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi049-64859-2"}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.745270+0000 mon.a (mon.0) 1077 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.755933+0000 mon.c (mon.2) 209 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.767386+0000 mon.c (mon.2) 210 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:18.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.768152+0000 mon.b (mon.1) 76 : audit 1 from='client.? v1:172.21.15.49:0/3006504836' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:16.769647+0000 mon.b (mon.1) 77 : audit 1 from='client.? v1:172.21.15.49:0/1284792770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:17.343113+0000 mon.a (mon.0) 1078 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:18.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:17.344901+0000 mon.a (mon.0) 1079 : audit 1 from='client.28048 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:17 smithi049 bash[28804]: audit 2024-03-11T22:13:17.345403+0000 mon.a (mon.0) 1080 : audit 1 from='client.28051 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: Running main() from gmock_main.cc 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [----------] Global test environment set-up. 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ OK ] NeoRadosPools.PoolList (16279 ms) 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (10562 ms) 2024-03-11T22:13:18.506 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (4698 ms) 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (7034 ms) 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (3402 ms) 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (3979 ms) 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [----------] 6 tests from NeoRadosPools (45954 ms total) 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [----------] Global test environment tear-down 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [==========] 6 tests from 1 test suite ran. (45954 ms total) 2024-03-11T22:13:18.507 INFO:tasks.workunit.client.0.smithi049.stdout: pool: [ PASSED ] 6 tests. 2024-03-11T22:13:18.510 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: Running main() from gmock_main.cc 2024-03-11T22:13:18.510 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-03-11T22:13:18.510 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [----------] Global test environment set-up. 2024-03-11T22:13:18.510 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-03-11T22:13:18.510 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-03-11T22:13:18.510 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (167 ms) 2024-03-11T22:13:18.510 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: no timeout :/ 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: no timeout :/ 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: no timeout :/ 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: no timeout :/ 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: no timeout :/ 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (24 ms) 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (8 ms) 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.Checksum (1434 ms) 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (7 ms) 2024-03-11T22:13:18.511 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (3 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (24 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.TruncTest (9 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (5 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (6 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.RmXattr (17 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIo.XattrIter (17 ms) 2024-03-11T22:13:18.512 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [----------] 14 tests from LibRadosIo (1723 ms total) 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (2377 ms) 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (1094 ms) 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (26 ms) 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (23 ms) 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (16 ms) 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2024-03-11T22:13:18.513 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (5 ms) 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (17 ms) 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (33 ms) 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (12 ms) 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [----------] 10 tests from LibRadosIoEC (3608 ms total) 2024-03-11T22:13:18.514 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: 2024-03-11T22:13:18.533 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [----------] Global test environment tear-down 2024-03-11T22:13:18.533 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [==========] 24 tests from 2 test suites ran. (46343 ms total) 2024-03-11T22:13:18.534 INFO:tasks.workunit.client.0.smithi049.stdout: api_io: [ PASSED ] 24 tests. 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: Running main() from gmock_main.cc 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [----------] Global test environment set-up. 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStat.Stat (248 ms) 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-03-11T22:13:18.553 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (5 ms) 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStat.StatNS (18 ms) 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (1 ms) 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (2 ms) 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [----------] 5 tests from LibRadosStat (274 ms total) 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (3477 ms) 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (46 ms) 2024-03-11T22:13:18.554 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (2 ms) 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (3527 ms total) 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [----------] Global test environment tear-down 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (46254 ms total) 2024-03-11T22:13:18.555 INFO:tasks.workunit.client.0.smithi049.stdout: api_stat: [ PASSED ] 9 tests. 2024-03-11T22:13:18.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:13:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.739689+0000 mon.a (mon.0) 1081 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.739786+0000 mon.a (mon.0) 1082 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.739869+0000 mon.a (mon.0) 1083 : audit 1 from='client.25957 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.739942+0000 mon.a (mon.0) 1084 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.740011+0000 mon.a (mon.0) 1085 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.740070+0000 mon.a (mon.0) 1086 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.741249+0000 mon.a (mon.0) 1087 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.741351+0000 mon.a (mon.0) 1088 : audit 1 from='client.28048 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.741434+0000 mon.a (mon.0) 1089 : audit 1 from='client.28051 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.745048+0000 mon.b (mon.1) 78 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:19.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.747705+0000 mon.b (mon.1) 79 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: cluster 2024-03-11T22:13:17.755728+0000 mon.a (mon.0) 1090 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.762572+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.775055+0000 mon.a (mon.0) 1091 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.775503+0000 mon.a (mon.0) 1092 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.776311+0000 mon.c (mon.2) 212 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.781221+0000 mon.a (mon.0) 1093 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:17.879487+0000 mon.b (mon.1) 80 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: cluster 2024-03-11T22:13:18.471001+0000 mon.a (mon.0) 1094 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: cluster 2024-03-11T22:13:18.474321+0000 mon.a (mon.0) 1095 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:18.482862+0000 mon.a (mon.0) 1096 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:18.482945+0000 mon.a (mon.0) 1097 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]': finished 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:18.483009+0000 mon.a (mon.0) 1098 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:18.518684+0000 mon.b (mon.1) 81 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: audit 2024-03-11T22:13:18.778996+0000 mon.c (mon.2) 213 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:19.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:19 smithi187 bash[23415]: cluster 2024-03-11T22:13:19.100368+0000 mon.a (mon.0) 1099 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.739689+0000 mon.a (mon.0) 1081 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.739786+0000 mon.a (mon.0) 1082 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.739869+0000 mon.a (mon.0) 1083 : audit 1 from='client.25957 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.739942+0000 mon.a (mon.0) 1084 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.740011+0000 mon.a (mon.0) 1085 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.740070+0000 mon.a (mon.0) 1086 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.741249+0000 mon.a (mon.0) 1087 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.741351+0000 mon.a (mon.0) 1088 : audit 1 from='client.28048 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.741434+0000 mon.a (mon.0) 1089 : audit 1 from='client.28051 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.745048+0000 mon.b (mon.1) 78 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.747705+0000 mon.b (mon.1) 79 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: cluster 2024-03-11T22:13:17.755728+0000 mon.a (mon.0) 1090 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.762572+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.775055+0000 mon.a (mon.0) 1091 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.775503+0000 mon.a (mon.0) 1092 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.776311+0000 mon.c (mon.2) 212 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.781221+0000 mon.a (mon.0) 1093 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:17.879487+0000 mon.b (mon.1) 80 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: cluster 2024-03-11T22:13:18.471001+0000 mon.a (mon.0) 1094 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: cluster 2024-03-11T22:13:18.474321+0000 mon.a (mon.0) 1095 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:18.482862+0000 mon.a (mon.0) 1096 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:18.482945+0000 mon.a (mon.0) 1097 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]': finished 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:18.483009+0000 mon.a (mon.0) 1098 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:19.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:18.518684+0000 mon.b (mon.1) 81 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:19.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: audit 2024-03-11T22:13:18.778996+0000 mon.c (mon.2) 213 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:19.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[28804]: cluster 2024-03-11T22:13:19.100368+0000 mon.a (mon.0) 1099 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-03-11T22:13:19.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.739689+0000 mon.a (mon.0) 1081 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:19.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.739786+0000 mon.a (mon.0) 1082 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.739869+0000 mon.a (mon.0) 1083 : audit 1 from='client.25957 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.739942+0000 mon.a (mon.0) 1084 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:19.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.740011+0000 mon.a (mon.0) 1085 : audit 1 from='client.? v1:172.21.15.49:0/1151473456' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi049-64859-2"}]': finished 2024-03-11T22:13:19.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.740070+0000 mon.a (mon.0) 1086 : audit 1 from='client.? v1:172.21.15.49:0/2593951977' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi049-64379-12"}]': finished 2024-03-11T22:13:19.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.741249+0000 mon.a (mon.0) 1087 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "overlaypool": "test-rados-api-smithi049-64412-6"}]': finished 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.741351+0000 mon.a (mon.0) 1088 : audit 1 from='client.28048 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.741434+0000 mon.a (mon.0) 1089 : audit 1 from='client.28051 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi049-64055-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.745048+0000 mon.b (mon.1) 78 : audit 1 from='client.? v1:172.21.15.49:0/1492229851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.747705+0000 mon.b (mon.1) 79 : audit 1 from='client.? v1:172.21.15.49:0/3223389891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: cluster 2024-03-11T22:13:17.755728+0000 mon.a (mon.0) 1090 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.762572+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]: dispatch 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.775055+0000 mon.a (mon.0) 1091 : audit 1 from='client.25216 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]: dispatch 2024-03-11T22:13:19.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.775503+0000 mon.a (mon.0) 1092 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]: dispatch 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.776311+0000 mon.c (mon.2) 212 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.781221+0000 mon.a (mon.0) 1093 : audit 1 from='client.25174 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]: dispatch 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:17.879487+0000 mon.b (mon.1) 80 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: cluster 2024-03-11T22:13:18.471001+0000 mon.a (mon.0) 1094 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: cluster 2024-03-11T22:13:18.474321+0000 mon.a (mon.0) 1095 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:18.482862+0000 mon.a (mon.0) 1096 : audit 1 from='client.25216 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi049-64071-16"}]': finished 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:18.482945+0000 mon.a (mon.0) 1097 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64412-6", "mode": "writeback"}]': finished 2024-03-11T22:13:19.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:18.483009+0000 mon.a (mon.0) 1098 : audit 1 from='client.25174 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi049-64290-7"}]': finished 2024-03-11T22:13:19.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:18.518684+0000 mon.b (mon.1) 81 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:19.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: audit 2024-03-11T22:13:18.778996+0000 mon.c (mon.2) 213 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:19.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:19 smithi049 bash[21434]: cluster 2024-03-11T22:13:19.100368+0000 mon.a (mon.0) 1099 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-03-11T22:13:21.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:21 smithi187 bash[23415]: audit 2024-03-11T22:13:18.559659+0000 mgr.y (mgr.14601) 194 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:21.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:21 smithi187 bash[23415]: cluster 2024-03-11T22:13:18.645530+0000 mgr.y (mgr.14601) 195 : cluster 0 pgmap v152: 584 pgs: 552 active+clean, 32 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 495 B/s wr, 2 op/s 2024-03-11T22:13:21.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:21 smithi187 bash[23415]: audit 2024-03-11T22:13:19.117288+0000 mon.a (mon.0) 1100 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:21.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:21 smithi187 bash[23415]: audit 2024-03-11T22:13:19.683141+0000 mon.a (mon.0) 1101 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:21.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:21 smithi187 bash[23415]: audit 2024-03-11T22:13:19.704104+0000 mon.a (mon.0) 1102 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:21.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[21434]: audit 2024-03-11T22:13:18.559659+0000 mgr.y (mgr.14601) 194 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[21434]: cluster 2024-03-11T22:13:18.645530+0000 mgr.y (mgr.14601) 195 : cluster 0 pgmap v152: 584 pgs: 552 active+clean, 32 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 495 B/s wr, 2 op/s 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[21434]: audit 2024-03-11T22:13:19.117288+0000 mon.a (mon.0) 1100 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[21434]: audit 2024-03-11T22:13:19.683141+0000 mon.a (mon.0) 1101 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[21434]: audit 2024-03-11T22:13:19.704104+0000 mon.a (mon.0) 1102 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[28804]: audit 2024-03-11T22:13:18.559659+0000 mgr.y (mgr.14601) 194 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[28804]: cluster 2024-03-11T22:13:18.645530+0000 mgr.y (mgr.14601) 195 : cluster 0 pgmap v152: 584 pgs: 552 active+clean, 32 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 495 B/s wr, 2 op/s 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[28804]: audit 2024-03-11T22:13:19.117288+0000 mon.a (mon.0) 1100 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[28804]: audit 2024-03-11T22:13:19.683141+0000 mon.a (mon.0) 1101 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:21.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:21 smithi049 bash[28804]: audit 2024-03-11T22:13:19.704104+0000 mon.a (mon.0) 1102 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi049-64859-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: notify 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (2999 ms) 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (12 ms) 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (3011 ms total) 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: 2024-03-11T22:13:21.835 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: notify 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (1171 ms) 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: notify 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (7368 ms) 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (40 ms) 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (19 ms) 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429653984 notify_id 438086664193 notifier_gid 25406 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (33 ms) 2024-03-11T22:13:21.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429674512 notify_id 438086664194 notifier_gid 25406 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (32 ms) 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429674512 notify_id 438086664195 notifier_gid 25406 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (27 ms) 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429674512 notify_id 438086664196 notifier_gid 25406 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (10 ms) 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429676704 notify_id 438086664193 notifier_gid 25406 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (21 ms) 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429684848 notify_id 438086664195 notifier_gid 25406 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (10 ms) 2024-03-11T22:13:21.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-03-11T22:13:21.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: trying... 2024-03-11T22:13:21.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429684848 notify_id 438086664196 notifier_gid 25406 2024-03-11T22:13:21.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: timed out 2024-03-11T22:13:21.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: flushing 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: audit 2024-03-11T22:13:19.710230+0000 mon.b (mon.1) 82 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: audit 2024-03-11T22:13:19.751819+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.49:0/2215232607' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: audit 2024-03-11T22:13:19.781769+0000 mon.c (mon.2) 215 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: cluster 2024-03-11T22:13:20.646281+0000 mgr.y (mgr.14601) 196 : cluster 0 pgmap v154: 584 pgs: 488 active+clean, 96 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: audit 2024-03-11T22:13:20.785168+0000 mon.c (mon.2) 216 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: cluster 2024-03-11T22:13:21.395044+0000 mon.a (mon.0) 1103 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: audit 2024-03-11T22:13:21.402802+0000 mon.a (mon.0) 1104 : audit 1 from='client.31823 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:22.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:22 smithi187 bash[23415]: audit 2024-03-11T22:13:21.410151+0000 mon.a (mon.0) 1105 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: audit 2024-03-11T22:13:19.710230+0000 mon.b (mon.1) 82 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: audit 2024-03-11T22:13:19.751819+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.49:0/2215232607' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: audit 2024-03-11T22:13:19.781769+0000 mon.c (mon.2) 215 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: cluster 2024-03-11T22:13:20.646281+0000 mgr.y (mgr.14601) 196 : cluster 0 pgmap v154: 584 pgs: 488 active+clean, 96 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: audit 2024-03-11T22:13:20.785168+0000 mon.c (mon.2) 216 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: cluster 2024-03-11T22:13:21.395044+0000 mon.a (mon.0) 1103 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: audit 2024-03-11T22:13:21.402802+0000 mon.a (mon.0) 1104 : audit 1 from='client.31823 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:23.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[28804]: audit 2024-03-11T22:13:21.410151+0000 mon.a (mon.0) 1105 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: audit 2024-03-11T22:13:19.710230+0000 mon.b (mon.1) 82 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: audit 2024-03-11T22:13:19.751819+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.49:0/2215232607' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: audit 2024-03-11T22:13:19.781769+0000 mon.c (mon.2) 215 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: cluster 2024-03-11T22:13:20.646281+0000 mgr.y (mgr.14601) 196 : cluster 0 pgmap v154: 584 pgs: 488 active+clean, 96 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: audit 2024-03-11T22:13:20.785168+0000 mon.c (mon.2) 216 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: cluster 2024-03-11T22:13:21.395044+0000 mon.a (mon.0) 1103 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: audit 2024-03-11T22:13:21.402802+0000 mon.a (mon.0) 1104 : audit 1 from='client.31823 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:23.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:22 smithi049 bash[21434]: audit 2024-03-11T22:13:21.410151+0000 mon.a (mon.0) 1105 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:24.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: audit 2024-03-11T22:13:21.418050+0000 mon.a (mon.0) 1106 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:24.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: audit 2024-03-11T22:13:21.459584+0000 mon.b (mon.1) 83 : audit 1 from='client.? v1:172.21.15.49:0/2957615436' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:24.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: audit 2024-03-11T22:13:21.558777+0000 mon.b (mon.1) 84 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:24.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: audit 2024-03-11T22:13:21.792238+0000 mon.c (mon.2) 217 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:24.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: cluster 2024-03-11T22:13:22.534057+0000 mon.a (mon.0) 1107 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-03-11T22:13:24.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: audit 2024-03-11T22:13:22.543640+0000 mon.a (mon.0) 1108 : audit 1 from='client.32257 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:24.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: audit 2024-03-11T22:13:22.545103+0000 mon.a (mon.0) 1109 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:24.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:24 smithi187 bash[23415]: audit 2024-03-11T22:13:22.564517+0000 mon.a (mon.0) 1110 : audit 1 from='client.31823 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: audit 2024-03-11T22:13:21.418050+0000 mon.a (mon.0) 1106 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: audit 2024-03-11T22:13:21.459584+0000 mon.b (mon.1) 83 : audit 1 from='client.? v1:172.21.15.49:0/2957615436' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: audit 2024-03-11T22:13:21.558777+0000 mon.b (mon.1) 84 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: audit 2024-03-11T22:13:21.792238+0000 mon.c (mon.2) 217 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: cluster 2024-03-11T22:13:22.534057+0000 mon.a (mon.0) 1107 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: audit 2024-03-11T22:13:22.543640+0000 mon.a (mon.0) 1108 : audit 1 from='client.32257 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: audit 2024-03-11T22:13:22.545103+0000 mon.a (mon.0) 1109 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[28804]: audit 2024-03-11T22:13:22.564517+0000 mon.a (mon.0) 1110 : audit 1 from='client.31823 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:13:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: audit 2024-03-11T22:13:21.418050+0000 mon.a (mon.0) 1106 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: audit 2024-03-11T22:13:21.459584+0000 mon.b (mon.1) 83 : audit 1 from='client.? v1:172.21.15.49:0/2957615436' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: audit 2024-03-11T22:13:21.558777+0000 mon.b (mon.1) 84 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: audit 2024-03-11T22:13:21.792238+0000 mon.c (mon.2) 217 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: cluster 2024-03-11T22:13:22.534057+0000 mon.a (mon.0) 1107 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: audit 2024-03-11T22:13:22.543640+0000 mon.a (mon.0) 1108 : audit 1 from='client.32257 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: audit 2024-03-11T22:13:22.545103+0000 mon.a (mon.0) 1109 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:24 smithi049 bash[21434]: audit 2024-03-11T22:13:22.564517+0000 mon.a (mon.0) 1110 : audit 1 from='client.31823 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:22.647035+0000 mgr.y (mgr.14601) 197 : cluster 0 pgmap v157: 680 pgs: 424 active+clean, 256 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-11T22:13:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.799401+0000 mon.c (mon.2) 218 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.900429+0000 mon.b (mon.1) 85 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:13:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.902708+0000 mon.b (mon.1) 86 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:13:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.904480+0000 mon.b (mon.1) 87 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:13:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.907366+0000 mon.b (mon.1) 88 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.907792+0000 mgr.y (mgr.14601) 198 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.908878+0000 mgr.y (mgr.14601) 199 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.909605+0000 mon.b (mon.1) 89 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.912053+0000 mgr.y (mgr.14601) 200 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.913468+0000 mgr.y (mgr.14601) 201 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.914712+0000 mon.b (mon.1) 90 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.916240+0000 mon.b (mon.1) 91 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.917127+0000 mon.b (mon.1) 92 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.918162+0000 mon.b (mon.1) 93 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.918865+0000 mgr.y (mgr.14601) 202 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.919425+0000 mon.b (mon.1) 94 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.921497+0000 mgr.y (mgr.14601) 203 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.922498+0000 mgr.y (mgr.14601) 204 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:13:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.923254+0000 mgr.y (mgr.14601) 205 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.924263+0000 mgr.y (mgr.14601) 206 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:22.926439+0000 mgr.y (mgr.14601) 207 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:23.126602+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.49:0/309474609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:23.141409+0000 mon.c (mon.2) 219 : audit 1 from='client.? v1:172.21.15.49:0/2855769851' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.375096+0000 osd.0 (osd.0) 5 : cluster 0 13.3 deep-scrub starts 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.409372+0000 osd.0 (osd.0) 6 : cluster 0 13.3 deep-scrub ok 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.461221+0000 osd.2 (osd.2) 5 : cluster 0 13.8 deep-scrub starts 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.468053+0000 osd.2 (osd.2) 6 : cluster 0 13.8 deep-scrub ok 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.669445+0000 osd.5 (osd.5) 7 : cluster 0 13.2 deep-scrub starts 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.670758+0000 osd.7 (osd.7) 7 : cluster 0 13.7 deep-scrub starts 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.673806+0000 osd.7 (osd.7) 8 : cluster 0 13.7 deep-scrub ok 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.679524+0000 osd.5 (osd.5) 8 : cluster 0 13.2 deep-scrub ok 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.690601+0000 osd.4 (osd.4) 7 : cluster 0 13.6 deep-scrub starts 2024-03-11T22:13:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.696679+0000 osd.4 (osd.4) 8 : cluster 0 13.6 deep-scrub ok 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:23.803461+0000 mon.c (mon.2) 220 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.888954+0000 osd.6 (osd.6) 7 : cluster 0 13.1 deep-scrub starts 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:23.894599+0000 osd.6 (osd.6) 8 : cluster 0 13.1 deep-scrub ok 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.212891+0000 mon.a (mon.0) 1111 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.216869+0000 mon.a (mon.0) 1112 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.236745+0000 mon.a (mon.0) 1113 : audit 1 from='client.33536 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.239512+0000 mon.a (mon.0) 1114 : audit 1 from='client.34075 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.256960+0000 mon.a (mon.0) 1115 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.257814+0000 mon.a (mon.0) 1116 : audit 1 from='client.32257 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.257925+0000 mon.a (mon.0) 1117 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.261852+0000 mon.a (mon.0) 1118 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.277262+0000 mon.b (mon.1) 96 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.279700+0000 mon.c (mon.2) 221 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.280065+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.49:0/3118530704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.647860+0000 mgr.y (mgr.14601) 208 : cluster 0 pgmap v159: 752 pgs: 1 active+clean+scrubbing+deep, 487 active+clean, 73 creating+peering, 191 unknown; 217 MiB data, 942 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 15 MiB/s wr, 5 op/s 2024-03-11T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.806043+0000 mon.c (mon.2) 223 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.855419+0000 mon.a (mon.0) 1119 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-03-11T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.869026+0000 mon.a (mon.0) 1120 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:25 smithi187 bash[23415]: audit 2024-03-11T22:13:24.869485+0000 mon.a (mon.0) 1121 : audit 1 from='client.35210 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:22.647035+0000 mgr.y (mgr.14601) 197 : cluster 0 pgmap v157: 680 pgs: 424 active+clean, 256 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.799401+0000 mon.c (mon.2) 218 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.900429+0000 mon.b (mon.1) 85 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.902708+0000 mon.b (mon.1) 86 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.904480+0000 mon.b (mon.1) 87 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.907366+0000 mon.b (mon.1) 88 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.907792+0000 mgr.y (mgr.14601) 198 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.908878+0000 mgr.y (mgr.14601) 199 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.909605+0000 mon.b (mon.1) 89 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:13:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.912053+0000 mgr.y (mgr.14601) 200 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.913468+0000 mgr.y (mgr.14601) 201 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.914712+0000 mon.b (mon.1) 90 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.916240+0000 mon.b (mon.1) 91 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.917127+0000 mon.b (mon.1) 92 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.918162+0000 mon.b (mon.1) 93 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.918865+0000 mgr.y (mgr.14601) 202 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.919425+0000 mon.b (mon.1) 94 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.921497+0000 mgr.y (mgr.14601) 203 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.922498+0000 mgr.y (mgr.14601) 204 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.923254+0000 mgr.y (mgr.14601) 205 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.924263+0000 mgr.y (mgr.14601) 206 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:22.926439+0000 mgr.y (mgr.14601) 207 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:23.126602+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.49:0/309474609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:23.141409+0000 mon.c (mon.2) 219 : audit 1 from='client.? v1:172.21.15.49:0/2855769851' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.375096+0000 osd.0 (osd.0) 5 : cluster 0 13.3 deep-scrub starts 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.409372+0000 osd.0 (osd.0) 6 : cluster 0 13.3 deep-scrub ok 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.461221+0000 osd.2 (osd.2) 5 : cluster 0 13.8 deep-scrub starts 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.468053+0000 osd.2 (osd.2) 6 : cluster 0 13.8 deep-scrub ok 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.669445+0000 osd.5 (osd.5) 7 : cluster 0 13.2 deep-scrub starts 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.670758+0000 osd.7 (osd.7) 7 : cluster 0 13.7 deep-scrub starts 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.673806+0000 osd.7 (osd.7) 8 : cluster 0 13.7 deep-scrub ok 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.679524+0000 osd.5 (osd.5) 8 : cluster 0 13.2 deep-scrub ok 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.690601+0000 osd.4 (osd.4) 7 : cluster 0 13.6 deep-scrub starts 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.696679+0000 osd.4 (osd.4) 8 : cluster 0 13.6 deep-scrub ok 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:23.803461+0000 mon.c (mon.2) 220 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.888954+0000 osd.6 (osd.6) 7 : cluster 0 13.1 deep-scrub starts 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:23.894599+0000 osd.6 (osd.6) 8 : cluster 0 13.1 deep-scrub ok 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.212891+0000 mon.a (mon.0) 1111 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-03-11T22:13:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.216869+0000 mon.a (mon.0) 1112 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.236745+0000 mon.a (mon.0) 1113 : audit 1 from='client.33536 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.239512+0000 mon.a (mon.0) 1114 : audit 1 from='client.34075 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.256960+0000 mon.a (mon.0) 1115 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.257814+0000 mon.a (mon.0) 1116 : audit 1 from='client.32257 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.257925+0000 mon.a (mon.0) 1117 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.261852+0000 mon.a (mon.0) 1118 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.277262+0000 mon.b (mon.1) 96 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.279700+0000 mon.c (mon.2) 221 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.280065+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.49:0/3118530704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.647860+0000 mgr.y (mgr.14601) 208 : cluster 0 pgmap v159: 752 pgs: 1 active+clean+scrubbing+deep, 487 active+clean, 73 creating+peering, 191 unknown; 217 MiB data, 942 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 15 MiB/s wr, 5 op/s 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.806043+0000 mon.c (mon.2) 223 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.855419+0000 mon.a (mon.0) 1119 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-03-11T22:13:25.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.869026+0000 mon.a (mon.0) 1120 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:25.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[28804]: audit 2024-03-11T22:13:24.869485+0000 mon.a (mon.0) 1121 : audit 1 from='client.35210 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:22.647035+0000 mgr.y (mgr.14601) 197 : cluster 0 pgmap v157: 680 pgs: 424 active+clean, 256 unknown; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.799401+0000 mon.c (mon.2) 218 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.900429+0000 mon.b (mon.1) 85 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.902708+0000 mon.b (mon.1) 86 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.904480+0000 mon.b (mon.1) 87 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.907366+0000 mon.b (mon.1) 88 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.907792+0000 mgr.y (mgr.14601) 198 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.908878+0000 mgr.y (mgr.14601) 199 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.909605+0000 mon.b (mon.1) 89 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.912053+0000 mgr.y (mgr.14601) 200 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.913468+0000 mgr.y (mgr.14601) 201 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2024-03-11T22:13:25.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.914712+0000 mon.b (mon.1) 90 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.916240+0000 mon.b (mon.1) 91 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.917127+0000 mon.b (mon.1) 92 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.918162+0000 mon.b (mon.1) 93 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.918865+0000 mgr.y (mgr.14601) 202 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.919425+0000 mon.b (mon.1) 94 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.921497+0000 mgr.y (mgr.14601) 203 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.922498+0000 mgr.y (mgr.14601) 204 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.923254+0000 mgr.y (mgr.14601) 205 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.924263+0000 mgr.y (mgr.14601) 206 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:22.926439+0000 mgr.y (mgr.14601) 207 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:23.126602+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.49:0/309474609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:23.141409+0000 mon.c (mon.2) 219 : audit 1 from='client.? v1:172.21.15.49:0/2855769851' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.375096+0000 osd.0 (osd.0) 5 : cluster 0 13.3 deep-scrub starts 2024-03-11T22:13:25.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.409372+0000 osd.0 (osd.0) 6 : cluster 0 13.3 deep-scrub ok 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.461221+0000 osd.2 (osd.2) 5 : cluster 0 13.8 deep-scrub starts 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.468053+0000 osd.2 (osd.2) 6 : cluster 0 13.8 deep-scrub ok 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.669445+0000 osd.5 (osd.5) 7 : cluster 0 13.2 deep-scrub starts 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.670758+0000 osd.7 (osd.7) 7 : cluster 0 13.7 deep-scrub starts 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.673806+0000 osd.7 (osd.7) 8 : cluster 0 13.7 deep-scrub ok 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.679524+0000 osd.5 (osd.5) 8 : cluster 0 13.2 deep-scrub ok 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.690601+0000 osd.4 (osd.4) 7 : cluster 0 13.6 deep-scrub starts 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.696679+0000 osd.4 (osd.4) 8 : cluster 0 13.6 deep-scrub ok 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:23.803461+0000 mon.c (mon.2) 220 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.888954+0000 osd.6 (osd.6) 7 : cluster 0 13.1 deep-scrub starts 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:23.894599+0000 osd.6 (osd.6) 8 : cluster 0 13.1 deep-scrub ok 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.212891+0000 mon.a (mon.0) 1111 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-03-11T22:13:25.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.216869+0000 mon.a (mon.0) 1112 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.236745+0000 mon.a (mon.0) 1113 : audit 1 from='client.33536 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.239512+0000 mon.a (mon.0) 1114 : audit 1 from='client.34075 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.256960+0000 mon.a (mon.0) 1115 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi049-64859-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.257814+0000 mon.a (mon.0) 1116 : audit 1 from='client.32257 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi049-64272-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.257925+0000 mon.a (mon.0) 1117 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.261852+0000 mon.a (mon.0) 1118 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.277262+0000 mon.b (mon.1) 96 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.279700+0000 mon.c (mon.2) 221 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.280065+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.49:0/3118530704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.647860+0000 mgr.y (mgr.14601) 208 : cluster 0 pgmap v159: 752 pgs: 1 active+clean+scrubbing+deep, 487 active+clean, 73 creating+peering, 191 unknown; 217 MiB data, 942 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 15 MiB/s wr, 5 op/s 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.806043+0000 mon.c (mon.2) 223 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.855419+0000 mon.a (mon.0) 1119 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-03-11T22:13:25.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.869026+0000 mon.a (mon.0) 1120 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:25.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:25 smithi049 bash[21434]: audit 2024-03-11T22:13:24.869485+0000 mon.a (mon.0) 1121 : audit 1 from='client.35210 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.655866+0000 osd.4 (osd.4) 9 : cluster 0 13.5 deep-scrub starts 2024-03-11T22:13:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.657375+0000 osd.4 (osd.4) 10 : cluster 0 13.5 deep-scrub ok 2024-03-11T22:13:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.669958+0000 osd.7 (osd.7) 9 : cluster 0 13.0 deep-scrub starts 2024-03-11T22:13:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.671474+0000 osd.7 (osd.7) 10 : cluster 0 13.0 deep-scrub ok 2024-03-11T22:13:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.698207+0000 osd.5 (osd.5) 9 : cluster 0 13.9 deep-scrub starts 2024-03-11T22:13:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.772113+0000 osd.5 (osd.5) 10 : cluster 0 13.9 deep-scrub ok 2024-03-11T22:13:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.891768+0000 osd.6 (osd.6) 9 : cluster 0 13.4 deep-scrub starts 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:24.894472+0000 osd.6 (osd.6) 10 : cluster 0 13.4 deep-scrub ok 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: audit 2024-03-11T22:13:25.262434+0000 mon.a (mon.0) 1122 : audit 1 from='client.33536 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: audit 2024-03-11T22:13:25.262601+0000 mon.a (mon.0) 1123 : audit 1 from='client.34075 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: audit 2024-03-11T22:13:25.262684+0000 mon.a (mon.0) 1124 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]': finished 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: audit 2024-03-11T22:13:25.262754+0000 mon.a (mon.0) 1125 : audit 1 from='client.35210 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: cluster 2024-03-11T22:13:25.267516+0000 mon.a (mon.0) 1126 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: audit 2024-03-11T22:13:25.494724+0000 mon.b (mon.1) 97 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: audit 2024-03-11T22:13:25.810350+0000 mon.c (mon.2) 224 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:26 smithi187 bash[23415]: audit 2024-03-11T22:13:26.000366+0000 mon.a (mon.0) 1127 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:26.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.655866+0000 osd.4 (osd.4) 9 : cluster 0 13.5 deep-scrub starts 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.657375+0000 osd.4 (osd.4) 10 : cluster 0 13.5 deep-scrub ok 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.669958+0000 osd.7 (osd.7) 9 : cluster 0 13.0 deep-scrub starts 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.671474+0000 osd.7 (osd.7) 10 : cluster 0 13.0 deep-scrub ok 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.698207+0000 osd.5 (osd.5) 9 : cluster 0 13.9 deep-scrub starts 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.772113+0000 osd.5 (osd.5) 10 : cluster 0 13.9 deep-scrub ok 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.891768+0000 osd.6 (osd.6) 9 : cluster 0 13.4 deep-scrub starts 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:24.894472+0000 osd.6 (osd.6) 10 : cluster 0 13.4 deep-scrub ok 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: audit 2024-03-11T22:13:25.262434+0000 mon.a (mon.0) 1122 : audit 1 from='client.33536 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: audit 2024-03-11T22:13:25.262601+0000 mon.a (mon.0) 1123 : audit 1 from='client.34075 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: audit 2024-03-11T22:13:25.262684+0000 mon.a (mon.0) 1124 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]': finished 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: audit 2024-03-11T22:13:25.262754+0000 mon.a (mon.0) 1125 : audit 1 from='client.35210 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: cluster 2024-03-11T22:13:25.267516+0000 mon.a (mon.0) 1126 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: audit 2024-03-11T22:13:25.494724+0000 mon.b (mon.1) 97 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: audit 2024-03-11T22:13:25.810350+0000 mon.c (mon.2) 224 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[21434]: audit 2024-03-11T22:13:26.000366+0000 mon.a (mon.0) 1127 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.655866+0000 osd.4 (osd.4) 9 : cluster 0 13.5 deep-scrub starts 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.657375+0000 osd.4 (osd.4) 10 : cluster 0 13.5 deep-scrub ok 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.669958+0000 osd.7 (osd.7) 9 : cluster 0 13.0 deep-scrub starts 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.671474+0000 osd.7 (osd.7) 10 : cluster 0 13.0 deep-scrub ok 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.698207+0000 osd.5 (osd.5) 9 : cluster 0 13.9 deep-scrub starts 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.772113+0000 osd.5 (osd.5) 10 : cluster 0 13.9 deep-scrub ok 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.891768+0000 osd.6 (osd.6) 9 : cluster 0 13.4 deep-scrub starts 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:24.894472+0000 osd.6 (osd.6) 10 : cluster 0 13.4 deep-scrub ok 2024-03-11T22:13:26.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: audit 2024-03-11T22:13:25.262434+0000 mon.a (mon.0) 1122 : audit 1 from='client.33536 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi049-64055-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: audit 2024-03-11T22:13:25.262601+0000 mon.a (mon.0) 1123 : audit 1 from='client.34075 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: audit 2024-03-11T22:13:25.262684+0000 mon.a (mon.0) 1124 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-7"}]': finished 2024-03-11T22:13:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: audit 2024-03-11T22:13:25.262754+0000 mon.a (mon.0) 1125 : audit 1 from='client.35210 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi049-64063-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: cluster 2024-03-11T22:13:25.267516+0000 mon.a (mon.0) 1126 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-03-11T22:13:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: audit 2024-03-11T22:13:25.494724+0000 mon.b (mon.1) 97 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: audit 2024-03-11T22:13:25.810350+0000 mon.c (mon.2) 224 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:26 smithi049 bash[28804]: audit 2024-03-11T22:13:26.000366+0000 mon.a (mon.0) 1127 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:28.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:13:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:13:29.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[21434]: audit 2024-03-11T22:13:26.269751+0000 mon.a (mon.0) 1128 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[21434]: cluster 2024-03-11T22:13:26.277435+0000 mon.a (mon.0) 1129 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-03-11T22:13:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[21434]: audit 2024-03-11T22:13:26.295135+0000 mon.b (mon.1) 98 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[21434]: audit 2024-03-11T22:13:26.310607+0000 mon.a (mon.0) 1130 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[21434]: audit 2024-03-11T22:13:26.818954+0000 mon.c (mon.2) 225 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:29.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[28804]: audit 2024-03-11T22:13:26.269751+0000 mon.a (mon.0) 1128 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:29.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[28804]: cluster 2024-03-11T22:13:26.277435+0000 mon.a (mon.0) 1129 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-03-11T22:13:29.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[28804]: audit 2024-03-11T22:13:26.295135+0000 mon.b (mon.1) 98 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:29.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[28804]: audit 2024-03-11T22:13:26.310607+0000 mon.a (mon.0) 1130 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:29.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:29 smithi049 bash[28804]: audit 2024-03-11T22:13:26.818954+0000 mon.c (mon.2) 225 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:29.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:29 smithi187 bash[23415]: audit 2024-03-11T22:13:26.269751+0000 mon.a (mon.0) 1128 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:29.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:29 smithi187 bash[23415]: cluster 2024-03-11T22:13:26.277435+0000 mon.a (mon.0) 1129 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-03-11T22:13:29.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:29 smithi187 bash[23415]: audit 2024-03-11T22:13:26.295135+0000 mon.b (mon.1) 98 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:29.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:29 smithi187 bash[23415]: audit 2024-03-11T22:13:26.310607+0000 mon.a (mon.0) 1130 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]: dispatch 2024-03-11T22:13:29.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:29 smithi187 bash[23415]: audit 2024-03-11T22:13:26.818954+0000 mon.c (mon.2) 225 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: cluster 2024-03-11T22:13:26.648749+0000 mgr.y (mgr.14601) 209 : cluster 0 pgmap v162: 592 pgs: 1 active+clean+scrubbing+deep, 471 active+clean, 32 creating+peering, 88 unknown; 217 MiB data, 942 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-03-11T22:13:30.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:27.586183+0000 mon.a (mon.0) 1131 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]': finished 2024-03-11T22:13:30.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:27.611381+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.49:0/435120943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:27.820605+0000 mon.c (mon.2) 227 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:28.567983+0000 mgr.y (mgr.14601) 210 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: cluster 2024-03-11T22:13:28.652340+0000 mgr.y (mgr.14601) 211 : cluster 0 pgmap v164: 624 pgs: 560 active+clean, 30 creating+peering, 34 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 5 op/s 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:28.824594+0000 mon.c (mon.2) 228 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: cluster 2024-03-11T22:13:29.251129+0000 mon.a (mon.0) 1132 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: cluster 2024-03-11T22:13:29.262482+0000 mon.a (mon.0) 1133 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:29.266692+0000 mon.a (mon.0) 1134 : audit 1 from='client.39323 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:29.315388+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.49:0/907086635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:29.336746+0000 mon.b (mon.1) 100 : audit 1 from='client.? v1:172.21.15.49:0/2702338133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:29.833292+0000 mon.c (mon.2) 229 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: cluster 2024-03-11T22:13:29.907130+0000 mon.a (mon.0) 1135 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:29.931850+0000 mon.a (mon.0) 1136 : audit 1 from='client.40291 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.768 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[28804]: audit 2024-03-11T22:13:29.932231+0000 mon.a (mon.0) 1137 : audit 1 from='client.40270 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: cluster 2024-03-11T22:13:26.648749+0000 mgr.y (mgr.14601) 209 : cluster 0 pgmap v162: 592 pgs: 1 active+clean+scrubbing+deep, 471 active+clean, 32 creating+peering, 88 unknown; 217 MiB data, 942 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:27.586183+0000 mon.a (mon.0) 1131 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]': finished 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:27.611381+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.49:0/435120943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:27.820605+0000 mon.c (mon.2) 227 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:28.567983+0000 mgr.y (mgr.14601) 210 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: cluster 2024-03-11T22:13:28.652340+0000 mgr.y (mgr.14601) 211 : cluster 0 pgmap v164: 624 pgs: 560 active+clean, 30 creating+peering, 34 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 5 op/s 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:28.824594+0000 mon.c (mon.2) 228 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: cluster 2024-03-11T22:13:29.251129+0000 mon.a (mon.0) 1132 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: cluster 2024-03-11T22:13:29.262482+0000 mon.a (mon.0) 1133 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:29.266692+0000 mon.a (mon.0) 1134 : audit 1 from='client.39323 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:29.315388+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.49:0/907086635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:29.336746+0000 mon.b (mon.1) 100 : audit 1 from='client.? v1:172.21.15.49:0/2702338133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:29.833292+0000 mon.c (mon.2) 229 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: cluster 2024-03-11T22:13:29.907130+0000 mon.a (mon.0) 1135 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-03-11T22:13:30.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:29.931850+0000 mon.a (mon.0) 1136 : audit 1 from='client.40291 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:30 smithi049 bash[21434]: audit 2024-03-11T22:13:29.932231+0000 mon.a (mon.0) 1137 : audit 1 from='client.40270 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: cluster 2024-03-11T22:13:26.648749+0000 mgr.y (mgr.14601) 209 : cluster 0 pgmap v162: 592 pgs: 1 active+clean+scrubbing+deep, 471 active+clean, 32 creating+peering, 88 unknown; 217 MiB data, 942 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:27.586183+0000 mon.a (mon.0) 1131 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-7"}]': finished 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:27.611381+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.49:0/435120943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:27.820605+0000 mon.c (mon.2) 227 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:28.567983+0000 mgr.y (mgr.14601) 210 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: cluster 2024-03-11T22:13:28.652340+0000 mgr.y (mgr.14601) 211 : cluster 0 pgmap v164: 624 pgs: 560 active+clean, 30 creating+peering, 34 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 5 op/s 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:28.824594+0000 mon.c (mon.2) 228 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: cluster 2024-03-11T22:13:29.251129+0000 mon.a (mon.0) 1132 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: cluster 2024-03-11T22:13:29.262482+0000 mon.a (mon.0) 1133 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:29.266692+0000 mon.a (mon.0) 1134 : audit 1 from='client.39323 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:29.315388+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.49:0/907086635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:29.336746+0000 mon.b (mon.1) 100 : audit 1 from='client.? v1:172.21.15.49:0/2702338133' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:29.833292+0000 mon.c (mon.2) 229 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: cluster 2024-03-11T22:13:29.907130+0000 mon.a (mon.0) 1135 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-03-11T22:13:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:29.931850+0000 mon.a (mon.0) 1136 : audit 1 from='client.40291 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:30 smithi187 bash[23415]: audit 2024-03-11T22:13:29.932231+0000 mon.a (mon.0) 1137 : audit 1 from='client.40270 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.542187+0000 mon.a (mon.0) 1138 : audit 1 from='client.39323 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.542288+0000 mon.a (mon.0) 1139 : audit 1 from='client.40291 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.542365+0000 mon.a (mon.0) 1140 : audit 1 from='client.40270 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: cluster 2024-03-11T22:13:30.550525+0000 mon.a (mon.0) 1141 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-03-11T22:13:32.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.554268+0000 mon.b (mon.1) 101 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:32.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.565773+0000 mon.a (mon.0) 1142 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:32.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.570026+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.49:0/1338870233' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:32.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.838118+0000 mon.c (mon.2) 231 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:32.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:30.905247+0000 mon.c (mon.2) 232 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]: dispatch 2024-03-11T22:13:32.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:31 smithi187 bash[23415]: audit 2024-03-11T22:13:31.239119+0000 mon.a (mon.0) 1143 : audit 1 from='client.40346 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:32.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.542187+0000 mon.a (mon.0) 1138 : audit 1 from='client.39323 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.542288+0000 mon.a (mon.0) 1139 : audit 1 from='client.40291 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.542365+0000 mon.a (mon.0) 1140 : audit 1 from='client.40270 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: cluster 2024-03-11T22:13:30.550525+0000 mon.a (mon.0) 1141 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.554268+0000 mon.b (mon.1) 101 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.565773+0000 mon.a (mon.0) 1142 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.570026+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.49:0/1338870233' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.838118+0000 mon.c (mon.2) 231 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:30.905247+0000 mon.c (mon.2) 232 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]: dispatch 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[21434]: audit 2024-03-11T22:13:31.239119+0000 mon.a (mon.0) 1143 : audit 1 from='client.40346 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.542187+0000 mon.a (mon.0) 1138 : audit 1 from='client.39323 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi049-64063-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.542288+0000 mon.a (mon.0) 1139 : audit 1 from='client.40291 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64472-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.542365+0000 mon.a (mon.0) 1140 : audit 1 from='client.40270 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi049-64055-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: cluster 2024-03-11T22:13:30.550525+0000 mon.a (mon.0) 1141 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-03-11T22:13:32.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.554268+0000 mon.b (mon.1) 101 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:32.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.565773+0000 mon.a (mon.0) 1142 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:32.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.570026+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.49:0/1338870233' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:32.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.838118+0000 mon.c (mon.2) 231 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:32.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:30.905247+0000 mon.c (mon.2) 232 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]: dispatch 2024-03-11T22:13:32.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:31 smithi049 bash[28804]: audit 2024-03-11T22:13:31.239119+0000 mon.a (mon.0) 1143 : audit 1 from='client.40346 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:32.989 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: Running main() from gmock_main.cc 2024-03-11T22:13:32.989 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-03-11T22:13:32.989 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [----------] Global test environment set-up. 2024-03-11T22:13:32.989 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (30512 ms) 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (14683 ms) 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (15253 ms) 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [----------] 3 tests from NeoradosECList (60448 ms total) 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [----------] Global test environment tear-down 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (60449 ms total) 2024-03-11T22:13:32.990 INFO:tasks.workunit.client.0.smithi049.stdout: ec_list: [ PASSED ] 3 tests. 2024-03-11T22:13:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: cluster 2024-03-11T22:13:30.655195+0000 mgr.y (mgr.14601) 212 : cluster 0 pgmap v167: 680 pgs: 456 active+clean, 30 creating+peering, 194 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-03-11T22:13:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.777518+0000 mon.a (mon.0) 1144 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.777643+0000 mon.a (mon.0) 1145 : audit 1 from='client.40346 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: cluster 2024-03-11T22:13:31.783301+0000 mon.a (mon.0) 1146 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-03-11T22:13:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.788748+0000 mon.b (mon.1) 102 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.792641+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:33.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.795280+0000 mon.a (mon.0) 1147 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]: dispatch 2024-03-11T22:13:33.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.824157+0000 mon.a (mon.0) 1148 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:33.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.824605+0000 mon.a (mon.0) 1149 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:33.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:32 smithi187 bash[23415]: audit 2024-03-11T22:13:31.841456+0000 mon.c (mon.2) 233 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:33.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: cluster 2024-03-11T22:13:30.655195+0000 mgr.y (mgr.14601) 212 : cluster 0 pgmap v167: 680 pgs: 456 active+clean, 30 creating+peering, 194 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-03-11T22:13:33.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: audit 2024-03-11T22:13:31.777518+0000 mon.a (mon.0) 1144 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:33.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: audit 2024-03-11T22:13:31.777643+0000 mon.a (mon.0) 1145 : audit 1 from='client.40346 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:33.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: cluster 2024-03-11T22:13:31.783301+0000 mon.a (mon.0) 1146 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-03-11T22:13:33.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: audit 2024-03-11T22:13:31.788748+0000 mon.b (mon.1) 102 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:33.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: audit 2024-03-11T22:13:31.792641+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:33.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: audit 2024-03-11T22:13:31.795280+0000 mon.a (mon.0) 1147 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]: dispatch 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: audit 2024-03-11T22:13:31.824157+0000 mon.a (mon.0) 1148 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:32 smithi049 bash[21434]: audit 2024-03-11T22:13:31.824605+0000 mon.a (mon.0) 1149 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[21434]: audit 2024-03-11T22:13:31.841456+0000 mon.c (mon.2) 233 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: cluster 2024-03-11T22:13:30.655195+0000 mgr.y (mgr.14601) 212 : cluster 0 pgmap v167: 680 pgs: 456 active+clean, 30 creating+peering, 194 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.777518+0000 mon.a (mon.0) 1144 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.777643+0000 mon.a (mon.0) 1145 : audit 1 from='client.40346 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: cluster 2024-03-11T22:13:31.783301+0000 mon.a (mon.0) 1146 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.788748+0000 mon.b (mon.1) 102 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.792641+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.49:0/396680354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:33.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.795280+0000 mon.a (mon.0) 1147 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]: dispatch 2024-03-11T22:13:33.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.824157+0000 mon.a (mon.0) 1148 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:33.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.824605+0000 mon.a (mon.0) 1149 : audit 1 from='client.32167 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]: dispatch 2024-03-11T22:13:33.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:33 smithi049 bash[28804]: audit 2024-03-11T22:13:31.841456+0000 mon.c (mon.2) 233 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:34.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:13:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:13:35.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: cluster 2024-03-11T22:13:32.655790+0000 mgr.y (mgr.14601) 213 : cluster 0 pgmap v169: 712 pgs: 456 active+clean, 12 creating+peering, 244 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1010 B/s wr, 2 op/s 2024-03-11T22:13:35.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:32.845929+0000 mon.c (mon.2) 234 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:32.978233+0000 mon.a (mon.0) 1150 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]': finished 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:32.978345+0000 mon.a (mon.0) 1151 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:32.978432+0000 mon.a (mon.0) 1152 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: cluster 2024-03-11T22:13:32.984598+0000 mon.a (mon.0) 1153 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:32.993058+0000 mon.c (mon.2) 235 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:32.995415+0000 mon.a (mon.0) 1154 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:33.096792+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:35.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:34 smithi187 bash[23415]: audit 2024-03-11T22:13:33.651571+0000 mon.a (mon.0) 1155 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:35.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: cluster 2024-03-11T22:13:32.655790+0000 mgr.y (mgr.14601) 213 : cluster 0 pgmap v169: 712 pgs: 456 active+clean, 12 creating+peering, 244 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1010 B/s wr, 2 op/s 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:32.845929+0000 mon.c (mon.2) 234 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:32.978233+0000 mon.a (mon.0) 1150 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]': finished 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:32.978345+0000 mon.a (mon.0) 1151 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:32.978432+0000 mon.a (mon.0) 1152 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: cluster 2024-03-11T22:13:32.984598+0000 mon.a (mon.0) 1153 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:32.993058+0000 mon.c (mon.2) 235 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:32.995415+0000 mon.a (mon.0) 1154 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:33.096792+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[21434]: audit 2024-03-11T22:13:33.651571+0000 mon.a (mon.0) 1155 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: cluster 2024-03-11T22:13:32.655790+0000 mgr.y (mgr.14601) 213 : cluster 0 pgmap v169: 712 pgs: 456 active+clean, 12 creating+peering, 244 unknown; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1010 B/s wr, 2 op/s 2024-03-11T22:13:35.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:32.845929+0000 mon.c (mon.2) 234 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:32.978233+0000 mon.a (mon.0) 1150 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4"}]': finished 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:32.978345+0000 mon.a (mon.0) 1151 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:32.978432+0000 mon.a (mon.0) 1152 : audit 1 from='client.32167 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi049-64859-3"}]': finished 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: cluster 2024-03-11T22:13:32.984598+0000 mon.a (mon.0) 1153 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:32.993058+0000 mon.c (mon.2) 235 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:32.995415+0000 mon.a (mon.0) 1154 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]: dispatch 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:33.096792+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:35.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:34 smithi049 bash[28804]: audit 2024-03-11T22:13:33.651571+0000 mon.a (mon.0) 1155 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:35.289 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-03-11T22:13:35.289 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-03-11T22:13:35.289 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-03-11T22:13:35.289 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-03-11T22:13:35.289 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-03-11T22:13:35.289 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-03-11T22:13:35.289 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (19933 ms) 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (10752 ms) 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (6081 ms) 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (4280 ms) 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (6309 ms) 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (6592 ms) 2024-03-11T22:13:35.290 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-03-11T22:13:35.291 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (8965 ms) 2024-03-11T22:13:35.291 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (62912 ms total) 2024-03-11T22:13:35.291 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: 2024-03-11T22:13:35.291 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-03-11T22:13:35.291 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (62912 ms total) 2024-03-11T22:13:35.291 INFO:tasks.workunit.client.0.smithi049.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] Global test environment set-up. 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: 2024-03-11T22:13:35.314 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: 2024-03-11T22:12:32.421+0000 7fd7eb0e8880 -1 failed for service _ceph-mon._tcp 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: 2024-03-11T22:12:32.421+0000 7fd7eb0e8880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (158 ms) 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2013 ms) 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2171 ms total) 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: started 0x560cde2192a0 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: started 0x560cde54b720 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: started 0x560cde549fe0 2024-03-11T22:13:35.315 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: started 3 aios 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: waiting 0x560cde2192a0 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: waiting 0x560cde54b720 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: waiting 0x560cde549fe0 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: done. 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (20721 ms) 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (20721 ms total) 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.Exec (163 ms) 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (7 ms) 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-03-11T22:13:35.316 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (1366 ms) 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.Applications (9166 ms) 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (24388 ms) 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] 8 tests from LibRadosMisc (35090 ms total) 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [----------] Global test environment tear-down 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (63046 ms total) 2024-03-11T22:13:35.317 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc: [ PASSED ] 12 tests. 2024-03-11T22:13:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:33.850036+0000 mon.c (mon.2) 236 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: cluster 2024-03-11T22:13:34.274485+0000 mon.a (mon.0) 1156 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: cluster 2024-03-11T22:13:34.276412+0000 mon.a (mon.0) 1157 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.282733+0000 mon.a (mon.0) 1158 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]': finished 2024-03-11T22:13:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.282834+0000 mon.a (mon.0) 1159 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.292614+0000 mon.c (mon.2) 237 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:13:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.308496+0000 mon.b (mon.1) 105 : audit 1 from='client.? v1:172.21.15.49:0/3571176635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.309748+0000 mon.b (mon.1) 106 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: cluster 2024-03-11T22:13:34.656600+0000 mgr.y (mgr.14601) 214 : cluster 0 pgmap v172: 680 pgs: 546 active+clean, 70 creating+peering, 64 unknown; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: cluster 2024-03-11T22:13:34.781467+0000 mon.a (mon.0) 1160 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.782953+0000 mon.a (mon.0) 1161 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.792450+0000 mon.a (mon.0) 1162 : audit 1 from='client.46363 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.793439+0000 mon.a (mon.0) 1163 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.813086+0000 mon.a (mon.0) 1164 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.814926+0000 mon.a (mon.0) 1165 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.815213+0000 mon.a (mon.0) 1166 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:34.853544+0000 mon.c (mon.2) 238 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.286406+0000 mon.a (mon.0) 1167 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]': finished 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.286505+0000 mon.a (mon.0) 1168 : audit 1 from='client.46363 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.286561+0000 mon.a (mon.0) 1169 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]': finished 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.286632+0000 mon.a (mon.0) 1170 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: cluster 2024-03-11T22:13:35.289477+0000 mon.a (mon.0) 1171 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-03-11T22:13:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.290455+0000 mon.b (mon.1) 107 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]: dispatch 2024-03-11T22:13:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.290598+0000 mon.a (mon.0) 1172 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi049-64261-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.291645+0000 mon.b (mon.1) 108 : audit 1 from='client.? v1:172.21.15.49:0/1302079074' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.297195+0000 mon.a (mon.0) 1173 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]: dispatch 2024-03-11T22:13:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:36 smithi187 bash[23415]: audit 2024-03-11T22:13:35.298418+0000 mon.a (mon.0) 1174 : audit 1 from='client.46417 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:33.850036+0000 mon.c (mon.2) 236 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: cluster 2024-03-11T22:13:34.274485+0000 mon.a (mon.0) 1156 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: cluster 2024-03-11T22:13:34.276412+0000 mon.a (mon.0) 1157 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.282733+0000 mon.a (mon.0) 1158 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]': finished 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.282834+0000 mon.a (mon.0) 1159 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.292614+0000 mon.c (mon.2) 237 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.308496+0000 mon.b (mon.1) 105 : audit 1 from='client.? v1:172.21.15.49:0/3571176635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.309748+0000 mon.b (mon.1) 106 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: cluster 2024-03-11T22:13:34.656600+0000 mgr.y (mgr.14601) 214 : cluster 0 pgmap v172: 680 pgs: 546 active+clean, 70 creating+peering, 64 unknown; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: cluster 2024-03-11T22:13:34.781467+0000 mon.a (mon.0) 1160 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.782953+0000 mon.a (mon.0) 1161 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.792450+0000 mon.a (mon.0) 1162 : audit 1 from='client.46363 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.793439+0000 mon.a (mon.0) 1163 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.813086+0000 mon.a (mon.0) 1164 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:33.850036+0000 mon.c (mon.2) 236 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: cluster 2024-03-11T22:13:34.274485+0000 mon.a (mon.0) 1156 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: cluster 2024-03-11T22:13:34.276412+0000 mon.a (mon.0) 1157 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.282733+0000 mon.a (mon.0) 1158 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi049-64412-4", "tierpool": "test-rados-api-smithi049-64412-6"}]': finished 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.282834+0000 mon.a (mon.0) 1159 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.292614+0000 mon.c (mon.2) 237 : audit 1 from='client.? v1:172.21.15.49:0/1198416165' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.308496+0000 mon.b (mon.1) 105 : audit 1 from='client.? v1:172.21.15.49:0/3571176635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.309748+0000 mon.b (mon.1) 106 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: cluster 2024-03-11T22:13:34.656600+0000 mgr.y (mgr.14601) 214 : cluster 0 pgmap v172: 680 pgs: 546 active+clean, 70 creating+peering, 64 unknown; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:13:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: cluster 2024-03-11T22:13:34.781467+0000 mon.a (mon.0) 1160 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-03-11T22:13:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.782953+0000 mon.a (mon.0) 1161 : audit 1 from='client.25406 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.792450+0000 mon.a (mon.0) 1162 : audit 1 from='client.46363 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.793439+0000 mon.a (mon.0) 1163 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.813086+0000 mon.a (mon.0) 1164 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.814926+0000 mon.a (mon.0) 1165 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.815213+0000 mon.a (mon.0) 1166 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:34.853544+0000 mon.c (mon.2) 238 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.286406+0000 mon.a (mon.0) 1167 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]': finished 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.286505+0000 mon.a (mon.0) 1168 : audit 1 from='client.46363 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.286561+0000 mon.a (mon.0) 1169 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]': finished 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.286632+0000 mon.a (mon.0) 1170 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: cluster 2024-03-11T22:13:35.289477+0000 mon.a (mon.0) 1171 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-03-11T22:13:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.290455+0000 mon.b (mon.1) 107 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]: dispatch 2024-03-11T22:13:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.290598+0000 mon.a (mon.0) 1172 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi049-64261-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.291645+0000 mon.b (mon.1) 108 : audit 1 from='client.? v1:172.21.15.49:0/1302079074' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.297195+0000 mon.a (mon.0) 1173 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]: dispatch 2024-03-11T22:13:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[21434]: audit 2024-03-11T22:13:35.298418+0000 mon.a (mon.0) 1174 : audit 1 from='client.46417 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.814926+0000 mon.a (mon.0) 1165 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:37.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.815213+0000 mon.a (mon.0) 1166 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:34.853544+0000 mon.c (mon.2) 238 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.286406+0000 mon.a (mon.0) 1167 : audit 1 from='client.25406 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi049-64412-6", "pool2": "test-rados-api-smithi049-64412-6", "yes_i_really_really_mean_it": true}]': finished 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.286505+0000 mon.a (mon.0) 1168 : audit 1 from='client.46363 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi049-64063-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.286561+0000 mon.a (mon.0) 1169 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-9"}]': finished 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.286632+0000 mon.a (mon.0) 1170 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: cluster 2024-03-11T22:13:35.289477+0000 mon.a (mon.0) 1171 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.290455+0000 mon.b (mon.1) 107 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]: dispatch 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.290598+0000 mon.a (mon.0) 1172 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi049-64261-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.291645+0000 mon.b (mon.1) 108 : audit 1 from='client.? v1:172.21.15.49:0/1302079074' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.297195+0000 mon.a (mon.0) 1173 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]: dispatch 2024-03-11T22:13:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:36 smithi049 bash[28804]: audit 2024-03-11T22:13:35.298418+0000 mon.a (mon.0) 1174 : audit 1 from='client.46417 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.170 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: flushed 2024-03-11T22:13:37.170 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3028 ms) 2024-03-11T22:13:37.170 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: trying... 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429684848 notify_id 446676598789 notifier_gid 25406 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: timed out 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: flushing 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: flushed 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3024 ms) 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: List watches 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: notify2 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429676640 notify_id 455266533378 notifier_gid 25406 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: notify2 done 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: watch_check 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: unwatch2 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: flushing 2024-03-11T22:13:37.171 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: done 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3023 ms) 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: List watches 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: notify2 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: handle_notify cookie 94345429676400 notify_id 468151435266 notifier_gid 25406 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: notify2 done 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: watch_check 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: unwatch2 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: flushing 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: done 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3008 ms) 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (20814 ms total) 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-03-11T22:13:37.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (64838 ms total) 2024-03-11T22:13:37.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:35.854485+0000 mon.c (mon.2) 239 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: cluster 2024-03-11T22:13:36.657596+0000 mgr.y (mgr.14601) 215 : cluster 0 pgmap v174: 548 pgs: 432 active+clean, 20 creating+peering, 96 unknown; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: cluster 2024-03-11T22:13:36.703142+0000 mon.a (mon.0) 1175 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:36.715166+0000 mon.a (mon.0) 1176 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]': finished 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:36.715325+0000 mon.a (mon.0) 1177 : audit 1 from='client.46417 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:36.849033+0000 mon.b (mon.1) 109 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:36.855592+0000 mon.c (mon.2) 240 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:37.181760+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: cluster 2024-03-11T22:13:37.186026+0000 mon.a (mon.0) 1178 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-03-11T22:13:37.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:37.187651+0000 mon.a (mon.0) 1179 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:37.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:37 smithi187 bash[23415]: audit 2024-03-11T22:13:37.191101+0000 mon.a (mon.0) 1180 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:35.854485+0000 mon.c (mon.2) 239 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: cluster 2024-03-11T22:13:36.657596+0000 mgr.y (mgr.14601) 215 : cluster 0 pgmap v174: 548 pgs: 432 active+clean, 20 creating+peering, 96 unknown; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: cluster 2024-03-11T22:13:36.703142+0000 mon.a (mon.0) 1175 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:36.715166+0000 mon.a (mon.0) 1176 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]': finished 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:36.715325+0000 mon.a (mon.0) 1177 : audit 1 from='client.46417 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:36.849033+0000 mon.b (mon.1) 109 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:36.855592+0000 mon.c (mon.2) 240 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:37.181760+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: cluster 2024-03-11T22:13:37.186026+0000 mon.a (mon.0) 1178 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:37.187651+0000 mon.a (mon.0) 1179 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[21434]: audit 2024-03-11T22:13:37.191101+0000 mon.a (mon.0) 1180 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:35.854485+0000 mon.c (mon.2) 239 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: cluster 2024-03-11T22:13:36.657596+0000 mgr.y (mgr.14601) 215 : cluster 0 pgmap v174: 548 pgs: 432 active+clean, 20 creating+peering, 96 unknown; 217 MiB data, 1022 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: cluster 2024-03-11T22:13:36.703142+0000 mon.a (mon.0) 1175 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:36.715166+0000 mon.a (mon.0) 1176 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-9", "mode": "writeback"}]': finished 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:36.715325+0000 mon.a (mon.0) 1177 : audit 1 from='client.46417 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi049-64055-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:36.849033+0000 mon.b (mon.1) 109 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:36.855592+0000 mon.c (mon.2) 240 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:37.181760+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: cluster 2024-03-11T22:13:37.186026+0000 mon.a (mon.0) 1178 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-03-11T22:13:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:37.187651+0000 mon.a (mon.0) 1179 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:37 smithi049 bash[28804]: audit 2024-03-11T22:13:37.191101+0000 mon.a (mon.0) 1180 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:38.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:13:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:13:39.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: audit 2024-03-11T22:13:37.725488+0000 mon.a (mon.0) 1181 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi049-64261-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:39.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: audit 2024-03-11T22:13:37.725714+0000 mon.a (mon.0) 1182 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:39.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: audit 2024-03-11T22:13:37.725933+0000 mon.a (mon.0) 1183 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:39.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: audit 2024-03-11T22:13:37.732209+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:39.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: cluster 2024-03-11T22:13:37.733709+0000 mon.a (mon.0) 1184 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-03-11T22:13:39.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: audit 2024-03-11T22:13:37.739811+0000 mon.a (mon.0) 1185 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:39.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: audit 2024-03-11T22:13:37.856270+0000 mon.c (mon.2) 242 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:39.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:39 smithi187 bash[23415]: audit 2024-03-11T22:13:38.857316+0000 mon.c (mon.2) 243 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: audit 2024-03-11T22:13:37.725488+0000 mon.a (mon.0) 1181 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi049-64261-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: audit 2024-03-11T22:13:37.725714+0000 mon.a (mon.0) 1182 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: audit 2024-03-11T22:13:37.725933+0000 mon.a (mon.0) 1183 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: audit 2024-03-11T22:13:37.732209+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: cluster 2024-03-11T22:13:37.733709+0000 mon.a (mon.0) 1184 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: audit 2024-03-11T22:13:37.739811+0000 mon.a (mon.0) 1185 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: audit 2024-03-11T22:13:37.856270+0000 mon.c (mon.2) 242 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[21434]: audit 2024-03-11T22:13:38.857316+0000 mon.c (mon.2) 243 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: audit 2024-03-11T22:13:37.725488+0000 mon.a (mon.0) 1181 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi049-64261-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: audit 2024-03-11T22:13:37.725714+0000 mon.a (mon.0) 1182 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64252-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:40.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: audit 2024-03-11T22:13:37.725933+0000 mon.a (mon.0) 1183 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: audit 2024-03-11T22:13:37.732209+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: cluster 2024-03-11T22:13:37.733709+0000 mon.a (mon.0) 1184 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-03-11T22:13:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: audit 2024-03-11T22:13:37.739811+0000 mon.a (mon.0) 1185 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]: dispatch 2024-03-11T22:13:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: audit 2024-03-11T22:13:37.856270+0000 mon.c (mon.2) 242 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:39 smithi049 bash[28804]: audit 2024-03-11T22:13:38.857316+0000 mon.c (mon.2) 243 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:40.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:38.579139+0000 mgr.y (mgr.14601) 216 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:40.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: cluster 2024-03-11T22:13:38.661562+0000 mgr.y (mgr.14601) 217 : cluster 0 pgmap v177: 524 pgs: 484 active+clean, 40 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:40.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: cluster 2024-03-11T22:13:39.112887+0000 mon.a (mon.0) 1186 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:40.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.117465+0000 mon.a (mon.0) 1187 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]': finished 2024-03-11T22:13:40.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.130665+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]: dispatch 2024-03-11T22:13:40.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.131336+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.49:0/833828134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: cluster 2024-03-11T22:13:39.592580+0000 mon.a (mon.0) 1188 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: cluster 2024-03-11T22:13:39.593757+0000 mon.a (mon.0) 1189 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.609611+0000 mon.a (mon.0) 1190 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]: dispatch 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.621785+0000 mon.a (mon.0) 1191 : audit 1 from='client.46391 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.633673+0000 mon.b (mon.1) 111 : audit 1 from='client.? v1:172.21.15.49:0/49521535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: cluster 2024-03-11T22:13:39.634782+0000 mon.a (mon.0) 1192 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.664544+0000 mon.a (mon.0) 1193 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.667522+0000 mon.a (mon.0) 1194 : audit 1 from='client.47710 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.669198+0000 mon.c (mon.2) 246 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:40.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:40 smithi187 bash[23415]: audit 2024-03-11T22:13:39.858836+0000 mon.c (mon.2) 247 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:41.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:38.579139+0000 mgr.y (mgr.14601) 216 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:41.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: cluster 2024-03-11T22:13:38.661562+0000 mgr.y (mgr.14601) 217 : cluster 0 pgmap v177: 524 pgs: 484 active+clean, 40 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:41.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: cluster 2024-03-11T22:13:39.112887+0000 mon.a (mon.0) 1186 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:41.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.117465+0000 mon.a (mon.0) 1187 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]': finished 2024-03-11T22:13:41.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.130665+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]: dispatch 2024-03-11T22:13:41.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.131336+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.49:0/833828134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: cluster 2024-03-11T22:13:39.592580+0000 mon.a (mon.0) 1188 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: cluster 2024-03-11T22:13:39.593757+0000 mon.a (mon.0) 1189 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.609611+0000 mon.a (mon.0) 1190 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]: dispatch 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.621785+0000 mon.a (mon.0) 1191 : audit 1 from='client.46391 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.633673+0000 mon.b (mon.1) 111 : audit 1 from='client.? v1:172.21.15.49:0/49521535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: cluster 2024-03-11T22:13:39.634782+0000 mon.a (mon.0) 1192 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.664544+0000 mon.a (mon.0) 1193 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.667522+0000 mon.a (mon.0) 1194 : audit 1 from='client.47710 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.669198+0000 mon.c (mon.2) 246 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[21434]: audit 2024-03-11T22:13:39.858836+0000 mon.c (mon.2) 247 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:38.579139+0000 mgr.y (mgr.14601) 216 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: cluster 2024-03-11T22:13:38.661562+0000 mgr.y (mgr.14601) 217 : cluster 0 pgmap v177: 524 pgs: 484 active+clean, 40 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:41.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: cluster 2024-03-11T22:13:39.112887+0000 mon.a (mon.0) 1186 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.117465+0000 mon.a (mon.0) 1187 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-9"}]': finished 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.130665+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]: dispatch 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.131336+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.49:0/833828134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: cluster 2024-03-11T22:13:39.592580+0000 mon.a (mon.0) 1188 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: cluster 2024-03-11T22:13:39.593757+0000 mon.a (mon.0) 1189 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.609611+0000 mon.a (mon.0) 1190 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]: dispatch 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.621785+0000 mon.a (mon.0) 1191 : audit 1 from='client.46391 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.633673+0000 mon.b (mon.1) 111 : audit 1 from='client.? v1:172.21.15.49:0/49521535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: cluster 2024-03-11T22:13:39.634782+0000 mon.a (mon.0) 1192 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.664544+0000 mon.a (mon.0) 1193 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.667522+0000 mon.a (mon.0) 1194 : audit 1 from='client.47710 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.669198+0000 mon.c (mon.2) 246 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:41.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:40 smithi049 bash[28804]: audit 2024-03-11T22:13:39.858836+0000 mon.c (mon.2) 247 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: audit 2024-03-11T22:13:40.629114+0000 mon.a (mon.0) 1195 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]': finished 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: audit 2024-03-11T22:13:40.629383+0000 mon.a (mon.0) 1196 : audit 1 from='client.46391 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: audit 2024-03-11T22:13:40.629580+0000 mon.a (mon.0) 1197 : audit 1 from='client.47710 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: cluster 2024-03-11T22:13:40.637517+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: audit 2024-03-11T22:13:40.638697+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: audit 2024-03-11T22:13:40.657782+0000 mon.a (mon.0) 1199 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: cluster 2024-03-11T22:13:40.662705+0000 mgr.y (mgr.14601) 218 : cluster 0 pgmap v181: 588 pgs: 388 active+clean, 192 unknown, 8 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-03-11T22:13:41.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:41 smithi187 bash[23415]: audit 2024-03-11T22:13:40.860299+0000 mon.c (mon.2) 249 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: audit 2024-03-11T22:13:40.629114+0000 mon.a (mon.0) 1195 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]': finished 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: audit 2024-03-11T22:13:40.629383+0000 mon.a (mon.0) 1196 : audit 1 from='client.46391 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: audit 2024-03-11T22:13:40.629580+0000 mon.a (mon.0) 1197 : audit 1 from='client.47710 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: cluster 2024-03-11T22:13:40.637517+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: audit 2024-03-11T22:13:40.638697+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: audit 2024-03-11T22:13:40.657782+0000 mon.a (mon.0) 1199 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: cluster 2024-03-11T22:13:40.662705+0000 mgr.y (mgr.14601) 218 : cluster 0 pgmap v181: 588 pgs: 388 active+clean, 192 unknown, 8 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[21434]: audit 2024-03-11T22:13:40.860299+0000 mon.c (mon.2) 249 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: audit 2024-03-11T22:13:40.629114+0000 mon.a (mon.0) 1195 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache", "force_nonempty":""}]': finished 2024-03-11T22:13:42.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: audit 2024-03-11T22:13:40.629383+0000 mon.a (mon.0) 1196 : audit 1 from='client.46391 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi049-64055-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:42.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: audit 2024-03-11T22:13:40.629580+0000 mon.a (mon.0) 1197 : audit 1 from='client.47710 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi049-64063-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:42.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: cluster 2024-03-11T22:13:40.637517+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-03-11T22:13:42.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: audit 2024-03-11T22:13:40.638697+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:42.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: audit 2024-03-11T22:13:40.657782+0000 mon.a (mon.0) 1199 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:42.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: cluster 2024-03-11T22:13:40.662705+0000 mgr.y (mgr.14601) 218 : cluster 0 pgmap v181: 588 pgs: 388 active+clean, 192 unknown, 8 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.8 KiB/s wr, 4 op/s 2024-03-11T22:13:42.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:41 smithi049 bash[28804]: audit 2024-03-11T22:13:40.860299+0000 mon.c (mon.2) 249 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:41.634544+0000 mon.a (mon.0) 1200 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:41.643572+0000 mon.b (mon.1) 112 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: cluster 2024-03-11T22:13:41.646855+0000 mon.a (mon.0) 1201 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:41.657463+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]: dispatch 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:41.678673+0000 mon.a (mon.0) 1202 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]: dispatch 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:41.679434+0000 mon.a (mon.0) 1203 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:41.861610+0000 mon.c (mon.2) 251 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:43.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:42.639367+0000 mon.a (mon.0) 1204 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]': finished 2024-03-11T22:13:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:42.639449+0000 mon.a (mon.0) 1205 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: cluster 2024-03-11T22:13:42.644684+0000 mon.a (mon.0) 1206 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-03-11T22:13:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:42.647293+0000 mon.c (mon.2) 252 : audit 1 from='client.? v1:172.21.15.49:0/3368366818' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:42.647904+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.49:0/1760348582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:42.653345+0000 mon.a (mon.0) 1207 : audit 1 from='client.46421 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:42.656076+0000 mon.a (mon.0) 1208 : audit 1 from='client.46418 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:43 smithi187 bash[23415]: audit 2024-03-11T22:13:42.862644+0000 mon.c (mon.2) 254 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:41.634544+0000 mon.a (mon.0) 1200 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:41.643572+0000 mon.b (mon.1) 112 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: cluster 2024-03-11T22:13:41.646855+0000 mon.a (mon.0) 1201 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:41.657463+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]: dispatch 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:41.678673+0000 mon.a (mon.0) 1202 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]: dispatch 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:41.679434+0000 mon.a (mon.0) 1203 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:41.861610+0000 mon.c (mon.2) 251 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:42.639367+0000 mon.a (mon.0) 1204 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]': finished 2024-03-11T22:13:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:42.639449+0000 mon.a (mon.0) 1205 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: cluster 2024-03-11T22:13:42.644684+0000 mon.a (mon.0) 1206 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-03-11T22:13:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:42.647293+0000 mon.c (mon.2) 252 : audit 1 from='client.? v1:172.21.15.49:0/3368366818' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:42.647904+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.49:0/1760348582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:42.653345+0000 mon.a (mon.0) 1207 : audit 1 from='client.46421 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:42.656076+0000 mon.a (mon.0) 1208 : audit 1 from='client.46418 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[21434]: audit 2024-03-11T22:13:42.862644+0000 mon.c (mon.2) 254 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:41.634544+0000 mon.a (mon.0) 1200 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64252-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:41.643572+0000 mon.b (mon.1) 112 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: cluster 2024-03-11T22:13:41.646855+0000 mon.a (mon.0) 1201 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:41.657463+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.49:0/813171242' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:41.678673+0000 mon.a (mon.0) 1202 : audit 1 from='client.46370 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:41.679434+0000 mon.a (mon.0) 1203 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:41.861610+0000 mon.c (mon.2) 251 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:42.639367+0000 mon.a (mon.0) 1204 : audit 1 from='client.46370 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64252-10", "tierpool":"test-rados-api-smithi049-64252-10-cache"}]': finished 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:42.639449+0000 mon.a (mon.0) 1205 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: cluster 2024-03-11T22:13:42.644684+0000 mon.a (mon.0) 1206 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:42.647293+0000 mon.c (mon.2) 252 : audit 1 from='client.? v1:172.21.15.49:0/3368366818' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:42.647904+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.49:0/1760348582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:42.653345+0000 mon.a (mon.0) 1207 : audit 1 from='client.46421 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:42.656076+0000 mon.a (mon.0) 1208 : audit 1 from='client.46418 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:44.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:43 smithi049 bash[28804]: audit 2024-03-11T22:13:42.862644+0000 mon.c (mon.2) 254 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:44.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:13:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:13:44.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: Running main() from gmock_main.cc 2024-03-11T22:13:44.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-03-11T22:13:44.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [----------] Global test environment set-up. 2024-03-11T22:13:44.663 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolList (18126 ms) 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3835 ms) 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (4640 ms) 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (5246 ms) 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (5983 ms) 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (7728 ms) 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (9797 ms) 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-03-11T22:13:44.664 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (7700 ms) 2024-03-11T22:13:44.665 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-03-11T22:13:44.665 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (9355 ms) 2024-03-11T22:13:44.665 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [----------] 9 tests from LibRadosPools (72411 ms total) 2024-03-11T22:13:44.665 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: 2024-03-11T22:13:44.665 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [----------] Global test environment tear-down 2024-03-11T22:13:44.665 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (72411 ms total) 2024-03-11T22:13:44.665 INFO:tasks.workunit.client.0.smithi049.stdout: api_pool: [ PASSED ] 9 tests. 2024-03-11T22:13:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:44 smithi187 bash[23415]: cluster 2024-03-11T22:13:42.664342+0000 mgr.y (mgr.14601) 219 : cluster 0 pgmap v184: 588 pgs: 388 active+clean, 192 unknown, 8 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:44 smithi187 bash[23415]: audit 2024-03-11T22:13:43.653021+0000 mon.a (mon.0) 1209 : audit 1 from='client.46421 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:44 smithi187 bash[23415]: audit 2024-03-11T22:13:43.653259+0000 mon.a (mon.0) 1210 : audit 1 from='client.46418 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:44 smithi187 bash[23415]: cluster 2024-03-11T22:13:43.662094+0000 mon.a (mon.0) 1211 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-03-11T22:13:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:44 smithi187 bash[23415]: audit 2024-03-11T22:13:43.769603+0000 mon.b (mon.1) 113 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:44 smithi187 bash[23415]: audit 2024-03-11T22:13:43.864131+0000 mon.c (mon.2) 255 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:44 smithi187 bash[23415]: audit 2024-03-11T22:13:44.155220+0000 mon.a (mon.0) 1212 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21434]: cluster 2024-03-11T22:13:42.664342+0000 mgr.y (mgr.14601) 219 : cluster 0 pgmap v184: 588 pgs: 388 active+clean, 192 unknown, 8 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21434]: audit 2024-03-11T22:13:43.653021+0000 mon.a (mon.0) 1209 : audit 1 from='client.46421 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21434]: audit 2024-03-11T22:13:43.653259+0000 mon.a (mon.0) 1210 : audit 1 from='client.46418 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21434]: cluster 2024-03-11T22:13:43.662094+0000 mon.a (mon.0) 1211 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21434]: audit 2024-03-11T22:13:43.769603+0000 mon.b (mon.1) 113 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21434]: audit 2024-03-11T22:13:43.864131+0000 mon.c (mon.2) 255 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[21434]: audit 2024-03-11T22:13:44.155220+0000 mon.a (mon.0) 1212 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:45.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[28804]: cluster 2024-03-11T22:13:42.664342+0000 mgr.y (mgr.14601) 219 : cluster 0 pgmap v184: 588 pgs: 388 active+clean, 192 unknown, 8 creating+peering; 217 MiB data, 995 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[28804]: audit 2024-03-11T22:13:43.653021+0000 mon.a (mon.0) 1209 : audit 1 from='client.46421 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi049-64055-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[28804]: audit 2024-03-11T22:13:43.653259+0000 mon.a (mon.0) 1210 : audit 1 from='client.46418 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[28804]: cluster 2024-03-11T22:13:43.662094+0000 mon.a (mon.0) 1211 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-03-11T22:13:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[28804]: audit 2024-03-11T22:13:43.769603+0000 mon.b (mon.1) 113 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[28804]: audit 2024-03-11T22:13:43.864131+0000 mon.c (mon.2) 255 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:44 smithi049 bash[28804]: audit 2024-03-11T22:13:44.155220+0000 mon.a (mon.0) 1212 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:45 smithi187 bash[23415]: cluster 2024-03-11T22:13:44.604376+0000 mon.a (mon.0) 1213 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:45 smithi187 bash[23415]: audit 2024-03-11T22:13:44.657531+0000 mon.a (mon.0) 1214 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:45 smithi187 bash[23415]: audit 2024-03-11T22:13:44.661398+0000 mon.b (mon.1) 114 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:45 smithi187 bash[23415]: cluster 2024-03-11T22:13:44.665941+0000 mon.a (mon.0) 1215 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-03-11T22:13:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:45 smithi187 bash[23415]: audit 2024-03-11T22:13:44.686648+0000 mon.a (mon.0) 1216 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:45 smithi187 bash[23415]: audit 2024-03-11T22:13:44.865503+0000 mon.c (mon.2) 256 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:46.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[28804]: cluster 2024-03-11T22:13:44.604376+0000 mon.a (mon.0) 1213 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:46.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[28804]: audit 2024-03-11T22:13:44.657531+0000 mon.a (mon.0) 1214 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:46.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[28804]: audit 2024-03-11T22:13:44.661398+0000 mon.b (mon.1) 114 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:46.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[28804]: cluster 2024-03-11T22:13:44.665941+0000 mon.a (mon.0) 1215 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-03-11T22:13:46.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[28804]: audit 2024-03-11T22:13:44.686648+0000 mon.a (mon.0) 1216 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:46.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[28804]: audit 2024-03-11T22:13:44.865503+0000 mon.c (mon.2) 256 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[21434]: cluster 2024-03-11T22:13:44.604376+0000 mon.a (mon.0) 1213 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[21434]: audit 2024-03-11T22:13:44.657531+0000 mon.a (mon.0) 1214 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[21434]: audit 2024-03-11T22:13:44.661398+0000 mon.b (mon.1) 114 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[21434]: cluster 2024-03-11T22:13:44.665941+0000 mon.a (mon.0) 1215 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-03-11T22:13:46.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[21434]: audit 2024-03-11T22:13:44.686648+0000 mon.a (mon.0) 1216 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:46.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:45 smithi049 bash[21434]: audit 2024-03-11T22:13:44.865503+0000 mon.c (mon.2) 256 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: cluster 2024-03-11T22:13:44.665892+0000 mgr.y (mgr.14601) 220 : cluster 0 pgmap v187: 524 pgs: 428 active+clean, 96 unknown; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.667742+0000 mon.a (mon.0) 1217 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]': finished 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.671480+0000 mon.b (mon.1) 115 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: cluster 2024-03-11T22:13:45.674151+0000 mon.a (mon.0) 1218 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.676941+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.49:0/1835610008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.677979+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.49:0/2284565755' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.679392+0000 mon.a (mon.0) 1219 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.690802+0000 mon.a (mon.0) 1220 : audit 1 from='client.46445 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.691709+0000 mon.a (mon.0) 1221 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:45.866859+0000 mon.c (mon.2) 259 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:47.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:47 smithi187 bash[23415]: audit 2024-03-11T22:13:46.868345+0000 mon.c (mon.2) 260 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: cluster 2024-03-11T22:13:44.665892+0000 mgr.y (mgr.14601) 220 : cluster 0 pgmap v187: 524 pgs: 428 active+clean, 96 unknown; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-03-11T22:13:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.667742+0000 mon.a (mon.0) 1217 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]': finished 2024-03-11T22:13:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.671480+0000 mon.b (mon.1) 115 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]: dispatch 2024-03-11T22:13:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: cluster 2024-03-11T22:13:45.674151+0000 mon.a (mon.0) 1218 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-03-11T22:13:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.676941+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.49:0/1835610008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.677979+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.49:0/2284565755' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.679392+0000 mon.a (mon.0) 1219 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]: dispatch 2024-03-11T22:13:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.690802+0000 mon.a (mon.0) 1220 : audit 1 from='client.46445 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.691709+0000 mon.a (mon.0) 1221 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:45.866859+0000 mon.c (mon.2) 259 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[21434]: audit 2024-03-11T22:13:46.868345+0000 mon.c (mon.2) 260 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:47.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: cluster 2024-03-11T22:13:44.665892+0000 mgr.y (mgr.14601) 220 : cluster 0 pgmap v187: 524 pgs: 428 active+clean, 96 unknown; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-03-11T22:13:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.667742+0000 mon.a (mon.0) 1217 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-11"}]': finished 2024-03-11T22:13:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.671480+0000 mon.b (mon.1) 115 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]: dispatch 2024-03-11T22:13:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: cluster 2024-03-11T22:13:45.674151+0000 mon.a (mon.0) 1218 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-03-11T22:13:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.676941+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.49:0/1835610008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.677979+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.49:0/2284565755' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.679392+0000 mon.a (mon.0) 1219 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]: dispatch 2024-03-11T22:13:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.690802+0000 mon.a (mon.0) 1220 : audit 1 from='client.46445 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.691709+0000 mon.a (mon.0) 1221 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:45.866859+0000 mon.c (mon.2) 259 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:47 smithi049 bash[28804]: audit 2024-03-11T22:13:46.868345+0000 mon.c (mon.2) 260 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[23415]: cluster 2024-03-11T22:13:46.666951+0000 mgr.y (mgr.14601) 221 : cluster 0 pgmap v189: 460 pgs: 396 active+clean, 64 unknown; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-03-11T22:13:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[23415]: cluster 2024-03-11T22:13:47.039606+0000 mon.a (mon.0) 1222 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[23415]: audit 2024-03-11T22:13:47.051867+0000 mon.a (mon.0) 1223 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]': finished 2024-03-11T22:13:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[23415]: audit 2024-03-11T22:13:47.051936+0000 mon.a (mon.0) 1224 : audit 1 from='client.46445 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[23415]: audit 2024-03-11T22:13:47.051993+0000 mon.a (mon.0) 1225 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[23415]: cluster 2024-03-11T22:13:47.491094+0000 mon.a (mon.0) 1226 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-03-11T22:13:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[23415]: audit 2024-03-11T22:13:47.869954+0000 mon.c (mon.2) 261 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[21434]: cluster 2024-03-11T22:13:46.666951+0000 mgr.y (mgr.14601) 221 : cluster 0 pgmap v189: 460 pgs: 396 active+clean, 64 unknown; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[21434]: cluster 2024-03-11T22:13:47.039606+0000 mon.a (mon.0) 1222 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[21434]: audit 2024-03-11T22:13:47.051867+0000 mon.a (mon.0) 1223 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]': finished 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[21434]: audit 2024-03-11T22:13:47.051936+0000 mon.a (mon.0) 1224 : audit 1 from='client.46445 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[21434]: audit 2024-03-11T22:13:47.051993+0000 mon.a (mon.0) 1225 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[21434]: cluster 2024-03-11T22:13:47.491094+0000 mon.a (mon.0) 1226 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[21434]: audit 2024-03-11T22:13:47.869954+0000 mon.c (mon.2) 261 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[28804]: cluster 2024-03-11T22:13:46.666951+0000 mgr.y (mgr.14601) 221 : cluster 0 pgmap v189: 460 pgs: 396 active+clean, 64 unknown; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-03-11T22:13:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[28804]: cluster 2024-03-11T22:13:47.039606+0000 mon.a (mon.0) 1222 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:13:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[28804]: audit 2024-03-11T22:13:47.051867+0000 mon.a (mon.0) 1223 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-11", "mode": "writeback"}]': finished 2024-03-11T22:13:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[28804]: audit 2024-03-11T22:13:47.051936+0000 mon.a (mon.0) 1224 : audit 1 from='client.46445 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi049-64063-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[28804]: audit 2024-03-11T22:13:47.051993+0000 mon.a (mon.0) 1225 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi049-64055-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[28804]: cluster 2024-03-11T22:13:47.491094+0000 mon.a (mon.0) 1226 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-03-11T22:13:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:48 smithi049 bash[28804]: audit 2024-03-11T22:13:47.869954+0000 mon.c (mon.2) 261 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:48.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:13:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:13:49.090 INFO:tasks.workunit.client.0.smithi049.stdout: misc: Running main() from gmock_main.cc 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [----------] Global test environment set-up. 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.Version (17356 ms) 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (9492 ms) 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.LongName (7922 ms) 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-03-11T22:13:49.091 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (6113 ms) 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (8030 ms) 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (4880 ms) 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.Exec (6653 ms) 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (4194 ms) 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (3455 ms) 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-03-11T22:13:49.092 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3022 ms) 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2014 ms) 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3413 ms) 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [----------] 12 tests from NeoRadosMisc (76544 ms total) 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [----------] Global test environment tear-down 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [==========] 12 tests from 1 test suite ran. (76544 ms total) 2024-03-11T22:13:49.093 INFO:tasks.workunit.client.0.smithi049.stdout: misc: [ PASSED ] 12 tests. 2024-03-11T22:13:49.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:49 smithi187 bash[23415]: cluster 2024-03-11T22:13:48.065379+0000 mon.a (mon.0) 1227 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-03-11T22:13:49.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:49 smithi187 bash[23415]: audit 2024-03-11T22:13:48.194240+0000 mon.b (mon.1) 116 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:49.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:49 smithi187 bash[23415]: audit 2024-03-11T22:13:48.590314+0000 mgr.y (mgr.14601) 222 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:49.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:49 smithi187 bash[23415]: cluster 2024-03-11T22:13:48.669229+0000 mgr.y (mgr.14601) 223 : cluster 0 pgmap v192: 524 pgs: 492 active+clean, 32 creating+peering; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 258 KiB/s wr, 8 op/s 2024-03-11T22:13:49.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:49 smithi187 bash[23415]: audit 2024-03-11T22:13:48.871639+0000 mon.c (mon.2) 262 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:49.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:49 smithi187 bash[23415]: audit 2024-03-11T22:13:49.036241+0000 mon.a (mon.0) 1228 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[21434]: cluster 2024-03-11T22:13:48.065379+0000 mon.a (mon.0) 1227 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[21434]: audit 2024-03-11T22:13:48.194240+0000 mon.b (mon.1) 116 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[21434]: audit 2024-03-11T22:13:48.590314+0000 mgr.y (mgr.14601) 222 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[21434]: cluster 2024-03-11T22:13:48.669229+0000 mgr.y (mgr.14601) 223 : cluster 0 pgmap v192: 524 pgs: 492 active+clean, 32 creating+peering; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 258 KiB/s wr, 8 op/s 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[21434]: audit 2024-03-11T22:13:48.871639+0000 mon.c (mon.2) 262 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[21434]: audit 2024-03-11T22:13:49.036241+0000 mon.a (mon.0) 1228 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[28804]: cluster 2024-03-11T22:13:48.065379+0000 mon.a (mon.0) 1227 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-03-11T22:13:49.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[28804]: audit 2024-03-11T22:13:48.194240+0000 mon.b (mon.1) 116 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:49.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[28804]: audit 2024-03-11T22:13:48.590314+0000 mgr.y (mgr.14601) 222 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:49.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[28804]: cluster 2024-03-11T22:13:48.669229+0000 mgr.y (mgr.14601) 223 : cluster 0 pgmap v192: 524 pgs: 492 active+clean, 32 creating+peering; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 3.7 KiB/s rd, 258 KiB/s wr, 8 op/s 2024-03-11T22:13:49.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[28804]: audit 2024-03-11T22:13:48.871639+0000 mon.c (mon.2) 262 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:49.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:49 smithi049 bash[28804]: audit 2024-03-11T22:13:49.036241+0000 mon.a (mon.0) 1228 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.068748+0000 mon.a (mon.0) 1229 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.073335+0000 mon.b (mon.1) 117 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: cluster 2024-03-11T22:13:49.079135+0000 mon.a (mon.0) 1230 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.090408+0000 mon.a (mon.0) 1231 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.094701+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.49:0/1151762847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.095343+0000 mon.a (mon.0) 1232 : audit 1 from='client.46481 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.096262+0000 mon.a (mon.0) 1233 : audit 1 from='client.? v1:172.21.15.49:0/2924752513' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi049-64055-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: cluster 2024-03-11T22:13:49.608721+0000 mon.a (mon.0) 1234 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.612016+0000 mon.a (mon.0) 1235 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]': finished 2024-03-11T22:13:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.612202+0000 mon.a (mon.0) 1236 : audit 1 from='client.46481 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.612362+0000 mon.a (mon.0) 1237 : audit 1 from='client.? v1:172.21.15.49:0/2924752513' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi049-64055-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: cluster 2024-03-11T22:13:49.622590+0000 mon.a (mon.0) 1238 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-03-11T22:13:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:50 smithi187 bash[23415]: audit 2024-03-11T22:13:49.636209+0000 mon.a (mon.0) 1239 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.068748+0000 mon.a (mon.0) 1229 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.073335+0000 mon.b (mon.1) 117 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: cluster 2024-03-11T22:13:49.079135+0000 mon.a (mon.0) 1230 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.090408+0000 mon.a (mon.0) 1231 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.094701+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.49:0/1151762847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.095343+0000 mon.a (mon.0) 1232 : audit 1 from='client.46481 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.096262+0000 mon.a (mon.0) 1233 : audit 1 from='client.? v1:172.21.15.49:0/2924752513' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi049-64055-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: cluster 2024-03-11T22:13:49.608721+0000 mon.a (mon.0) 1234 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.612016+0000 mon.a (mon.0) 1235 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]': finished 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.612202+0000 mon.a (mon.0) 1236 : audit 1 from='client.46481 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.612362+0000 mon.a (mon.0) 1237 : audit 1 from='client.? v1:172.21.15.49:0/2924752513' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi049-64055-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: cluster 2024-03-11T22:13:49.622590+0000 mon.a (mon.0) 1238 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[21434]: audit 2024-03-11T22:13:49.636209+0000 mon.a (mon.0) 1239 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.068748+0000 mon.a (mon.0) 1229 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.073335+0000 mon.b (mon.1) 117 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: cluster 2024-03-11T22:13:49.079135+0000 mon.a (mon.0) 1230 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.090408+0000 mon.a (mon.0) 1231 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]: dispatch 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.094701+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.49:0/1151762847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.095343+0000 mon.a (mon.0) 1232 : audit 1 from='client.46481 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.096262+0000 mon.a (mon.0) 1233 : audit 1 from='client.? v1:172.21.15.49:0/2924752513' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi049-64055-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: cluster 2024-03-11T22:13:49.608721+0000 mon.a (mon.0) 1234 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:13:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.612016+0000 mon.a (mon.0) 1235 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-11"}]': finished 2024-03-11T22:13:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.612202+0000 mon.a (mon.0) 1236 : audit 1 from='client.46481 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi049-64063-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.612362+0000 mon.a (mon.0) 1237 : audit 1 from='client.? v1:172.21.15.49:0/2924752513' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi049-64055-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: cluster 2024-03-11T22:13:49.622590+0000 mon.a (mon.0) 1238 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-03-11T22:13:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:50 smithi049 bash[28804]: audit 2024-03-11T22:13:49.636209+0000 mon.a (mon.0) 1239 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:51.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:51 smithi187 bash[23415]: audit 2024-03-11T22:13:49.873008+0000 mon.c (mon.2) 264 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:51.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:51 smithi187 bash[23415]: audit 2024-03-11T22:13:50.616427+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:51.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:51 smithi187 bash[23415]: cluster 2024-03-11T22:13:50.625565+0000 mon.a (mon.0) 1241 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-03-11T22:13:51.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:51 smithi187 bash[23415]: audit 2024-03-11T22:13:50.629460+0000 mon.a (mon.0) 1242 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:51.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:51 smithi187 bash[23415]: audit 2024-03-11T22:13:50.874524+0000 mon.c (mon.2) 265 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:52.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[21434]: audit 2024-03-11T22:13:49.873008+0000 mon.c (mon.2) 264 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:52.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[21434]: audit 2024-03-11T22:13:50.616427+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:52.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[21434]: cluster 2024-03-11T22:13:50.625565+0000 mon.a (mon.0) 1241 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-03-11T22:13:52.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[21434]: audit 2024-03-11T22:13:50.629460+0000 mon.a (mon.0) 1242 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:52.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[21434]: audit 2024-03-11T22:13:50.874524+0000 mon.c (mon.2) 265 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:52.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[28804]: audit 2024-03-11T22:13:49.873008+0000 mon.c (mon.2) 264 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:52.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[28804]: audit 2024-03-11T22:13:50.616427+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:52.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[28804]: cluster 2024-03-11T22:13:50.625565+0000 mon.a (mon.0) 1241 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-03-11T22:13:52.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[28804]: audit 2024-03-11T22:13:50.629460+0000 mon.a (mon.0) 1242 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]: dispatch 2024-03-11T22:13:52.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:51 smithi049 bash[28804]: audit 2024-03-11T22:13:50.874524+0000 mon.c (mon.2) 265 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:53.239 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: cluster 2024-03-11T22:13:50.670556+0000 mgr.y (mgr.14601) 224 : cluster 0 pgmap v196: 420 pgs: 356 active+clean, 64 unknown; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 284 KiB/s wr, 3 op/s 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: audit 2024-03-11T22:13:51.875996+0000 mon.c (mon.2) 266 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: cluster 2024-03-11T22:13:52.013797+0000 mon.a (mon.0) 1243 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: audit 2024-03-11T22:13:52.024851+0000 mon.a (mon.0) 1244 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: audit 2024-03-11T22:13:52.031038+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: audit 2024-03-11T22:13:52.037570+0000 mon.c (mon.2) 267 : audit 1 from='client.? v1:172.21.15.49:0/1358182374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: cluster 2024-03-11T22:13:52.468369+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: audit 2024-03-11T22:13:52.470306+0000 mon.a (mon.0) 1246 : audit 1 from='client.46502 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:52 smithi187 bash[23415]: audit 2024-03-11T22:13:52.477686+0000 mon.a (mon.0) 1247 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.266 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: cluster 2024-03-11T22:13:50.670556+0000 mgr.y (mgr.14601) 224 : cluster 0 pgmap v196: 420 pgs: 356 active+clean, 64 unknown; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 284 KiB/s wr, 3 op/s 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: audit 2024-03-11T22:13:51.875996+0000 mon.c (mon.2) 266 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: cluster 2024-03-11T22:13:52.013797+0000 mon.a (mon.0) 1243 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: audit 2024-03-11T22:13:52.024851+0000 mon.a (mon.0) 1244 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: audit 2024-03-11T22:13:52.031038+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: audit 2024-03-11T22:13:52.037570+0000 mon.c (mon.2) 267 : audit 1 from='client.? v1:172.21.15.49:0/1358182374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: cluster 2024-03-11T22:13:52.468369+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: audit 2024-03-11T22:13:52.470306+0000 mon.a (mon.0) 1246 : audit 1 from='client.46502 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[28804]: audit 2024-03-11T22:13:52.477686+0000 mon.a (mon.0) 1247 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: cluster 2024-03-11T22:13:50.670556+0000 mgr.y (mgr.14601) 224 : cluster 0 pgmap v196: 420 pgs: 356 active+clean, 64 unknown; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 284 KiB/s wr, 3 op/s 2024-03-11T22:13:53.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: audit 2024-03-11T22:13:51.875996+0000 mon.c (mon.2) 266 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: cluster 2024-03-11T22:13:52.013797+0000 mon.a (mon.0) 1243 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: audit 2024-03-11T22:13:52.024851+0000 mon.a (mon.0) 1244 : audit 1 from='client.? v1:172.21.15.49:0/3890731672' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi049-64261-10"}]': finished 2024-03-11T22:13:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: audit 2024-03-11T22:13:52.031038+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: audit 2024-03-11T22:13:52.037570+0000 mon.c (mon.2) 267 : audit 1 from='client.? v1:172.21.15.49:0/1358182374' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: cluster 2024-03-11T22:13:52.468369+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-03-11T22:13:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: audit 2024-03-11T22:13:52.470306+0000 mon.a (mon.0) 1246 : audit 1 from='client.46502 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:53.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:52 smithi049 bash[21434]: audit 2024-03-11T22:13:52.477686+0000 mon.a (mon.0) 1247 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.505542+0000 mon.c (mon.2) 268 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: cluster 2024-03-11T22:13:52.671504+0000 mgr.y (mgr.14601) 225 : cluster 0 pgmap v198: 484 pgs: 356 active+clean, 128 unknown; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:54.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.877354+0000 mon.c (mon.2) 269 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.917415+0000 mon.a (mon.0) 1248 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.918171+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.929171+0000 mon.a (mon.0) 1249 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.929963+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.930381+0000 mon.a (mon.0) 1250 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.934863+0000 mon.b (mon.1) 119 : audit 0 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.941682+0000 mon.b (mon.1) 120 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:52.948546+0000 mon.a (mon.0) 1251 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.030117+0000 mon.a (mon.0) 1252 : audit 1 from='client.46502 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.030346+0000 mon.a (mon.0) 1253 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.030576+0000 mon.a (mon.0) 1254 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.030739+0000 mon.a (mon.0) 1255 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: cluster 2024-03-11T22:13:53.039253+0000 mon.a (mon.0) 1256 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.040359+0000 mon.b (mon.1) 121 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2"}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.040760+0000 mon.c (mon.2) 272 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.049260+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.49:0/4149347464' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.051589+0000 mon.a (mon.0) 1257 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.064400+0000 mon.a (mon.0) 1258 : audit 1 from='client.46496 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.066956+0000 mon.b (mon.1) 122 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.074266+0000 mon.a (mon.0) 1259 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[21434]: audit 2024-03-11T22:13:53.878784+0000 mon.c (mon.2) 274 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:54.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.505542+0000 mon.c (mon.2) 268 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: cluster 2024-03-11T22:13:52.671504+0000 mgr.y (mgr.14601) 225 : cluster 0 pgmap v198: 484 pgs: 356 active+clean, 128 unknown; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.877354+0000 mon.c (mon.2) 269 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.917415+0000 mon.a (mon.0) 1248 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.918171+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.929171+0000 mon.a (mon.0) 1249 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.929963+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.930381+0000 mon.a (mon.0) 1250 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.934863+0000 mon.b (mon.1) 119 : audit 0 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.941682+0000 mon.b (mon.1) 120 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:52.948546+0000 mon.a (mon.0) 1251 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.030117+0000 mon.a (mon.0) 1252 : audit 1 from='client.46502 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.030346+0000 mon.a (mon.0) 1253 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.030576+0000 mon.a (mon.0) 1254 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.030739+0000 mon.a (mon.0) 1255 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: cluster 2024-03-11T22:13:53.039253+0000 mon.a (mon.0) 1256 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.040359+0000 mon.b (mon.1) 121 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2"}]: dispatch 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.040760+0000 mon.c (mon.2) 272 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.049260+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.49:0/4149347464' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.051589+0000 mon.a (mon.0) 1257 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.064400+0000 mon.a (mon.0) 1258 : audit 1 from='client.46496 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.066956+0000 mon.b (mon.1) 122 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.074266+0000 mon.a (mon.0) 1259 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:53 smithi049 bash[28804]: audit 2024-03-11T22:13:53.878784+0000 mon.c (mon.2) 274 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:54.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.505542+0000 mon.c (mon.2) 268 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: cluster 2024-03-11T22:13:52.671504+0000 mgr.y (mgr.14601) 225 : cluster 0 pgmap v198: 484 pgs: 356 active+clean, 128 unknown; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:54.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.877354+0000 mon.c (mon.2) 269 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:54.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.917415+0000 mon.a (mon.0) 1248 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.918171+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.929171+0000 mon.a (mon.0) 1249 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.929963+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.930381+0000 mon.a (mon.0) 1250 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.934863+0000 mon.b (mon.1) 119 : audit 0 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.941682+0000 mon.b (mon.1) 120 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:52.948546+0000 mon.a (mon.0) 1251 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.030117+0000 mon.a (mon.0) 1252 : audit 1 from='client.46502 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi049-64063-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.030346+0000 mon.a (mon.0) 1253 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.030576+0000 mon.a (mon.0) 1254 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.030739+0000 mon.a (mon.0) 1255 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: cluster 2024-03-11T22:13:53.039253+0000 mon.a (mon.0) 1256 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.040359+0000 mon.b (mon.1) 121 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2"}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.040760+0000 mon.c (mon.2) 272 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.049260+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.49:0/4149347464' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.051589+0000 mon.a (mon.0) 1257 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:13:54.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.064400+0000 mon.a (mon.0) 1258 : audit 1 from='client.46496 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.066956+0000 mon.b (mon.1) 122 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.074266+0000 mon.a (mon.0) 1259 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:54.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:53 smithi187 bash[23415]: audit 2024-03-11T22:13:53.878784+0000 mon.c (mon.2) 274 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:54.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:13:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:13:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: audit 2024-03-11T22:13:54.035585+0000 mon.a (mon.0) 1260 : audit 1 from='client.46496 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: audit 2024-03-11T22:13:54.035819+0000 mon.a (mon.0) 1261 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: audit 2024-03-11T22:13:54.042682+0000 mon.b (mon.1) 123 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: audit 2024-03-11T22:13:54.043864+0000 mon.b (mon.1) 124 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: cluster 2024-03-11T22:13:54.525228+0000 mon.a (mon.0) 1262 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: audit 2024-03-11T22:13:54.529472+0000 mon.a (mon.0) 1263 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: cluster 2024-03-11T22:13:54.672561+0000 mgr.y (mgr.14601) 226 : cluster 0 pgmap v201: 516 pgs: 420 active+clean, 64 creating+peering, 32 unknown; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 27 KiB/s wr, 29 op/s 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: audit 2024-03-11T22:13:54.690755+0000 mon.c (mon.2) 275 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:55.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:55 smithi187 bash[23415]: audit 2024-03-11T22:13:54.880338+0000 mon.c (mon.2) 276 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: audit 2024-03-11T22:13:54.035585+0000 mon.a (mon.0) 1260 : audit 1 from='client.46496 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: audit 2024-03-11T22:13:54.035819+0000 mon.a (mon.0) 1261 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: audit 2024-03-11T22:13:54.042682+0000 mon.b (mon.1) 123 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: audit 2024-03-11T22:13:54.043864+0000 mon.b (mon.1) 124 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: cluster 2024-03-11T22:13:54.525228+0000 mon.a (mon.0) 1262 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: audit 2024-03-11T22:13:54.529472+0000 mon.a (mon.0) 1263 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: cluster 2024-03-11T22:13:54.672561+0000 mgr.y (mgr.14601) 226 : cluster 0 pgmap v201: 516 pgs: 420 active+clean, 64 creating+peering, 32 unknown; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 27 KiB/s wr, 29 op/s 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: audit 2024-03-11T22:13:54.690755+0000 mon.c (mon.2) 275 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:55.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[21434]: audit 2024-03-11T22:13:54.880338+0000 mon.c (mon.2) 276 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: audit 2024-03-11T22:13:54.035585+0000 mon.a (mon.0) 1260 : audit 1 from='client.46496 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi049-64055-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: audit 2024-03-11T22:13:54.035819+0000 mon.a (mon.0) 1261 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi049-64227-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: audit 2024-03-11T22:13:54.042682+0000 mon.b (mon.1) 123 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: audit 2024-03-11T22:13:54.043864+0000 mon.b (mon.1) 124 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: cluster 2024-03-11T22:13:54.525228+0000 mon.a (mon.0) 1262 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: audit 2024-03-11T22:13:54.529472+0000 mon.a (mon.0) 1263 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: cluster 2024-03-11T22:13:54.672561+0000 mgr.y (mgr.14601) 226 : cluster 0 pgmap v201: 516 pgs: 420 active+clean, 64 creating+peering, 32 unknown; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 27 KiB/s wr, 29 op/s 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: audit 2024-03-11T22:13:54.690755+0000 mon.c (mon.2) 275 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:13:55.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:55 smithi049 bash[28804]: audit 2024-03-11T22:13:54.880338+0000 mon.c (mon.2) 276 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:56 smithi187 bash[23415]: audit 2024-03-11T22:13:55.047086+0000 mon.a (mon.0) 1264 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:13:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:56 smithi187 bash[23415]: audit 2024-03-11T22:13:55.047355+0000 mon.a (mon.0) 1265 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-11T22:13:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:56 smithi187 bash[23415]: audit 2024-03-11T22:13:55.057087+0000 mon.b (mon.1) 125 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:56 smithi187 bash[23415]: cluster 2024-03-11T22:13:55.057753+0000 mon.a (mon.0) 1266 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-03-11T22:13:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:56 smithi187 bash[23415]: audit 2024-03-11T22:13:55.063338+0000 mon.a (mon.0) 1267 : audit 1 from='client.? v1:172.21.15.49:0/2742841078' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi049-64063-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:56 smithi187 bash[23415]: audit 2024-03-11T22:13:55.064782+0000 mon.a (mon.0) 1268 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:56.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:56 smithi187 bash[23415]: audit 2024-03-11T22:13:55.881916+0000 mon.c (mon.2) 277 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:56.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[21434]: audit 2024-03-11T22:13:55.047086+0000 mon.a (mon.0) 1264 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:13:56.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[21434]: audit 2024-03-11T22:13:55.047355+0000 mon.a (mon.0) 1265 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-11T22:13:56.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[21434]: audit 2024-03-11T22:13:55.057087+0000 mon.b (mon.1) 125 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:56.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[21434]: cluster 2024-03-11T22:13:55.057753+0000 mon.a (mon.0) 1266 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-03-11T22:13:56.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[21434]: audit 2024-03-11T22:13:55.063338+0000 mon.a (mon.0) 1267 : audit 1 from='client.? v1:172.21.15.49:0/2742841078' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi049-64063-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:56.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[21434]: audit 2024-03-11T22:13:55.064782+0000 mon.a (mon.0) 1268 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:56.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[21434]: audit 2024-03-11T22:13:55.881916+0000 mon.c (mon.2) 277 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:56.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[28804]: audit 2024-03-11T22:13:55.047086+0000 mon.a (mon.0) 1264 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi049-64261-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:13:56.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[28804]: audit 2024-03-11T22:13:55.047355+0000 mon.a (mon.0) 1265 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-11T22:13:56.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[28804]: audit 2024-03-11T22:13:55.057087+0000 mon.b (mon.1) 125 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:56.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[28804]: cluster 2024-03-11T22:13:55.057753+0000 mon.a (mon.0) 1266 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-03-11T22:13:56.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[28804]: audit 2024-03-11T22:13:55.063338+0000 mon.a (mon.0) 1267 : audit 1 from='client.? v1:172.21.15.49:0/2742841078' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi049-64063-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:56.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[28804]: audit 2024-03-11T22:13:55.064782+0000 mon.a (mon.0) 1268 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-11T22:13:56.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:56 smithi049 bash[28804]: audit 2024-03-11T22:13:55.881916+0000 mon.c (mon.2) 277 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: audit 2024-03-11T22:13:56.059525+0000 mon.a (mon.0) 1269 : audit 1 from='client.? v1:172.21.15.49:0/2742841078' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi049-64063-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: audit 2024-03-11T22:13:56.059700+0000 mon.a (mon.0) 1270 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: audit 2024-03-11T22:13:56.064509+0000 mon.b (mon.1) 126 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: cluster 2024-03-11T22:13:56.071037+0000 mon.a (mon.0) 1271 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: audit 2024-03-11T22:13:56.074439+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.49:0/14212430' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: audit 2024-03-11T22:13:56.077686+0000 mon.a (mon.0) 1272 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: audit 2024-03-11T22:13:56.078304+0000 mon.a (mon.0) 1273 : audit 1 from='client.46532 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: cluster 2024-03-11T22:13:56.673625+0000 mgr.y (mgr.14601) 227 : cluster 0 pgmap v204: 524 pgs: 420 active+clean, 104 unknown; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 27 KiB/s wr, 29 op/s 2024-03-11T22:13:57.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:57 smithi187 bash[23415]: audit 2024-03-11T22:13:56.883588+0000 mon.c (mon.2) 279 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: audit 2024-03-11T22:13:56.059525+0000 mon.a (mon.0) 1269 : audit 1 from='client.? v1:172.21.15.49:0/2742841078' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi049-64063-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: audit 2024-03-11T22:13:56.059700+0000 mon.a (mon.0) 1270 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: audit 2024-03-11T22:13:56.064509+0000 mon.b (mon.1) 126 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: cluster 2024-03-11T22:13:56.071037+0000 mon.a (mon.0) 1271 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: audit 2024-03-11T22:13:56.074439+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.49:0/14212430' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: audit 2024-03-11T22:13:56.077686+0000 mon.a (mon.0) 1272 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: audit 2024-03-11T22:13:56.078304+0000 mon.a (mon.0) 1273 : audit 1 from='client.46532 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: cluster 2024-03-11T22:13:56.673625+0000 mgr.y (mgr.14601) 227 : cluster 0 pgmap v204: 524 pgs: 420 active+clean, 104 unknown; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 27 KiB/s wr, 29 op/s 2024-03-11T22:13:57.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[21434]: audit 2024-03-11T22:13:56.883588+0000 mon.c (mon.2) 279 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: audit 2024-03-11T22:13:56.059525+0000 mon.a (mon.0) 1269 : audit 1 from='client.? v1:172.21.15.49:0/2742841078' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi049-64063-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: audit 2024-03-11T22:13:56.059700+0000 mon.a (mon.0) 1270 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: audit 2024-03-11T22:13:56.064509+0000 mon.b (mon.1) 126 : audit 1 from='client.? v1:172.21.15.49:0/2602210738' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: cluster 2024-03-11T22:13:56.071037+0000 mon.a (mon.0) 1271 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: audit 2024-03-11T22:13:56.074439+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.49:0/14212430' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: audit 2024-03-11T22:13:56.077686+0000 mon.a (mon.0) 1272 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]: dispatch 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: audit 2024-03-11T22:13:56.078304+0000 mon.a (mon.0) 1273 : audit 1 from='client.46532 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: cluster 2024-03-11T22:13:56.673625+0000 mgr.y (mgr.14601) 227 : cluster 0 pgmap v204: 524 pgs: 420 active+clean, 104 unknown; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 27 KiB/s wr, 29 op/s 2024-03-11T22:13:57.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:57 smithi049 bash[28804]: audit 2024-03-11T22:13:56.883588+0000 mon.c (mon.2) 279 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-03-11T22:13:58.072 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: seed 64227 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (2 ms) 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (1636 ms) 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (32 ms) 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (7 ms) 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (9 ms) 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (4 ms) 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2024-03-11T22:13:58.073 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (4 ms) 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2 ms) 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (10 ms) 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (3 ms) 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (5 ms) 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (11 ms) 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: osd_max_attr_size = 0 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-03-11T22:13:58.074 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (2377 ms) 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (372 ms) 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: done waiting, doing copies 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: waiting for final deep scrubs... 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: done waiting 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (61022 ms) 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (7 ms) 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (6 ms) 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4137 ms) 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-03-11T22:13:58.075 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-03-11T22:13:58.076 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-03-11T22:13:58.076 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-03-11T22:13:58.076 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-03-11T22:13:58.076 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-03-11T22:13:58.078 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP io: Running main() from gmock_main.cc 2024-03-11T22:13:58.078 INFO:tasks.workunit.client.0.smithi049.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-03-11T22:13:58.078 INFO:tasks.workunit.client.0.smithi049.stdout: io: [----------] Global test environment set-up. 2024-03-11T22:13:58.078 INFO:tasks.workunit.client.0.smithi049.stdout: io: [----------] 14 tests from NeoRadosIo 2024-03-11T22:13:58.078 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-03-11T22:13:58.078 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.Limits (26845 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (4697 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.ReadOp (7010 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.SparseRead (6679 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.RoundTrip (7520 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (5289 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (4718 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (4313 ms) 2024-03-11T22:13:58.079 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (3026 ms) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.Trunc (3048 ms) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.Remove (3398 ms) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3377 ms) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.RmXattr (2594 ms) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3021 ms) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [----------] 14 tests from NeoRadosIo (85535 ms total) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [----------] Global test environment tear-down 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [==========] 14 tests from 1 test suite ran. (85535 ms total) 2024-03-11T22:13:58.080 INFO:tasks.workunit.client.0.smithi049.stdout: io: [ PASSED ] 14 tests. 2024-03-11T22:13:58.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: cluster 2024-03-11T22:13:57.062569+0000 mon.a (mon.0) 1274 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:58.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: audit 2024-03-11T22:13:57.064335+0000 mon.a (mon.0) 1275 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]': finished 2024-03-11T22:13:58.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: audit 2024-03-11T22:13:57.064619+0000 mon.a (mon.0) 1276 : audit 1 from='client.46532 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:58.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: cluster 2024-03-11T22:13:57.076925+0000 mon.a (mon.0) 1277 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-03-11T22:13:58.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: audit 2024-03-11T22:13:57.304779+0000 mon.b (mon.1) 127 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:58.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: audit 2024-03-11T22:13:57.885136+0000 mon.c (mon.2) 280 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:58.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: audit 2024-03-11T22:13:58.012338+0000 mon.a (mon.0) 1278 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:58.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[23415]: audit 2024-03-11T22:13:58.068943+0000 mon.a (mon.0) 1279 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: cluster 2024-03-11T22:13:57.062569+0000 mon.a (mon.0) 1274 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: audit 2024-03-11T22:13:57.064335+0000 mon.a (mon.0) 1275 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]': finished 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: audit 2024-03-11T22:13:57.064619+0000 mon.a (mon.0) 1276 : audit 1 from='client.46532 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: cluster 2024-03-11T22:13:57.076925+0000 mon.a (mon.0) 1277 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: audit 2024-03-11T22:13:57.304779+0000 mon.b (mon.1) 127 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: audit 2024-03-11T22:13:57.885136+0000 mon.c (mon.2) 280 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: audit 2024-03-11T22:13:58.012338+0000 mon.a (mon.0) 1278 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[21434]: audit 2024-03-11T22:13:58.068943+0000 mon.a (mon.0) 1279 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:58.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: cluster 2024-03-11T22:13:57.062569+0000 mon.a (mon.0) 1274 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:13:58.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: audit 2024-03-11T22:13:57.064335+0000 mon.a (mon.0) 1275 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi049-64227-1","app":"app1","key":"key1"}]': finished 2024-03-11T22:13:58.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: audit 2024-03-11T22:13:57.064619+0000 mon.a (mon.0) 1276 : audit 1 from='client.46532 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi049-64055-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:58.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: cluster 2024-03-11T22:13:57.076925+0000 mon.a (mon.0) 1277 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-03-11T22:13:58.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: audit 2024-03-11T22:13:57.304779+0000 mon.b (mon.1) 127 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:58.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: audit 2024-03-11T22:13:57.885136+0000 mon.c (mon.2) 280 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:58.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: audit 2024-03-11T22:13:58.012338+0000 mon.a (mon.0) 1278 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:13:58.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:58 smithi049 bash[28804]: audit 2024-03-11T22:13:58.068943+0000 mon.a (mon.0) 1279 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:13:58.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:13:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:13:59.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.074155+0000 mon.b (mon.1) 128 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:13:59.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.076024+0000 mon.b (mon.1) 129 : audit 1 from='client.? v1:172.21.15.49:0/248691222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: cluster 2024-03-11T22:13:58.079703+0000 mon.a (mon.0) 1280 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-03-11T22:13:59.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.094381+0000 mon.a (mon.0) 1281 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.094859+0000 mon.a (mon.0) 1282 : audit 1 from='client.47830 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.132259+0000 mon.a (mon.0) 1283 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.136537+0000 mon.a (mon.0) 1284 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.136941+0000 mon.a (mon.0) 1285 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64227-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.600170+0000 mgr.y (mgr.14601) 228 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: cluster 2024-03-11T22:13:58.677117+0000 mgr.y (mgr.14601) 229 : cluster 0 pgmap v207: 460 pgs: 396 active+clean, 64 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:58.886560+0000 mon.c (mon.2) 281 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.074420+0000 mon.a (mon.0) 1286 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]': finished 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.074784+0000 mon.a (mon.0) 1287 : audit 1 from='client.47830 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.075060+0000 mon.a (mon.0) 1288 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64227-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.078706+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: cluster 2024-03-11T22:13:59.087583+0000 mon.a (mon.0) 1289 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.090786+0000 mon.a (mon.0) 1290 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64227-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.091380+0000 mon.a (mon.0) 1291 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]: dispatch 2024-03-11T22:13:59.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.099596+0000 mon.b (mon.1) 131 : audit 1 from='client.? v1:172.21.15.49:0/4057854519' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:13:59 smithi187 bash[23415]: audit 2024-03-11T22:13:59.107529+0000 mon.a (mon.0) 1292 : audit 1 from='client.47833 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.074155+0000 mon.b (mon.1) 128 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:13:59.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.076024+0000 mon.b (mon.1) 129 : audit 1 from='client.? v1:172.21.15.49:0/248691222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: cluster 2024-03-11T22:13:58.079703+0000 mon.a (mon.0) 1280 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-03-11T22:13:59.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.094381+0000 mon.a (mon.0) 1281 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:13:59.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.094859+0000 mon.a (mon.0) 1282 : audit 1 from='client.47830 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.132259+0000 mon.a (mon.0) 1283 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.136537+0000 mon.a (mon.0) 1284 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.136941+0000 mon.a (mon.0) 1285 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64227-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.600170+0000 mgr.y (mgr.14601) 228 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: cluster 2024-03-11T22:13:58.677117+0000 mgr.y (mgr.14601) 229 : cluster 0 pgmap v207: 460 pgs: 396 active+clean, 64 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:58.886560+0000 mon.c (mon.2) 281 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.074420+0000 mon.a (mon.0) 1286 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]': finished 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.074784+0000 mon.a (mon.0) 1287 : audit 1 from='client.47830 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.075060+0000 mon.a (mon.0) 1288 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64227-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.078706+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: cluster 2024-03-11T22:13:59.087583+0000 mon.a (mon.0) 1289 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.090786+0000 mon.a (mon.0) 1290 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64227-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.091380+0000 mon.a (mon.0) 1291 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.099596+0000 mon.b (mon.1) 131 : audit 1 from='client.? v1:172.21.15.49:0/4057854519' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[28804]: audit 2024-03-11T22:13:59.107529+0000 mon.a (mon.0) 1292 : audit 1 from='client.47833 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.074155+0000 mon.b (mon.1) 128 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.076024+0000 mon.b (mon.1) 129 : audit 1 from='client.? v1:172.21.15.49:0/248691222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: cluster 2024-03-11T22:13:58.079703+0000 mon.a (mon.0) 1280 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.094381+0000 mon.a (mon.0) 1281 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.094859+0000 mon.a (mon.0) 1282 : audit 1 from='client.47830 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.132259+0000 mon.a (mon.0) 1283 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.136537+0000 mon.a (mon.0) 1284 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.136941+0000 mon.a (mon.0) 1285 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64227-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.600170+0000 mgr.y (mgr.14601) 228 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:13:59.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: cluster 2024-03-11T22:13:58.677117+0000 mgr.y (mgr.14601) 229 : cluster 0 pgmap v207: 460 pgs: 396 active+clean, 64 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:58.886560+0000 mon.c (mon.2) 281 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.074420+0000 mon.a (mon.0) 1286 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-13"}]': finished 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.074784+0000 mon.a (mon.0) 1287 : audit 1 from='client.47830 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi049-64063-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.075060+0000 mon.a (mon.0) 1288 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64227-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.078706+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]: dispatch 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: cluster 2024-03-11T22:13:59.087583+0000 mon.a (mon.0) 1289 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.090786+0000 mon.a (mon.0) 1290 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64227-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.091380+0000 mon.a (mon.0) 1291 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]: dispatch 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.099596+0000 mon.b (mon.1) 131 : audit 1 from='client.? v1:172.21.15.49:0/4057854519' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:13:59.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:13:59 smithi049 bash[21434]: audit 2024-03-11T22:13:59.107529+0000 mon.a (mon.0) 1292 : audit 1 from='client.47833 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:00.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:00 smithi049 bash[21434]: audit 2024-03-11T22:13:59.888199+0000 mon.c (mon.2) 282 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:00.766 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:00 smithi049 bash[21434]: cluster 2024-03-11T22:14:00.006013+0000 mon.a (mon.0) 1293 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:00.767 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:00 smithi049 bash[21434]: audit 2024-03-11T22:14:00.009674+0000 mon.a (mon.0) 1294 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]': finished 2024-03-11T22:14:00.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:00 smithi049 bash[28804]: audit 2024-03-11T22:13:59.888199+0000 mon.c (mon.2) 282 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:00.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:00 smithi049 bash[28804]: cluster 2024-03-11T22:14:00.006013+0000 mon.a (mon.0) 1293 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:00.767 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:00 smithi049 bash[28804]: audit 2024-03-11T22:14:00.009674+0000 mon.a (mon.0) 1294 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]': finished 2024-03-11T22:14:00.989 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:00 smithi187 bash[23415]: audit 2024-03-11T22:13:59.888199+0000 mon.c (mon.2) 282 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:00.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:00 smithi187 bash[23415]: cluster 2024-03-11T22:14:00.006013+0000 mon.a (mon.0) 1293 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:00.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:00 smithi187 bash[23415]: audit 2024-03-11T22:14:00.009674+0000 mon.a (mon.0) 1294 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-13", "mode": "writeback"}]': finished 2024-03-11T22:14:02.038 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: Running main() from gmock_main.cc 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [----------] Global test environment set-up. 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (26815 ms) 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (11705 ms) 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (6700 ms) 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (8504 ms) 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (5491 ms) 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-03-11T22:14:02.039 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3515 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (4325 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3012 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (3034 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (3943 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (3423 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3031 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3014 ms) 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-03-11T22:14:02.040 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2952 ms) 2024-03-11T22:14:02.041 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (89464 ms total) 2024-03-11T22:14:02.041 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: 2024-03-11T22:14:02.041 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [----------] Global test environment tear-down 2024-03-11T22:14:02.041 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (89464 ms total) 2024-03-11T22:14:02.041 INFO:tasks.workunit.client.0.smithi049.stdout: read_operations: [ PASSED ] 14 tests. 2024-03-11T22:14:02.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.009962+0000 mon.a (mon.0) 1295 : audit 1 from='client.47833 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:02.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: cluster 2024-03-11T22:14:00.500177+0000 mon.a (mon.0) 1296 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-03-11T22:14:02.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: cluster 2024-03-11T22:14:00.677719+0000 mgr.y (mgr.14601) 230 : cluster 0 pgmap v210: 460 pgs: 364 active+clean, 64 unknown, 32 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.867355+0000 mon.b (mon.1) 132 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.0"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.868521+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.1"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.869369+0000 mon.b (mon.1) 134 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.2"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.870186+0000 mon.b (mon.1) 135 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.3"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.870988+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.4"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.871800+0000 mon.b (mon.1) 137 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.5"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.872554+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.6"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.873258+0000 mon.b (mon.1) 139 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.7"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.873950+0000 mgr.y (mgr.14601) 231 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.0"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.874001+0000 mon.b (mon.1) 140 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.8"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.874695+0000 mon.b (mon.1) 141 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.9"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.875031+0000 mgr.y (mgr.14601) 232 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.1"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.875890+0000 mgr.y (mgr.14601) 233 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.2"}]: dispatch 2024-03-11T22:14:02.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.876638+0000 mgr.y (mgr.14601) 234 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.3"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.877472+0000 mgr.y (mgr.14601) 235 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.4"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.878255+0000 mgr.y (mgr.14601) 236 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.5"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.878998+0000 mgr.y (mgr.14601) 237 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.6"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.879713+0000 mgr.y (mgr.14601) 238 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.7"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.880446+0000 mgr.y (mgr.14601) 239 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.8"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.881133+0000 mgr.y (mgr.14601) 240 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.9"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:00.889597+0000 mon.c (mon.2) 283 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:01.013986+0000 mon.a (mon.0) 1297 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64227-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.022744+0000 mon.a (mon.0) 1298 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:01.029418+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.49:0/398197015' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:02.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:01 smithi187 bash[23415]: audit 2024-03-11T22:14:01.035078+0000 mon.a (mon.0) 1299 : audit 1 from='client.46565 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:02.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.009962+0000 mon.a (mon.0) 1295 : audit 1 from='client.47833 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:02.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: cluster 2024-03-11T22:14:00.500177+0000 mon.a (mon.0) 1296 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-03-11T22:14:02.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: cluster 2024-03-11T22:14:00.677719+0000 mgr.y (mgr.14601) 230 : cluster 0 pgmap v210: 460 pgs: 364 active+clean, 64 unknown, 32 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:14:02.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.867355+0000 mon.b (mon.1) 132 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.0"}]: dispatch 2024-03-11T22:14:02.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.868521+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.1"}]: dispatch 2024-03-11T22:14:02.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.869369+0000 mon.b (mon.1) 134 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.2"}]: dispatch 2024-03-11T22:14:02.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.870186+0000 mon.b (mon.1) 135 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.3"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.870988+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.4"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.871800+0000 mon.b (mon.1) 137 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.5"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.872554+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.6"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.873258+0000 mon.b (mon.1) 139 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.7"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.873950+0000 mgr.y (mgr.14601) 231 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.0"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.874001+0000 mon.b (mon.1) 140 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.8"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.874695+0000 mon.b (mon.1) 141 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.9"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.875031+0000 mgr.y (mgr.14601) 232 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.1"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.875890+0000 mgr.y (mgr.14601) 233 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.2"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.876638+0000 mgr.y (mgr.14601) 234 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.3"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.877472+0000 mgr.y (mgr.14601) 235 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.4"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.878255+0000 mgr.y (mgr.14601) 236 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.5"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.878998+0000 mgr.y (mgr.14601) 237 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.6"}]: dispatch 2024-03-11T22:14:02.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.879713+0000 mgr.y (mgr.14601) 238 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.7"}]: dispatch 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.880446+0000 mgr.y (mgr.14601) 239 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.8"}]: dispatch 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.881133+0000 mgr.y (mgr.14601) 240 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.9"}]: dispatch 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:00.889597+0000 mon.c (mon.2) 283 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:01.013986+0000 mon.a (mon.0) 1297 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64227-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.022744+0000 mon.a (mon.0) 1298 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:01.029418+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.49:0/398197015' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[28804]: audit 2024-03-11T22:14:01.035078+0000 mon.a (mon.0) 1299 : audit 1 from='client.46565 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.009962+0000 mon.a (mon.0) 1295 : audit 1 from='client.47833 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi049-64055-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:02.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: cluster 2024-03-11T22:14:00.500177+0000 mon.a (mon.0) 1296 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: cluster 2024-03-11T22:14:00.677719+0000 mgr.y (mgr.14601) 230 : cluster 0 pgmap v210: 460 pgs: 364 active+clean, 64 unknown, 32 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.867355+0000 mon.b (mon.1) 132 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.0"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.868521+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.1"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.869369+0000 mon.b (mon.1) 134 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.2"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.870186+0000 mon.b (mon.1) 135 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.3"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.870988+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.4"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.871800+0000 mon.b (mon.1) 137 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.5"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.872554+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.6"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.873258+0000 mon.b (mon.1) 139 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.7"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.873950+0000 mgr.y (mgr.14601) 231 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.0"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.874001+0000 mon.b (mon.1) 140 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.8"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.874695+0000 mon.b (mon.1) 141 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "157.9"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.875031+0000 mgr.y (mgr.14601) 232 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.1"}]: dispatch 2024-03-11T22:14:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.875890+0000 mgr.y (mgr.14601) 233 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.2"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.876638+0000 mgr.y (mgr.14601) 234 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.3"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.877472+0000 mgr.y (mgr.14601) 235 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.4"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.878255+0000 mgr.y (mgr.14601) 236 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.5"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.878998+0000 mgr.y (mgr.14601) 237 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.6"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.879713+0000 mgr.y (mgr.14601) 238 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.7"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.880446+0000 mgr.y (mgr.14601) 239 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.8"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.881133+0000 mgr.y (mgr.14601) 240 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "157.9"}]: dispatch 2024-03-11T22:14:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:00.889597+0000 mon.c (mon.2) 283 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:01.013986+0000 mon.a (mon.0) 1297 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64227-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.022744+0000 mon.a (mon.0) 1298 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-03-11T22:14:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:01.029418+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.49:0/398197015' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:01 smithi049 bash[21434]: audit 2024-03-11T22:14:01.035078+0000 mon.a (mon.0) 1299 : audit 1 from='client.46565 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.259268+0000 osd.0 (osd.0) 7 : cluster 0 157.4 scrub starts 2024-03-11T22:14:03.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.263304+0000 osd.0 (osd.0) 8 : cluster 0 157.4 scrub ok 2024-03-11T22:14:03.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.726881+0000 osd.2 (osd.2) 7 : cluster 0 157.7 scrub starts 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.737460+0000 osd.2 (osd.2) 8 : cluster 0 157.7 scrub ok 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.751099+0000 osd.1 (osd.1) 3 : cluster 0 157.2 scrub starts 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.755436+0000 osd.1 (osd.1) 4 : cluster 0 157.2 scrub ok 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.779828+0000 osd.4 (osd.4) 11 : cluster 0 157.3 deep-scrub starts 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.784359+0000 osd.7 (osd.7) 11 : cluster 0 157.6 deep-scrub starts 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.796149+0000 osd.7 (osd.7) 12 : cluster 0 157.6 deep-scrub ok 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.799433+0000 osd.4 (osd.4) 12 : cluster 0 157.3 deep-scrub ok 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: audit 2024-03-11T22:14:01.890713+0000 mon.c (mon.2) 285 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.906057+0000 osd.6 (osd.6) 11 : cluster 0 157.9 scrub starts 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:01.912350+0000 osd.6 (osd.6) 12 : cluster 0 157.9 scrub ok 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: audit 2024-03-11T22:14:02.017975+0000 mon.a (mon.0) 1300 : audit 1 from='client.46565 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.025506+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: audit 2024-03-11T22:14:02.043211+0000 mon.c (mon.2) 286 : audit 1 from='client.? v1:172.21.15.49:0/2812029751' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: audit 2024-03-11T22:14:02.052016+0000 mon.a (mon.0) 1302 : audit 1 from='client.46571 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: audit 2024-03-11T22:14:02.052350+0000 mon.a (mon.0) 1303 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:02 smithi187 bash[23415]: audit 2024-03-11T22:14:02.892288+0000 mon.c (mon.2) 287 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:03.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.259268+0000 osd.0 (osd.0) 7 : cluster 0 157.4 scrub starts 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.263304+0000 osd.0 (osd.0) 8 : cluster 0 157.4 scrub ok 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.726881+0000 osd.2 (osd.2) 7 : cluster 0 157.7 scrub starts 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.737460+0000 osd.2 (osd.2) 8 : cluster 0 157.7 scrub ok 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.751099+0000 osd.1 (osd.1) 3 : cluster 0 157.2 scrub starts 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.755436+0000 osd.1 (osd.1) 4 : cluster 0 157.2 scrub ok 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.779828+0000 osd.4 (osd.4) 11 : cluster 0 157.3 deep-scrub starts 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.784359+0000 osd.7 (osd.7) 11 : cluster 0 157.6 deep-scrub starts 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.796149+0000 osd.7 (osd.7) 12 : cluster 0 157.6 deep-scrub ok 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.799433+0000 osd.4 (osd.4) 12 : cluster 0 157.3 deep-scrub ok 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: audit 2024-03-11T22:14:01.890713+0000 mon.c (mon.2) 285 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:03.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.906057+0000 osd.6 (osd.6) 11 : cluster 0 157.9 scrub starts 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:01.912350+0000 osd.6 (osd.6) 12 : cluster 0 157.9 scrub ok 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: audit 2024-03-11T22:14:02.017975+0000 mon.a (mon.0) 1300 : audit 1 from='client.46565 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.025506+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: audit 2024-03-11T22:14:02.043211+0000 mon.c (mon.2) 286 : audit 1 from='client.? v1:172.21.15.49:0/2812029751' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: audit 2024-03-11T22:14:02.052016+0000 mon.a (mon.0) 1302 : audit 1 from='client.46571 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: audit 2024-03-11T22:14:02.052350+0000 mon.a (mon.0) 1303 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[21434]: audit 2024-03-11T22:14:02.892288+0000 mon.c (mon.2) 287 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.259268+0000 osd.0 (osd.0) 7 : cluster 0 157.4 scrub starts 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.263304+0000 osd.0 (osd.0) 8 : cluster 0 157.4 scrub ok 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.726881+0000 osd.2 (osd.2) 7 : cluster 0 157.7 scrub starts 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.737460+0000 osd.2 (osd.2) 8 : cluster 0 157.7 scrub ok 2024-03-11T22:14:03.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.751099+0000 osd.1 (osd.1) 3 : cluster 0 157.2 scrub starts 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.755436+0000 osd.1 (osd.1) 4 : cluster 0 157.2 scrub ok 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.779828+0000 osd.4 (osd.4) 11 : cluster 0 157.3 deep-scrub starts 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.784359+0000 osd.7 (osd.7) 11 : cluster 0 157.6 deep-scrub starts 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.796149+0000 osd.7 (osd.7) 12 : cluster 0 157.6 deep-scrub ok 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.799433+0000 osd.4 (osd.4) 12 : cluster 0 157.3 deep-scrub ok 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: audit 2024-03-11T22:14:01.890713+0000 mon.c (mon.2) 285 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.906057+0000 osd.6 (osd.6) 11 : cluster 0 157.9 scrub starts 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:01.912350+0000 osd.6 (osd.6) 12 : cluster 0 157.9 scrub ok 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: audit 2024-03-11T22:14:02.017975+0000 mon.a (mon.0) 1300 : audit 1 from='client.46565 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi049-64063-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.025506+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: audit 2024-03-11T22:14:02.043211+0000 mon.c (mon.2) 286 : audit 1 from='client.? v1:172.21.15.49:0/2812029751' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: audit 2024-03-11T22:14:02.052016+0000 mon.a (mon.0) 1302 : audit 1 from='client.46571 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: audit 2024-03-11T22:14:02.052350+0000 mon.a (mon.0) 1303 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:03.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:02 smithi049 bash[28804]: audit 2024-03-11T22:14:02.892288+0000 mon.c (mon.2) 287 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.678873+0000 mgr.y (mgr.14601) 241 : cluster 0 pgmap v213: 500 pgs: 364 active+clean, 104 unknown, 32 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.735159+0000 osd.4 (osd.4) 13 : cluster 0 157.0 scrub starts 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.738854+0000 osd.4 (osd.4) 14 : cluster 0 157.0 scrub ok 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.745020+0000 osd.7 (osd.7) 13 : cluster 0 157.8 scrub starts 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.748794+0000 osd.7 (osd.7) 14 : cluster 0 157.8 scrub ok 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.753078+0000 osd.2 (osd.2) 9 : cluster 0 157.5 scrub starts 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:02.758515+0000 osd.2 (osd.2) 10 : cluster 0 157.5 scrub ok 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:03.017956+0000 mon.a (mon.0) 1304 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: audit 2024-03-11T22:14:03.027476+0000 mon.a (mon.0) 1305 : audit 1 from='client.46571 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: audit 2024-03-11T22:14:03.027691+0000 mon.a (mon.0) 1306 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: cluster 2024-03-11T22:14:03.035548+0000 mon.a (mon.0) 1307 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: audit 2024-03-11T22:14:03.040997+0000 mon.a (mon.0) 1308 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: audit 2024-03-11T22:14:03.227491+0000 mon.c (mon.2) 288 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[21434]: audit 2024-03-11T22:14:03.893834+0000 mon.c (mon.2) 289 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.678873+0000 mgr.y (mgr.14601) 241 : cluster 0 pgmap v213: 500 pgs: 364 active+clean, 104 unknown, 32 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.735159+0000 osd.4 (osd.4) 13 : cluster 0 157.0 scrub starts 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.738854+0000 osd.4 (osd.4) 14 : cluster 0 157.0 scrub ok 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.745020+0000 osd.7 (osd.7) 13 : cluster 0 157.8 scrub starts 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.748794+0000 osd.7 (osd.7) 14 : cluster 0 157.8 scrub ok 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.753078+0000 osd.2 (osd.2) 9 : cluster 0 157.5 scrub starts 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:02.758515+0000 osd.2 (osd.2) 10 : cluster 0 157.5 scrub ok 2024-03-11T22:14:04.223 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:03.017956+0000 mon.a (mon.0) 1304 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:04.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: audit 2024-03-11T22:14:03.027476+0000 mon.a (mon.0) 1305 : audit 1 from='client.46571 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:04.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: audit 2024-03-11T22:14:03.027691+0000 mon.a (mon.0) 1306 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:04.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: cluster 2024-03-11T22:14:03.035548+0000 mon.a (mon.0) 1307 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-03-11T22:14:04.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: audit 2024-03-11T22:14:03.040997+0000 mon.a (mon.0) 1308 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:04.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: audit 2024-03-11T22:14:03.227491+0000 mon.c (mon.2) 288 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:14:04.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:03 smithi049 bash[28804]: audit 2024-03-11T22:14:03.893834+0000 mon.c (mon.2) 289 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.678873+0000 mgr.y (mgr.14601) 241 : cluster 0 pgmap v213: 500 pgs: 364 active+clean, 104 unknown, 32 creating+peering; 607 KiB data, 823 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.735159+0000 osd.4 (osd.4) 13 : cluster 0 157.0 scrub starts 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.738854+0000 osd.4 (osd.4) 14 : cluster 0 157.0 scrub ok 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.745020+0000 osd.7 (osd.7) 13 : cluster 0 157.8 scrub starts 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.748794+0000 osd.7 (osd.7) 14 : cluster 0 157.8 scrub ok 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.753078+0000 osd.2 (osd.2) 9 : cluster 0 157.5 scrub starts 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:02.758515+0000 osd.2 (osd.2) 10 : cluster 0 157.5 scrub ok 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:03.017956+0000 mon.a (mon.0) 1304 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: audit 2024-03-11T22:14:03.027476+0000 mon.a (mon.0) 1305 : audit 1 from='client.46571 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi049-64055-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: audit 2024-03-11T22:14:03.027691+0000 mon.a (mon.0) 1306 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: cluster 2024-03-11T22:14:03.035548+0000 mon.a (mon.0) 1307 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-03-11T22:14:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: audit 2024-03-11T22:14:03.040997+0000 mon.a (mon.0) 1308 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:04.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: audit 2024-03-11T22:14:03.227491+0000 mon.c (mon.2) 288 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:14:04.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:03 smithi187 bash[23415]: audit 2024-03-11T22:14:03.893834+0000 mon.c (mon.2) 289 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:04.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:14:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: cluster 2024-03-11T22:14:03.739317+0000 osd.7 (osd.7) 15 : cluster 0 157.1 scrub starts 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: cluster 2024-03-11T22:14:03.741651+0000 osd.7 (osd.7) 16 : cluster 0 157.1 scrub ok 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:03.963967+0000 mon.c (mon.2) 290 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:03.976855+0000 mon.c (mon.2) 291 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: cluster 2024-03-11T22:14:03.983446+0000 mgr.y (mgr.14601) 242 : cluster 0 pgmap v215: 468 pgs: 468 active+clean; 595 KiB data, 433 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 7.8 KiB/s wr, 83 op/s 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:03.987081+0000 mon.a (mon.0) 1309 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:04.029932+0000 mon.a (mon.0) 1310 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: cluster 2024-03-11T22:14:04.034982+0000 mon.a (mon.0) 1311 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-03-11T22:14:05.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:04.036500+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:05.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:04.036834+0000 mon.a (mon.0) 1312 : audit 1 from='client.? v1:172.21.15.49:0/4219281420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi049-64063-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:05.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:04.037106+0000 mon.a (mon.0) 1313 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:05.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:04 smithi187 bash[23415]: audit 2024-03-11T22:14:04.895294+0000 mon.c (mon.2) 293 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:05.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: cluster 2024-03-11T22:14:03.739317+0000 osd.7 (osd.7) 15 : cluster 0 157.1 scrub starts 2024-03-11T22:14:05.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: cluster 2024-03-11T22:14:03.741651+0000 osd.7 (osd.7) 16 : cluster 0 157.1 scrub ok 2024-03-11T22:14:05.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:03.963967+0000 mon.c (mon.2) 290 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:14:05.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:03.976855+0000 mon.c (mon.2) 291 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:14:05.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: cluster 2024-03-11T22:14:03.983446+0000 mgr.y (mgr.14601) 242 : cluster 0 pgmap v215: 468 pgs: 468 active+clean; 595 KiB data, 433 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 7.8 KiB/s wr, 83 op/s 2024-03-11T22:14:05.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:03.987081+0000 mon.a (mon.0) 1309 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:05.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:04.029932+0000 mon.a (mon.0) 1310 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: cluster 2024-03-11T22:14:04.034982+0000 mon.a (mon.0) 1311 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:04.036500+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:04.036834+0000 mon.a (mon.0) 1312 : audit 1 from='client.? v1:172.21.15.49:0/4219281420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi049-64063-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:04.037106+0000 mon.a (mon.0) 1313 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[21434]: audit 2024-03-11T22:14:04.895294+0000 mon.c (mon.2) 293 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: cluster 2024-03-11T22:14:03.739317+0000 osd.7 (osd.7) 15 : cluster 0 157.1 scrub starts 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: cluster 2024-03-11T22:14:03.741651+0000 osd.7 (osd.7) 16 : cluster 0 157.1 scrub ok 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:03.963967+0000 mon.c (mon.2) 290 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:03.976855+0000 mon.c (mon.2) 291 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: cluster 2024-03-11T22:14:03.983446+0000 mgr.y (mgr.14601) 242 : cluster 0 pgmap v215: 468 pgs: 468 active+clean; 595 KiB data, 433 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 7.8 KiB/s wr, 83 op/s 2024-03-11T22:14:05.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:03.987081+0000 mon.a (mon.0) 1309 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:05.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:04.029932+0000 mon.a (mon.0) 1310 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64227-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:05.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: cluster 2024-03-11T22:14:04.034982+0000 mon.a (mon.0) 1311 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-03-11T22:14:05.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:04.036500+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:05.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:04.036834+0000 mon.a (mon.0) 1312 : audit 1 from='client.? v1:172.21.15.49:0/4219281420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi049-64063-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:05.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:04.037106+0000 mon.a (mon.0) 1313 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:05.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:04 smithi049 bash[28804]: audit 2024-03-11T22:14:04.895294+0000 mon.c (mon.2) 293 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:06.036 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: Running main() from gmock_main.cc 2024-03-11T22:14:06.036 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-03-11T22:14:06.036 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] Global test environment set-up. 2024-03-11T22:14:06.036 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-03-11T22:14:06.036 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2457 ms) 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2921 ms) 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (3741 ms) 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (3278 ms) 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (12397 ms total) 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-03-11T22:14:06.037 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (6050 ms) 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (10894 ms) 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (8840 ms) 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (25784 ms total) 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3908 ms) 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2006 ms) 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-03-11T22:14:06.038 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1991 ms) 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (3414 ms) 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (11319 ms total) 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4114 ms) 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3939 ms) 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8053 ms total) 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [----------] Global test environment tear-down 2024-03-11T22:14:06.039 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (93773 ms total) 2024-03-11T22:14:06.040 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: cluster 2024-03-11T22:14:04.983217+0000 mon.a (mon.0) 1314 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.013844+0000 mon.a (mon.0) 1315 : audit 1 from='client.? v1:172.21.15.49:0/4219281420' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi049-64063-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.014116+0000 mon.a (mon.0) 1316 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.022075+0000 mon.c (mon.2) 294 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: cluster 2024-03-11T22:14:05.022530+0000 mon.a (mon.0) 1317 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.028571+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.49:0/4133808776' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.030233+0000 mon.a (mon.0) 1318 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:06.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.045332+0000 mon.a (mon.0) 1319 : audit 1 from='client.46583 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:06.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.897011+0000 mon.c (mon.2) 296 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:06.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.898480+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:06.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:05 smithi187 bash[23415]: audit 2024-03-11T22:14:05.899345+0000 mon.a (mon.0) 1320 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: cluster 2024-03-11T22:14:04.983217+0000 mon.a (mon.0) 1314 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.013844+0000 mon.a (mon.0) 1315 : audit 1 from='client.? v1:172.21.15.49:0/4219281420' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi049-64063-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.014116+0000 mon.a (mon.0) 1316 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.022075+0000 mon.c (mon.2) 294 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: cluster 2024-03-11T22:14:05.022530+0000 mon.a (mon.0) 1317 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.028571+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.49:0/4133808776' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.030233+0000 mon.a (mon.0) 1318 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.045332+0000 mon.a (mon.0) 1319 : audit 1 from='client.46583 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:06.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.897011+0000 mon.c (mon.2) 296 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.898480+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[21434]: audit 2024-03-11T22:14:05.899345+0000 mon.a (mon.0) 1320 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: cluster 2024-03-11T22:14:04.983217+0000 mon.a (mon.0) 1314 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.013844+0000 mon.a (mon.0) 1315 : audit 1 from='client.? v1:172.21.15.49:0/4219281420' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi049-64063-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.014116+0000 mon.a (mon.0) 1316 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.022075+0000 mon.c (mon.2) 294 : audit 1 from='client.? v1:172.21.15.49:0/3413073501' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: cluster 2024-03-11T22:14:05.022530+0000 mon.a (mon.0) 1317 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.028571+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.49:0/4133808776' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.030233+0000 mon.a (mon.0) 1318 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.045332+0000 mon.a (mon.0) 1319 : audit 1 from='client.46583 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.897011+0000 mon.c (mon.2) 296 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:06.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.898480+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:06.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:05 smithi049 bash[28804]: audit 2024-03-11T22:14:05.899345+0000 mon.a (mon.0) 1320 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:07.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: cluster 2024-03-11T22:14:05.984444+0000 mgr.y (mgr.14601) 243 : cluster 0 pgmap v218: 428 pgs: 64 unknown, 364 active+clean; 594 KiB data, 433 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 77 op/s 2024-03-11T22:14:07.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.018432+0000 mon.a (mon.0) 1321 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:14:07.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.018688+0000 mon.a (mon.0) 1322 : audit 1 from='client.46583 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:07.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.018969+0000 mon.a (mon.0) 1323 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]': finished 2024-03-11T22:14:07.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: cluster 2024-03-11T22:14:06.028052+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-03-11T22:14:07.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.029576+0000 mon.c (mon.2) 298 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.036245+0000 mon.a (mon.0) 1325 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.045142+0000 mon.c (mon.2) 299 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.050858+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[21434]: audit 2024-03-11T22:14:06.053522+0000 mon.a (mon.0) 1326 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: cluster 2024-03-11T22:14:05.984444+0000 mgr.y (mgr.14601) 243 : cluster 0 pgmap v218: 428 pgs: 64 unknown, 364 active+clean; 594 KiB data, 433 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 77 op/s 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.018432+0000 mon.a (mon.0) 1321 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.018688+0000 mon.a (mon.0) 1322 : audit 1 from='client.46583 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.018969+0000 mon.a (mon.0) 1323 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]': finished 2024-03-11T22:14:07.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: cluster 2024-03-11T22:14:06.028052+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-03-11T22:14:07.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.029576+0000 mon.c (mon.2) 298 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:07.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.036245+0000 mon.a (mon.0) 1325 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:14:07.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.045142+0000 mon.c (mon.2) 299 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:07.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.050858+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:07.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:07 smithi049 bash[28804]: audit 2024-03-11T22:14:06.053522+0000 mon.a (mon.0) 1326 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: cluster 2024-03-11T22:14:05.984444+0000 mgr.y (mgr.14601) 243 : cluster 0 pgmap v218: 428 pgs: 64 unknown, 364 active+clean; 594 KiB data, 433 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 77 op/s 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.018432+0000 mon.a (mon.0) 1321 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi049-64261-15"}]': finished 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.018688+0000 mon.a (mon.0) 1322 : audit 1 from='client.46583 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi049-64055-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.018969+0000 mon.a (mon.0) 1323 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]': finished 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: cluster 2024-03-11T22:14:06.028052+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.029576+0000 mon.c (mon.2) 298 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.036245+0000 mon.a (mon.0) 1325 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.045142+0000 mon.c (mon.2) 299 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.050858+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:07 smithi187 bash[23415]: audit 2024-03-11T22:14:06.053522+0000 mon.a (mon.0) 1326 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[23415]: audit 2024-03-11T22:14:07.030402+0000 mon.a (mon.0) 1327 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[23415]: audit 2024-03-11T22:14:07.030608+0000 mon.a (mon.0) 1328 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]': finished 2024-03-11T22:14:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[23415]: cluster 2024-03-11T22:14:07.037985+0000 mon.a (mon.0) 1329 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-03-11T22:14:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[23415]: audit 2024-03-11T22:14:07.040030+0000 mon.c (mon.2) 301 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[23415]: audit 2024-03-11T22:14:07.040800+0000 mon.a (mon.0) 1330 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:14:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[23415]: audit 2024-03-11T22:14:07.045755+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.49:0/3995943398' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[23415]: audit 2024-03-11T22:14:07.046677+0000 mon.a (mon.0) 1331 : audit 1 from='client.46592 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:08.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[21434]: audit 2024-03-11T22:14:07.030402+0000 mon.a (mon.0) 1327 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[21434]: audit 2024-03-11T22:14:07.030608+0000 mon.a (mon.0) 1328 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]': finished 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[21434]: cluster 2024-03-11T22:14:07.037985+0000 mon.a (mon.0) 1329 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[21434]: audit 2024-03-11T22:14:07.040030+0000 mon.c (mon.2) 301 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[21434]: audit 2024-03-11T22:14:07.040800+0000 mon.a (mon.0) 1330 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[21434]: audit 2024-03-11T22:14:07.045755+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.49:0/3995943398' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[21434]: audit 2024-03-11T22:14:07.046677+0000 mon.a (mon.0) 1331 : audit 1 from='client.46592 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[28804]: audit 2024-03-11T22:14:07.030402+0000 mon.a (mon.0) 1327 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[28804]: audit 2024-03-11T22:14:07.030608+0000 mon.a (mon.0) 1328 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]': finished 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[28804]: cluster 2024-03-11T22:14:07.037985+0000 mon.a (mon.0) 1329 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-03-11T22:14:08.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[28804]: audit 2024-03-11T22:14:07.040030+0000 mon.c (mon.2) 301 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:08.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[28804]: audit 2024-03-11T22:14:07.040800+0000 mon.a (mon.0) 1330 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]: dispatch 2024-03-11T22:14:08.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[28804]: audit 2024-03-11T22:14:07.045755+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.49:0/3995943398' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:08.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:08 smithi049 bash[28804]: audit 2024-03-11T22:14:07.046677+0000 mon.a (mon.0) 1331 : audit 1 from='client.46592 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:08.989 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:14:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: cluster 2024-03-11T22:14:07.985470+0000 mgr.y (mgr.14601) 244 : cluster 0 pgmap v221: 420 pgs: 64 unknown, 356 active+clean; 594 KiB data, 433 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: cluster 2024-03-11T22:14:08.030462+0000 mon.a (mon.0) 1332 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: audit 2024-03-11T22:14:08.044172+0000 mon.c (mon.2) 303 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: audit 2024-03-11T22:14:08.047204+0000 mon.a (mon.0) 1333 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: audit 2024-03-11T22:14:08.047431+0000 mon.a (mon.0) 1334 : audit 1 from='client.46592 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: cluster 2024-03-11T22:14:08.059507+0000 mon.a (mon.0) 1335 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: audit 2024-03-11T22:14:08.062629+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.49:0/1802813029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:09.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: audit 2024-03-11T22:14:08.074055+0000 mon.a (mon.0) 1336 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: audit 2024-03-11T22:14:08.611521+0000 mgr.y (mgr.14601) 245 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:09 smithi187 bash[23415]: audit 2024-03-11T22:14:09.045992+0000 mon.c (mon.2) 305 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: cluster 2024-03-11T22:14:07.985470+0000 mgr.y (mgr.14601) 244 : cluster 0 pgmap v221: 420 pgs: 64 unknown, 356 active+clean; 594 KiB data, 433 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: cluster 2024-03-11T22:14:08.030462+0000 mon.a (mon.0) 1332 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: audit 2024-03-11T22:14:08.044172+0000 mon.c (mon.2) 303 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: audit 2024-03-11T22:14:08.047204+0000 mon.a (mon.0) 1333 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: audit 2024-03-11T22:14:08.047431+0000 mon.a (mon.0) 1334 : audit 1 from='client.46592 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: cluster 2024-03-11T22:14:08.059507+0000 mon.a (mon.0) 1335 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: audit 2024-03-11T22:14:08.062629+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.49:0/1802813029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: audit 2024-03-11T22:14:08.074055+0000 mon.a (mon.0) 1336 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: audit 2024-03-11T22:14:08.611521+0000 mgr.y (mgr.14601) 245 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:09.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[28804]: audit 2024-03-11T22:14:09.045992+0000 mon.c (mon.2) 305 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: cluster 2024-03-11T22:14:07.985470+0000 mgr.y (mgr.14601) 244 : cluster 0 pgmap v221: 420 pgs: 64 unknown, 356 active+clean; 594 KiB data, 433 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: cluster 2024-03-11T22:14:08.030462+0000 mon.a (mon.0) 1332 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: audit 2024-03-11T22:14:08.044172+0000 mon.c (mon.2) 303 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: audit 2024-03-11T22:14:08.047204+0000 mon.a (mon.0) 1333 : audit 1 from='client.? v1:172.21.15.49:0/2430986478' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64227-24"}]': finished 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: audit 2024-03-11T22:14:08.047431+0000 mon.a (mon.0) 1334 : audit 1 from='client.46592 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: cluster 2024-03-11T22:14:08.059507+0000 mon.a (mon.0) 1335 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: audit 2024-03-11T22:14:08.062629+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.49:0/1802813029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: audit 2024-03-11T22:14:08.074055+0000 mon.a (mon.0) 1336 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:09.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: audit 2024-03-11T22:14:08.611521+0000 mgr.y (mgr.14601) 245 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:09.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:09 smithi049 bash[21434]: audit 2024-03-11T22:14:09.045992+0000 mon.c (mon.2) 305 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:09.051408+0000 mon.a (mon.0) 1337 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: cluster 2024-03-11T22:14:09.064032+0000 mon.a (mon.0) 1338 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-03-11T22:14:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:09.066736+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.49:0/16918404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:09.071934+0000 mon.a (mon.0) 1339 : audit 1 from='client.46604 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:09.717616+0000 mon.a (mon.0) 1340 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:09.720527+0000 mon.c (mon.2) 307 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: cluster 2024-03-11T22:14:09.986615+0000 mgr.y (mgr.14601) 246 : cluster 0 pgmap v224: 452 pgs: 32 creating+peering, 32 unknown, 388 active+clean; 1.6 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-03-11T22:14:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:10.047617+0000 mon.c (mon.2) 308 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:10.055949+0000 mon.a (mon.0) 1341 : audit 1 from='client.46604 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: cluster 2024-03-11T22:14:10.065331+0000 mon.a (mon.0) 1342 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-03-11T22:14:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:10 smithi187 bash[23415]: audit 2024-03-11T22:14:10.072461+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.49:0/1620913566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:09.051408+0000 mon.a (mon.0) 1337 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: cluster 2024-03-11T22:14:09.064032+0000 mon.a (mon.0) 1338 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-03-11T22:14:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:09.066736+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.49:0/16918404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:09.071934+0000 mon.a (mon.0) 1339 : audit 1 from='client.46604 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:09.717616+0000 mon.a (mon.0) 1340 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:09.720527+0000 mon.c (mon.2) 307 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: cluster 2024-03-11T22:14:09.986615+0000 mgr.y (mgr.14601) 246 : cluster 0 pgmap v224: 452 pgs: 32 creating+peering, 32 unknown, 388 active+clean; 1.6 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:10.047617+0000 mon.c (mon.2) 308 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:10.055949+0000 mon.a (mon.0) 1341 : audit 1 from='client.46604 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: cluster 2024-03-11T22:14:10.065331+0000 mon.a (mon.0) 1342 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[21434]: audit 2024-03-11T22:14:10.072461+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.49:0/1620913566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:09.051408+0000 mon.a (mon.0) 1337 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi049-64055-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: cluster 2024-03-11T22:14:09.064032+0000 mon.a (mon.0) 1338 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-03-11T22:14:10.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:09.066736+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.49:0/16918404' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:09.071934+0000 mon.a (mon.0) 1339 : audit 1 from='client.46604 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:09.717616+0000 mon.a (mon.0) 1340 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:09.720527+0000 mon.c (mon.2) 307 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: cluster 2024-03-11T22:14:09.986615+0000 mgr.y (mgr.14601) 246 : cluster 0 pgmap v224: 452 pgs: 32 creating+peering, 32 unknown, 388 active+clean; 1.6 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:10.047617+0000 mon.c (mon.2) 308 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:10.055949+0000 mon.a (mon.0) 1341 : audit 1 from='client.46604 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi049-64227-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: cluster 2024-03-11T22:14:10.065331+0000 mon.a (mon.0) 1342 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-03-11T22:14:10.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:10 smithi049 bash[28804]: audit 2024-03-11T22:14:10.072461+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.49:0/1620913566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:11 smithi187 bash[23415]: audit 2024-03-11T22:14:10.091540+0000 mon.a (mon.0) 1343 : audit 1 from='client.46610 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:11 smithi187 bash[23415]: audit 2024-03-11T22:14:11.049025+0000 mon.c (mon.2) 310 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:11 smithi187 bash[23415]: audit 2024-03-11T22:14:11.059896+0000 mon.a (mon.0) 1344 : audit 1 from='client.46610 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:11 smithi187 bash[23415]: cluster 2024-03-11T22:14:11.068110+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-03-11T22:14:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:11 smithi187 bash[23415]: audit 2024-03-11T22:14:11.084103+0000 mon.a (mon.0) 1346 : audit 1 from='client.? v1:172.21.15.49:0/66764410' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi049-64055-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:11.516 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[28804]: audit 2024-03-11T22:14:10.091540+0000 mon.a (mon.0) 1343 : audit 1 from='client.46610 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[28804]: audit 2024-03-11T22:14:11.049025+0000 mon.c (mon.2) 310 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:11.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[28804]: audit 2024-03-11T22:14:11.059896+0000 mon.a (mon.0) 1344 : audit 1 from='client.46610 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:11.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[28804]: cluster 2024-03-11T22:14:11.068110+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-03-11T22:14:11.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[28804]: audit 2024-03-11T22:14:11.084103+0000 mon.a (mon.0) 1346 : audit 1 from='client.? v1:172.21.15.49:0/66764410' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi049-64055-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[21434]: audit 2024-03-11T22:14:10.091540+0000 mon.a (mon.0) 1343 : audit 1 from='client.46610 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[21434]: audit 2024-03-11T22:14:11.049025+0000 mon.c (mon.2) 310 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[21434]: audit 2024-03-11T22:14:11.059896+0000 mon.a (mon.0) 1344 : audit 1 from='client.46610 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi049-64063-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[21434]: cluster 2024-03-11T22:14:11.068110+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-03-11T22:14:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:11 smithi049 bash[21434]: audit 2024-03-11T22:14:11.084103+0000 mon.a (mon.0) 1346 : audit 1 from='client.? v1:172.21.15.49:0/66764410' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi049-64055-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:12 smithi187 bash[23415]: cluster 2024-03-11T22:14:11.987539+0000 mgr.y (mgr.14601) 247 : cluster 0 pgmap v227: 420 pgs: 64 unknown, 356 active+clean; 594 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:12 smithi187 bash[23415]: audit 2024-03-11T22:14:12.050551+0000 mon.c (mon.2) 311 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:12 smithi187 bash[23415]: audit 2024-03-11T22:14:12.064436+0000 mon.a (mon.0) 1347 : audit 1 from='client.? v1:172.21.15.49:0/66764410' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi049-64055-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:12 smithi187 bash[23415]: cluster 2024-03-11T22:14:12.074024+0000 mon.a (mon.0) 1348 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-03-11T22:14:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:12 smithi187 bash[23415]: audit 2024-03-11T22:14:12.099556+0000 mon.c (mon.2) 312 : audit 1 from='client.? v1:172.21.15.49:0/1621029584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:12 smithi187 bash[23415]: audit 2024-03-11T22:14:12.100681+0000 mon.a (mon.0) 1349 : audit 1 from='client.46622 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:12.516 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[28804]: cluster 2024-03-11T22:14:11.987539+0000 mgr.y (mgr.14601) 247 : cluster 0 pgmap v227: 420 pgs: 64 unknown, 356 active+clean; 594 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[28804]: audit 2024-03-11T22:14:12.050551+0000 mon.c (mon.2) 311 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[28804]: audit 2024-03-11T22:14:12.064436+0000 mon.a (mon.0) 1347 : audit 1 from='client.? v1:172.21.15.49:0/66764410' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi049-64055-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[28804]: cluster 2024-03-11T22:14:12.074024+0000 mon.a (mon.0) 1348 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[28804]: audit 2024-03-11T22:14:12.099556+0000 mon.c (mon.2) 312 : audit 1 from='client.? v1:172.21.15.49:0/1621029584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[28804]: audit 2024-03-11T22:14:12.100681+0000 mon.a (mon.0) 1349 : audit 1 from='client.46622 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[21434]: cluster 2024-03-11T22:14:11.987539+0000 mgr.y (mgr.14601) 247 : cluster 0 pgmap v227: 420 pgs: 64 unknown, 356 active+clean; 594 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[21434]: audit 2024-03-11T22:14:12.050551+0000 mon.c (mon.2) 311 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[21434]: audit 2024-03-11T22:14:12.064436+0000 mon.a (mon.0) 1347 : audit 1 from='client.? v1:172.21.15.49:0/66764410' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi049-64055-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[21434]: cluster 2024-03-11T22:14:12.074024+0000 mon.a (mon.0) 1348 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-03-11T22:14:12.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[21434]: audit 2024-03-11T22:14:12.099556+0000 mon.c (mon.2) 312 : audit 1 from='client.? v1:172.21.15.49:0/1621029584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:12.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:12 smithi049 bash[21434]: audit 2024-03-11T22:14:12.100681+0000 mon.a (mon.0) 1349 : audit 1 from='client.46622 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:13 smithi187 bash[23415]: audit 2024-03-11T22:14:13.051928+0000 mon.c (mon.2) 313 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:13.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:13 smithi187 bash[23415]: audit 2024-03-11T22:14:13.069755+0000 mon.a (mon.0) 1350 : audit 1 from='client.46622 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:13.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:13 smithi187 bash[23415]: cluster 2024-03-11T22:14:13.080997+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-03-11T22:14:13.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:13 smithi187 bash[23415]: audit 2024-03-11T22:14:13.082569+0000 mon.c (mon.2) 314 : audit 1 from='client.? v1:172.21.15.49:0/4143374548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:13 smithi187 bash[23415]: audit 2024-03-11T22:14:13.087624+0000 mon.a (mon.0) 1352 : audit 1 from='client.46634 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:13 smithi187 bash[23415]: audit 2024-03-11T22:14:13.089677+0000 mon.a (mon.0) 1353 : audit 1 from='client.? v1:172.21.15.49:0/3288792944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi049-64063-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[21434]: audit 2024-03-11T22:14:13.051928+0000 mon.c (mon.2) 313 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[21434]: audit 2024-03-11T22:14:13.069755+0000 mon.a (mon.0) 1350 : audit 1 from='client.46622 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[21434]: cluster 2024-03-11T22:14:13.080997+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[21434]: audit 2024-03-11T22:14:13.082569+0000 mon.c (mon.2) 314 : audit 1 from='client.? v1:172.21.15.49:0/4143374548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[21434]: audit 2024-03-11T22:14:13.087624+0000 mon.a (mon.0) 1352 : audit 1 from='client.46634 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[21434]: audit 2024-03-11T22:14:13.089677+0000 mon.a (mon.0) 1353 : audit 1 from='client.? v1:172.21.15.49:0/3288792944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi049-64063-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[28804]: audit 2024-03-11T22:14:13.051928+0000 mon.c (mon.2) 313 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[28804]: audit 2024-03-11T22:14:13.069755+0000 mon.a (mon.0) 1350 : audit 1 from='client.46622 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi049-64227-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:13.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[28804]: cluster 2024-03-11T22:14:13.080997+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-03-11T22:14:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[28804]: audit 2024-03-11T22:14:13.082569+0000 mon.c (mon.2) 314 : audit 1 from='client.? v1:172.21.15.49:0/4143374548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[28804]: audit 2024-03-11T22:14:13.087624+0000 mon.a (mon.0) 1352 : audit 1 from='client.46634 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:13 smithi049 bash[28804]: audit 2024-03-11T22:14:13.089677+0000 mon.a (mon.0) 1353 : audit 1 from='client.? v1:172.21.15.49:0/3288792944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi049-64063-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:14 smithi187 bash[23415]: cluster 2024-03-11T22:14:13.991036+0000 mgr.y (mgr.14601) 248 : cluster 0 pgmap v230: 452 pgs: 64 creating+peering, 388 active+clean; 600 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:14 smithi187 bash[23415]: audit 2024-03-11T22:14:14.053519+0000 mon.c (mon.2) 315 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:14 smithi187 bash[23415]: audit 2024-03-11T22:14:14.074172+0000 mon.a (mon.0) 1354 : audit 1 from='client.46634 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:14 smithi187 bash[23415]: audit 2024-03-11T22:14:14.074442+0000 mon.a (mon.0) 1355 : audit 1 from='client.? v1:172.21.15.49:0/3288792944' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi049-64063-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:14 smithi187 bash[23415]: cluster 2024-03-11T22:14:14.085678+0000 mon.a (mon.0) 1356 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-03-11T22:14:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:14 smithi187 bash[23415]: audit 2024-03-11T22:14:14.100583+0000 mon.a (mon.0) 1357 : audit 1 from='client.? v1:172.21.15.49:0/4120253069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64055-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:14.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:14:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:14:14.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[28804]: cluster 2024-03-11T22:14:13.991036+0000 mgr.y (mgr.14601) 248 : cluster 0 pgmap v230: 452 pgs: 64 creating+peering, 388 active+clean; 600 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:14.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[28804]: audit 2024-03-11T22:14:14.053519+0000 mon.c (mon.2) 315 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:14.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[28804]: audit 2024-03-11T22:14:14.074172+0000 mon.a (mon.0) 1354 : audit 1 from='client.46634 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:14.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[28804]: audit 2024-03-11T22:14:14.074442+0000 mon.a (mon.0) 1355 : audit 1 from='client.? v1:172.21.15.49:0/3288792944' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi049-64063-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:14.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[28804]: cluster 2024-03-11T22:14:14.085678+0000 mon.a (mon.0) 1356 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-03-11T22:14:14.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[28804]: audit 2024-03-11T22:14:14.100583+0000 mon.a (mon.0) 1357 : audit 1 from='client.? v1:172.21.15.49:0/4120253069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64055-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:14.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[21434]: cluster 2024-03-11T22:14:13.991036+0000 mgr.y (mgr.14601) 248 : cluster 0 pgmap v230: 452 pgs: 64 creating+peering, 388 active+clean; 600 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:14.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[21434]: audit 2024-03-11T22:14:14.053519+0000 mon.c (mon.2) 315 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:14.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[21434]: audit 2024-03-11T22:14:14.074172+0000 mon.a (mon.0) 1354 : audit 1 from='client.46634 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64272-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:14.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[21434]: audit 2024-03-11T22:14:14.074442+0000 mon.a (mon.0) 1355 : audit 1 from='client.? v1:172.21.15.49:0/3288792944' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi049-64063-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:14.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[21434]: cluster 2024-03-11T22:14:14.085678+0000 mon.a (mon.0) 1356 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-03-11T22:14:14.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:14 smithi049 bash[21434]: audit 2024-03-11T22:14:14.100583+0000 mon.a (mon.0) 1357 : audit 1 from='client.? v1:172.21.15.49:0/4120253069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64055-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:15.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:15 smithi187 bash[23415]: cluster 2024-03-11T22:14:14.120696+0000 mon.a (mon.0) 1358 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:15.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:15 smithi187 bash[23415]: audit 2024-03-11T22:14:15.055176+0000 mon.c (mon.2) 316 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:15.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:15 smithi187 bash[23415]: audit 2024-03-11T22:14:15.078553+0000 mon.a (mon.0) 1359 : audit 1 from='client.? v1:172.21.15.49:0/4120253069' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64055-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:15.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:15 smithi187 bash[23415]: cluster 2024-03-11T22:14:15.089977+0000 mon.a (mon.0) 1360 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-03-11T22:14:15.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:15 smithi187 bash[23415]: audit 2024-03-11T22:14:15.113344+0000 mon.c (mon.2) 317 : audit 1 from='client.? v1:172.21.15.49:0/3237210491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:15.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:15 smithi187 bash[23415]: audit 2024-03-11T22:14:15.114867+0000 mon.a (mon.0) 1361 : audit 1 from='client.46652 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[21434]: cluster 2024-03-11T22:14:14.120696+0000 mon.a (mon.0) 1358 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[21434]: audit 2024-03-11T22:14:15.055176+0000 mon.c (mon.2) 316 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[21434]: audit 2024-03-11T22:14:15.078553+0000 mon.a (mon.0) 1359 : audit 1 from='client.? v1:172.21.15.49:0/4120253069' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64055-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[21434]: cluster 2024-03-11T22:14:15.089977+0000 mon.a (mon.0) 1360 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-03-11T22:14:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[21434]: audit 2024-03-11T22:14:15.113344+0000 mon.c (mon.2) 317 : audit 1 from='client.? v1:172.21.15.49:0/3237210491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[21434]: audit 2024-03-11T22:14:15.114867+0000 mon.a (mon.0) 1361 : audit 1 from='client.46652 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[28804]: cluster 2024-03-11T22:14:14.120696+0000 mon.a (mon.0) 1358 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[28804]: audit 2024-03-11T22:14:15.055176+0000 mon.c (mon.2) 316 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[28804]: audit 2024-03-11T22:14:15.078553+0000 mon.a (mon.0) 1359 : audit 1 from='client.? v1:172.21.15.49:0/4120253069' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64055-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[28804]: cluster 2024-03-11T22:14:15.089977+0000 mon.a (mon.0) 1360 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-03-11T22:14:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[28804]: audit 2024-03-11T22:14:15.113344+0000 mon.c (mon.2) 317 : audit 1 from='client.? v1:172.21.15.49:0/3237210491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:15 smithi049 bash[28804]: audit 2024-03-11T22:14:15.114867+0000 mon.a (mon.0) 1361 : audit 1 from='client.46652 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:16.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:16 smithi187 bash[23415]: cluster 2024-03-11T22:14:15.991959+0000 mgr.y (mgr.14601) 249 : cluster 0 pgmap v233: 420 pgs: 64 unknown, 32 creating+peering, 324 active+clean; 592 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:16.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:16 smithi187 bash[23415]: audit 2024-03-11T22:14:16.056670+0000 mon.c (mon.2) 318 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:16.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:16 smithi187 bash[23415]: audit 2024-03-11T22:14:16.083345+0000 mon.a (mon.0) 1362 : audit 1 from='client.46652 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:16.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:16 smithi187 bash[23415]: cluster 2024-03-11T22:14:16.093366+0000 mon.a (mon.0) 1363 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-03-11T22:14:16.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:16 smithi187 bash[23415]: audit 2024-03-11T22:14:16.105572+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.49:0/879084703' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:16.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:16 smithi187 bash[23415]: audit 2024-03-11T22:14:16.110392+0000 mon.a (mon.0) 1364 : audit 1 from='client.46667 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[21434]: cluster 2024-03-11T22:14:15.991959+0000 mgr.y (mgr.14601) 249 : cluster 0 pgmap v233: 420 pgs: 64 unknown, 32 creating+peering, 324 active+clean; 592 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[21434]: audit 2024-03-11T22:14:16.056670+0000 mon.c (mon.2) 318 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[21434]: audit 2024-03-11T22:14:16.083345+0000 mon.a (mon.0) 1362 : audit 1 from='client.46652 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[21434]: cluster 2024-03-11T22:14:16.093366+0000 mon.a (mon.0) 1363 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[21434]: audit 2024-03-11T22:14:16.105572+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.49:0/879084703' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[21434]: audit 2024-03-11T22:14:16.110392+0000 mon.a (mon.0) 1364 : audit 1 from='client.46667 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[28804]: cluster 2024-03-11T22:14:15.991959+0000 mgr.y (mgr.14601) 249 : cluster 0 pgmap v233: 420 pgs: 64 unknown, 32 creating+peering, 324 active+clean; 592 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[28804]: audit 2024-03-11T22:14:16.056670+0000 mon.c (mon.2) 318 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:16.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[28804]: audit 2024-03-11T22:14:16.083345+0000 mon.a (mon.0) 1362 : audit 1 from='client.46652 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi049-64227-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[28804]: cluster 2024-03-11T22:14:16.093366+0000 mon.a (mon.0) 1363 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-03-11T22:14:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[28804]: audit 2024-03-11T22:14:16.105572+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.49:0/879084703' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:16 smithi049 bash[28804]: audit 2024-03-11T22:14:16.110392+0000 mon.a (mon.0) 1364 : audit 1 from='client.46667 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:17.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:17 smithi187 bash[23415]: audit 2024-03-11T22:14:17.057928+0000 mon.c (mon.2) 320 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:17.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:17 smithi187 bash[23415]: audit 2024-03-11T22:14:17.088249+0000 mon.a (mon.0) 1365 : audit 1 from='client.46667 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:17.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:17 smithi187 bash[23415]: cluster 2024-03-11T22:14:17.099451+0000 mon.a (mon.0) 1366 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-03-11T22:14:17.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:17 smithi187 bash[23415]: audit 2024-03-11T22:14:17.113637+0000 mon.c (mon.2) 321 : audit 1 from='client.? v1:172.21.15.49:0/2041634433' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:17 smithi187 bash[23415]: audit 2024-03-11T22:14:17.114560+0000 mon.a (mon.0) 1367 : audit 1 from='client.46679 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:17.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[21434]: audit 2024-03-11T22:14:17.057928+0000 mon.c (mon.2) 320 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:17.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[21434]: audit 2024-03-11T22:14:17.088249+0000 mon.a (mon.0) 1365 : audit 1 from='client.46667 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:17.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[21434]: cluster 2024-03-11T22:14:17.099451+0000 mon.a (mon.0) 1366 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-03-11T22:14:17.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[21434]: audit 2024-03-11T22:14:17.113637+0000 mon.c (mon.2) 321 : audit 1 from='client.? v1:172.21.15.49:0/2041634433' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:17.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[21434]: audit 2024-03-11T22:14:17.114560+0000 mon.a (mon.0) 1367 : audit 1 from='client.46679 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:17.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[28804]: audit 2024-03-11T22:14:17.057928+0000 mon.c (mon.2) 320 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[28804]: audit 2024-03-11T22:14:17.088249+0000 mon.a (mon.0) 1365 : audit 1 from='client.46667 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi049-64063-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[28804]: cluster 2024-03-11T22:14:17.099451+0000 mon.a (mon.0) 1366 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-03-11T22:14:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[28804]: audit 2024-03-11T22:14:17.113637+0000 mon.c (mon.2) 321 : audit 1 from='client.? v1:172.21.15.49:0/2041634433' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:17 smithi049 bash[28804]: audit 2024-03-11T22:14:17.114560+0000 mon.a (mon.0) 1367 : audit 1 from='client.46679 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:18.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.157072+0000 mon.a (mon.0) 1368 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.164529+0000 mon.a (mon.0) 1369 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.167160+0000 mon.a (mon.0) 1370 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.200175+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.201334+0000 mon.b (mon.1) 143 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.202107+0000 mon.b (mon.1) 144 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.206964+0000 mon.a (mon.0) 1371 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.208077+0000 mon.a (mon.0) 1372 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:17.208880+0000 mon.a (mon.0) 1373 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: cluster 2024-03-11T22:14:17.992941+0000 mgr.y (mgr.14601) 250 : cluster 0 pgmap v236: 420 pgs: 96 unknown, 324 active+clean; 592 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:18.059652+0000 mon.c (mon.2) 322 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:18.091531+0000 mon.a (mon.0) 1374 : audit 1 from='client.46679 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:18.091796+0000 mon.a (mon.0) 1375 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:18.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:18.092007+0000 mon.a (mon.0) 1376 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:18.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:18.095365+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: cluster 2024-03-11T22:14:18.100090+0000 mon.a (mon.0) 1377 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-03-11T22:14:18.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:18.107773+0000 mon.a (mon.0) 1378 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi049-64227-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[23415]: audit 2024-03-11T22:14:18.108414+0000 mon.a (mon.0) 1379 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.157072+0000 mon.a (mon.0) 1368 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.164529+0000 mon.a (mon.0) 1369 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.167160+0000 mon.a (mon.0) 1370 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.200175+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.201334+0000 mon.b (mon.1) 143 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.202107+0000 mon.b (mon.1) 144 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.206964+0000 mon.a (mon.0) 1371 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.208077+0000 mon.a (mon.0) 1372 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:17.208880+0000 mon.a (mon.0) 1373 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: cluster 2024-03-11T22:14:17.992941+0000 mgr.y (mgr.14601) 250 : cluster 0 pgmap v236: 420 pgs: 96 unknown, 324 active+clean; 592 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:18.059652+0000 mon.c (mon.2) 322 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:18.091531+0000 mon.a (mon.0) 1374 : audit 1 from='client.46679 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:18.091796+0000 mon.a (mon.0) 1375 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:18.092007+0000 mon.a (mon.0) 1376 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.157072+0000 mon.a (mon.0) 1368 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.164529+0000 mon.a (mon.0) 1369 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.167160+0000 mon.a (mon.0) 1370 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.200175+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.201334+0000 mon.b (mon.1) 143 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.202107+0000 mon.b (mon.1) 144 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.206964+0000 mon.a (mon.0) 1371 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.208077+0000 mon.a (mon.0) 1372 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:17.208880+0000 mon.a (mon.0) 1373 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: cluster 2024-03-11T22:14:17.992941+0000 mgr.y (mgr.14601) 250 : cluster 0 pgmap v236: 420 pgs: 96 unknown, 324 active+clean; 592 KiB data, 478 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:18.059652+0000 mon.c (mon.2) 322 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:18.091531+0000 mon.a (mon.0) 1374 : audit 1 from='client.46679 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi049-64055-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:18.091796+0000 mon.a (mon.0) 1375 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:18.092007+0000 mon.a (mon.0) 1376 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:18.095365+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: cluster 2024-03-11T22:14:18.100090+0000 mon.a (mon.0) 1377 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-03-11T22:14:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:18.107773+0000 mon.a (mon.0) 1378 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi049-64227-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[28804]: audit 2024-03-11T22:14:18.108414+0000 mon.a (mon.0) 1379 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:18.095365+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: cluster 2024-03-11T22:14:18.100090+0000 mon.a (mon.0) 1377 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-03-11T22:14:18.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:18.107773+0000 mon.a (mon.0) 1378 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi049-64227-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:18.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:18 smithi049 bash[21434]: audit 2024-03-11T22:14:18.108414+0000 mon.a (mon.0) 1379 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:18.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:14:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:14:20.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:20 smithi049 bash[28804]: audit 2024-03-11T22:14:18.622859+0000 mgr.y (mgr.14601) 251 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:20.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:20 smithi049 bash[28804]: audit 2024-03-11T22:14:19.061416+0000 mon.c (mon.2) 323 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:20.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:20 smithi049 bash[21434]: audit 2024-03-11T22:14:18.622859+0000 mgr.y (mgr.14601) 251 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:20.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:20 smithi049 bash[21434]: audit 2024-03-11T22:14:19.061416+0000 mon.c (mon.2) 323 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:20 smithi187 bash[23415]: audit 2024-03-11T22:14:18.622859+0000 mgr.y (mgr.14601) 251 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:20 smithi187 bash[23415]: audit 2024-03-11T22:14:19.061416+0000 mon.c (mon.2) 323 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:21.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: cluster 2024-03-11T22:14:19.993851+0000 mgr.y (mgr.14601) 252 : cluster 0 pgmap v239: 388 pgs: 32 unknown, 356 active+clean; 592 KiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:21.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: cluster 2024-03-11T22:14:20.016735+0000 mon.a (mon.0) 1380 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-03-11T22:14:21.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: cluster 2024-03-11T22:14:20.018053+0000 mon.a (mon.0) 1381 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:21.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: audit 2024-03-11T22:14:20.022792+0000 mon.a (mon.0) 1382 : audit 1 from='client.? v1:172.21.15.49:0/3172742588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi049-64063-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:21.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: audit 2024-03-11T22:14:20.062841+0000 mon.c (mon.2) 324 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:21.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: audit 2024-03-11T22:14:20.499889+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi049-64227-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:21.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: audit 2024-03-11T22:14:20.500147+0000 mon.a (mon.0) 1384 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: audit 2024-03-11T22:14:20.500421+0000 mon.a (mon.0) 1385 : audit 1 from='client.? v1:172.21.15.49:0/3172742588' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi049-64063-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: cluster 2024-03-11T22:14:20.508662+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[28804]: audit 2024-03-11T22:14:20.512781+0000 mon.a (mon.0) 1387 : audit 1 from='client.? v1:172.21.15.49:0/3846516283' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi049-64055-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: cluster 2024-03-11T22:14:19.993851+0000 mgr.y (mgr.14601) 252 : cluster 0 pgmap v239: 388 pgs: 32 unknown, 356 active+clean; 592 KiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: cluster 2024-03-11T22:14:20.016735+0000 mon.a (mon.0) 1380 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: cluster 2024-03-11T22:14:20.018053+0000 mon.a (mon.0) 1381 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: audit 2024-03-11T22:14:20.022792+0000 mon.a (mon.0) 1382 : audit 1 from='client.? v1:172.21.15.49:0/3172742588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi049-64063-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: audit 2024-03-11T22:14:20.062841+0000 mon.c (mon.2) 324 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:21.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: audit 2024-03-11T22:14:20.499889+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi049-64227-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:21.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: audit 2024-03-11T22:14:20.500147+0000 mon.a (mon.0) 1384 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:21.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: audit 2024-03-11T22:14:20.500421+0000 mon.a (mon.0) 1385 : audit 1 from='client.? v1:172.21.15.49:0/3172742588' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi049-64063-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:21.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: cluster 2024-03-11T22:14:20.508662+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-03-11T22:14:21.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:21 smithi049 bash[21434]: audit 2024-03-11T22:14:20.512781+0000 mon.a (mon.0) 1387 : audit 1 from='client.? v1:172.21.15.49:0/3846516283' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi049-64055-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:21.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: cluster 2024-03-11T22:14:19.993851+0000 mgr.y (mgr.14601) 252 : cluster 0 pgmap v239: 388 pgs: 32 unknown, 356 active+clean; 592 KiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:21.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: cluster 2024-03-11T22:14:20.016735+0000 mon.a (mon.0) 1380 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-03-11T22:14:21.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: cluster 2024-03-11T22:14:20.018053+0000 mon.a (mon.0) 1381 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:21.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: audit 2024-03-11T22:14:20.022792+0000 mon.a (mon.0) 1382 : audit 1 from='client.? v1:172.21.15.49:0/3172742588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi049-64063-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:21.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: audit 2024-03-11T22:14:20.062841+0000 mon.c (mon.2) 324 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:21.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: audit 2024-03-11T22:14:20.499889+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi049-64227-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:21.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: audit 2024-03-11T22:14:20.500147+0000 mon.a (mon.0) 1384 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi049-64272-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: audit 2024-03-11T22:14:20.500421+0000 mon.a (mon.0) 1385 : audit 1 from='client.? v1:172.21.15.49:0/3172742588' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi049-64063-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: cluster 2024-03-11T22:14:20.508662+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-03-11T22:14:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:21 smithi187 bash[23415]: audit 2024-03-11T22:14:20.512781+0000 mon.a (mon.0) 1387 : audit 1 from='client.? v1:172.21.15.49:0/3846516283' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi049-64055-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:22 smithi187 bash[23415]: audit 2024-03-11T22:14:21.063978+0000 mon.c (mon.2) 325 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:22 smithi187 bash[23415]: audit 2024-03-11T22:14:21.503461+0000 mon.a (mon.0) 1388 : audit 1 from='client.? v1:172.21.15.49:0/3846516283' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi049-64055-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:22 smithi187 bash[23415]: cluster 2024-03-11T22:14:21.513149+0000 mon.a (mon.0) 1389 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-03-11T22:14:22.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:22 smithi049 bash[21434]: audit 2024-03-11T22:14:21.063978+0000 mon.c (mon.2) 325 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:22.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:22 smithi049 bash[21434]: audit 2024-03-11T22:14:21.503461+0000 mon.a (mon.0) 1388 : audit 1 from='client.? v1:172.21.15.49:0/3846516283' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi049-64055-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:22.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:22 smithi049 bash[21434]: cluster 2024-03-11T22:14:21.513149+0000 mon.a (mon.0) 1389 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-03-11T22:14:22.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:22 smithi049 bash[28804]: audit 2024-03-11T22:14:21.063978+0000 mon.c (mon.2) 325 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:22.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:22 smithi049 bash[28804]: audit 2024-03-11T22:14:21.503461+0000 mon.a (mon.0) 1388 : audit 1 from='client.? v1:172.21.15.49:0/3846516283' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi049-64055-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:22.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:22 smithi049 bash[28804]: cluster 2024-03-11T22:14:21.513149+0000 mon.a (mon.0) 1389 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-03-11T22:14:23.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:23 smithi187 bash[23415]: cluster 2024-03-11T22:14:21.994930+0000 mgr.y (mgr.14601) 253 : cluster 0 pgmap v242: 404 pgs: 48 unknown, 356 active+clean; 592 KiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:23.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:23 smithi187 bash[23415]: audit 2024-03-11T22:14:22.065420+0000 mon.c (mon.2) 326 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:23.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:23 smithi187 bash[23415]: cluster 2024-03-11T22:14:22.520405+0000 mon.a (mon.0) 1390 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-03-11T22:14:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:23 smithi187 bash[23415]: audit 2024-03-11T22:14:22.537629+0000 mon.c (mon.2) 327 : audit 1 from='client.? v1:172.21.15.49:0/1804062424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:23 smithi187 bash[23415]: audit 2024-03-11T22:14:22.538456+0000 mon.a (mon.0) 1391 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:23 smithi187 bash[23415]: audit 2024-03-11T22:14:22.538968+0000 mon.a (mon.0) 1392 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[21434]: cluster 2024-03-11T22:14:21.994930+0000 mgr.y (mgr.14601) 253 : cluster 0 pgmap v242: 404 pgs: 48 unknown, 356 active+clean; 592 KiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[21434]: audit 2024-03-11T22:14:22.065420+0000 mon.c (mon.2) 326 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[21434]: cluster 2024-03-11T22:14:22.520405+0000 mon.a (mon.0) 1390 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-03-11T22:14:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[21434]: audit 2024-03-11T22:14:22.537629+0000 mon.c (mon.2) 327 : audit 1 from='client.? v1:172.21.15.49:0/1804062424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[21434]: audit 2024-03-11T22:14:22.538456+0000 mon.a (mon.0) 1391 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:23.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[21434]: audit 2024-03-11T22:14:22.538968+0000 mon.a (mon.0) 1392 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[28804]: cluster 2024-03-11T22:14:21.994930+0000 mgr.y (mgr.14601) 253 : cluster 0 pgmap v242: 404 pgs: 48 unknown, 356 active+clean; 592 KiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[28804]: audit 2024-03-11T22:14:22.065420+0000 mon.c (mon.2) 326 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[28804]: cluster 2024-03-11T22:14:22.520405+0000 mon.a (mon.0) 1390 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-03-11T22:14:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[28804]: audit 2024-03-11T22:14:22.537629+0000 mon.c (mon.2) 327 : audit 1 from='client.? v1:172.21.15.49:0/1804062424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[28804]: audit 2024-03-11T22:14:22.538456+0000 mon.a (mon.0) 1391 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:23 smithi049 bash[28804]: audit 2024-03-11T22:14:22.538968+0000 mon.a (mon.0) 1392 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:24.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:24 smithi187 bash[23415]: audit 2024-03-11T22:14:23.066835+0000 mon.c (mon.2) 328 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:24.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:24 smithi187 bash[23415]: audit 2024-03-11T22:14:23.517530+0000 mon.a (mon.0) 1393 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:24.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:24 smithi187 bash[23415]: audit 2024-03-11T22:14:23.517841+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:24.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:24 smithi187 bash[23415]: cluster 2024-03-11T22:14:23.525752+0000 mon.a (mon.0) 1395 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-03-11T22:14:24.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:24 smithi187 bash[23415]: audit 2024-03-11T22:14:23.529655+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:24 smithi187 bash[23415]: audit 2024-03-11T22:14:23.533697+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.49:0/2660823965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:24 smithi187 bash[23415]: audit 2024-03-11T22:14:23.534560+0000 mon.a (mon.0) 1397 : audit 1 from='client.46718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:24.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:14:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:14:24.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[28804]: audit 2024-03-11T22:14:23.066835+0000 mon.c (mon.2) 328 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:24.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[28804]: audit 2024-03-11T22:14:23.517530+0000 mon.a (mon.0) 1393 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:24.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[28804]: audit 2024-03-11T22:14:23.517841+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:24.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[28804]: cluster 2024-03-11T22:14:23.525752+0000 mon.a (mon.0) 1395 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-03-11T22:14:24.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[28804]: audit 2024-03-11T22:14:23.529655+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[28804]: audit 2024-03-11T22:14:23.533697+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.49:0/2660823965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[28804]: audit 2024-03-11T22:14:23.534560+0000 mon.a (mon.0) 1397 : audit 1 from='client.46718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21434]: audit 2024-03-11T22:14:23.066835+0000 mon.c (mon.2) 328 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21434]: audit 2024-03-11T22:14:23.517530+0000 mon.a (mon.0) 1393 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi049-64063-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21434]: audit 2024-03-11T22:14:23.517841+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21434]: cluster 2024-03-11T22:14:23.525752+0000 mon.a (mon.0) 1395 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21434]: audit 2024-03-11T22:14:23.529655+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]: dispatch 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21434]: audit 2024-03-11T22:14:23.533697+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.49:0/2660823965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:24 smithi049 bash[21434]: audit 2024-03-11T22:14:23.534560+0000 mon.a (mon.0) 1397 : audit 1 from='client.46718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:24.536 INFO:tasks.workunit.client.0.smithi049.stdout: (69650 ms total) 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (528 ms) 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (528 ms total) 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (83 ms) 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (4 ms) 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (87 ms total) 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: 2024-03-11T22:14:24.537 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (88 ms) 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (5 ms) 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (93 ms total) 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (100 ms) 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (5 ms) 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (105 ms total) 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: 2024-03-11T22:14:24.538 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-03-11T22:14:24.539 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-03-11T22:14:24.539 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1090 ms) 2024-03-11T22:14:24.539 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1090 ms total) 2024-03-11T22:14:24.539 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: 2024-03-11T22:14:24.539 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-03-11T22:14:24.539 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (112270 ms total) 2024-03-11T22:14:24.539 INFO:tasks.workunit.client.0.smithi049.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-03-11T22:14:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:25 smithi187 bash[23415]: cluster 2024-03-11T22:14:23.996490+0000 mgr.y (mgr.14601) 254 : cluster 0 pgmap v245: 428 pgs: 32 creating+peering, 32 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:25 smithi187 bash[23415]: audit 2024-03-11T22:14:24.068339+0000 mon.c (mon.2) 330 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:25 smithi187 bash[23415]: audit 2024-03-11T22:14:24.527802+0000 mon.a (mon.0) 1398 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:25 smithi187 bash[23415]: audit 2024-03-11T22:14:24.527929+0000 mon.a (mon.0) 1399 : audit 1 from='client.46718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:25 smithi187 bash[23415]: cluster 2024-03-11T22:14:24.535549+0000 mon.a (mon.0) 1400 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-03-11T22:14:25.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:25 smithi187 bash[23415]: audit 2024-03-11T22:14:24.757679+0000 mon.c (mon.2) 331 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[21434]: cluster 2024-03-11T22:14:23.996490+0000 mgr.y (mgr.14601) 254 : cluster 0 pgmap v245: 428 pgs: 32 creating+peering, 32 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[21434]: audit 2024-03-11T22:14:24.068339+0000 mon.c (mon.2) 330 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[21434]: audit 2024-03-11T22:14:24.527802+0000 mon.a (mon.0) 1398 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[21434]: audit 2024-03-11T22:14:24.527929+0000 mon.a (mon.0) 1399 : audit 1 from='client.46718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[21434]: cluster 2024-03-11T22:14:24.535549+0000 mon.a (mon.0) 1400 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-03-11T22:14:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[21434]: audit 2024-03-11T22:14:24.757679+0000 mon.c (mon.2) 331 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:25.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[28804]: cluster 2024-03-11T22:14:23.996490+0000 mgr.y (mgr.14601) 254 : cluster 0 pgmap v245: 428 pgs: 32 creating+peering, 32 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[28804]: audit 2024-03-11T22:14:24.068339+0000 mon.c (mon.2) 330 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[28804]: audit 2024-03-11T22:14:24.527802+0000 mon.a (mon.0) 1398 : audit 1 from='client.? v1:172.21.15.49:0/35839865' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi049-64227-36"}]': finished 2024-03-11T22:14:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[28804]: audit 2024-03-11T22:14:24.527929+0000 mon.a (mon.0) 1399 : audit 1 from='client.46718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi049-64055-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[28804]: cluster 2024-03-11T22:14:24.535549+0000 mon.a (mon.0) 1400 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-03-11T22:14:25.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:25 smithi049 bash[28804]: audit 2024-03-11T22:14:24.757679+0000 mon.c (mon.2) 331 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: cluster 2024-03-11T22:14:25.031463+0000 mon.a (mon.0) 1401 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: cluster 2024-03-11T22:14:25.042876+0000 mon.a (mon.0) 1402 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-03-11T22:14:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: audit 2024-03-11T22:14:25.057699+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.49:0/2160806562' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: audit 2024-03-11T22:14:25.064785+0000 mon.a (mon.0) 1403 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: audit 2024-03-11T22:14:25.069861+0000 mon.c (mon.2) 333 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:26.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: cluster 2024-03-11T22:14:25.997538+0000 mgr.y (mgr.14601) 255 : cluster 0 pgmap v248: 428 pgs: 64 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: audit 2024-03-11T22:14:26.042449+0000 mon.a (mon.0) 1404 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:26 smithi187 bash[23415]: cluster 2024-03-11T22:14:26.049505+0000 mon.a (mon.0) 1405 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: cluster 2024-03-11T22:14:25.031463+0000 mon.a (mon.0) 1401 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: cluster 2024-03-11T22:14:25.042876+0000 mon.a (mon.0) 1402 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: audit 2024-03-11T22:14:25.057699+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.49:0/2160806562' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: audit 2024-03-11T22:14:25.064785+0000 mon.a (mon.0) 1403 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: audit 2024-03-11T22:14:25.069861+0000 mon.c (mon.2) 333 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: cluster 2024-03-11T22:14:25.997538+0000 mgr.y (mgr.14601) 255 : cluster 0 pgmap v248: 428 pgs: 64 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: audit 2024-03-11T22:14:26.042449+0000 mon.a (mon.0) 1404 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:26.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[28804]: cluster 2024-03-11T22:14:26.049505+0000 mon.a (mon.0) 1405 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: cluster 2024-03-11T22:14:25.031463+0000 mon.a (mon.0) 1401 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: cluster 2024-03-11T22:14:25.042876+0000 mon.a (mon.0) 1402 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: audit 2024-03-11T22:14:25.057699+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.49:0/2160806562' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: audit 2024-03-11T22:14:25.064785+0000 mon.a (mon.0) 1403 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: audit 2024-03-11T22:14:25.069861+0000 mon.c (mon.2) 333 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: cluster 2024-03-11T22:14:25.997538+0000 mgr.y (mgr.14601) 255 : cluster 0 pgmap v248: 428 pgs: 64 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: audit 2024-03-11T22:14:26.042449+0000 mon.a (mon.0) 1404 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi049-64063-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:26.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:26 smithi049 bash[21434]: cluster 2024-03-11T22:14:26.049505+0000 mon.a (mon.0) 1405 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-03-11T22:14:27.081 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-03-11T22:14:27.081 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-03-11T22:14:27.081 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-03-11T22:14:27.081 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-03-11T22:14:27.081 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: seed 64272 2024-03-11T22:14:27.081 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (3488 ms) 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (4236 ms) 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (6513 ms) 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2886 ms) 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (10812 ms) 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (27935 ms total) 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-03-11T22:14:27.082 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (6496 ms) 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (6391 ms) 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (7488 ms) 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4955 ms) 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (3517 ms) 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:463: Skipped 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi049-64272-7 2024-03-11T22:14:27.083 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: waiting for snaps to purge 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (18020 ms) 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (46867 ms total) 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (12 ms) 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5098 ms) 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5110 ms total) 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3024 ms) 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-03-11T22:14:27.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (1512 ms) 2024-03-11T22:14:27.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-03-11T22:14:27.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2046 ms) 2024-03-11T22:14:27.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:27 smithi187 bash[23415]: audit 2024-03-11T22:14:26.073854+0000 mon.c (mon.2) 334 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:27.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:27 smithi187 bash[23415]: audit 2024-03-11T22:14:27.075542+0000 mon.c (mon.2) 335 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:27.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:27 smithi049 bash[21434]: audit 2024-03-11T22:14:26.073854+0000 mon.c (mon.2) 334 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:27.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:27 smithi049 bash[21434]: audit 2024-03-11T22:14:27.075542+0000 mon.c (mon.2) 335 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:27.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:27 smithi049 bash[28804]: audit 2024-03-11T22:14:26.073854+0000 mon.c (mon.2) 334 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:27.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:27 smithi049 bash[28804]: audit 2024-03-11T22:14:27.075542+0000 mon.c (mon.2) 335 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:28.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:28 smithi187 bash[23415]: cluster 2024-03-11T22:14:27.090474+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-03-11T22:14:28.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:28 smithi187 bash[23415]: audit 2024-03-11T22:14:27.094239+0000 mon.c (mon.2) 336 : audit 1 from='client.? v1:172.21.15.49:0/53532551' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:28.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:28 smithi187 bash[23415]: audit 2024-03-11T22:14:27.097841+0000 mon.a (mon.0) 1407 : audit 1 from='client.46727 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:28.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:28 smithi187 bash[23415]: cluster 2024-03-11T22:14:27.998528+0000 mgr.y (mgr.14601) 256 : cluster 0 pgmap v251: 396 pgs: 32 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:28.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:28 smithi187 bash[23415]: audit 2024-03-11T22:14:28.077227+0000 mon.c (mon.2) 337 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:28.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:28 smithi187 bash[23415]: audit 2024-03-11T22:14:28.085651+0000 mon.a (mon.0) 1408 : audit 1 from='client.46727 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:28.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[21434]: cluster 2024-03-11T22:14:27.090474+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-03-11T22:14:28.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[21434]: audit 2024-03-11T22:14:27.094239+0000 mon.c (mon.2) 336 : audit 1 from='client.? v1:172.21.15.49:0/53532551' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:28.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[21434]: audit 2024-03-11T22:14:27.097841+0000 mon.a (mon.0) 1407 : audit 1 from='client.46727 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:28.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[21434]: cluster 2024-03-11T22:14:27.998528+0000 mgr.y (mgr.14601) 256 : cluster 0 pgmap v251: 396 pgs: 32 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:28.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[21434]: audit 2024-03-11T22:14:28.077227+0000 mon.c (mon.2) 337 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:28.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[21434]: audit 2024-03-11T22:14:28.085651+0000 mon.a (mon.0) 1408 : audit 1 from='client.46727 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:28.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[28804]: cluster 2024-03-11T22:14:27.090474+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-03-11T22:14:28.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[28804]: audit 2024-03-11T22:14:27.094239+0000 mon.c (mon.2) 336 : audit 1 from='client.? v1:172.21.15.49:0/53532551' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:28.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[28804]: audit 2024-03-11T22:14:27.097841+0000 mon.a (mon.0) 1407 : audit 1 from='client.46727 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:28.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[28804]: cluster 2024-03-11T22:14:27.998528+0000 mgr.y (mgr.14601) 256 : cluster 0 pgmap v251: 396 pgs: 32 unknown, 364 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:28.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[28804]: audit 2024-03-11T22:14:28.077227+0000 mon.c (mon.2) 337 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:28.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:28 smithi049 bash[28804]: audit 2024-03-11T22:14:28.085651+0000 mon.a (mon.0) 1408 : audit 1 from='client.46727 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi049-64055-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:28.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:14:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:14:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:29 smithi187 bash[23415]: cluster 2024-03-11T22:14:28.095378+0000 mon.a (mon.0) 1409 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-03-11T22:14:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:29 smithi187 bash[23415]: audit 2024-03-11T22:14:28.106411+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.49:0/2618571265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:29 smithi187 bash[23415]: audit 2024-03-11T22:14:28.110146+0000 mon.a (mon.0) 1410 : audit 1 from='client.46733 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:29 smithi187 bash[23415]: audit 2024-03-11T22:14:28.634361+0000 mgr.y (mgr.14601) 257 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:29 smithi187 bash[23415]: audit 2024-03-11T22:14:29.078868+0000 mon.c (mon.2) 339 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:29.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:29 smithi187 bash[23415]: audit 2024-03-11T22:14:29.088657+0000 mon.a (mon.0) 1411 : audit 1 from='client.46733 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:29.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:29 smithi187 bash[23415]: cluster 2024-03-11T22:14:29.096308+0000 mon.a (mon.0) 1412 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-03-11T22:14:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[21434]: cluster 2024-03-11T22:14:28.095378+0000 mon.a (mon.0) 1409 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-03-11T22:14:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[21434]: audit 2024-03-11T22:14:28.106411+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.49:0/2618571265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[21434]: audit 2024-03-11T22:14:28.110146+0000 mon.a (mon.0) 1410 : audit 1 from='client.46733 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:29.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[21434]: audit 2024-03-11T22:14:28.634361+0000 mgr.y (mgr.14601) 257 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:29.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[21434]: audit 2024-03-11T22:14:29.078868+0000 mon.c (mon.2) 339 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:29.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[21434]: audit 2024-03-11T22:14:29.088657+0000 mon.a (mon.0) 1411 : audit 1 from='client.46733 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:29.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[21434]: cluster 2024-03-11T22:14:29.096308+0000 mon.a (mon.0) 1412 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-03-11T22:14:29.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[28804]: cluster 2024-03-11T22:14:28.095378+0000 mon.a (mon.0) 1409 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-03-11T22:14:29.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[28804]: audit 2024-03-11T22:14:28.106411+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.49:0/2618571265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:29.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[28804]: audit 2024-03-11T22:14:28.110146+0000 mon.a (mon.0) 1410 : audit 1 from='client.46733 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:29.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[28804]: audit 2024-03-11T22:14:28.634361+0000 mgr.y (mgr.14601) 257 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:29.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[28804]: audit 2024-03-11T22:14:29.078868+0000 mon.c (mon.2) 339 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:29.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[28804]: audit 2024-03-11T22:14:29.088657+0000 mon.a (mon.0) 1411 : audit 1 from='client.46733 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi049-64063-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:29.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:29 smithi049 bash[28804]: cluster 2024-03-11T22:14:29.096308+0000 mon.a (mon.0) 1412 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-03-11T22:14:30.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:30 smithi187 bash[23415]: cluster 2024-03-11T22:14:29.999541+0000 mgr.y (mgr.14601) 258 : cluster 0 pgmap v254: 396 pgs: 32 creating+peering, 364 active+clean; 592 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:14:30.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:30 smithi187 bash[23415]: audit 2024-03-11T22:14:30.080511+0000 mon.c (mon.2) 340 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:30.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:30 smithi187 bash[23415]: audit 2024-03-11T22:14:30.096766+0000 mon.b (mon.1) 146 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:30.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:30 smithi187 bash[23415]: cluster 2024-03-11T22:14:30.100639+0000 mon.a (mon.0) 1413 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-03-11T22:14:30.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:30 smithi187 bash[23415]: audit 2024-03-11T22:14:30.103561+0000 mon.c (mon.2) 341 : audit 1 from='client.? v1:172.21.15.49:0/3211071921' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:30.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:30 smithi187 bash[23415]: audit 2024-03-11T22:14:30.107027+0000 mon.a (mon.0) 1414 : audit 1 from='client.46736 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:30.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:30 smithi187 bash[23415]: audit 2024-03-11T22:14:30.107397+0000 mon.a (mon.0) 1415 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[28804]: cluster 2024-03-11T22:14:29.999541+0000 mgr.y (mgr.14601) 258 : cluster 0 pgmap v254: 396 pgs: 32 creating+peering, 364 active+clean; 592 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[28804]: audit 2024-03-11T22:14:30.080511+0000 mon.c (mon.2) 340 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[28804]: audit 2024-03-11T22:14:30.096766+0000 mon.b (mon.1) 146 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[28804]: cluster 2024-03-11T22:14:30.100639+0000 mon.a (mon.0) 1413 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[28804]: audit 2024-03-11T22:14:30.103561+0000 mon.c (mon.2) 341 : audit 1 from='client.? v1:172.21.15.49:0/3211071921' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[28804]: audit 2024-03-11T22:14:30.107027+0000 mon.a (mon.0) 1414 : audit 1 from='client.46736 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[28804]: audit 2024-03-11T22:14:30.107397+0000 mon.a (mon.0) 1415 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:30.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[21434]: cluster 2024-03-11T22:14:29.999541+0000 mgr.y (mgr.14601) 258 : cluster 0 pgmap v254: 396 pgs: 32 creating+peering, 364 active+clean; 592 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:14:30.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[21434]: audit 2024-03-11T22:14:30.080511+0000 mon.c (mon.2) 340 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:30.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[21434]: audit 2024-03-11T22:14:30.096766+0000 mon.b (mon.1) 146 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:30.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[21434]: cluster 2024-03-11T22:14:30.100639+0000 mon.a (mon.0) 1413 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-03-11T22:14:30.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[21434]: audit 2024-03-11T22:14:30.103561+0000 mon.c (mon.2) 341 : audit 1 from='client.? v1:172.21.15.49:0/3211071921' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:30.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[21434]: audit 2024-03-11T22:14:30.107027+0000 mon.a (mon.0) 1414 : audit 1 from='client.46736 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:30.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:30 smithi049 bash[21434]: audit 2024-03-11T22:14:30.107397+0000 mon.a (mon.0) 1415 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:31.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: cluster 2024-03-11T22:14:30.124539+0000 mon.a (mon.0) 1416 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:31.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: audit 2024-03-11T22:14:31.082074+0000 mon.c (mon.2) 342 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:31.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: audit 2024-03-11T22:14:31.097056+0000 mon.a (mon.0) 1417 : audit 1 from='client.46736 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:31.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: audit 2024-03-11T22:14:31.097309+0000 mon.a (mon.0) 1418 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:31.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: audit 2024-03-11T22:14:31.100516+0000 mon.b (mon.1) 147 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:31.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: cluster 2024-03-11T22:14:31.108576+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-03-11T22:14:31.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: audit 2024-03-11T22:14:31.115950+0000 mon.a (mon.0) 1420 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:31.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:31 smithi187 bash[23415]: audit 2024-03-11T22:14:31.119088+0000 mon.a (mon.0) 1421 : audit 1 from='client.? v1:172.21.15.49:0/1953425774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi049-64063-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: cluster 2024-03-11T22:14:30.124539+0000 mon.a (mon.0) 1416 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: audit 2024-03-11T22:14:31.082074+0000 mon.c (mon.2) 342 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: audit 2024-03-11T22:14:31.097056+0000 mon.a (mon.0) 1417 : audit 1 from='client.46736 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: audit 2024-03-11T22:14:31.097309+0000 mon.a (mon.0) 1418 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: audit 2024-03-11T22:14:31.100516+0000 mon.b (mon.1) 147 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: cluster 2024-03-11T22:14:31.108576+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: audit 2024-03-11T22:14:31.115950+0000 mon.a (mon.0) 1420 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[28804]: audit 2024-03-11T22:14:31.119088+0000 mon.a (mon.0) 1421 : audit 1 from='client.? v1:172.21.15.49:0/1953425774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi049-64063-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:31.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: cluster 2024-03-11T22:14:30.124539+0000 mon.a (mon.0) 1416 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:31.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: audit 2024-03-11T22:14:31.082074+0000 mon.c (mon.2) 342 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:31.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: audit 2024-03-11T22:14:31.097056+0000 mon.a (mon.0) 1417 : audit 1 from='client.46736 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi049-64055-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:31.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: audit 2024-03-11T22:14:31.097309+0000 mon.a (mon.0) 1418 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:31.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: audit 2024-03-11T22:14:31.100516+0000 mon.b (mon.1) 147 : audit 1 from='client.? v1:172.21.15.49:0/4040852947' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:31.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: cluster 2024-03-11T22:14:31.108576+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-03-11T22:14:31.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: audit 2024-03-11T22:14:31.115950+0000 mon.a (mon.0) 1420 : audit 1 from='client.47935 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]: dispatch 2024-03-11T22:14:31.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:31 smithi049 bash[21434]: audit 2024-03-11T22:14:31.119088+0000 mon.a (mon.0) 1421 : audit 1 from='client.? v1:172.21.15.49:0/1953425774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi049-64063-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:32.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:32 smithi187 bash[23415]: cluster 2024-03-11T22:14:32.000597+0000 mgr.y (mgr.14601) 259 : cluster 0 pgmap v257: 420 pgs: 64 unknown, 356 active+clean; 592 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:32.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:32 smithi187 bash[23415]: audit 2024-03-11T22:14:32.083735+0000 mon.c (mon.2) 343 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:32.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:32 smithi187 bash[23415]: audit 2024-03-11T22:14:32.101268+0000 mon.a (mon.0) 1422 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:32.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:32 smithi187 bash[23415]: audit 2024-03-11T22:14:32.101517+0000 mon.a (mon.0) 1423 : audit 1 from='client.? v1:172.21.15.49:0/1953425774' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi049-64063-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:32.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:32 smithi187 bash[23415]: cluster 2024-03-11T22:14:32.108671+0000 mon.a (mon.0) 1424 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[21434]: cluster 2024-03-11T22:14:32.000597+0000 mgr.y (mgr.14601) 259 : cluster 0 pgmap v257: 420 pgs: 64 unknown, 356 active+clean; 592 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[21434]: audit 2024-03-11T22:14:32.083735+0000 mon.c (mon.2) 343 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[21434]: audit 2024-03-11T22:14:32.101268+0000 mon.a (mon.0) 1422 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[21434]: audit 2024-03-11T22:14:32.101517+0000 mon.a (mon.0) 1423 : audit 1 from='client.? v1:172.21.15.49:0/1953425774' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi049-64063-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[21434]: cluster 2024-03-11T22:14:32.108671+0000 mon.a (mon.0) 1424 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[28804]: cluster 2024-03-11T22:14:32.000597+0000 mgr.y (mgr.14601) 259 : cluster 0 pgmap v257: 420 pgs: 64 unknown, 356 active+clean; 592 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[28804]: audit 2024-03-11T22:14:32.083735+0000 mon.c (mon.2) 343 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:32.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[28804]: audit 2024-03-11T22:14:32.101268+0000 mon.a (mon.0) 1422 : audit 1 from='client.47935 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi049-64272-16"}]': finished 2024-03-11T22:14:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[28804]: audit 2024-03-11T22:14:32.101517+0000 mon.a (mon.0) 1423 : audit 1 from='client.? v1:172.21.15.49:0/1953425774' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi049-64063-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:32 smithi049 bash[28804]: cluster 2024-03-11T22:14:32.108671+0000 mon.a (mon.0) 1424 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-03-11T22:14:33.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:32.634795+0000 mon.a (mon.0) 1425 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:32.637648+0000 mon.a (mon.0) 1426 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:32.638170+0000 mon.a (mon.0) 1427 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:33.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:33.085327+0000 mon.c (mon.2) 344 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:33.104789+0000 mon.a (mon.0) 1428 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: cluster 2024-03-11T22:14:33.114879+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-03-11T22:14:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:33.121895+0000 mon.a (mon.0) 1430 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:33.121994+0000 mon.c (mon.2) 345 : audit 1 from='client.? v1:172.21.15.49:0/2816348627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:33 smithi187 bash[23415]: audit 2024-03-11T22:14:33.123295+0000 mon.a (mon.0) 1431 : audit 1 from='client.46748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:32.634795+0000 mon.a (mon.0) 1425 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:32.637648+0000 mon.a (mon.0) 1426 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:32.638170+0000 mon.a (mon.0) 1427 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:33.085327+0000 mon.c (mon.2) 344 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:33.104789+0000 mon.a (mon.0) 1428 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: cluster 2024-03-11T22:14:33.114879+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:33.121895+0000 mon.a (mon.0) 1430 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:33.121994+0000 mon.c (mon.2) 345 : audit 1 from='client.? v1:172.21.15.49:0/2816348627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[21434]: audit 2024-03-11T22:14:33.123295+0000 mon.a (mon.0) 1431 : audit 1 from='client.46748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:32.634795+0000 mon.a (mon.0) 1425 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:32.637648+0000 mon.a (mon.0) 1426 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:32.638170+0000 mon.a (mon.0) 1427 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:33.085327+0000 mon.c (mon.2) 344 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:33.104789+0000 mon.a (mon.0) 1428 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: cluster 2024-03-11T22:14:33.114879+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:33.121895+0000 mon.a (mon.0) 1430 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:33.121994+0000 mon.c (mon.2) 345 : audit 1 from='client.? v1:172.21.15.49:0/2816348627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:33.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:33 smithi049 bash[28804]: audit 2024-03-11T22:14:33.123295+0000 mon.a (mon.0) 1431 : audit 1 from='client.46748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:34.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:14:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:14:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:14:34.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:34 smithi187 bash[23415]: cluster 2024-03-11T22:14:34.003986+0000 mgr.y (mgr.14601) 260 : cluster 0 pgmap v260: 388 pgs: 32 creating+peering, 356 active+clean; 588 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:14:34.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:34 smithi187 bash[23415]: audit 2024-03-11T22:14:34.086930+0000 mon.c (mon.2) 346 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:34.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:34 smithi187 bash[23415]: audit 2024-03-11T22:14:34.109821+0000 mon.a (mon.0) 1432 : audit 1 from='client.46748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:34 smithi049 bash[28804]: cluster 2024-03-11T22:14:34.003986+0000 mgr.y (mgr.14601) 260 : cluster 0 pgmap v260: 388 pgs: 32 creating+peering, 356 active+clean; 588 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:14:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:34 smithi049 bash[28804]: audit 2024-03-11T22:14:34.086930+0000 mon.c (mon.2) 346 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:34 smithi049 bash[28804]: audit 2024-03-11T22:14:34.109821+0000 mon.a (mon.0) 1432 : audit 1 from='client.46748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:35.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:34 smithi049 bash[21434]: cluster 2024-03-11T22:14:34.003986+0000 mgr.y (mgr.14601) 260 : cluster 0 pgmap v260: 388 pgs: 32 creating+peering, 356 active+clean; 588 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:14:35.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:34 smithi049 bash[21434]: audit 2024-03-11T22:14:34.086930+0000 mon.c (mon.2) 346 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:35.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:34 smithi049 bash[21434]: audit 2024-03-11T22:14:34.109821+0000 mon.a (mon.0) 1432 : audit 1 from='client.46748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi049-64055-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:35.051 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots api_aio: Running main() from gmock_main.cc 2024-03-11T22:14:35.051 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-03-11T22:14:35.051 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [----------] Global test environment set-up. 2024-03-11T22:14:35.051 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-03-11T22:14:35.051 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-03-11T22:14:35.051 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.TooBig (16657 ms) 2024-03-11T22:14:35.051 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (10566 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (7924 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (6116 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (6308 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (6565 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (6713 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (4714 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3918 ms) 2024-03-11T22:14:35.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3013 ms) 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3408 ms) 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (2554 ms) 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (4435 ms) 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3019 ms) 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.Flush (2941 ms) 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3014 ms) 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-03-11T22:14:35.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3001 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3030 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3016 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3010 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3919 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2506 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3533 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3044 ms) 2024-03-11T22:14:35.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-03-11T22:14:35.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3016 ms) 2024-03-11T22:14:35.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-03-11T22:14:35.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2940 ms) 2024-03-11T22:14:35.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [----------] 26 tests from LibRadosAio (122880 ms total) 2024-03-11T22:14:35.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: 2024-03-11T22:14:35.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrit snapshots: Running main() from gmock_main.cc 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [----------] Global test environment set-up. 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (31502 ms) 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (14460 ms) 2024-03-11T22:14:35.056 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (10777 ms) 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (8423 ms) 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (7929 ms) 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (73091 ms total) 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (4953 ms) 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6452 ms) 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7971 ms) 2024-03-11T22:14:35.057 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6020 ms) 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4022 ms) 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi049-64973-11. 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: Waiting for snaps to purge. 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19962 ms) 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (49380 ms total) 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [----------] Global test environment tear-down 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (122471 ms total) 2024-03-11T22:14:35.058 INFO:tasks.workunit.client.0.smithi049.stdout: snapshots: [ PASSED ] 11 tests. 2024-03-11T22:14:35.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: cluster 2024-03-11T22:14:34.595569+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:34.613077+0000 mon.a (mon.0) 1434 : audit 1 from='client.? v1:172.21.15.49:0/4115863957' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi049-64063-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:34.871756+0000 mon.b (mon.1) 148 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:34.879173+0000 mon.a (mon.0) 1435 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.044353+0000 mon.a (mon.0) 1436 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.044547+0000 mon.a (mon.0) 1437 : audit 1 from='client.? v1:172.21.15.49:0/4115863957' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi049-64063-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.044719+0000 mon.a (mon.0) 1438 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.046675+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: cluster 2024-03-11T22:14:35.052272+0000 mon.a (mon.0) 1439 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.057856+0000 mon.a (mon.0) 1440 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.088410+0000 mon.c (mon.2) 347 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.111540+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.112203+0000 mon.a (mon.0) 1441 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:35.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.116070+0000 mon.c (mon.2) 349 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:35.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.116722+0000 mon.a (mon.0) 1442 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:35.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.117473+0000 mon.c (mon.2) 350 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:35.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:35 smithi187 bash[23415]: audit 2024-03-11T22:14:35.117979+0000 mon.a (mon.0) 1443 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: cluster 2024-03-11T22:14:34.595569+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-03-11T22:14:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:34.613077+0000 mon.a (mon.0) 1434 : audit 1 from='client.? v1:172.21.15.49:0/4115863957' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi049-64063-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:34.871756+0000 mon.b (mon.1) 148 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:34.879173+0000 mon.a (mon.0) 1435 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.044353+0000 mon.a (mon.0) 1436 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.044547+0000 mon.a (mon.0) 1437 : audit 1 from='client.? v1:172.21.15.49:0/4115863957' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi049-64063-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.044719+0000 mon.a (mon.0) 1438 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.046675+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: cluster 2024-03-11T22:14:35.052272+0000 mon.a (mon.0) 1439 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.057856+0000 mon.a (mon.0) 1440 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.088410+0000 mon.c (mon.2) 347 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.111540+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.112203+0000 mon.a (mon.0) 1441 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.116070+0000 mon.c (mon.2) 349 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.116722+0000 mon.a (mon.0) 1442 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: cluster 2024-03-11T22:14:34.595569+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-03-11T22:14:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:34.613077+0000 mon.a (mon.0) 1434 : audit 1 from='client.? v1:172.21.15.49:0/4115863957' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi049-64063-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:34.871756+0000 mon.b (mon.1) 148 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:34.879173+0000 mon.a (mon.0) 1435 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.044353+0000 mon.a (mon.0) 1436 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.044547+0000 mon.a (mon.0) 1437 : audit 1 from='client.? v1:172.21.15.49:0/4115863957' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi049-64063-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.044719+0000 mon.a (mon.0) 1438 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.046675+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: cluster 2024-03-11T22:14:35.052272+0000 mon.a (mon.0) 1439 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.057856+0000 mon.a (mon.0) 1440 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.088410+0000 mon.c (mon.2) 347 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.111540+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.112203+0000 mon.a (mon.0) 1441 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.116070+0000 mon.c (mon.2) 349 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.116722+0000 mon.a (mon.0) 1442 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.117473+0000 mon.c (mon.2) 350 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[28804]: audit 2024-03-11T22:14:35.117979+0000 mon.a (mon.0) 1443 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:36.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.117473+0000 mon.c (mon.2) 350 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:36.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:35 smithi049 bash[21434]: audit 2024-03-11T22:14:35.117979+0000 mon.a (mon.0) 1443 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: cluster 2024-03-11T22:14:36.004988+0000 mgr.y (mgr.14601) 261 : cluster 0 pgmap v263: 364 pgs: 40 unknown, 324 active+clean; 587 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: cluster 2024-03-11T22:14:36.044907+0000 mon.a (mon.0) 1444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: audit 2024-03-11T22:14:36.047365+0000 mon.a (mon.0) 1445 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]': finished 2024-03-11T22:14:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: audit 2024-03-11T22:14:36.047650+0000 mon.a (mon.0) 1446 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: cluster 2024-03-11T22:14:36.054607+0000 mon.a (mon.0) 1447 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-03-11T22:14:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: audit 2024-03-11T22:14:36.063795+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: audit 2024-03-11T22:14:36.082753+0000 mon.a (mon.0) 1448 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:36 smithi187 bash[23415]: audit 2024-03-11T22:14:36.093338+0000 mon.c (mon.2) 352 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: cluster 2024-03-11T22:14:36.004988+0000 mgr.y (mgr.14601) 261 : cluster 0 pgmap v263: 364 pgs: 40 unknown, 324 active+clean; 587 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: cluster 2024-03-11T22:14:36.044907+0000 mon.a (mon.0) 1444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: audit 2024-03-11T22:14:36.047365+0000 mon.a (mon.0) 1445 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]': finished 2024-03-11T22:14:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: audit 2024-03-11T22:14:36.047650+0000 mon.a (mon.0) 1446 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: cluster 2024-03-11T22:14:36.054607+0000 mon.a (mon.0) 1447 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: audit 2024-03-11T22:14:36.063795+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: audit 2024-03-11T22:14:36.082753+0000 mon.a (mon.0) 1448 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[21434]: audit 2024-03-11T22:14:36.093338+0000 mon.c (mon.2) 352 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: cluster 2024-03-11T22:14:36.004988+0000 mgr.y (mgr.14601) 261 : cluster 0 pgmap v263: 364 pgs: 40 unknown, 324 active+clean; 587 KiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: cluster 2024-03-11T22:14:36.044907+0000 mon.a (mon.0) 1444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: audit 2024-03-11T22:14:36.047365+0000 mon.a (mon.0) 1445 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-13"}]': finished 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: audit 2024-03-11T22:14:36.047650+0000 mon.a (mon.0) 1446 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi049-64055-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: cluster 2024-03-11T22:14:36.054607+0000 mon.a (mon.0) 1447 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: audit 2024-03-11T22:14:36.063795+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: audit 2024-03-11T22:14:36.082753+0000 mon.a (mon.0) 1448 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:36 smithi049 bash[28804]: audit 2024-03-11T22:14:36.093338+0000 mon.c (mon.2) 352 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:38.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:37 smithi187 bash[23415]: cluster 2024-03-11T22:14:36.612031+0000 mon.a (mon.0) 1449 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:38.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:37 smithi187 bash[23415]: audit 2024-03-11T22:14:37.094689+0000 mon.c (mon.2) 353 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:38.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:37 smithi187 bash[23415]: cluster 2024-03-11T22:14:37.527698+0000 mon.a (mon.0) 1450 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-03-11T22:14:38.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:37 smithi187 bash[23415]: audit 2024-03-11T22:14:37.529099+0000 mon.c (mon.2) 354 : audit 1 from='client.? v1:172.21.15.49:0/3346825909' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:38.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:37 smithi187 bash[23415]: audit 2024-03-11T22:14:37.529687+0000 mon.a (mon.0) 1451 : audit 1 from='client.46760 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:38.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[21434]: cluster 2024-03-11T22:14:36.612031+0000 mon.a (mon.0) 1449 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:38.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[21434]: audit 2024-03-11T22:14:37.094689+0000 mon.c (mon.2) 353 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:38.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[21434]: cluster 2024-03-11T22:14:37.527698+0000 mon.a (mon.0) 1450 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-03-11T22:14:38.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[21434]: audit 2024-03-11T22:14:37.529099+0000 mon.c (mon.2) 354 : audit 1 from='client.? v1:172.21.15.49:0/3346825909' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:38.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[21434]: audit 2024-03-11T22:14:37.529687+0000 mon.a (mon.0) 1451 : audit 1 from='client.46760 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:38.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[28804]: cluster 2024-03-11T22:14:36.612031+0000 mon.a (mon.0) 1449 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:38.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[28804]: audit 2024-03-11T22:14:37.094689+0000 mon.c (mon.2) 353 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:38.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[28804]: cluster 2024-03-11T22:14:37.527698+0000 mon.a (mon.0) 1450 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-03-11T22:14:38.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[28804]: audit 2024-03-11T22:14:37.529099+0000 mon.c (mon.2) 354 : audit 1 from='client.? v1:172.21.15.49:0/3346825909' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:38.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:37 smithi049 bash[28804]: audit 2024-03-11T22:14:37.529687+0000 mon.a (mon.0) 1451 : audit 1 from='client.46760 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:38.963 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:14:39.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[23415]: cluster 2024-03-11T22:14:38.005851+0000 mgr.y (mgr.14601) 262 : cluster 0 pgmap v266: 332 pgs: 40 unknown, 292 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:39.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[23415]: audit 2024-03-11T22:14:38.055587+0000 mon.a (mon.0) 1452 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:39.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[23415]: audit 2024-03-11T22:14:38.055868+0000 mon.a (mon.0) 1453 : audit 1 from='client.46760 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:39.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[23415]: audit 2024-03-11T22:14:38.060494+0000 mon.b (mon.1) 150 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:39.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[23415]: cluster 2024-03-11T22:14:38.064414+0000 mon.a (mon.0) 1454 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-03-11T22:14:39.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[23415]: audit 2024-03-11T22:14:38.074512+0000 mon.a (mon.0) 1455 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:39.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:38 smithi187 bash[23415]: audit 2024-03-11T22:14:38.096185+0000 mon.c (mon.2) 355 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[28804]: cluster 2024-03-11T22:14:38.005851+0000 mgr.y (mgr.14601) 262 : cluster 0 pgmap v266: 332 pgs: 40 unknown, 292 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[28804]: audit 2024-03-11T22:14:38.055587+0000 mon.a (mon.0) 1452 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[28804]: audit 2024-03-11T22:14:38.055868+0000 mon.a (mon.0) 1453 : audit 1 from='client.46760 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[28804]: audit 2024-03-11T22:14:38.060494+0000 mon.b (mon.1) 150 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[28804]: cluster 2024-03-11T22:14:38.064414+0000 mon.a (mon.0) 1454 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[28804]: audit 2024-03-11T22:14:38.074512+0000 mon.a (mon.0) 1455 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[28804]: audit 2024-03-11T22:14:38.096185+0000 mon.c (mon.2) 355 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[21434]: cluster 2024-03-11T22:14:38.005851+0000 mgr.y (mgr.14601) 262 : cluster 0 pgmap v266: 332 pgs: 40 unknown, 292 active+clean; 586 KiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[21434]: audit 2024-03-11T22:14:38.055587+0000 mon.a (mon.0) 1452 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi049-64055-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:39.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[21434]: audit 2024-03-11T22:14:38.055868+0000 mon.a (mon.0) 1453 : audit 1 from='client.46760 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi049-64063-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:39.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[21434]: audit 2024-03-11T22:14:38.060494+0000 mon.b (mon.1) 150 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:39.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[21434]: cluster 2024-03-11T22:14:38.064414+0000 mon.a (mon.0) 1454 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-03-11T22:14:39.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[21434]: audit 2024-03-11T22:14:38.074512+0000 mon.a (mon.0) 1455 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:39.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:38 smithi049 bash[21434]: audit 2024-03-11T22:14:38.096185+0000 mon.c (mon.2) 355 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:39 smithi187 bash[23415]: audit 2024-03-11T22:14:38.645852+0000 mgr.y (mgr.14601) 263 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:39 smithi187 bash[23415]: audit 2024-03-11T22:14:39.058926+0000 mon.a (mon.0) 1456 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:39 smithi187 bash[23415]: cluster 2024-03-11T22:14:39.069134+0000 mon.a (mon.0) 1457 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-03-11T22:14:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:39 smithi187 bash[23415]: audit 2024-03-11T22:14:39.097466+0000 mon.c (mon.2) 356 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:40.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:39 smithi187 bash[23415]: audit 2024-03-11T22:14:39.802636+0000 mon.a (mon.0) 1458 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:40.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:39 smithi187 bash[23415]: audit 2024-03-11T22:14:39.805612+0000 mon.c (mon.2) 357 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[28804]: audit 2024-03-11T22:14:38.645852+0000 mgr.y (mgr.14601) 263 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[28804]: audit 2024-03-11T22:14:39.058926+0000 mon.a (mon.0) 1456 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[28804]: cluster 2024-03-11T22:14:39.069134+0000 mon.a (mon.0) 1457 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[28804]: audit 2024-03-11T22:14:39.097466+0000 mon.c (mon.2) 356 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[28804]: audit 2024-03-11T22:14:39.802636+0000 mon.a (mon.0) 1458 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[28804]: audit 2024-03-11T22:14:39.805612+0000 mon.c (mon.2) 357 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[21434]: audit 2024-03-11T22:14:38.645852+0000 mgr.y (mgr.14601) 263 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[21434]: audit 2024-03-11T22:14:39.058926+0000 mon.a (mon.0) 1456 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:40.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[21434]: cluster 2024-03-11T22:14:39.069134+0000 mon.a (mon.0) 1457 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-03-11T22:14:40.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[21434]: audit 2024-03-11T22:14:39.097466+0000 mon.c (mon.2) 356 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:40.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[21434]: audit 2024-03-11T22:14:39.802636+0000 mon.a (mon.0) 1458 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:14:40.268 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:39 smithi049 bash[21434]: audit 2024-03-11T22:14:39.805612+0000 mon.c (mon.2) 357 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:41.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: cluster 2024-03-11T22:14:40.006800+0000 mgr.y (mgr.14601) 264 : cluster 0 pgmap v269: 340 pgs: 40 creating+peering, 300 active+clean; 601 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s wr, 0 op/s 2024-03-11T22:14:41.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: cluster 2024-03-11T22:14:40.070638+0000 mon.a (mon.0) 1459 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-03-11T22:14:41.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: audit 2024-03-11T22:14:40.074117+0000 mon.c (mon.2) 358 : audit 1 from='client.? v1:172.21.15.49:0/180914890' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:41.240 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: audit 2024-03-11T22:14:40.074370+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:41.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: audit 2024-03-11T22:14:40.076182+0000 mon.a (mon.0) 1460 : audit 1 from='client.46766 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:41.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: audit 2024-03-11T22:14:40.076605+0000 mon.a (mon.0) 1461 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:41.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: audit 2024-03-11T22:14:40.081903+0000 mon.b (mon.1) 151 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:41.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: audit 2024-03-11T22:14:40.089454+0000 mon.a (mon.0) 1462 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:41.241 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:40 smithi187 bash[23415]: audit 2024-03-11T22:14:40.098860+0000 mon.c (mon.2) 360 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: cluster 2024-03-11T22:14:40.006800+0000 mgr.y (mgr.14601) 264 : cluster 0 pgmap v269: 340 pgs: 40 creating+peering, 300 active+clean; 601 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s wr, 0 op/s 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: cluster 2024-03-11T22:14:40.070638+0000 mon.a (mon.0) 1459 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: audit 2024-03-11T22:14:40.074117+0000 mon.c (mon.2) 358 : audit 1 from='client.? v1:172.21.15.49:0/180914890' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: audit 2024-03-11T22:14:40.074370+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: audit 2024-03-11T22:14:40.076182+0000 mon.a (mon.0) 1460 : audit 1 from='client.46766 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: audit 2024-03-11T22:14:40.076605+0000 mon.a (mon.0) 1461 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: audit 2024-03-11T22:14:40.081903+0000 mon.b (mon.1) 151 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: audit 2024-03-11T22:14:40.089454+0000 mon.a (mon.0) 1462 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:41.267 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[21434]: audit 2024-03-11T22:14:40.098860+0000 mon.c (mon.2) 360 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: cluster 2024-03-11T22:14:40.006800+0000 mgr.y (mgr.14601) 264 : cluster 0 pgmap v269: 340 pgs: 40 creating+peering, 300 active+clean; 601 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s wr, 0 op/s 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: cluster 2024-03-11T22:14:40.070638+0000 mon.a (mon.0) 1459 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: audit 2024-03-11T22:14:40.074117+0000 mon.c (mon.2) 358 : audit 1 from='client.? v1:172.21.15.49:0/180914890' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: audit 2024-03-11T22:14:40.074370+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: audit 2024-03-11T22:14:40.076182+0000 mon.a (mon.0) 1460 : audit 1 from='client.46766 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: audit 2024-03-11T22:14:40.076605+0000 mon.a (mon.0) 1461 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: audit 2024-03-11T22:14:40.081903+0000 mon.b (mon.1) 151 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: audit 2024-03-11T22:14:40.089454+0000 mon.a (mon.0) 1462 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:41.268 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:40 smithi049 bash[28804]: audit 2024-03-11T22:14:40.098860+0000 mon.c (mon.2) 360 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.065765+0000 mon.a (mon.0) 1463 : audit 1 from='client.46766 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:42.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.066002+0000 mon.a (mon.0) 1464 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.066241+0000 mon.a (mon.0) 1465 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.068153+0000 mon.b (mon.1) 152 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: cluster 2024-03-11T22:14:41.075124+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.078287+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.084295+0000 mon.a (mon.0) 1467 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.086138+0000 mon.a (mon.0) 1468 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: audit 2024-03-11T22:14:41.100393+0000 mon.c (mon.2) 362 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:42 smithi187 bash[23415]: cluster 2024-03-11T22:14:42.007798+0000 mgr.y (mgr.14601) 265 : cluster 0 pgmap v272: 364 pgs: 32 unknown, 32 creating+peering, 300 active+clean; 601 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.065765+0000 mon.a (mon.0) 1463 : audit 1 from='client.46766 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.066002+0000 mon.a (mon.0) 1464 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.066241+0000 mon.a (mon.0) 1465 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.068153+0000 mon.b (mon.1) 152 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: cluster 2024-03-11T22:14:41.075124+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.078287+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.084295+0000 mon.a (mon.0) 1467 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.086138+0000 mon.a (mon.0) 1468 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: audit 2024-03-11T22:14:41.100393+0000 mon.c (mon.2) 362 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[21434]: cluster 2024-03-11T22:14:42.007798+0000 mgr.y (mgr.14601) 265 : cluster 0 pgmap v272: 364 pgs: 32 unknown, 32 creating+peering, 300 active+clean; 601 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.065765+0000 mon.a (mon.0) 1463 : audit 1 from='client.46766 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi049-64063-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.066002+0000 mon.a (mon.0) 1464 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.066241+0000 mon.a (mon.0) 1465 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.068153+0000 mon.b (mon.1) 152 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: cluster 2024-03-11T22:14:41.075124+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.078287+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.49:0/1073240674' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.084295+0000 mon.a (mon.0) 1467 : audit 1 from='client.46757 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]: dispatch 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.086138+0000 mon.a (mon.0) 1468 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: audit 2024-03-11T22:14:41.100393+0000 mon.c (mon.2) 362 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:42.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:42 smithi049 bash[28804]: cluster 2024-03-11T22:14:42.007798+0000 mgr.y (mgr.14601) 265 : cluster 0 pgmap v272: 364 pgs: 32 unknown, 32 creating+peering, 300 active+clean; 601 KiB data, 587 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-11T22:14:43.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: cluster 2024-03-11T22:14:42.065653+0000 mon.a (mon.0) 1469 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.075976+0000 mon.a (mon.0) 1470 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.076225+0000 mon.a (mon.0) 1471 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]': finished 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.079049+0000 mon.b (mon.1) 153 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: cluster 2024-03-11T22:14:42.085772+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.093449+0000 mon.a (mon.0) 1473 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.102127+0000 mon.c (mon.2) 363 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.118772+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.119262+0000 mon.a (mon.0) 1474 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.120477+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.120749+0000 mon.a (mon.0) 1475 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.121332+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:43.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:43 smithi187 bash[23415]: audit 2024-03-11T22:14:42.121623+0000 mon.a (mon.0) 1476 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:43.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: cluster 2024-03-11T22:14:42.065653+0000 mon.a (mon.0) 1469 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:43.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.075976+0000 mon.a (mon.0) 1470 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:43.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.076225+0000 mon.a (mon.0) 1471 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]': finished 2024-03-11T22:14:43.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.079049+0000 mon.b (mon.1) 153 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]: dispatch 2024-03-11T22:14:43.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: cluster 2024-03-11T22:14:42.085772+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-03-11T22:14:43.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.093449+0000 mon.a (mon.0) 1473 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]: dispatch 2024-03-11T22:14:43.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.102127+0000 mon.c (mon.2) 363 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.118772+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.119262+0000 mon.a (mon.0) 1474 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.120477+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.120749+0000 mon.a (mon.0) 1475 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.121332+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[28804]: audit 2024-03-11T22:14:42.121623+0000 mon.a (mon.0) 1476 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: cluster 2024-03-11T22:14:42.065653+0000 mon.a (mon.0) 1469 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.075976+0000 mon.a (mon.0) 1470 : audit 1 from='client.46757 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi049-64055-27"}]': finished 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.076225+0000 mon.a (mon.0) 1471 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-15"}]': finished 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.079049+0000 mon.b (mon.1) 153 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]: dispatch 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: cluster 2024-03-11T22:14:42.085772+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-03-11T22:14:43.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.093449+0000 mon.a (mon.0) 1473 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]: dispatch 2024-03-11T22:14:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.102127+0000 mon.c (mon.2) 363 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.118772+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.119262+0000 mon.a (mon.0) 1474 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.120477+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.120749+0000 mon.a (mon.0) 1475 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.121332+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:43 smithi049 bash[21434]: audit 2024-03-11T22:14:42.121623+0000 mon.a (mon.0) 1476 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:44.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:14:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:14:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: cluster 2024-03-11T22:14:43.077566+0000 mon.a (mon.0) 1477 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:44.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:43.080430+0000 mon.a (mon.0) 1478 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]': finished 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:43.080651+0000 mon.a (mon.0) 1479 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:43.086133+0000 mon.b (mon.1) 154 : audit 1 from='client.? v1:172.21.15.49:0/297218817' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:43.090021+0000 mon.c (mon.2) 367 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: cluster 2024-03-11T22:14:43.090726+0000 mon.a (mon.0) 1480 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:43.093548+0000 mon.a (mon.0) 1481 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:43.095658+0000 mon.a (mon.0) 1482 : audit 1 from='client.47992 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:43.106830+0000 mon.c (mon.2) 368 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: cluster 2024-03-11T22:14:44.011062+0000 mgr.y (mgr.14601) 266 : cluster 0 pgmap v275: 364 pgs: 32 creating+peering, 332 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-03-11T22:14:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:44 smithi187 bash[23415]: audit 2024-03-11T22:14:44.084418+0000 mon.a (mon.0) 1483 : audit 1 from='client.47992 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:45.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: cluster 2024-03-11T22:14:43.077566+0000 mon.a (mon.0) 1477 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:45.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:43.080430+0000 mon.a (mon.0) 1478 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]': finished 2024-03-11T22:14:45.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:43.080651+0000 mon.a (mon.0) 1479 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:45.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:43.086133+0000 mon.b (mon.1) 154 : audit 1 from='client.? v1:172.21.15.49:0/297218817' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:43.090021+0000 mon.c (mon.2) 367 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: cluster 2024-03-11T22:14:43.090726+0000 mon.a (mon.0) 1480 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:43.093548+0000 mon.a (mon.0) 1481 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:43.095658+0000 mon.a (mon.0) 1482 : audit 1 from='client.47992 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:43.106830+0000 mon.c (mon.2) 368 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: cluster 2024-03-11T22:14:44.011062+0000 mgr.y (mgr.14601) 266 : cluster 0 pgmap v275: 364 pgs: 32 creating+peering, 332 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[21434]: audit 2024-03-11T22:14:44.084418+0000 mon.a (mon.0) 1483 : audit 1 from='client.47992 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: cluster 2024-03-11T22:14:43.077566+0000 mon.a (mon.0) 1477 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:43.080430+0000 mon.a (mon.0) 1478 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-15", "mode": "writeback"}]': finished 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:43.080651+0000 mon.a (mon.0) 1479 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi049-64055-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:45.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:43.086133+0000 mon.b (mon.1) 154 : audit 1 from='client.? v1:172.21.15.49:0/297218817' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:43.090021+0000 mon.c (mon.2) 367 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: cluster 2024-03-11T22:14:43.090726+0000 mon.a (mon.0) 1480 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-03-11T22:14:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:43.093548+0000 mon.a (mon.0) 1481 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:43.095658+0000 mon.a (mon.0) 1482 : audit 1 from='client.47992 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:43.106830+0000 mon.c (mon.2) 368 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: cluster 2024-03-11T22:14:44.011062+0000 mgr.y (mgr.14601) 266 : cluster 0 pgmap v275: 364 pgs: 32 creating+peering, 332 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-03-11T22:14:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:44 smithi049 bash[28804]: audit 2024-03-11T22:14:44.084418+0000 mon.a (mon.0) 1483 : audit 1 from='client.47992 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi049-64063-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:45.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-03-11T22:14:45.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-03-11T22:14:45.052 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (18653 ms) 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (20301 ms) 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (15189 ms) 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (6680 ms) 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (4739 ms) 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3910 ms) 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-03-11T22:14:45.053 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3022 ms) 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3406 ms) 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2564 ms) 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3884 ms) 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2553 ms) 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3422 ms) 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2538 ms) 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-03-11T22:14:45.054 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3005 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3022 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3013 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3022 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3000 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3415 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3022 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2555 ms) 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-03-11T22:14:45.055 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3009 ms) 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3022 ms) 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2932 ms) 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3016 ms) 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3017 ms) 2024-03-11T22:14:45.056 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-03-11T22:14:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:44.110181+0000 mon.c (mon.2) 369 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: cluster 2024-03-11T22:14:44.563276+0000 mon.a (mon.0) 1484 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-03-11T22:14:45.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:44.602379+0000 mon.b (mon.1) 155 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:44.609837+0000 mon.a (mon.0) 1485 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:45.049116+0000 mon.a (mon.0) 1486 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:45.049391+0000 mon.a (mon.0) 1487 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:45.052598+0000 mon.b (mon.1) 156 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: cluster 2024-03-11T22:14:45.056368+0000 mon.a (mon.0) 1488 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-03-11T22:14:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:45.063076+0000 mon.a (mon.0) 1489 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:45 smithi187 bash[23415]: audit 2024-03-11T22:14:45.111238+0000 mon.c (mon.2) 370 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:46.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:44.110181+0000 mon.c (mon.2) 369 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:46.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: cluster 2024-03-11T22:14:44.563276+0000 mon.a (mon.0) 1484 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-03-11T22:14:46.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:44.602379+0000 mon.b (mon.1) 155 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:46.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:44.609837+0000 mon.a (mon.0) 1485 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:46.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:45.049116+0000 mon.a (mon.0) 1486 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:45.049391+0000 mon.a (mon.0) 1487 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:45.052598+0000 mon.b (mon.1) 156 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: cluster 2024-03-11T22:14:45.056368+0000 mon.a (mon.0) 1488 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:45.063076+0000 mon.a (mon.0) 1489 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[21434]: audit 2024-03-11T22:14:45.111238+0000 mon.c (mon.2) 370 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:44.110181+0000 mon.c (mon.2) 369 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: cluster 2024-03-11T22:14:44.563276+0000 mon.a (mon.0) 1484 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:44.602379+0000 mon.b (mon.1) 155 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:44.609837+0000 mon.a (mon.0) 1485 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:46.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:45.049116+0000 mon.a (mon.0) 1486 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi049-64055-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:45.049391+0000 mon.a (mon.0) 1487 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:45.052598+0000 mon.b (mon.1) 156 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: cluster 2024-03-11T22:14:45.056368+0000 mon.a (mon.0) 1488 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-03-11T22:14:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:45.063076+0000 mon.a (mon.0) 1489 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]: dispatch 2024-03-11T22:14:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:45 smithi049 bash[28804]: audit 2024-03-11T22:14:45.111238+0000 mon.c (mon.2) 370 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:46.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:46 smithi187 bash[23415]: cluster 2024-03-11T22:14:46.012101+0000 mgr.y (mgr.14601) 267 : cluster 0 pgmap v278: 340 pgs: 8 unknown, 332 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-03-11T22:14:46.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:46 smithi187 bash[23415]: cluster 2024-03-11T22:14:46.050173+0000 mon.a (mon.0) 1490 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:46.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:46 smithi187 bash[23415]: audit 2024-03-11T22:14:46.053375+0000 mon.a (mon.0) 1491 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]': finished 2024-03-11T22:14:46.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:46 smithi187 bash[23415]: cluster 2024-03-11T22:14:46.060869+0000 mon.a (mon.0) 1492 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-03-11T22:14:46.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:46 smithi187 bash[23415]: audit 2024-03-11T22:14:46.063907+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.49:0/305212670' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:46.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:46 smithi187 bash[23415]: audit 2024-03-11T22:14:46.069212+0000 mon.a (mon.0) 1493 : audit 1 from='client.46784 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:46.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:46 smithi187 bash[23415]: audit 2024-03-11T22:14:46.112183+0000 mon.c (mon.2) 372 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[21434]: cluster 2024-03-11T22:14:46.012101+0000 mgr.y (mgr.14601) 267 : cluster 0 pgmap v278: 340 pgs: 8 unknown, 332 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[21434]: cluster 2024-03-11T22:14:46.050173+0000 mon.a (mon.0) 1490 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[21434]: audit 2024-03-11T22:14:46.053375+0000 mon.a (mon.0) 1491 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]': finished 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[21434]: cluster 2024-03-11T22:14:46.060869+0000 mon.a (mon.0) 1492 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[21434]: audit 2024-03-11T22:14:46.063907+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.49:0/305212670' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[21434]: audit 2024-03-11T22:14:46.069212+0000 mon.a (mon.0) 1493 : audit 1 from='client.46784 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[21434]: audit 2024-03-11T22:14:46.112183+0000 mon.c (mon.2) 372 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:47.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[28804]: cluster 2024-03-11T22:14:46.012101+0000 mgr.y (mgr.14601) 267 : cluster 0 pgmap v278: 340 pgs: 8 unknown, 332 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-03-11T22:14:47.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[28804]: cluster 2024-03-11T22:14:46.050173+0000 mon.a (mon.0) 1490 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:47.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[28804]: audit 2024-03-11T22:14:46.053375+0000 mon.a (mon.0) 1491 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-15"}]': finished 2024-03-11T22:14:47.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[28804]: cluster 2024-03-11T22:14:46.060869+0000 mon.a (mon.0) 1492 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-03-11T22:14:47.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[28804]: audit 2024-03-11T22:14:46.063907+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.49:0/305212670' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:47.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[28804]: audit 2024-03-11T22:14:46.069212+0000 mon.a (mon.0) 1493 : audit 1 from='client.46784 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:47.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:46 smithi049 bash[28804]: audit 2024-03-11T22:14:46.112183+0000 mon.c (mon.2) 372 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:48 smithi187 bash[23415]: audit 2024-03-11T22:14:47.056511+0000 mon.a (mon.0) 1494 : audit 1 from='client.46784 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:48 smithi187 bash[23415]: cluster 2024-03-11T22:14:47.063762+0000 mon.a (mon.0) 1495 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-03-11T22:14:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:48 smithi187 bash[23415]: audit 2024-03-11T22:14:47.067785+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:48 smithi187 bash[23415]: audit 2024-03-11T22:14:47.113297+0000 mon.c (mon.2) 374 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:48.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:48 smithi187 bash[23415]: audit 2024-03-11T22:14:47.547053+0000 mon.a (mon.0) 1496 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:48.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:48 smithi187 bash[23415]: cluster 2024-03-11T22:14:48.013075+0000 mgr.y (mgr.14601) 268 : cluster 0 pgmap v281: 332 pgs: 32 unknown, 300 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[21434]: audit 2024-03-11T22:14:47.056511+0000 mon.a (mon.0) 1494 : audit 1 from='client.46784 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[21434]: cluster 2024-03-11T22:14:47.063762+0000 mon.a (mon.0) 1495 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[21434]: audit 2024-03-11T22:14:47.067785+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[21434]: audit 2024-03-11T22:14:47.113297+0000 mon.c (mon.2) 374 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[21434]: audit 2024-03-11T22:14:47.547053+0000 mon.a (mon.0) 1496 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[21434]: cluster 2024-03-11T22:14:48.013075+0000 mgr.y (mgr.14601) 268 : cluster 0 pgmap v281: 332 pgs: 32 unknown, 300 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[28804]: audit 2024-03-11T22:14:47.056511+0000 mon.a (mon.0) 1494 : audit 1 from='client.46784 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi049-64063-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[28804]: cluster 2024-03-11T22:14:47.063762+0000 mon.a (mon.0) 1495 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[28804]: audit 2024-03-11T22:14:47.067785+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[28804]: audit 2024-03-11T22:14:47.113297+0000 mon.c (mon.2) 374 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[28804]: audit 2024-03-11T22:14:47.547053+0000 mon.a (mon.0) 1496 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:48 smithi049 bash[28804]: cluster 2024-03-11T22:14:48.013075+0000 mgr.y (mgr.14601) 268 : cluster 0 pgmap v281: 332 pgs: 32 unknown, 300 active+clean; 609 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:48.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:14:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:14:49.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: cluster 2024-03-11T22:14:48.058363+0000 mon.a (mon.0) 1497 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.060283+0000 mon.a (mon.0) 1498 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.068974+0000 mon.c (mon.2) 375 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: cluster 2024-03-11T22:14:48.069736+0000 mon.a (mon.0) 1499 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.071953+0000 mon.a (mon.0) 1500 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.077862+0000 mon.a (mon.0) 1501 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.080009+0000 mon.b (mon.1) 157 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.106323+0000 mon.a (mon.0) 1502 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.115215+0000 mon.c (mon.2) 376 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:48.656803+0000 mgr.y (mgr.14601) 269 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:49.065727+0000 mon.a (mon.0) 1503 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:49.066008+0000 mon.a (mon.0) 1504 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:49.066262+0000 mon.a (mon.0) 1505 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: cluster 2024-03-11T22:14:49.078156+0000 mon.a (mon.0) 1506 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-03-11T22:14:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:49.080769+0000 mon.a (mon.0) 1507 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:49 smithi187 bash[23415]: audit 2024-03-11T22:14:49.082576+0000 mon.a (mon.0) 1508 : audit 1 from='client.? v1:172.21.15.49:0/3106215338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi049-64063-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: cluster 2024-03-11T22:14:48.058363+0000 mon.a (mon.0) 1497 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.060283+0000 mon.a (mon.0) 1498 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.068974+0000 mon.c (mon.2) 375 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: cluster 2024-03-11T22:14:48.069736+0000 mon.a (mon.0) 1499 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-03-11T22:14:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.071953+0000 mon.a (mon.0) 1500 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.077862+0000 mon.a (mon.0) 1501 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:49.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.080009+0000 mon.b (mon.1) 157 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.106323+0000 mon.a (mon.0) 1502 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.115215+0000 mon.c (mon.2) 376 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:48.656803+0000 mgr.y (mgr.14601) 269 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:49.065727+0000 mon.a (mon.0) 1503 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:49.066008+0000 mon.a (mon.0) 1504 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:49.066262+0000 mon.a (mon.0) 1505 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: cluster 2024-03-11T22:14:49.078156+0000 mon.a (mon.0) 1506 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:49.080769+0000 mon.a (mon.0) 1507 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[21434]: audit 2024-03-11T22:14:49.082576+0000 mon.a (mon.0) 1508 : audit 1 from='client.? v1:172.21.15.49:0/3106215338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi049-64063-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: cluster 2024-03-11T22:14:48.058363+0000 mon.a (mon.0) 1497 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.060283+0000 mon.a (mon.0) 1498 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:49.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.068974+0000 mon.c (mon.2) 375 : audit 1 from='client.? v1:172.21.15.49:0/591882462' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: cluster 2024-03-11T22:14:48.069736+0000 mon.a (mon.0) 1499 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.071953+0000 mon.a (mon.0) 1500 : audit 1 from='client.46775 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.077862+0000 mon.a (mon.0) 1501 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.080009+0000 mon.b (mon.1) 157 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.106323+0000 mon.a (mon.0) 1502 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.115215+0000 mon.c (mon.2) 376 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:48.656803+0000 mgr.y (mgr.14601) 269 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:49.065727+0000 mon.a (mon.0) 1503 : audit 1 from='client.46775 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi049-64055-28"}]': finished 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:49.066008+0000 mon.a (mon.0) 1504 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:49.066262+0000 mon.a (mon.0) 1505 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: cluster 2024-03-11T22:14:49.078156+0000 mon.a (mon.0) 1506 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:49.080769+0000 mon.a (mon.0) 1507 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]: dispatch 2024-03-11T22:14:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:49 smithi049 bash[28804]: audit 2024-03-11T22:14:49.082576+0000 mon.a (mon.0) 1508 : audit 1 from='client.? v1:172.21.15.49:0/3106215338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi049-64063-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:50.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosA_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-03-11T22:14:50.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2006 ms) 2024-03-11T22:14:50.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8589 ms total) 2024-03-11T22:14:50.084 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4065 ms) 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3974 ms) 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3970 ms) 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12009 ms total) 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (137810 ms total) 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-03-11T22:14:50.085 INFO:tasks.workunit.client.0.smithi049.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.119224+0000 mon.c (mon.2) 377 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.129407+0000 mon.b (mon.1) 158 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.133729+0000 mon.c (mon.2) 378 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.134074+0000 mon.a (mon.0) 1509 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.136289+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.136631+0000 mon.a (mon.0) 1510 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.137016+0000 mon.a (mon.0) 1511 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.137508+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:49.137839+0000 mon.a (mon.0) 1512 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: cluster 2024-03-11T22:14:50.014166+0000 mgr.y (mgr.14601) 270 : cluster 0 pgmap v284: 356 pgs: 32 unknown, 32 creating+peering, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.069393+0000 mon.a (mon.0) 1513 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.069579+0000 mon.a (mon.0) 1514 : audit 1 from='client.? v1:172.21.15.49:0/3106215338' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi049-64063-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.069727+0000 mon.a (mon.0) 1515 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:50.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.069864+0000 mon.a (mon.0) 1516 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:50.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.071589+0000 mon.b (mon.1) 159 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:50.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: cluster 2024-03-11T22:14:50.077947+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-03-11T22:14:50.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.078354+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.084482+0000 mon.a (mon.0) 1518 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:50.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:50 smithi187 bash[23415]: audit 2024-03-11T22:14:50.085414+0000 mon.a (mon.0) 1519 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.119224+0000 mon.c (mon.2) 377 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.129407+0000 mon.b (mon.1) 158 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.133729+0000 mon.c (mon.2) 378 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.134074+0000 mon.a (mon.0) 1509 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.136289+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.136631+0000 mon.a (mon.0) 1510 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.137016+0000 mon.a (mon.0) 1511 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.137508+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:49.137839+0000 mon.a (mon.0) 1512 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: cluster 2024-03-11T22:14:50.014166+0000 mgr.y (mgr.14601) 270 : cluster 0 pgmap v284: 356 pgs: 32 unknown, 32 creating+peering, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.069393+0000 mon.a (mon.0) 1513 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.069579+0000 mon.a (mon.0) 1514 : audit 1 from='client.? v1:172.21.15.49:0/3106215338' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi049-64063-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.069727+0000 mon.a (mon.0) 1515 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.069864+0000 mon.a (mon.0) 1516 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.119224+0000 mon.c (mon.2) 377 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.129407+0000 mon.b (mon.1) 158 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.133729+0000 mon.c (mon.2) 378 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.134074+0000 mon.a (mon.0) 1509 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.136289+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.136631+0000 mon.a (mon.0) 1510 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.137016+0000 mon.a (mon.0) 1511 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.137508+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:49.137839+0000 mon.a (mon.0) 1512 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: cluster 2024-03-11T22:14:50.014166+0000 mgr.y (mgr.14601) 270 : cluster 0 pgmap v284: 356 pgs: 32 unknown, 32 creating+peering, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.069393+0000 mon.a (mon.0) 1513 : audit 1 from='client.? v1:172.21.15.49:0/133569628' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi049-64272-21"}]': finished 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.069579+0000 mon.a (mon.0) 1514 : audit 1 from='client.? v1:172.21.15.49:0/3106215338' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi049-64063-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.069727+0000 mon.a (mon.0) 1515 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.069864+0000 mon.a (mon.0) 1516 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi049-64055-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.071589+0000 mon.b (mon.1) 159 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: cluster 2024-03-11T22:14:50.077947+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.078354+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.084482+0000 mon.a (mon.0) 1518 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[21434]: audit 2024-03-11T22:14:50.085414+0000 mon.a (mon.0) 1519 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.071589+0000 mon.b (mon.1) 159 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: cluster 2024-03-11T22:14:50.077947+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.078354+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.084482+0000 mon.a (mon.0) 1518 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:50.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:50 smithi049 bash[28804]: audit 2024-03-11T22:14:50.085414+0000 mon.a (mon.0) 1519 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:51.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:51 smithi187 bash[23415]: audit 2024-03-11T22:14:50.120716+0000 mon.c (mon.2) 382 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:51.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:51 smithi187 bash[23415]: audit 2024-03-11T22:14:51.072962+0000 mon.a (mon.0) 1520 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]': finished 2024-03-11T22:14:52.016 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:51 smithi049 bash[28804]: audit 2024-03-11T22:14:50.120716+0000 mon.c (mon.2) 382 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:52.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:51 smithi049 bash[28804]: audit 2024-03-11T22:14:51.072962+0000 mon.a (mon.0) 1520 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]': finished 2024-03-11T22:14:52.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:51 smithi049 bash[21434]: audit 2024-03-11T22:14:50.120716+0000 mon.c (mon.2) 382 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:52.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:51 smithi049 bash[21434]: audit 2024-03-11T22:14:51.072962+0000 mon.a (mon.0) 1520 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-17"}]': finished 2024-03-11T22:14:52.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:51.074803+0000 mon.b (mon.1) 160 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]: dispatch 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:51.122341+0000 mon.c (mon.2) 383 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: cluster 2024-03-11T22:14:51.536383+0000 mon.a (mon.0) 1521 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:51.538369+0000 mon.a (mon.0) 1522 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]: dispatch 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: cluster 2024-03-11T22:14:52.015077+0000 mgr.y (mgr.14601) 271 : cluster 0 pgmap v287: 324 pgs: 32 creating+peering, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: cluster 2024-03-11T22:14:52.074279+0000 mon.a (mon.0) 1523 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:52.078164+0000 mon.a (mon.0) 1524 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:52.078403+0000 mon.a (mon.0) 1525 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]': finished 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: cluster 2024-03-11T22:14:52.086926+0000 mon.a (mon.0) 1526 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:52.090139+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.49:0/532448790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:52.090959+0000 mon.a (mon.0) 1527 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:52.123164+0000 mon.c (mon.2) 385 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:52.200011+0000 mon.b (mon.1) 161 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:52.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:52 smithi187 bash[23415]: audit 2024-03-11T22:14:52.207389+0000 mon.a (mon.0) 1528 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:51.074803+0000 mon.b (mon.1) 160 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]: dispatch 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:51.122341+0000 mon.c (mon.2) 383 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: cluster 2024-03-11T22:14:51.536383+0000 mon.a (mon.0) 1521 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:51.538369+0000 mon.a (mon.0) 1522 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]: dispatch 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: cluster 2024-03-11T22:14:52.015077+0000 mgr.y (mgr.14601) 271 : cluster 0 pgmap v287: 324 pgs: 32 creating+peering, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: cluster 2024-03-11T22:14:52.074279+0000 mon.a (mon.0) 1523 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:52.078164+0000 mon.a (mon.0) 1524 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:52.078403+0000 mon.a (mon.0) 1525 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]': finished 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: cluster 2024-03-11T22:14:52.086926+0000 mon.a (mon.0) 1526 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:52.090139+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.49:0/532448790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:53.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:52.090959+0000 mon.a (mon.0) 1527 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:52.123164+0000 mon.c (mon.2) 385 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:52.200011+0000 mon.b (mon.1) 161 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[21434]: audit 2024-03-11T22:14:52.207389+0000 mon.a (mon.0) 1528 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:51.074803+0000 mon.b (mon.1) 160 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]: dispatch 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:51.122341+0000 mon.c (mon.2) 383 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: cluster 2024-03-11T22:14:51.536383+0000 mon.a (mon.0) 1521 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:51.538369+0000 mon.a (mon.0) 1522 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]: dispatch 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: cluster 2024-03-11T22:14:52.015077+0000 mgr.y (mgr.14601) 271 : cluster 0 pgmap v287: 324 pgs: 32 creating+peering, 292 active+clean; 585 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: cluster 2024-03-11T22:14:52.074279+0000 mon.a (mon.0) 1523 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:52.078164+0000 mon.a (mon.0) 1524 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi049-64055-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:53.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:52.078403+0000 mon.a (mon.0) 1525 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-17", "mode": "writeback"}]': finished 2024-03-11T22:14:53.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: cluster 2024-03-11T22:14:52.086926+0000 mon.a (mon.0) 1526 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-03-11T22:14:53.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:52.090139+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.49:0/532448790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:53.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:52.090959+0000 mon.a (mon.0) 1527 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:53.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:52.123164+0000 mon.c (mon.2) 385 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:53.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:52.200011+0000 mon.b (mon.1) 161 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:53.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:52 smithi049 bash[28804]: audit 2024-03-11T22:14:52.207389+0000 mon.a (mon.0) 1528 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: audit 2024-03-11T22:14:53.081393+0000 mon.a (mon.0) 1529 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: audit 2024-03-11T22:14:53.081746+0000 mon.a (mon.0) 1530 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: audit 2024-03-11T22:14:53.084112+0000 mon.b (mon.1) 162 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: cluster 2024-03-11T22:14:53.090568+0000 mon.a (mon.0) 1531 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: audit 2024-03-11T22:14:53.095890+0000 mon.a (mon.0) 1532 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: audit 2024-03-11T22:14:53.124288+0000 mon.c (mon.2) 386 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: cluster 2024-03-11T22:14:54.018224+0000 mgr.y (mgr.14601) 272 : cluster 0 pgmap v290: 364 pgs: 364 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: audit 2024-03-11T22:14:54.018870+0000 mon.c (mon.2) 387 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: audit 2024-03-11T22:14:54.021803+0000 mon.a (mon.0) 1533 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-11T22:14:54.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:54 smithi187 bash[23415]: cluster 2024-03-11T22:14:54.081306+0000 mon.a (mon.0) 1534 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:54.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:14:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: audit 2024-03-11T22:14:53.081393+0000 mon.a (mon.0) 1529 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: audit 2024-03-11T22:14:53.081746+0000 mon.a (mon.0) 1530 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: audit 2024-03-11T22:14:53.084112+0000 mon.b (mon.1) 162 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: cluster 2024-03-11T22:14:53.090568+0000 mon.a (mon.0) 1531 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: audit 2024-03-11T22:14:53.095890+0000 mon.a (mon.0) 1532 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: audit 2024-03-11T22:14:53.124288+0000 mon.c (mon.2) 386 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: cluster 2024-03-11T22:14:54.018224+0000 mgr.y (mgr.14601) 272 : cluster 0 pgmap v290: 364 pgs: 364 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-03-11T22:14:54.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: audit 2024-03-11T22:14:54.018870+0000 mon.c (mon.2) 387 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: audit 2024-03-11T22:14:54.021803+0000 mon.a (mon.0) 1533 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[21434]: cluster 2024-03-11T22:14:54.081306+0000 mon.a (mon.0) 1534 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: audit 2024-03-11T22:14:53.081393+0000 mon.a (mon.0) 1529 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi049-64063-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: audit 2024-03-11T22:14:53.081746+0000 mon.a (mon.0) 1530 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: audit 2024-03-11T22:14:53.084112+0000 mon.b (mon.1) 162 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: cluster 2024-03-11T22:14:53.090568+0000 mon.a (mon.0) 1531 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: audit 2024-03-11T22:14:53.095890+0000 mon.a (mon.0) 1532 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]: dispatch 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: audit 2024-03-11T22:14:53.124288+0000 mon.c (mon.2) 386 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: cluster 2024-03-11T22:14:54.018224+0000 mgr.y (mgr.14601) 272 : cluster 0 pgmap v290: 364 pgs: 364 active+clean; 586 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: audit 2024-03-11T22:14:54.018870+0000 mon.c (mon.2) 387 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-11T22:14:54.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: audit 2024-03-11T22:14:54.021803+0000 mon.a (mon.0) 1533 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-11T22:14:54.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:54 smithi049 bash[28804]: cluster 2024-03-11T22:14:54.081306+0000 mon.a (mon.0) 1534 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: cluster 2024-03-11T22:14:54.082437+0000 mon.a (mon.0) 1535 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:54.091036+0000 mon.a (mon.0) 1536 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]': finished 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:54.091282+0000 mon.a (mon.0) 1537 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: cluster 2024-03-11T22:14:54.101923+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:54.105949+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:54.106989+0000 mon.a (mon.0) 1539 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:54.125793+0000 mon.c (mon.2) 389 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:54.841768+0000 mon.c (mon.2) 390 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:55.054423+0000 mon.a (mon.0) 1540 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:55.063725+0000 mon.c (mon.2) 391 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: cluster 2024-03-11T22:14:55.063815+0000 mon.a (mon.0) 1541 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-03-11T22:14:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:55.067085+0000 mon.a (mon.0) 1542 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:55 smithi187 bash[23415]: audit 2024-03-11T22:14:55.077998+0000 mon.a (mon.0) 1543 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi049-64063-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:56.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: cluster 2024-03-11T22:14:54.082437+0000 mon.a (mon.0) 1535 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:56.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:54.091036+0000 mon.a (mon.0) 1536 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]': finished 2024-03-11T22:14:56.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:54.091282+0000 mon.a (mon.0) 1537 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-03-11T22:14:56.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: cluster 2024-03-11T22:14:54.101923+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-03-11T22:14:56.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:54.105949+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:54.106989+0000 mon.a (mon.0) 1539 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:54.125793+0000 mon.c (mon.2) 389 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:54.841768+0000 mon.c (mon.2) 390 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:55.054423+0000 mon.a (mon.0) 1540 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:55.063725+0000 mon.c (mon.2) 391 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: cluster 2024-03-11T22:14:55.063815+0000 mon.a (mon.0) 1541 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:55.067085+0000 mon.a (mon.0) 1542 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[28804]: audit 2024-03-11T22:14:55.077998+0000 mon.a (mon.0) 1543 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi049-64063-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: cluster 2024-03-11T22:14:54.082437+0000 mon.a (mon.0) 1535 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:54.091036+0000 mon.a (mon.0) 1536 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-17"}]': finished 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:54.091282+0000 mon.a (mon.0) 1537 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-03-11T22:14:56.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: cluster 2024-03-11T22:14:54.101923+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:54.105949+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:54.106989+0000 mon.a (mon.0) 1539 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:54.125793+0000 mon.c (mon.2) 389 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:54.841768+0000 mon.c (mon.2) 390 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:55.054423+0000 mon.a (mon.0) 1540 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:55.063725+0000 mon.c (mon.2) 391 : audit 1 from='client.? v1:172.21.15.49:0/811032242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: cluster 2024-03-11T22:14:55.063815+0000 mon.a (mon.0) 1541 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:55.067085+0000 mon.a (mon.0) 1542 : audit 1 from='client.46790 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]: dispatch 2024-03-11T22:14:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:55 smithi049 bash[21434]: audit 2024-03-11T22:14:55.077998+0000 mon.a (mon.0) 1543 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi049-64063-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:55.197725+0000 mon.c (mon.2) 392 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:55.198387+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:55.538062+0000 mon.a (mon.0) 1544 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: cluster 2024-03-11T22:14:56.019316+0000 mgr.y (mgr.14601) 273 : cluster 0 pgmap v293: 324 pgs: 32 unknown, 292 active+clean; 585 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.058987+0000 mon.a (mon.0) 1545 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.059219+0000 mon.a (mon.0) 1546 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi049-64063-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.059411+0000 mon.a (mon.0) 1547 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]': finished 2024-03-11T22:14:56.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.064267+0000 mon.b (mon.1) 163 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.066177+0000 mon.c (mon.2) 394 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: cluster 2024-03-11T22:14:56.067351+0000 mon.a (mon.0) 1548 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.069346+0000 mon.c (mon.2) 395 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.072567+0000 mon.c (mon.2) 396 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.077674+0000 mon.a (mon.0) 1549 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.092747+0000 mon.a (mon.0) 1550 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.110437+0000 mon.a (mon.0) 1551 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.113100+0000 mon.a (mon.0) 1552 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:56.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:56 smithi187 bash[23415]: audit 2024-03-11T22:14:56.114511+0000 mon.a (mon.0) 1553 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi049-64055-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:57.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:55.197725+0000 mon.c (mon.2) 392 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:57.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:55.198387+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:57.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:55.538062+0000 mon.a (mon.0) 1544 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:57.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: cluster 2024-03-11T22:14:56.019316+0000 mgr.y (mgr.14601) 273 : cluster 0 pgmap v293: 324 pgs: 32 unknown, 292 active+clean; 585 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:14:57.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.058987+0000 mon.a (mon.0) 1545 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.059219+0000 mon.a (mon.0) 1546 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi049-64063-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.059411+0000 mon.a (mon.0) 1547 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]': finished 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.064267+0000 mon.b (mon.1) 163 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.066177+0000 mon.c (mon.2) 394 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: cluster 2024-03-11T22:14:56.067351+0000 mon.a (mon.0) 1548 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.069346+0000 mon.c (mon.2) 395 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.072567+0000 mon.c (mon.2) 396 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.077674+0000 mon.a (mon.0) 1549 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.092747+0000 mon.a (mon.0) 1550 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.110437+0000 mon.a (mon.0) 1551 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:57.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:55.197725+0000 mon.c (mon.2) 392 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:55.198387+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:55.538062+0000 mon.a (mon.0) 1544 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: cluster 2024-03-11T22:14:56.019316+0000 mgr.y (mgr.14601) 273 : cluster 0 pgmap v293: 324 pgs: 32 unknown, 292 active+clean; 585 KiB data, 569 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.058987+0000 mon.a (mon.0) 1545 : audit 1 from='client.46790 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi049-64055-29"}]': finished 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.059219+0000 mon.a (mon.0) 1546 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi049-64063-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.059411+0000 mon.a (mon.0) 1547 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pg_num","val":"11"}]': finished 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.064267+0000 mon.b (mon.1) 163 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.066177+0000 mon.c (mon.2) 394 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: cluster 2024-03-11T22:14:56.067351+0000 mon.a (mon.0) 1548 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.069346+0000 mon.c (mon.2) 395 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.072567+0000 mon.c (mon.2) 396 : audit 1 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.077674+0000 mon.a (mon.0) 1549 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:57.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.092747+0000 mon.a (mon.0) 1550 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-11T22:14:57.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.110437+0000 mon.a (mon.0) 1551 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:57.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.113100+0000 mon.a (mon.0) 1552 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:57.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[21434]: audit 2024-03-11T22:14:56.114511+0000 mon.a (mon.0) 1553 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi049-64055-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:57.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.113100+0000 mon.a (mon.0) 1552 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:57.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:56 smithi049 bash[28804]: audit 2024-03-11T22:14:56.114511+0000 mon.a (mon.0) 1553 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi049-64055-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:56.590455+0000 mon.a (mon.0) 1554 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd=[{ 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:56.590523+0000 mon.a (mon.0) 1555 : audit 1 "prefix": "osd pool set", 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:56.590558+0000 mon.a (mon.0) 1556 : audit 1 "pool": "PoolEIOFlag_smithi049-64063-33", 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:56.590584+0000 mon.a (mon.0) 1557 : audit 1 "var": "eio", 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:56.590616+0000 mon.a (mon.0) 1558 : audit 1 "val": "true" 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:56.590670+0000 mon.a (mon.0) 1559 : audit 1 }]: dispatch 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.061927+0000 mon.a (mon.0) 1560 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062094+0000 mon.a (mon.0) 1561 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]': finished 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062280+0000 mon.a (mon.0) 1562 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi049-64055-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062385+0000 mon.a (mon.0) 1563 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd='[{ 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062411+0000 mon.a (mon.0) 1564 : audit 1 "prefix": "osd pool set", 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062427+0000 mon.a (mon.0) 1565 : audit 1 "pool": "PoolEIOFlag_smithi049-64063-33", 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062456+0000 mon.a (mon.0) 1566 : audit 1 "var": "eio", 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062490+0000 mon.a (mon.0) 1567 : audit 1 "val": "true" 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.062518+0000 mon.a (mon.0) 1568 : audit 1 }]': finished 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.066321+0000 mon.b (mon.1) 164 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: cluster 2024-03-11T22:14:57.071980+0000 mon.a (mon.0) 1569 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.072737+0000 mon.c (mon.2) 397 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.081302+0000 mon.a (mon.0) 1570 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi049-64055-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:57 smithi187 bash[23415]: audit 2024-03-11T22:14:57.082145+0000 mon.a (mon.0) 1571 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:58.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:56.590455+0000 mon.a (mon.0) 1554 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd=[{ 2024-03-11T22:14:58.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:56.590523+0000 mon.a (mon.0) 1555 : audit 1 "prefix": "osd pool set", 2024-03-11T22:14:58.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:56.590558+0000 mon.a (mon.0) 1556 : audit 1 "pool": "PoolEIOFlag_smithi049-64063-33", 2024-03-11T22:14:58.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:56.590584+0000 mon.a (mon.0) 1557 : audit 1 "var": "eio", 2024-03-11T22:14:58.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:56.590616+0000 mon.a (mon.0) 1558 : audit 1 "val": "true" 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:56.590670+0000 mon.a (mon.0) 1559 : audit 1 }]: dispatch 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.061927+0000 mon.a (mon.0) 1560 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062094+0000 mon.a (mon.0) 1561 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]': finished 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062280+0000 mon.a (mon.0) 1562 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi049-64055-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062385+0000 mon.a (mon.0) 1563 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd='[{ 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062411+0000 mon.a (mon.0) 1564 : audit 1 "prefix": "osd pool set", 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062427+0000 mon.a (mon.0) 1565 : audit 1 "pool": "PoolEIOFlag_smithi049-64063-33", 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062456+0000 mon.a (mon.0) 1566 : audit 1 "var": "eio", 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062490+0000 mon.a (mon.0) 1567 : audit 1 "val": "true" 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.062518+0000 mon.a (mon.0) 1568 : audit 1 }]': finished 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.066321+0000 mon.b (mon.1) 164 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: cluster 2024-03-11T22:14:57.071980+0000 mon.a (mon.0) 1569 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-03-11T22:14:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.072737+0000 mon.c (mon.2) 397 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.081302+0000 mon.a (mon.0) 1570 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi049-64055-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[21434]: audit 2024-03-11T22:14:57.082145+0000 mon.a (mon.0) 1571 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:56.590455+0000 mon.a (mon.0) 1554 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd=[{ 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:56.590523+0000 mon.a (mon.0) 1555 : audit 1 "prefix": "osd pool set", 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:56.590558+0000 mon.a (mon.0) 1556 : audit 1 "pool": "PoolEIOFlag_smithi049-64063-33", 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:56.590584+0000 mon.a (mon.0) 1557 : audit 1 "var": "eio", 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:56.590616+0000 mon.a (mon.0) 1558 : audit 1 "val": "true" 2024-03-11T22:14:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:56.590670+0000 mon.a (mon.0) 1559 : audit 1 }]: dispatch 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.061927+0000 mon.a (mon.0) 1560 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062094+0000 mon.a (mon.0) 1561 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi049-64092-1","var":"pgp_num","val":"11"}]': finished 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062280+0000 mon.a (mon.0) 1562 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi049-64055-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062385+0000 mon.a (mon.0) 1563 : audit 1 from='client.? v1:172.21.15.49:0/1823521941' entity='client.admin' cmd='[{ 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062411+0000 mon.a (mon.0) 1564 : audit 1 "prefix": "osd pool set", 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062427+0000 mon.a (mon.0) 1565 : audit 1 "pool": "PoolEIOFlag_smithi049-64063-33", 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062456+0000 mon.a (mon.0) 1566 : audit 1 "var": "eio", 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062490+0000 mon.a (mon.0) 1567 : audit 1 "val": "true" 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.062518+0000 mon.a (mon.0) 1568 : audit 1 }]': finished 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.066321+0000 mon.b (mon.1) 164 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: cluster 2024-03-11T22:14:57.071980+0000 mon.a (mon.0) 1569 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.072737+0000 mon.c (mon.2) 397 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.081302+0000 mon.a (mon.0) 1570 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi049-64055-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:14:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:57 smithi049 bash[28804]: audit 2024-03-11T22:14:57.082145+0000 mon.a (mon.0) 1571 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:14:58.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:14:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:14:58.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:58 smithi187 bash[23415]: cluster 2024-03-11T22:14:58.020241+0000 mgr.y (mgr.14601) 274 : cluster 0 pgmap v296: 356 pgs: 64 unknown, 292 active+clean; 585 KiB data, 569 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:58 smithi187 bash[23415]: audit 2024-03-11T22:14:58.065565+0000 mon.a (mon.0) 1572 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:58 smithi187 bash[23415]: audit 2024-03-11T22:14:58.069722+0000 mon.b (mon.1) 165 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:14:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:58 smithi187 bash[23415]: audit 2024-03-11T22:14:58.074928+0000 mon.c (mon.2) 398 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:58 smithi187 bash[23415]: cluster 2024-03-11T22:14:58.539276+0000 mon.a (mon.0) 1573 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-03-11T22:14:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:58 smithi187 bash[23415]: audit 2024-03-11T22:14:58.540794+0000 mon.a (mon.0) 1574 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:14:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[21434]: cluster 2024-03-11T22:14:58.020241+0000 mgr.y (mgr.14601) 274 : cluster 0 pgmap v296: 356 pgs: 64 unknown, 292 active+clean; 585 KiB data, 569 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[21434]: audit 2024-03-11T22:14:58.065565+0000 mon.a (mon.0) 1572 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[21434]: audit 2024-03-11T22:14:58.069722+0000 mon.b (mon.1) 165 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:14:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[21434]: audit 2024-03-11T22:14:58.074928+0000 mon.c (mon.2) 398 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[21434]: cluster 2024-03-11T22:14:58.539276+0000 mon.a (mon.0) 1573 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-03-11T22:14:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[21434]: audit 2024-03-11T22:14:58.540794+0000 mon.a (mon.0) 1574 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:14:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[28804]: cluster 2024-03-11T22:14:58.020241+0000 mgr.y (mgr.14601) 274 : cluster 0 pgmap v296: 356 pgs: 64 unknown, 292 active+clean; 585 KiB data, 569 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:14:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[28804]: audit 2024-03-11T22:14:58.065565+0000 mon.a (mon.0) 1572 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:14:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[28804]: audit 2024-03-11T22:14:58.069722+0000 mon.b (mon.1) 165 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:14:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[28804]: audit 2024-03-11T22:14:58.074928+0000 mon.c (mon.2) 398 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[28804]: cluster 2024-03-11T22:14:58.539276+0000 mon.a (mon.0) 1573 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-03-11T22:14:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:58 smithi049 bash[28804]: audit 2024-03-11T22:14:58.540794+0000 mon.a (mon.0) 1574 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:14:59.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:58.667154+0000 mgr.y (mgr.14601) 275 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:14:59.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:59.068757+0000 mon.a (mon.0) 1575 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi049-64055-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:14:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:59.068860+0000 mon.a (mon.0) 1576 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]': finished 2024-03-11T22:14:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: cluster 2024-03-11T22:14:59.072274+0000 mon.a (mon.0) 1577 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-03-11T22:14:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:59.076526+0000 mon.b (mon.1) 166 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]: dispatch 2024-03-11T22:14:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:59.076987+0000 mon.c (mon.2) 399 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:14:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:59.077983+0000 mon.c (mon.2) 400 : audit 1 from='client.? v1:172.21.15.49:0/298553620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:59.078923+0000 mon.a (mon.0) 1578 : audit 1 from='client.46814 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:14:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:14:59 smithi187 bash[23415]: audit 2024-03-11T22:14:59.089030+0000 mon.a (mon.0) 1579 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]: dispatch 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:58.667154+0000 mgr.y (mgr.14601) 275 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:59.068757+0000 mon.a (mon.0) 1575 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi049-64055-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:59.068860+0000 mon.a (mon.0) 1576 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]': finished 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: cluster 2024-03-11T22:14:59.072274+0000 mon.a (mon.0) 1577 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:59.076526+0000 mon.b (mon.1) 166 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]: dispatch 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:59.076987+0000 mon.c (mon.2) 399 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:59.077983+0000 mon.c (mon.2) 400 : audit 1 from='client.? v1:172.21.15.49:0/298553620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:00.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:59.078923+0000 mon.a (mon.0) 1578 : audit 1 from='client.46814 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[28804]: audit 2024-03-11T22:14:59.089030+0000 mon.a (mon.0) 1579 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]: dispatch 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:58.667154+0000 mgr.y (mgr.14601) 275 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:59.068757+0000 mon.a (mon.0) 1575 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi049-64055-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:59.068860+0000 mon.a (mon.0) 1576 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-19"}]': finished 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: cluster 2024-03-11T22:14:59.072274+0000 mon.a (mon.0) 1577 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:59.076526+0000 mon.b (mon.1) 166 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]: dispatch 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:59.076987+0000 mon.c (mon.2) 399 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:59.077983+0000 mon.c (mon.2) 400 : audit 1 from='client.? v1:172.21.15.49:0/298553620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:59.078923+0000 mon.a (mon.0) 1578 : audit 1 from='client.46814 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:00.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:14:59 smithi049 bash[21434]: audit 2024-03-11T22:14:59.089030+0000 mon.a (mon.0) 1579 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]: dispatch 2024-03-11T22:15:00.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: cluster 2024-03-11T22:15:00.021291+0000 mgr.y (mgr.14601) 276 : cluster 0 pgmap v299: 364 pgs: 40 unknown, 324 active+clean; 585 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.022037+0000 mon.c (mon.2) 401 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.025160+0000 mon.a (mon.0) 1580 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: cluster 2024-03-11T22:15:00.053405+0000 mon.a (mon.0) 1581 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: cluster 2024-03-11T22:15:00.069553+0000 mon.a (mon.0) 1582 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.071882+0000 mon.a (mon.0) 1583 : audit 1 from='client.46814 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.072302+0000 mon.a (mon.0) 1584 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]': finished 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.072535+0000 mon.a (mon.0) 1585 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: cluster 2024-03-11T22:15:00.081187+0000 mon.a (mon.0) 1586 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.084391+0000 mon.c (mon.2) 402 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.162656+0000 mon.b (mon.1) 167 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:00 smithi187 bash[23415]: audit 2024-03-11T22:15:00.170054+0000 mon.a (mon.0) 1587 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: cluster 2024-03-11T22:15:00.021291+0000 mgr.y (mgr.14601) 276 : cluster 0 pgmap v299: 364 pgs: 40 unknown, 324 active+clean; 585 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-03-11T22:15:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.022037+0000 mon.c (mon.2) 401 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-11T22:15:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.025160+0000 mon.a (mon.0) 1580 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-11T22:15:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: cluster 2024-03-11T22:15:00.053405+0000 mon.a (mon.0) 1581 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: cluster 2024-03-11T22:15:00.069553+0000 mon.a (mon.0) 1582 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.071882+0000 mon.a (mon.0) 1583 : audit 1 from='client.46814 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:01.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.072302+0000 mon.a (mon.0) 1584 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]': finished 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.072535+0000 mon.a (mon.0) 1585 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: cluster 2024-03-11T22:15:00.081187+0000 mon.a (mon.0) 1586 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.084391+0000 mon.c (mon.2) 402 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.162656+0000 mon.b (mon.1) 167 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[28804]: audit 2024-03-11T22:15:00.170054+0000 mon.a (mon.0) 1587 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: cluster 2024-03-11T22:15:00.021291+0000 mgr.y (mgr.14601) 276 : cluster 0 pgmap v299: 364 pgs: 40 unknown, 324 active+clean; 585 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.022037+0000 mon.c (mon.2) 401 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-11T22:15:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.025160+0000 mon.a (mon.0) 1580 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: cluster 2024-03-11T22:15:00.053405+0000 mon.a (mon.0) 1581 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: cluster 2024-03-11T22:15:00.069553+0000 mon.a (mon.0) 1582 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.071882+0000 mon.a (mon.0) 1583 : audit 1 from='client.46814 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi049-64063-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.072302+0000 mon.a (mon.0) 1584 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-19", "mode": "writeback"}]': finished 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.072535+0000 mon.a (mon.0) 1585 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: cluster 2024-03-11T22:15:00.081187+0000 mon.a (mon.0) 1586 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.084391+0000 mon.c (mon.2) 402 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.162656+0000 mon.b (mon.1) 167 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:00 smithi049 bash[21434]: audit 2024-03-11T22:15:00.170054+0000 mon.a (mon.0) 1587 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:02.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: audit 2024-03-11T22:15:01.074561+0000 mon.a (mon.0) 1588 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: audit 2024-03-11T22:15:01.076670+0000 mon.b (mon.1) 168 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: cluster 2024-03-11T22:15:01.082216+0000 mon.a (mon.0) 1589 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: audit 2024-03-11T22:15:01.086255+0000 mon.a (mon.0) 1590 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: audit 2024-03-11T22:15:01.087226+0000 mon.a (mon.0) 1591 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: audit 2024-03-11T22:15:01.087925+0000 mon.c (mon.2) 403 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: cluster 2024-03-11T22:15:02.022360+0000 mgr.y (mgr.14601) 277 : cluster 0 pgmap v302: 324 pgs: 324 active+clean; 585 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: audit 2024-03-11T22:15:02.023122+0000 mon.c (mon.2) 404 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:02 smithi187 bash[23415]: audit 2024-03-11T22:15:02.026171+0000 mon.a (mon.0) 1592 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: audit 2024-03-11T22:15:01.074561+0000 mon.a (mon.0) 1588 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: audit 2024-03-11T22:15:01.076670+0000 mon.b (mon.1) 168 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: cluster 2024-03-11T22:15:01.082216+0000 mon.a (mon.0) 1589 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: audit 2024-03-11T22:15:01.086255+0000 mon.a (mon.0) 1590 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: audit 2024-03-11T22:15:01.087226+0000 mon.a (mon.0) 1591 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: audit 2024-03-11T22:15:01.087925+0000 mon.c (mon.2) 403 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: cluster 2024-03-11T22:15:02.022360+0000 mgr.y (mgr.14601) 277 : cluster 0 pgmap v302: 324 pgs: 324 active+clean; 585 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: audit 2024-03-11T22:15:02.023122+0000 mon.c (mon.2) 404 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:02.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[28804]: audit 2024-03-11T22:15:02.026171+0000 mon.a (mon.0) 1592 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: audit 2024-03-11T22:15:01.074561+0000 mon.a (mon.0) 1588 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: audit 2024-03-11T22:15:01.076670+0000 mon.b (mon.1) 168 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: cluster 2024-03-11T22:15:01.082216+0000 mon.a (mon.0) 1589 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: audit 2024-03-11T22:15:01.086255+0000 mon.a (mon.0) 1590 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]: dispatch 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: audit 2024-03-11T22:15:01.087226+0000 mon.a (mon.0) 1591 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: audit 2024-03-11T22:15:01.087925+0000 mon.c (mon.2) 403 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: cluster 2024-03-11T22:15:02.022360+0000 mgr.y (mgr.14601) 277 : cluster 0 pgmap v302: 324 pgs: 324 active+clean; 585 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: audit 2024-03-11T22:15:02.023122+0000 mon.c (mon.2) 404 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:02.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:02 smithi049 bash[21434]: audit 2024-03-11T22:15:02.026171+0000 mon.a (mon.0) 1592 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:03.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: cluster 2024-03-11T22:15:02.075706+0000 mon.a (mon.0) 1593 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:02.078420+0000 mon.a (mon.0) 1594 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]': finished 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:02.078674+0000 mon.a (mon.0) 1595 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:02.078796+0000 mon.a (mon.0) 1596 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: cluster 2024-03-11T22:15:02.090435+0000 mon.a (mon.0) 1597 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:02.093026+0000 mon.c (mon.2) 405 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:02.094730+0000 mon.a (mon.0) 1598 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:02.094739+0000 mon.c (mon.2) 406 : audit 1 from='client.? v1:172.21.15.49:0/3265055072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:02.106315+0000 mon.a (mon.0) 1599 : audit 1 from='client.46820 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:03.082335+0000 mon.a (mon.0) 1600 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: audit 2024-03-11T22:15:03.082496+0000 mon.a (mon.0) 1601 : audit 1 from='client.46820 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:03.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:03 smithi187 bash[23415]: cluster 2024-03-11T22:15:03.089859+0000 mon.a (mon.0) 1602 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-03-11T22:15:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: cluster 2024-03-11T22:15:02.075706+0000 mon.a (mon.0) 1593 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:02.078420+0000 mon.a (mon.0) 1594 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]': finished 2024-03-11T22:15:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:02.078674+0000 mon.a (mon.0) 1595 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:02.078796+0000 mon.a (mon.0) 1596 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-03-11T22:15:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: cluster 2024-03-11T22:15:02.090435+0000 mon.a (mon.0) 1597 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-03-11T22:15:04.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:02.093026+0000 mon.c (mon.2) 405 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:02.094730+0000 mon.a (mon.0) 1598 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:02.094739+0000 mon.c (mon.2) 406 : audit 1 from='client.? v1:172.21.15.49:0/3265055072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:02.106315+0000 mon.a (mon.0) 1599 : audit 1 from='client.46820 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:03.082335+0000 mon.a (mon.0) 1600 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: audit 2024-03-11T22:15:03.082496+0000 mon.a (mon.0) 1601 : audit 1 from='client.46820 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[21434]: cluster 2024-03-11T22:15:03.089859+0000 mon.a (mon.0) 1602 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: cluster 2024-03-11T22:15:02.075706+0000 mon.a (mon.0) 1593 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:02.078420+0000 mon.a (mon.0) 1594 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-19"}]': finished 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:02.078674+0000 mon.a (mon.0) 1595 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:02.078796+0000 mon.a (mon.0) 1596 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-03-11T22:15:04.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: cluster 2024-03-11T22:15:02.090435+0000 mon.a (mon.0) 1597 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-03-11T22:15:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:02.093026+0000 mon.c (mon.2) 405 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:02.094730+0000 mon.a (mon.0) 1598 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]: dispatch 2024-03-11T22:15:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:02.094739+0000 mon.c (mon.2) 406 : audit 1 from='client.? v1:172.21.15.49:0/3265055072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:02.106315+0000 mon.a (mon.0) 1599 : audit 1 from='client.46820 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:03.082335+0000 mon.a (mon.0) 1600 : audit 1 from='client.? v1:172.21.15.49:0/2442310188' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi049-64055-30"}]': finished 2024-03-11T22:15:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: audit 2024-03-11T22:15:03.082496+0000 mon.a (mon.0) 1601 : audit 1 from='client.46820 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi049-64063-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:04.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:03 smithi049 bash[28804]: cluster 2024-03-11T22:15:03.089859+0000 mon.a (mon.0) 1602 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-03-11T22:15:04.516 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:15:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:15:04.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:03.095931+0000 mon.c (mon.2) 407 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:04.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:03.588192+0000 mon.c (mon.2) 408 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:04.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:03.588763+0000 mon.a (mon.0) 1603 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:04.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:03.589567+0000 mon.c (mon.2) 409 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:04.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:03.589808+0000 mon.a (mon.0) 1604 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:04.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:03.590204+0000 mon.c (mon.2) 410 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:03.590445+0000 mon.a (mon.0) 1605 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: cluster 2024-03-11T22:15:04.025267+0000 mgr.y (mgr.14601) 278 : cluster 0 pgmap v305: 323 pgs: 323 active+clean; 584 KiB data, 542 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.025907+0000 mon.c (mon.2) 411 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.028778+0000 mon.a (mon.0) 1606 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.073327+0000 mon.c (mon.2) 412 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.086005+0000 mon.a (mon.0) 1607 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.086225+0000 mon.a (mon.0) 1608 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.092980+0000 mon.b (mon.1) 169 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: cluster 2024-03-11T22:15:04.094542+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.103147+0000 mon.a (mon.0) 1610 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.105746+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:04.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:04 smithi187 bash[23415]: audit 2024-03-11T22:15:04.124461+0000 mon.a (mon.0) 1611 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:03.095931+0000 mon.c (mon.2) 407 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:05.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:03.588192+0000 mon.c (mon.2) 408 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:03.588763+0000 mon.a (mon.0) 1603 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:03.589567+0000 mon.c (mon.2) 409 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:03.589808+0000 mon.a (mon.0) 1604 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:03.590204+0000 mon.c (mon.2) 410 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:05.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:03.590445+0000 mon.a (mon.0) 1605 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: cluster 2024-03-11T22:15:04.025267+0000 mgr.y (mgr.14601) 278 : cluster 0 pgmap v305: 323 pgs: 323 active+clean; 584 KiB data, 542 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.025907+0000 mon.c (mon.2) 411 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.028778+0000 mon.a (mon.0) 1606 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.073327+0000 mon.c (mon.2) 412 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.086005+0000 mon.a (mon.0) 1607 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.086225+0000 mon.a (mon.0) 1608 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.092980+0000 mon.b (mon.1) 169 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: cluster 2024-03-11T22:15:04.094542+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-03-11T22:15:05.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:03.095931+0000 mon.c (mon.2) 407 : audit 0 from='client.? v1:172.21.15.49:0/3346602376' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:03.588192+0000 mon.c (mon.2) 408 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:03.588763+0000 mon.a (mon.0) 1603 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:03.589567+0000 mon.c (mon.2) 409 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:03.589808+0000 mon.a (mon.0) 1604 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:03.590204+0000 mon.c (mon.2) 410 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:03.590445+0000 mon.a (mon.0) 1605 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: cluster 2024-03-11T22:15:04.025267+0000 mgr.y (mgr.14601) 278 : cluster 0 pgmap v305: 323 pgs: 323 active+clean; 584 KiB data, 542 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.025907+0000 mon.c (mon.2) 411 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.028778+0000 mon.a (mon.0) 1606 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.073327+0000 mon.c (mon.2) 412 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.086005+0000 mon.a (mon.0) 1607 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi049-64055-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.086225+0000 mon.a (mon.0) 1608 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi049-64092-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.092980+0000 mon.b (mon.1) 169 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:05.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: cluster 2024-03-11T22:15:04.094542+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-03-11T22:15:05.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.103147+0000 mon.a (mon.0) 1610 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:05.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.105746+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[28804]: audit 2024-03-11T22:15:04.124461+0000 mon.a (mon.0) 1611 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.103147+0000 mon.a (mon.0) 1610 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:05.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.105746+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:04 smithi049 bash[21434]: audit 2024-03-11T22:15:04.124461+0000 mon.a (mon.0) 1611 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:05.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:04.619014+0000 mon.a (mon.0) 1612 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:05.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:04.624411+0000 mon.a (mon.0) 1613 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:05.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:04.624884+0000 mon.a (mon.0) 1614 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi049-64092-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:04.819981+0000 mon.c (mon.2) 414 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:04.821793+0000 mon.c (mon.2) 415 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:04.833098+0000 mon.a (mon.0) 1615 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:05.091045+0000 mon.a (mon.0) 1616 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:05.091299+0000 mon.a (mon.0) 1617 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi049-64092-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:05.150352+0000 mon.b (mon.1) 170 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: cluster 2024-03-11T22:15:05.564267+0000 mon.a (mon.0) 1618 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:05.565560+0000 mon.a (mon.0) 1619 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi049-64092-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:05.565755+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.49:0/559839831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:05.566957+0000 mon.a (mon.0) 1620 : audit 1 from='client.46832 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:05 smithi187 bash[23415]: audit 2024-03-11T22:15:05.572045+0000 mon.a (mon.0) 1621 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:06.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:04.619014+0000 mon.a (mon.0) 1612 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:06.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:04.624411+0000 mon.a (mon.0) 1613 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:06.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:04.624884+0000 mon.a (mon.0) 1614 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi049-64092-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:06.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:04.819981+0000 mon.c (mon.2) 414 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:15:06.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:04.821793+0000 mon.c (mon.2) 415 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:15:06.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:04.833098+0000 mon.a (mon.0) 1615 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:05.091045+0000 mon.a (mon.0) 1616 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:05.091299+0000 mon.a (mon.0) 1617 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi049-64092-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:05.150352+0000 mon.b (mon.1) 170 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: cluster 2024-03-11T22:15:05.564267+0000 mon.a (mon.0) 1618 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:05.565560+0000 mon.a (mon.0) 1619 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi049-64092-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:05.565755+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.49:0/559839831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:05.566957+0000 mon.a (mon.0) 1620 : audit 1 from='client.46832 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[28804]: audit 2024-03-11T22:15:05.572045+0000 mon.a (mon.0) 1621 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:04.619014+0000 mon.a (mon.0) 1612 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:04.624411+0000 mon.a (mon.0) 1613 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:06.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:04.624884+0000 mon.a (mon.0) 1614 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi049-64092-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:04.819981+0000 mon.c (mon.2) 414 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:04.821793+0000 mon.c (mon.2) 415 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:04.833098+0000 mon.a (mon.0) 1615 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:05.091045+0000 mon.a (mon.0) 1616 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:05.091299+0000 mon.a (mon.0) 1617 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi049-64092-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:05.150352+0000 mon.b (mon.1) 170 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: cluster 2024-03-11T22:15:05.564267+0000 mon.a (mon.0) 1618 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:05.565560+0000 mon.a (mon.0) 1619 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi049-64092-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:05.565755+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.49:0/559839831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:05.566957+0000 mon.a (mon.0) 1620 : audit 1 from='client.46832 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:06.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:05 smithi049 bash[21434]: audit 2024-03-11T22:15:05.572045+0000 mon.a (mon.0) 1621 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:07.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:07 smithi187 bash[23415]: cluster 2024-03-11T22:15:06.026246+0000 mgr.y (mgr.14601) 279 : cluster 0 pgmap v308: 324 pgs: 64 unknown, 260 active+clean; 583 KiB data, 542 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:15:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:07 smithi187 bash[23415]: audit 2024-03-11T22:15:06.095491+0000 mon.a (mon.0) 1622 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:07 smithi187 bash[23415]: audit 2024-03-11T22:15:06.095785+0000 mon.a (mon.0) 1623 : audit 1 from='client.46832 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:07 smithi187 bash[23415]: audit 2024-03-11T22:15:06.096050+0000 mon.a (mon.0) 1624 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:07 smithi187 bash[23415]: audit 2024-03-11T22:15:06.097655+0000 mon.b (mon.1) 171 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:07 smithi187 bash[23415]: cluster 2024-03-11T22:15:06.576214+0000 mon.a (mon.0) 1625 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-03-11T22:15:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:07 smithi187 bash[23415]: audit 2024-03-11T22:15:06.578566+0000 mon.a (mon.0) 1626 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[21434]: cluster 2024-03-11T22:15:06.026246+0000 mgr.y (mgr.14601) 279 : cluster 0 pgmap v308: 324 pgs: 64 unknown, 260 active+clean; 583 KiB data, 542 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[21434]: audit 2024-03-11T22:15:06.095491+0000 mon.a (mon.0) 1622 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[21434]: audit 2024-03-11T22:15:06.095785+0000 mon.a (mon.0) 1623 : audit 1 from='client.46832 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[21434]: audit 2024-03-11T22:15:06.096050+0000 mon.a (mon.0) 1624 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[21434]: audit 2024-03-11T22:15:06.097655+0000 mon.b (mon.1) 171 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[21434]: cluster 2024-03-11T22:15:06.576214+0000 mon.a (mon.0) 1625 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[21434]: audit 2024-03-11T22:15:06.578566+0000 mon.a (mon.0) 1626 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[28804]: cluster 2024-03-11T22:15:06.026246+0000 mgr.y (mgr.14601) 279 : cluster 0 pgmap v308: 324 pgs: 64 unknown, 260 active+clean; 583 KiB data, 542 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:15:07.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[28804]: audit 2024-03-11T22:15:06.095491+0000 mon.a (mon.0) 1622 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi049-64055-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:07.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[28804]: audit 2024-03-11T22:15:06.095785+0000 mon.a (mon.0) 1623 : audit 1 from='client.46832 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:07.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[28804]: audit 2024-03-11T22:15:06.096050+0000 mon.a (mon.0) 1624 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:07.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[28804]: audit 2024-03-11T22:15:06.097655+0000 mon.b (mon.1) 171 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:07.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[28804]: cluster 2024-03-11T22:15:06.576214+0000 mon.a (mon.0) 1625 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-03-11T22:15:07.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:07 smithi049 bash[28804]: audit 2024-03-11T22:15:06.578566+0000 mon.a (mon.0) 1626 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout:2 expected=2 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:de5d7c5f:::12:head 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:de5d7c5f:::12:head expected=16:de5d7c5f:::12:head 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:de5d7c5f:::12:head -> 12 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=12 expected=12 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:02547ec2:::1:head 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:02547ec2:::1:head expected=16:02547ec2:::1:head 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:02547ec2:::1:head -> 1 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=1 expected=1 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:c4fdafeb:::6:head 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:c4fdafeb:::6:head expected=16:c4fdafeb:::6:head 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:c4fdafeb:::6:head -> 6 2024-03-11T22:15:08.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=6 expected=6 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:bd63b0f1:::8:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:bd63b0f1:::8:head expected=16:bd63b0f1:::8:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:bd63b0f1:::8:head -> 8 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=8 expected=8 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:b29083e3:::5:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:b29083e3:::5:head expected=16:b29083e3:::5:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:b29083e3:::5:head -> 5 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=5 expected=5 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:89d3ae78:::11:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:89d3ae78:::11:head expected=16:89d3ae78:::11:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:89d3ae78:::11:head -> 11 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=11 expected=11 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:863748b0:::15:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:863748b0:::15:head expected=16:863748b0:::15:head 2024-03-11T22:15:08.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:863748b0:::15:head -> 15 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=15 expected=15 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : seek to 16:52ea6a34:::10:head 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : cursor()=16:52ea6a34:::10:head expected=16:52ea6a34:::10:head 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: > 16:52ea6a34:::10:head -> 10 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: : entry=10 expected=10 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (261 ms) 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (125532 ms) 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: split 0/5 -> MIN 16:33333333::::head 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: split 1/5 -> 16:33333333::::head 16:66666666::::head 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: split 2/5 -> 16:66666666::::head 16:99999999::::head 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: split 3/5 -> 16:99999999::::head 16:cccccccc::::head 2024-03-11T22:15:08.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: split 4/5 -> 16:cccccccc::::head MAX 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (8036 ms) 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] 7 tests from LibRadosList (135797 ms total) 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1082 ms) 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset foo1,foo2,foo3 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo1 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo2 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo3 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset foo1,foo4,foo5 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo4 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo5 2024-03-11T22:15:08.222 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo1 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset foo6,foo7 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo7 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: foo6 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns1:foo4 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns1:foo5 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns2:foo7 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns2:foo6 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: ns1:foo1 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: :foo1 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: :foo2 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: :foo3 2024-03-11T22:15:08.223 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (41 ms) 2024-03-11T22:15:08.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: cluster 2024-03-11T22:15:07.031981+0000 mon.a (mon.0) 1627 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:08.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: audit 2024-03-11T22:15:07.099229+0000 mon.a (mon.0) 1628 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi049-64092-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:08.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: audit 2024-03-11T22:15:07.099488+0000 mon.a (mon.0) 1629 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]': finished 2024-03-11T22:15:08.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: cluster 2024-03-11T22:15:07.107221+0000 mon.a (mon.0) 1630 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-03-11T22:15:08.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: audit 2024-03-11T22:15:07.107648+0000 mon.b (mon.1) 172 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]: dispatch 2024-03-11T22:15:08.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: audit 2024-03-11T22:15:07.108894+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.49:0/3404680317' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:08.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: audit 2024-03-11T22:15:07.109932+0000 mon.a (mon.0) 1631 : audit 1 from='client.46841 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:08.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[23415]: audit 2024-03-11T22:15:07.116059+0000 mon.a (mon.0) 1632 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]: dispatch 2024-03-11T22:15:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: cluster 2024-03-11T22:15:07.031981+0000 mon.a (mon.0) 1627 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: audit 2024-03-11T22:15:07.099229+0000 mon.a (mon.0) 1628 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi049-64092-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:08.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: audit 2024-03-11T22:15:07.099488+0000 mon.a (mon.0) 1629 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]': finished 2024-03-11T22:15:08.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: cluster 2024-03-11T22:15:07.107221+0000 mon.a (mon.0) 1630 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-03-11T22:15:08.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: audit 2024-03-11T22:15:07.107648+0000 mon.b (mon.1) 172 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]: dispatch 2024-03-11T22:15:08.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: audit 2024-03-11T22:15:07.108894+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.49:0/3404680317' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:08.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: audit 2024-03-11T22:15:07.109932+0000 mon.a (mon.0) 1631 : audit 1 from='client.46841 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:08.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[21434]: audit 2024-03-11T22:15:07.116059+0000 mon.a (mon.0) 1632 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]: dispatch 2024-03-11T22:15:08.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: cluster 2024-03-11T22:15:07.031981+0000 mon.a (mon.0) 1627 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:08.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: audit 2024-03-11T22:15:07.099229+0000 mon.a (mon.0) 1628 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi049-64092-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:08.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: audit 2024-03-11T22:15:07.099488+0000 mon.a (mon.0) 1629 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-21"}]': finished 2024-03-11T22:15:08.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: cluster 2024-03-11T22:15:07.107221+0000 mon.a (mon.0) 1630 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-03-11T22:15:08.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: audit 2024-03-11T22:15:07.107648+0000 mon.b (mon.1) 172 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]: dispatch 2024-03-11T22:15:08.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: audit 2024-03-11T22:15:07.108894+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.49:0/3404680317' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:08.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: audit 2024-03-11T22:15:07.109932+0000 mon.a (mon.0) 1631 : audit 1 from='client.46841 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:08.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:08 smithi049 bash[28804]: audit 2024-03-11T22:15:07.116059+0000 mon.a (mon.0) 1632 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]: dispatch 2024-03-11T22:15:08.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:15:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: cluster 2024-03-11T22:15:08.027308+0000 mgr.y (mgr.14601) 280 : cluster 0 pgmap v311: 372 pgs: 112 unknown, 260 active+clean; 583 KiB data, 542 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: cluster 2024-03-11T22:15:08.100925+0000 mon.a (mon.0) 1633 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: audit 2024-03-11T22:15:08.108870+0000 mon.a (mon.0) 1634 : audit 1 from='client.46841 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: audit 2024-03-11T22:15:08.109153+0000 mon.a (mon.0) 1635 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]': finished 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: cluster 2024-03-11T22:15:08.116350+0000 mon.a (mon.0) 1636 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: audit 2024-03-11T22:15:08.121504+0000 mon.c (mon.2) 418 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: audit 2024-03-11T22:15:08.123526+0000 mon.a (mon.0) 1637 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: audit 2024-03-11T22:15:08.216324+0000 mon.b (mon.1) 173 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:09.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:09 smithi187 bash[23415]: audit 2024-03-11T22:15:08.655766+0000 mon.a (mon.0) 1638 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: cluster 2024-03-11T22:15:08.027308+0000 mgr.y (mgr.14601) 280 : cluster 0 pgmap v311: 372 pgs: 112 unknown, 260 active+clean; 583 KiB data, 542 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: cluster 2024-03-11T22:15:08.100925+0000 mon.a (mon.0) 1633 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: audit 2024-03-11T22:15:08.108870+0000 mon.a (mon.0) 1634 : audit 1 from='client.46841 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: audit 2024-03-11T22:15:08.109153+0000 mon.a (mon.0) 1635 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]': finished 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: cluster 2024-03-11T22:15:08.116350+0000 mon.a (mon.0) 1636 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: audit 2024-03-11T22:15:08.121504+0000 mon.c (mon.2) 418 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: audit 2024-03-11T22:15:08.123526+0000 mon.a (mon.0) 1637 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: audit 2024-03-11T22:15:08.216324+0000 mon.b (mon.1) 173 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:09.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[21434]: audit 2024-03-11T22:15:08.655766+0000 mon.a (mon.0) 1638 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: cluster 2024-03-11T22:15:08.027308+0000 mgr.y (mgr.14601) 280 : cluster 0 pgmap v311: 372 pgs: 112 unknown, 260 active+clean; 583 KiB data, 542 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: cluster 2024-03-11T22:15:08.100925+0000 mon.a (mon.0) 1633 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: audit 2024-03-11T22:15:08.108870+0000 mon.a (mon.0) 1634 : audit 1 from='client.46841 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: audit 2024-03-11T22:15:08.109153+0000 mon.a (mon.0) 1635 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-21", "mode": "writeback"}]': finished 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: cluster 2024-03-11T22:15:08.116350+0000 mon.a (mon.0) 1636 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: audit 2024-03-11T22:15:08.121504+0000 mon.c (mon.2) 418 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: audit 2024-03-11T22:15:08.123526+0000 mon.a (mon.0) 1637 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: audit 2024-03-11T22:15:08.216324+0000 mon.b (mon.1) 173 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:09.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:09 smithi049 bash[28804]: audit 2024-03-11T22:15:08.655766+0000 mon.a (mon.0) 1638 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:10.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:08.668505+0000 mgr.y (mgr.14601) 281 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:10.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.112541+0000 mon.a (mon.0) 1639 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:10.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.112754+0000 mon.a (mon.0) 1640 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:10.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.114355+0000 mon.b (mon.1) 174 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:10.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: cluster 2024-03-11T22:15:09.120071+0000 mon.a (mon.0) 1641 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-03-11T22:15:10.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.126093+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:10.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.127308+0000 mon.a (mon.0) 1642 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.127793+0000 mon.a (mon.0) 1643 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.130253+0000 mon.a (mon.0) 1644 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.131516+0000 mon.a (mon.0) 1645 : audit 1 from='client.? v1:172.21.15.49:0/356291653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.884238+0000 mon.a (mon.0) 1646 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: audit 2024-03-11T22:15:09.887249+0000 mon.c (mon.2) 420 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[21434]: cluster 2024-03-11T22:15:10.028420+0000 mgr.y (mgr.14601) 282 : cluster 0 pgmap v314: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 546 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:08.668505+0000 mgr.y (mgr.14601) 281 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.112541+0000 mon.a (mon.0) 1639 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.112754+0000 mon.a (mon.0) 1640 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.114355+0000 mon.b (mon.1) 174 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:10.042 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: cluster 2024-03-11T22:15:09.120071+0000 mon.a (mon.0) 1641 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.126093+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.127308+0000 mon.a (mon.0) 1642 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.127793+0000 mon.a (mon.0) 1643 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.130253+0000 mon.a (mon.0) 1644 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.131516+0000 mon.a (mon.0) 1645 : audit 1 from='client.? v1:172.21.15.49:0/356291653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.884238+0000 mon.a (mon.0) 1646 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: audit 2024-03-11T22:15:09.887249+0000 mon.c (mon.2) 420 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:10.043 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:10 smithi049 bash[28804]: cluster 2024-03-11T22:15:10.028420+0000 mgr.y (mgr.14601) 282 : cluster 0 pgmap v314: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 546 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:08.668505+0000 mgr.y (mgr.14601) 281 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.112541+0000 mon.a (mon.0) 1639 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.112754+0000 mon.a (mon.0) 1640 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.114355+0000 mon.b (mon.1) 174 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: cluster 2024-03-11T22:15:09.120071+0000 mon.a (mon.0) 1641 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.126093+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.49:0/427490617' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.127308+0000 mon.a (mon.0) 1642 : audit 1 from='client.46826 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]: dispatch 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.127793+0000 mon.a (mon.0) 1643 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.130253+0000 mon.a (mon.0) 1644 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]: dispatch 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.131516+0000 mon.a (mon.0) 1645 : audit 1 from='client.? v1:172.21.15.49:0/356291653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.884238+0000 mon.a (mon.0) 1646 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: audit 2024-03-11T22:15:09.887249+0000 mon.c (mon.2) 420 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:10 smithi187 bash[23415]: cluster 2024-03-11T22:15:10.028420+0000 mgr.y (mgr.14601) 282 : cluster 0 pgmap v314: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 546 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:15:11.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: cluster 2024-03-11T22:15:10.114199+0000 mon.a (mon.0) 1647 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.116800+0000 mon.a (mon.0) 1648 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.117002+0000 mon.a (mon.0) 1649 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.117174+0000 mon.a (mon.0) 1650 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]': finished 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.117390+0000 mon.a (mon.0) 1651 : audit 1 from='client.? v1:172.21.15.49:0/356291653' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: cluster 2024-03-11T22:15:10.126145+0000 mon.a (mon.0) 1652 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.136881+0000 mon.a (mon.0) 1653 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.186544+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.187152+0000 mon.a (mon.0) 1654 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.188171+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.188476+0000 mon.a (mon.0) 1655 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.188951+0000 mon.c (mon.2) 423 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:11 smithi187 bash[23415]: audit 2024-03-11T22:15:10.189227+0000 mon.a (mon.0) 1656 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: cluster 2024-03-11T22:15:10.114199+0000 mon.a (mon.0) 1647 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.116800+0000 mon.a (mon.0) 1648 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.117002+0000 mon.a (mon.0) 1649 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.117174+0000 mon.a (mon.0) 1650 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]': finished 2024-03-11T22:15:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.117390+0000 mon.a (mon.0) 1651 : audit 1 from='client.? v1:172.21.15.49:0/356291653' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:11.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: cluster 2024-03-11T22:15:10.126145+0000 mon.a (mon.0) 1652 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.136881+0000 mon.a (mon.0) 1653 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.186544+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.187152+0000 mon.a (mon.0) 1654 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.188171+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.188476+0000 mon.a (mon.0) 1655 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.188951+0000 mon.c (mon.2) 423 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[21434]: audit 2024-03-11T22:15:10.189227+0000 mon.a (mon.0) 1656 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: cluster 2024-03-11T22:15:10.114199+0000 mon.a (mon.0) 1647 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.116800+0000 mon.a (mon.0) 1648 : audit 1 from='client.46826 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi049-64055-31"}]': finished 2024-03-11T22:15:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.117002+0000 mon.a (mon.0) 1649 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.117174+0000 mon.a (mon.0) 1650 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-21"}]': finished 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.117390+0000 mon.a (mon.0) 1651 : audit 1 from='client.? v1:172.21.15.49:0/356291653' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi049-64063-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: cluster 2024-03-11T22:15:10.126145+0000 mon.a (mon.0) 1652 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.136881+0000 mon.a (mon.0) 1653 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]: dispatch 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.186544+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.187152+0000 mon.a (mon.0) 1654 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.188171+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.188476+0000 mon.a (mon.0) 1655 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.188951+0000 mon.c (mon.2) 423 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:11.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:11 smithi049 bash[28804]: audit 2024-03-11T22:15:10.189227+0000 mon.a (mon.0) 1656 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:12 smithi187 bash[23415]: audit 2024-03-11T22:15:11.120265+0000 mon.a (mon.0) 1657 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:12.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:12 smithi187 bash[23415]: audit 2024-03-11T22:15:11.120458+0000 mon.a (mon.0) 1658 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:12 smithi187 bash[23415]: cluster 2024-03-11T22:15:11.127549+0000 mon.a (mon.0) 1659 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-03-11T22:15:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:12 smithi187 bash[23415]: audit 2024-03-11T22:15:11.130425+0000 mon.c (mon.2) 424 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:12 smithi187 bash[23415]: audit 2024-03-11T22:15:11.601485+0000 mon.a (mon.0) 1660 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:12 smithi187 bash[23415]: cluster 2024-03-11T22:15:12.029336+0000 mgr.y (mgr.14601) 283 : cluster 0 pgmap v317: 324 pgs: 324 active+clean; 584 KiB data, 546 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:15:12.516 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[21434]: audit 2024-03-11T22:15:11.120265+0000 mon.a (mon.0) 1657 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[21434]: audit 2024-03-11T22:15:11.120458+0000 mon.a (mon.0) 1658 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[21434]: cluster 2024-03-11T22:15:11.127549+0000 mon.a (mon.0) 1659 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[21434]: audit 2024-03-11T22:15:11.130425+0000 mon.c (mon.2) 424 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[21434]: audit 2024-03-11T22:15:11.601485+0000 mon.a (mon.0) 1660 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[21434]: cluster 2024-03-11T22:15:12.029336+0000 mgr.y (mgr.14601) 283 : cluster 0 pgmap v317: 324 pgs: 324 active+clean; 584 KiB data, 546 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[28804]: audit 2024-03-11T22:15:11.120265+0000 mon.a (mon.0) 1657 : audit 1 from='client.? v1:172.21.15.49:0/49748074' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi049-64092-2"}]': finished 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[28804]: audit 2024-03-11T22:15:11.120458+0000 mon.a (mon.0) 1658 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi049-64055-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[28804]: cluster 2024-03-11T22:15:11.127549+0000 mon.a (mon.0) 1659 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[28804]: audit 2024-03-11T22:15:11.130425+0000 mon.c (mon.2) 424 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:12.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[28804]: audit 2024-03-11T22:15:11.601485+0000 mon.a (mon.0) 1660 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:12.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:12 smithi049 bash[28804]: cluster 2024-03-11T22:15:12.029336+0000 mgr.y (mgr.14601) 283 : cluster 0 pgmap v317: 324 pgs: 324 active+clean; 584 KiB data, 546 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:15:13.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:13 smithi187 bash[23415]: cluster 2024-03-11T22:15:12.120367+0000 mon.a (mon.0) 1661 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:13.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:13 smithi187 bash[23415]: audit 2024-03-11T22:15:12.171231+0000 mon.b (mon.1) 175 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:13 smithi187 bash[23415]: cluster 2024-03-11T22:15:12.614595+0000 mon.a (mon.0) 1662 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-03-11T22:15:13.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:13 smithi187 bash[23415]: audit 2024-03-11T22:15:12.616000+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.49:0/2057203881' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:13 smithi187 bash[23415]: audit 2024-03-11T22:15:12.622183+0000 mon.a (mon.0) 1663 : audit 1 from='client.46859 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:13 smithi187 bash[23415]: audit 2024-03-11T22:15:12.622705+0000 mon.a (mon.0) 1664 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[21434]: cluster 2024-03-11T22:15:12.120367+0000 mon.a (mon.0) 1661 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[21434]: audit 2024-03-11T22:15:12.171231+0000 mon.b (mon.1) 175 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[21434]: cluster 2024-03-11T22:15:12.614595+0000 mon.a (mon.0) 1662 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[21434]: audit 2024-03-11T22:15:12.616000+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.49:0/2057203881' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[21434]: audit 2024-03-11T22:15:12.622183+0000 mon.a (mon.0) 1663 : audit 1 from='client.46859 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[21434]: audit 2024-03-11T22:15:12.622705+0000 mon.a (mon.0) 1664 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[28804]: cluster 2024-03-11T22:15:12.120367+0000 mon.a (mon.0) 1661 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[28804]: audit 2024-03-11T22:15:12.171231+0000 mon.b (mon.1) 175 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[28804]: cluster 2024-03-11T22:15:12.614595+0000 mon.a (mon.0) 1662 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-03-11T22:15:13.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[28804]: audit 2024-03-11T22:15:12.616000+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.49:0/2057203881' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[28804]: audit 2024-03-11T22:15:12.622183+0000 mon.a (mon.0) 1663 : audit 1 from='client.46859 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:13.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:13 smithi049 bash[28804]: audit 2024-03-11T22:15:12.622705+0000 mon.a (mon.0) 1664 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:14.165 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 1 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 10 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 13 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 7 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 14 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 0 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 15 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 11 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 5 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 8 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 6 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 3 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 4 0 2024-03-11T22:15:14.166 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 12 0 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 9 0 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 2 0 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (56 ms) 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] 3 tests from LibRadosListEC (1180 ms total) 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2572 ms) 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] 1 test from LibRadosListNP (2572 ms total) 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [----------] Global test environment tear-down 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [==========] 11 tests from 3 test suites ran. (161957 ms total) 2024-03-11T22:15:14.167 INFO:tasks.workunit.client.0.smithi049.stdout: api_list: [ PASSED ] 11 tests. 2024-03-11T22:15:14.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:14 smithi187 bash[23415]: audit 2024-03-11T22:15:13.150712+0000 mon.a (mon.0) 1665 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:14.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:14 smithi187 bash[23415]: audit 2024-03-11T22:15:13.151005+0000 mon.a (mon.0) 1666 : audit 1 from='client.46859 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:14.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:14 smithi187 bash[23415]: audit 2024-03-11T22:15:13.151263+0000 mon.a (mon.0) 1667 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:14.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:14 smithi187 bash[23415]: cluster 2024-03-11T22:15:13.158982+0000 mon.a (mon.0) 1668 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-03-11T22:15:14.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:14 smithi187 bash[23415]: audit 2024-03-11T22:15:13.230670+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.49:0/2057203881' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-11T22:15:14.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:14 smithi187 bash[23415]: audit 2024-03-11T22:15:13.669069+0000 mon.a (mon.0) 1669 : audit 1 from='client.46859 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-11T22:15:14.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:14 smithi187 bash[23415]: cluster 2024-03-11T22:15:14.032135+0000 mgr.y (mgr.14601) 284 : cluster 0 pgmap v320: 332 pgs: 8 creating+peering, 324 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:15:14.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:15:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:15:14.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21434]: audit 2024-03-11T22:15:13.150712+0000 mon.a (mon.0) 1665 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:14.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21434]: audit 2024-03-11T22:15:13.151005+0000 mon.a (mon.0) 1666 : audit 1 from='client.46859 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:14.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21434]: audit 2024-03-11T22:15:13.151263+0000 mon.a (mon.0) 1667 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:14.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21434]: cluster 2024-03-11T22:15:13.158982+0000 mon.a (mon.0) 1668 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-03-11T22:15:14.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21434]: audit 2024-03-11T22:15:13.230670+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.49:0/2057203881' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-11T22:15:14.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21434]: audit 2024-03-11T22:15:13.669069+0000 mon.a (mon.0) 1669 : audit 1 from='client.46859 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[21434]: cluster 2024-03-11T22:15:14.032135+0000 mgr.y (mgr.14601) 284 : cluster 0 pgmap v320: 332 pgs: 8 creating+peering, 324 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[28804]: audit 2024-03-11T22:15:13.150712+0000 mon.a (mon.0) 1665 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi049-64055-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[28804]: audit 2024-03-11T22:15:13.151005+0000 mon.a (mon.0) 1666 : audit 1 from='client.46859 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64092-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[28804]: audit 2024-03-11T22:15:13.151263+0000 mon.a (mon.0) 1667 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[28804]: cluster 2024-03-11T22:15:13.158982+0000 mon.a (mon.0) 1668 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[28804]: audit 2024-03-11T22:15:13.230670+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.49:0/2057203881' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[28804]: audit 2024-03-11T22:15:13.669069+0000 mon.a (mon.0) 1669 : audit 1 from='client.46859 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-11T22:15:14.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:14 smithi049 bash[28804]: cluster 2024-03-11T22:15:14.032135+0000 mgr.y (mgr.14601) 284 : cluster 0 pgmap v320: 332 pgs: 8 creating+peering, 324 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:14.154887+0000 mon.a (mon.0) 1670 : audit 1 from='client.46859 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: cluster 2024-03-11T22:15:14.165689+0000 mon.a (mon.0) 1671 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:14.181342+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.49:0/1979380842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:14.203991+0000 mon.a (mon.0) 1672 : audit 1 from='client.46865 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:14.227559+0000 mon.b (mon.1) 176 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:14.235014+0000 mon.a (mon.0) 1673 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:15.158192+0000 mon.a (mon.0) 1674 : audit 1 from='client.46865 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:15.158748+0000 mon.a (mon.0) 1675 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:15.161239+0000 mon.b (mon.1) 177 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: cluster 2024-03-11T22:15:15.168096+0000 mon.a (mon.0) 1676 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-03-11T22:15:15.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:15.171378+0000 mon.c (mon.2) 428 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:15.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:15.171456+0000 mon.a (mon.0) 1677 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:15.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:15 smithi187 bash[23415]: audit 2024-03-11T22:15:15.172206+0000 mon.a (mon.0) 1678 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:14.154887+0000 mon.a (mon.0) 1670 : audit 1 from='client.46859 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-03-11T22:15:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: cluster 2024-03-11T22:15:14.165689+0000 mon.a (mon.0) 1671 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-03-11T22:15:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:14.181342+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.49:0/1979380842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:14.203991+0000 mon.a (mon.0) 1672 : audit 1 from='client.46865 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:15.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:14.227559+0000 mon.b (mon.1) 176 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:14.235014+0000 mon.a (mon.0) 1673 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:15.158192+0000 mon.a (mon.0) 1674 : audit 1 from='client.46865 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:15.158748+0000 mon.a (mon.0) 1675 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:15.161239+0000 mon.b (mon.1) 177 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: cluster 2024-03-11T22:15:15.168096+0000 mon.a (mon.0) 1676 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:15.171378+0000 mon.c (mon.2) 428 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:15.171456+0000 mon.a (mon.0) 1677 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[21434]: audit 2024-03-11T22:15:15.172206+0000 mon.a (mon.0) 1678 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:14.154887+0000 mon.a (mon.0) 1670 : audit 1 from='client.46859 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi049-64092-3","pool2":"test-rados-api-smithi049-64092-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: cluster 2024-03-11T22:15:14.165689+0000 mon.a (mon.0) 1671 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:14.181342+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.49:0/1979380842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:15.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:14.203991+0000 mon.a (mon.0) 1672 : audit 1 from='client.46865 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:14.227559+0000 mon.b (mon.1) 176 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:14.235014+0000 mon.a (mon.0) 1673 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:15.158192+0000 mon.a (mon.0) 1674 : audit 1 from='client.46865 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:15.158748+0000 mon.a (mon.0) 1675 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:15.161239+0000 mon.b (mon.1) 177 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: cluster 2024-03-11T22:15:15.168096+0000 mon.a (mon.0) 1676 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:15.171378+0000 mon.c (mon.2) 428 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:15.171456+0000 mon.a (mon.0) 1677 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:15.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:15 smithi049 bash[28804]: audit 2024-03-11T22:15:15.172206+0000 mon.a (mon.0) 1678 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:16.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: cluster 2024-03-11T22:15:16.032993+0000 mgr.y (mgr.14601) 285 : cluster 0 pgmap v323: 324 pgs: 32 unknown, 292 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: audit 2024-03-11T22:15:16.162023+0000 mon.a (mon.0) 1679 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]': finished 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: audit 2024-03-11T22:15:16.162315+0000 mon.a (mon.0) 1680 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: audit 2024-03-11T22:15:16.162727+0000 mon.b (mon.1) 178 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]: dispatch 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: audit 2024-03-11T22:15:16.170454+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: cluster 2024-03-11T22:15:16.174461+0000 mon.a (mon.0) 1681 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: audit 2024-03-11T22:15:16.185436+0000 mon.a (mon.0) 1682 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: audit 2024-03-11T22:15:16.188319+0000 mon.a (mon.0) 1683 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]: dispatch 2024-03-11T22:15:16.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:16 smithi187 bash[23415]: audit 2024-03-11T22:15:16.189175+0000 mon.a (mon.0) 1684 : audit 1 from='client.? v1:172.21.15.49:0/2776853608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: cluster 2024-03-11T22:15:16.032993+0000 mgr.y (mgr.14601) 285 : cluster 0 pgmap v323: 324 pgs: 32 unknown, 292 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: audit 2024-03-11T22:15:16.162023+0000 mon.a (mon.0) 1679 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]': finished 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: audit 2024-03-11T22:15:16.162315+0000 mon.a (mon.0) 1680 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: audit 2024-03-11T22:15:16.162727+0000 mon.b (mon.1) 178 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]: dispatch 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: audit 2024-03-11T22:15:16.170454+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: cluster 2024-03-11T22:15:16.174461+0000 mon.a (mon.0) 1681 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: audit 2024-03-11T22:15:16.185436+0000 mon.a (mon.0) 1682 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: audit 2024-03-11T22:15:16.188319+0000 mon.a (mon.0) 1683 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]: dispatch 2024-03-11T22:15:16.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[21434]: audit 2024-03-11T22:15:16.189175+0000 mon.a (mon.0) 1684 : audit 1 from='client.? v1:172.21.15.49:0/2776853608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: cluster 2024-03-11T22:15:16.032993+0000 mgr.y (mgr.14601) 285 : cluster 0 pgmap v323: 324 pgs: 32 unknown, 292 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: audit 2024-03-11T22:15:16.162023+0000 mon.a (mon.0) 1679 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-23"}]': finished 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: audit 2024-03-11T22:15:16.162315+0000 mon.a (mon.0) 1680 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: audit 2024-03-11T22:15:16.162727+0000 mon.b (mon.1) 178 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]: dispatch 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: audit 2024-03-11T22:15:16.170454+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.49:0/2747156418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: cluster 2024-03-11T22:15:16.174461+0000 mon.a (mon.0) 1681 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: audit 2024-03-11T22:15:16.185436+0000 mon.a (mon.0) 1682 : audit 1 from='client.46853 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]: dispatch 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: audit 2024-03-11T22:15:16.188319+0000 mon.a (mon.0) 1683 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]: dispatch 2024-03-11T22:15:16.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:16 smithi049 bash[28804]: audit 2024-03-11T22:15:16.189175+0000 mon.a (mon.0) 1684 : audit 1 from='client.? v1:172.21.15.49:0/2776853608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:17.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:17 smithi187 bash[23415]: cluster 2024-03-11T22:15:17.163483+0000 mon.a (mon.0) 1685 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:17 smithi187 bash[23415]: audit 2024-03-11T22:15:17.166128+0000 mon.a (mon.0) 1686 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:17 smithi187 bash[23415]: audit 2024-03-11T22:15:17.166353+0000 mon.a (mon.0) 1687 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]': finished 2024-03-11T22:15:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:17 smithi187 bash[23415]: audit 2024-03-11T22:15:17.166584+0000 mon.a (mon.0) 1688 : audit 1 from='client.? v1:172.21.15.49:0/2776853608' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:17 smithi187 bash[23415]: cluster 2024-03-11T22:15:17.173959+0000 mon.a (mon.0) 1689 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[21434]: cluster 2024-03-11T22:15:17.163483+0000 mon.a (mon.0) 1685 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[21434]: audit 2024-03-11T22:15:17.166128+0000 mon.a (mon.0) 1686 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[21434]: audit 2024-03-11T22:15:17.166353+0000 mon.a (mon.0) 1687 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]': finished 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[21434]: audit 2024-03-11T22:15:17.166584+0000 mon.a (mon.0) 1688 : audit 1 from='client.? v1:172.21.15.49:0/2776853608' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[21434]: cluster 2024-03-11T22:15:17.173959+0000 mon.a (mon.0) 1689 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[28804]: cluster 2024-03-11T22:15:17.163483+0000 mon.a (mon.0) 1685 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[28804]: audit 2024-03-11T22:15:17.166128+0000 mon.a (mon.0) 1686 : audit 1 from='client.46853 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi049-64055-32"}]': finished 2024-03-11T22:15:17.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[28804]: audit 2024-03-11T22:15:17.166353+0000 mon.a (mon.0) 1687 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-23", "mode": "writeback"}]': finished 2024-03-11T22:15:17.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[28804]: audit 2024-03-11T22:15:17.166584+0000 mon.a (mon.0) 1688 : audit 1 from='client.? v1:172.21.15.49:0/2776853608' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:17.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:17 smithi049 bash[28804]: cluster 2024-03-11T22:15:17.173959+0000 mon.a (mon.0) 1689 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:17.232048+0000 mon.c (mon.2) 430 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:17.232863+0000 mon.a (mon.0) 1690 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:17.234786+0000 mon.c (mon.2) 431 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:17.235657+0000 mon.a (mon.0) 1691 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:17.237079+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:17.237432+0000 mon.a (mon.0) 1692 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: cluster 2024-03-11T22:15:18.033878+0000 mgr.y (mgr.14601) 286 : cluster 0 pgmap v326: 356 pgs: 64 unknown, 292 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:18.169996+0000 mon.a (mon.0) 1693 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:18.180163+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: cluster 2024-03-11T22:15:18.181511+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-03-11T22:15:18.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:18.185872+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.49:0/2569934888' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:18.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:18.186729+0000 mon.a (mon.0) 1695 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[23415]: audit 2024-03-11T22:15:18.187980+0000 mon.a (mon.0) 1696 : audit 1 from='client.46883 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:18.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:17.232048+0000 mon.c (mon.2) 430 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:17.232863+0000 mon.a (mon.0) 1690 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:17.234786+0000 mon.c (mon.2) 431 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:17.235657+0000 mon.a (mon.0) 1691 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:17.237079+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:17.237432+0000 mon.a (mon.0) 1692 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: cluster 2024-03-11T22:15:18.033878+0000 mgr.y (mgr.14601) 286 : cluster 0 pgmap v326: 356 pgs: 64 unknown, 292 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:18.169996+0000 mon.a (mon.0) 1693 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:18.180163+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: cluster 2024-03-11T22:15:18.181511+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:18.185872+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.49:0/2569934888' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:18.186729+0000 mon.a (mon.0) 1695 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[21434]: audit 2024-03-11T22:15:18.187980+0000 mon.a (mon.0) 1696 : audit 1 from='client.46883 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:17.232048+0000 mon.c (mon.2) 430 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:17.232863+0000 mon.a (mon.0) 1690 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:17.234786+0000 mon.c (mon.2) 431 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:17.235657+0000 mon.a (mon.0) 1691 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:17.237079+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:17.237432+0000 mon.a (mon.0) 1692 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: cluster 2024-03-11T22:15:18.033878+0000 mgr.y (mgr.14601) 286 : cluster 0 pgmap v326: 356 pgs: 64 unknown, 292 active+clean; 584 KiB data, 559 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:18.169996+0000 mon.a (mon.0) 1693 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi049-64055-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:18.180163+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: cluster 2024-03-11T22:15:18.181511+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:18.185872+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.49:0/2569934888' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:18.186729+0000 mon.a (mon.0) 1695 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:18 smithi049 bash[28804]: audit 2024-03-11T22:15:18.187980+0000 mon.a (mon.0) 1696 : audit 1 from='client.46883 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:18.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:15:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:15:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:20 smithi187 bash[23415]: audit 2024-03-11T22:15:18.251446+0000 mon.b (mon.1) 179 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:20.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:20 smithi187 bash[23415]: audit 2024-03-11T22:15:18.258985+0000 mon.a (mon.0) 1697 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:20 smithi187 bash[23415]: audit 2024-03-11T22:15:18.677207+0000 mgr.y (mgr.14601) 287 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:20.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:20 smithi187 bash[23415]: audit 2024-03-11T22:15:19.174318+0000 mon.a (mon.0) 1698 : audit 1 from='client.46883 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:20.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[21434]: audit 2024-03-11T22:15:18.251446+0000 mon.b (mon.1) 179 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:20.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[21434]: audit 2024-03-11T22:15:18.258985+0000 mon.a (mon.0) 1697 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:20.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[21434]: audit 2024-03-11T22:15:18.677207+0000 mgr.y (mgr.14601) 287 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:20.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[21434]: audit 2024-03-11T22:15:19.174318+0000 mon.a (mon.0) 1698 : audit 1 from='client.46883 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:20.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[28804]: audit 2024-03-11T22:15:18.251446+0000 mon.b (mon.1) 179 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:20.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[28804]: audit 2024-03-11T22:15:18.258985+0000 mon.a (mon.0) 1697 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:20.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[28804]: audit 2024-03-11T22:15:18.677207+0000 mgr.y (mgr.14601) 287 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:20.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:20 smithi049 bash[28804]: audit 2024-03-11T22:15:19.174318+0000 mon.a (mon.0) 1698 : audit 1 from='client.46883 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: audit 2024-03-11T22:15:19.174593+0000 mon.a (mon.0) 1699 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: audit 2024-03-11T22:15:19.176225+0000 mon.b (mon.1) 180 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: cluster 2024-03-11T22:15:19.646414+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: audit 2024-03-11T22:15:19.650250+0000 mon.a (mon.0) 1701 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: cluster 2024-03-11T22:15:20.034812+0000 mgr.y (mgr.14601) 288 : cluster 0 pgmap v329: 388 pgs: 32 creating+peering, 356 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: cluster 2024-03-11T22:15:20.175344+0000 mon.a (mon.0) 1702 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: audit 2024-03-11T22:15:20.177869+0000 mon.a (mon.0) 1703 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: audit 2024-03-11T22:15:20.178079+0000 mon.a (mon.0) 1704 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]': finished 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: cluster 2024-03-11T22:15:20.185640+0000 mon.a (mon.0) 1705 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: audit 2024-03-11T22:15:20.197121+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.49:0/2868553777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:21.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:21 smithi187 bash[23415]: audit 2024-03-11T22:15:20.201453+0000 mon.a (mon.0) 1706 : audit 1 from='client.46889 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: audit 2024-03-11T22:15:19.174593+0000 mon.a (mon.0) 1699 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: audit 2024-03-11T22:15:19.176225+0000 mon.b (mon.1) 180 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: cluster 2024-03-11T22:15:19.646414+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: audit 2024-03-11T22:15:19.650250+0000 mon.a (mon.0) 1701 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: cluster 2024-03-11T22:15:20.034812+0000 mgr.y (mgr.14601) 288 : cluster 0 pgmap v329: 388 pgs: 32 creating+peering, 356 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: cluster 2024-03-11T22:15:20.175344+0000 mon.a (mon.0) 1702 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: audit 2024-03-11T22:15:20.177869+0000 mon.a (mon.0) 1703 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: audit 2024-03-11T22:15:20.178079+0000 mon.a (mon.0) 1704 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]': finished 2024-03-11T22:15:21.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: cluster 2024-03-11T22:15:20.185640+0000 mon.a (mon.0) 1705 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: audit 2024-03-11T22:15:20.197121+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.49:0/2868553777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[21434]: audit 2024-03-11T22:15:20.201453+0000 mon.a (mon.0) 1706 : audit 1 from='client.46889 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: audit 2024-03-11T22:15:19.174593+0000 mon.a (mon.0) 1699 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: audit 2024-03-11T22:15:19.176225+0000 mon.b (mon.1) 180 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: cluster 2024-03-11T22:15:19.646414+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: audit 2024-03-11T22:15:19.650250+0000 mon.a (mon.0) 1701 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]: dispatch 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: cluster 2024-03-11T22:15:20.034812+0000 mgr.y (mgr.14601) 288 : cluster 0 pgmap v329: 388 pgs: 32 creating+peering, 356 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: cluster 2024-03-11T22:15:20.175344+0000 mon.a (mon.0) 1702 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: audit 2024-03-11T22:15:20.177869+0000 mon.a (mon.0) 1703 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi049-64055-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: audit 2024-03-11T22:15:20.178079+0000 mon.a (mon.0) 1704 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-23"}]': finished 2024-03-11T22:15:21.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: cluster 2024-03-11T22:15:20.185640+0000 mon.a (mon.0) 1705 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-03-11T22:15:21.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: audit 2024-03-11T22:15:20.197121+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.49:0/2868553777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:21.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:21 smithi049 bash[28804]: audit 2024-03-11T22:15:20.201453+0000 mon.a (mon.0) 1706 : audit 1 from='client.46889 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:22 smithi187 bash[23415]: audit 2024-03-11T22:15:21.180495+0000 mon.a (mon.0) 1707 : audit 1 from='client.46889 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:22 smithi187 bash[23415]: cluster 2024-03-11T22:15:21.187772+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-03-11T22:15:22.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:22 smithi187 bash[23415]: cluster 2024-03-11T22:15:22.035733+0000 mgr.y (mgr.14601) 289 : cluster 0 pgmap v332: 396 pgs: 40 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-03-11T22:15:22.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:22 smithi049 bash[21434]: audit 2024-03-11T22:15:21.180495+0000 mon.a (mon.0) 1707 : audit 1 from='client.46889 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:22.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:22 smithi049 bash[21434]: cluster 2024-03-11T22:15:21.187772+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-03-11T22:15:22.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:22 smithi049 bash[21434]: cluster 2024-03-11T22:15:22.035733+0000 mgr.y (mgr.14601) 289 : cluster 0 pgmap v332: 396 pgs: 40 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-03-11T22:15:22.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:22 smithi049 bash[28804]: audit 2024-03-11T22:15:21.180495+0000 mon.a (mon.0) 1707 : audit 1 from='client.46889 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:22.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:22 smithi049 bash[28804]: cluster 2024-03-11T22:15:21.187772+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-03-11T22:15:22.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:22 smithi049 bash[28804]: cluster 2024-03-11T22:15:22.035733+0000 mgr.y (mgr.14601) 289 : cluster 0 pgmap v332: 396 pgs: 40 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: cluster 2024-03-11T22:15:22.181100+0000 mon.a (mon.0) 1709 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: audit 2024-03-11T22:15:22.197718+0000 mon.b (mon.1) 181 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: cluster 2024-03-11T22:15:22.200913+0000 mon.a (mon.0) 1710 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: audit 2024-03-11T22:15:22.205380+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: audit 2024-03-11T22:15:22.205717+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.49:0/896737701' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: audit 2024-03-11T22:15:22.206030+0000 mon.a (mon.0) 1711 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: audit 2024-03-11T22:15:22.206387+0000 mon.a (mon.0) 1712 : audit 1 from='client.46895 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:23 smithi187 bash[23415]: audit 2024-03-11T22:15:22.218417+0000 mon.a (mon.0) 1713 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: cluster 2024-03-11T22:15:22.181100+0000 mon.a (mon.0) 1709 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: audit 2024-03-11T22:15:22.197718+0000 mon.b (mon.1) 181 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: cluster 2024-03-11T22:15:22.200913+0000 mon.a (mon.0) 1710 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: audit 2024-03-11T22:15:22.205380+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: audit 2024-03-11T22:15:22.205717+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.49:0/896737701' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: audit 2024-03-11T22:15:22.206030+0000 mon.a (mon.0) 1711 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: audit 2024-03-11T22:15:22.206387+0000 mon.a (mon.0) 1712 : audit 1 from='client.46895 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[21434]: audit 2024-03-11T22:15:22.218417+0000 mon.a (mon.0) 1713 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: cluster 2024-03-11T22:15:22.181100+0000 mon.a (mon.0) 1709 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: audit 2024-03-11T22:15:22.197718+0000 mon.b (mon.1) 181 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: cluster 2024-03-11T22:15:22.200913+0000 mon.a (mon.0) 1710 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: audit 2024-03-11T22:15:22.205380+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: audit 2024-03-11T22:15:22.205717+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.49:0/896737701' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: audit 2024-03-11T22:15:22.206030+0000 mon.a (mon.0) 1711 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: audit 2024-03-11T22:15:22.206387+0000 mon.a (mon.0) 1712 : audit 1 from='client.46895 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:23.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:23 smithi049 bash[28804]: audit 2024-03-11T22:15:22.218417+0000 mon.a (mon.0) 1713 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:24.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:24 smithi187 bash[23415]: audit 2024-03-11T22:15:23.198336+0000 mon.a (mon.0) 1714 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:24 smithi187 bash[23415]: audit 2024-03-11T22:15:23.198525+0000 mon.a (mon.0) 1715 : audit 1 from='client.46895 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:24 smithi187 bash[23415]: audit 2024-03-11T22:15:23.198685+0000 mon.a (mon.0) 1716 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:24 smithi187 bash[23415]: cluster 2024-03-11T22:15:23.206723+0000 mon.a (mon.0) 1717 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-03-11T22:15:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:24 smithi187 bash[23415]: audit 2024-03-11T22:15:23.207999+0000 mon.c (mon.2) 438 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:24 smithi187 bash[23415]: audit 2024-03-11T22:15:23.211154+0000 mon.a (mon.0) 1718 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:24 smithi187 bash[23415]: cluster 2024-03-11T22:15:24.039348+0000 mgr.y (mgr.14601) 290 : cluster 0 pgmap v335: 452 pgs: 452 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:24.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:15:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:15:24.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21434]: audit 2024-03-11T22:15:23.198336+0000 mon.a (mon.0) 1714 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:24.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21434]: audit 2024-03-11T22:15:23.198525+0000 mon.a (mon.0) 1715 : audit 1 from='client.46895 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:24.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21434]: audit 2024-03-11T22:15:23.198685+0000 mon.a (mon.0) 1716 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:24.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21434]: cluster 2024-03-11T22:15:23.206723+0000 mon.a (mon.0) 1717 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-03-11T22:15:24.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21434]: audit 2024-03-11T22:15:23.207999+0000 mon.c (mon.2) 438 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21434]: audit 2024-03-11T22:15:23.211154+0000 mon.a (mon.0) 1718 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[21434]: cluster 2024-03-11T22:15:24.039348+0000 mgr.y (mgr.14601) 290 : cluster 0 pgmap v335: 452 pgs: 452 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[28804]: audit 2024-03-11T22:15:23.198336+0000 mon.a (mon.0) 1714 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[28804]: audit 2024-03-11T22:15:23.198525+0000 mon.a (mon.0) 1715 : audit 1 from='client.46895 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi049-64063-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[28804]: audit 2024-03-11T22:15:23.198685+0000 mon.a (mon.0) 1716 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[28804]: cluster 2024-03-11T22:15:23.206723+0000 mon.a (mon.0) 1717 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[28804]: audit 2024-03-11T22:15:23.207999+0000 mon.c (mon.2) 438 : audit 1 from='client.? v1:172.21.15.49:0/3919945726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[28804]: audit 2024-03-11T22:15:23.211154+0000 mon.a (mon.0) 1718 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]: dispatch 2024-03-11T22:15:24.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:24 smithi049 bash[28804]: cluster 2024-03-11T22:15:24.039348+0000 mgr.y (mgr.14601) 290 : cluster 0 pgmap v335: 452 pgs: 452 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:25.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.210820+0000 mon.a (mon.0) 1719 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: cluster 2024-03-11T22:15:24.220256+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.242281+0000 mon.b (mon.1) 182 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.250940+0000 mon.a (mon.0) 1721 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.259502+0000 mon.c (mon.2) 439 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.260087+0000 mon.a (mon.0) 1722 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.260892+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.261227+0000 mon.a (mon.0) 1723 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.261739+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.262023+0000 mon.a (mon.0) 1724 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.934041+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:24.937220+0000 mon.c (mon.2) 442 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:25.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:25.116086+0000 mon.a (mon.0) 1726 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:25.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:25.116322+0000 mon.a (mon.0) 1727 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:25.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:25.117212+0000 mon.b (mon.1) 183 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:25.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: cluster 2024-03-11T22:15:25.124521+0000 mon.a (mon.0) 1728 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-03-11T22:15:25.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:25.126424+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:25.128212+0000 mon.a (mon.0) 1729 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:25.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:25 smithi187 bash[23415]: audit 2024-03-11T22:15:25.129838+0000 mon.a (mon.0) 1730 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.210820+0000 mon.a (mon.0) 1719 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: cluster 2024-03-11T22:15:24.220256+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-03-11T22:15:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.242281+0000 mon.b (mon.1) 182 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:25.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.250940+0000 mon.a (mon.0) 1721 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.259502+0000 mon.c (mon.2) 439 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.260087+0000 mon.a (mon.0) 1722 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.260892+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.261227+0000 mon.a (mon.0) 1723 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.261739+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.262023+0000 mon.a (mon.0) 1724 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.934041+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:24.937220+0000 mon.c (mon.2) 442 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:25.116086+0000 mon.a (mon.0) 1726 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:25.116322+0000 mon.a (mon.0) 1727 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:25.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:25.117212+0000 mon.b (mon.1) 183 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.210820+0000 mon.a (mon.0) 1719 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi049-64055-33"}]': finished 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: cluster 2024-03-11T22:15:24.220256+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.242281+0000 mon.b (mon.1) 182 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.250940+0000 mon.a (mon.0) 1721 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.259502+0000 mon.c (mon.2) 439 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.260087+0000 mon.a (mon.0) 1722 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.260892+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.261227+0000 mon.a (mon.0) 1723 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.261739+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.262023+0000 mon.a (mon.0) 1724 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.934041+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:15:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:24.937220+0000 mon.c (mon.2) 442 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:25.116086+0000 mon.a (mon.0) 1726 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:25.116322+0000 mon.a (mon.0) 1727 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi049-64055-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:25.117212+0000 mon.b (mon.1) 183 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: cluster 2024-03-11T22:15:25.124521+0000 mon.a (mon.0) 1728 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:25.126424+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:25.128212+0000 mon.a (mon.0) 1729 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[21434]: audit 2024-03-11T22:15:25.129838+0000 mon.a (mon.0) 1730 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: cluster 2024-03-11T22:15:25.124521+0000 mon.a (mon.0) 1728 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-03-11T22:15:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:25.126424+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:25.128212+0000 mon.a (mon.0) 1729 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:25 smithi049 bash[28804]: audit 2024-03-11T22:15:25.129838+0000 mon.a (mon.0) 1730 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:26.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:26 smithi187 bash[23415]: cluster 2024-03-11T22:15:26.040385+0000 mgr.y (mgr.14601) 291 : cluster 0 pgmap v338: 388 pgs: 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:15:26.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:26 smithi187 bash[23415]: audit 2024-03-11T22:15:26.120222+0000 mon.a (mon.0) 1731 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]': finished 2024-03-11T22:15:26.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:26 smithi187 bash[23415]: audit 2024-03-11T22:15:26.124550+0000 mon.b (mon.1) 184 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]: dispatch 2024-03-11T22:15:26.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:26 smithi187 bash[23415]: cluster 2024-03-11T22:15:26.590982+0000 mon.a (mon.0) 1732 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-03-11T22:15:27.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[21434]: cluster 2024-03-11T22:15:26.040385+0000 mgr.y (mgr.14601) 291 : cluster 0 pgmap v338: 388 pgs: 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:15:27.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[21434]: audit 2024-03-11T22:15:26.120222+0000 mon.a (mon.0) 1731 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]': finished 2024-03-11T22:15:27.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[21434]: audit 2024-03-11T22:15:26.124550+0000 mon.b (mon.1) 184 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]: dispatch 2024-03-11T22:15:27.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[21434]: cluster 2024-03-11T22:15:26.590982+0000 mon.a (mon.0) 1732 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-03-11T22:15:27.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[28804]: cluster 2024-03-11T22:15:26.040385+0000 mgr.y (mgr.14601) 291 : cluster 0 pgmap v338: 388 pgs: 388 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:15:27.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[28804]: audit 2024-03-11T22:15:26.120222+0000 mon.a (mon.0) 1731 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-25"}]': finished 2024-03-11T22:15:27.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[28804]: audit 2024-03-11T22:15:26.124550+0000 mon.b (mon.1) 184 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]: dispatch 2024-03-11T22:15:27.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:26 smithi049 bash[28804]: cluster 2024-03-11T22:15:26.590982+0000 mon.a (mon.0) 1732 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-03-11T22:15:27.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:27 smithi187 bash[23415]: audit 2024-03-11T22:15:26.594304+0000 mon.a (mon.0) 1733 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]: dispatch 2024-03-11T22:15:27.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:27 smithi187 bash[23415]: cluster 2024-03-11T22:15:27.120911+0000 mon.a (mon.0) 1734 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:27.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:27 smithi187 bash[23415]: audit 2024-03-11T22:15:27.123495+0000 mon.a (mon.0) 1735 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:27.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:27 smithi187 bash[23415]: audit 2024-03-11T22:15:27.123696+0000 mon.a (mon.0) 1736 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]': finished 2024-03-11T22:15:27.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:27 smithi187 bash[23415]: cluster 2024-03-11T22:15:27.130964+0000 mon.a (mon.0) 1737 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-03-11T22:15:27.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:27 smithi187 bash[23415]: audit 2024-03-11T22:15:27.195691+0000 mon.b (mon.1) 185 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:27.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:27 smithi187 bash[23415]: audit 2024-03-11T22:15:27.203165+0000 mon.a (mon.0) 1738 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:28.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[21434]: audit 2024-03-11T22:15:26.594304+0000 mon.a (mon.0) 1733 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]: dispatch 2024-03-11T22:15:28.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[21434]: cluster 2024-03-11T22:15:27.120911+0000 mon.a (mon.0) 1734 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:28.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[21434]: audit 2024-03-11T22:15:27.123495+0000 mon.a (mon.0) 1735 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:28.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[21434]: audit 2024-03-11T22:15:27.123696+0000 mon.a (mon.0) 1736 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]': finished 2024-03-11T22:15:28.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[21434]: cluster 2024-03-11T22:15:27.130964+0000 mon.a (mon.0) 1737 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-03-11T22:15:28.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[21434]: audit 2024-03-11T22:15:27.195691+0000 mon.b (mon.1) 185 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:28.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[21434]: audit 2024-03-11T22:15:27.203165+0000 mon.a (mon.0) 1738 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:28.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[28804]: audit 2024-03-11T22:15:26.594304+0000 mon.a (mon.0) 1733 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]: dispatch 2024-03-11T22:15:28.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[28804]: cluster 2024-03-11T22:15:27.120911+0000 mon.a (mon.0) 1734 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:28.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[28804]: audit 2024-03-11T22:15:27.123495+0000 mon.a (mon.0) 1735 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi049-64055-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:28.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[28804]: audit 2024-03-11T22:15:27.123696+0000 mon.a (mon.0) 1736 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-25", "mode": "writeback"}]': finished 2024-03-11T22:15:28.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[28804]: cluster 2024-03-11T22:15:27.130964+0000 mon.a (mon.0) 1737 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-03-11T22:15:28.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[28804]: audit 2024-03-11T22:15:27.195691+0000 mon.b (mon.1) 185 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:28.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:27 smithi049 bash[28804]: audit 2024-03-11T22:15:27.203165+0000 mon.a (mon.0) 1738 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:28.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:15:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:15:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:28 smithi187 bash[23415]: cluster 2024-03-11T22:15:28.041514+0000 mgr.y (mgr.14601) 292 : cluster 0 pgmap v341: 332 pgs: 8 unknown, 324 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:28 smithi187 bash[23415]: audit 2024-03-11T22:15:28.126073+0000 mon.a (mon.0) 1739 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:28 smithi187 bash[23415]: audit 2024-03-11T22:15:28.128467+0000 mon.b (mon.1) 186 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:28 smithi187 bash[23415]: cluster 2024-03-11T22:15:28.134225+0000 mon.a (mon.0) 1740 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-03-11T22:15:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:28 smithi187 bash[23415]: audit 2024-03-11T22:15:28.136414+0000 mon.a (mon.0) 1741 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:29.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[21434]: cluster 2024-03-11T22:15:28.041514+0000 mgr.y (mgr.14601) 292 : cluster 0 pgmap v341: 332 pgs: 8 unknown, 324 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:29.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[21434]: audit 2024-03-11T22:15:28.126073+0000 mon.a (mon.0) 1739 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:29.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[21434]: audit 2024-03-11T22:15:28.128467+0000 mon.b (mon.1) 186 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:29.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[21434]: cluster 2024-03-11T22:15:28.134225+0000 mon.a (mon.0) 1740 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-03-11T22:15:29.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[21434]: audit 2024-03-11T22:15:28.136414+0000 mon.a (mon.0) 1741 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:29.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[28804]: cluster 2024-03-11T22:15:28.041514+0000 mgr.y (mgr.14601) 292 : cluster 0 pgmap v341: 332 pgs: 8 unknown, 324 active+clean; 584 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:29.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[28804]: audit 2024-03-11T22:15:28.126073+0000 mon.a (mon.0) 1739 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:29.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[28804]: audit 2024-03-11T22:15:28.128467+0000 mon.b (mon.1) 186 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:29.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[28804]: cluster 2024-03-11T22:15:28.134225+0000 mon.a (mon.0) 1740 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-03-11T22:15:29.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:28 smithi049 bash[28804]: audit 2024-03-11T22:15:28.136414+0000 mon.a (mon.0) 1741 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]: dispatch 2024-03-11T22:15:29.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: cluster 2024-03-11T22:15:28.641147+0000 mon.a (mon.0) 1742 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: audit 2024-03-11T22:15:28.687062+0000 mgr.y (mgr.14601) 293 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: cluster 2024-03-11T22:15:29.127055+0000 mon.a (mon.0) 1743 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: audit 2024-03-11T22:15:29.129620+0000 mon.a (mon.0) 1744 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]': finished 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: cluster 2024-03-11T22:15:29.136594+0000 mon.a (mon.0) 1745 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: audit 2024-03-11T22:15:29.140261+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.49:0/634052628' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: audit 2024-03-11T22:15:29.141278+0000 mon.a (mon.0) 1746 : audit 1 from='client.46907 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: audit 2024-03-11T22:15:29.142792+0000 mon.c (mon.2) 445 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:29 smithi187 bash[23415]: audit 2024-03-11T22:15:29.144329+0000 mon.a (mon.0) 1747 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:30.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: cluster 2024-03-11T22:15:28.641147+0000 mon.a (mon.0) 1742 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:30.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: audit 2024-03-11T22:15:28.687062+0000 mgr.y (mgr.14601) 293 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:30.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: cluster 2024-03-11T22:15:29.127055+0000 mon.a (mon.0) 1743 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:30.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: audit 2024-03-11T22:15:29.129620+0000 mon.a (mon.0) 1744 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]': finished 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: cluster 2024-03-11T22:15:29.136594+0000 mon.a (mon.0) 1745 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: audit 2024-03-11T22:15:29.140261+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.49:0/634052628' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: audit 2024-03-11T22:15:29.141278+0000 mon.a (mon.0) 1746 : audit 1 from='client.46907 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: audit 2024-03-11T22:15:29.142792+0000 mon.c (mon.2) 445 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[21434]: audit 2024-03-11T22:15:29.144329+0000 mon.a (mon.0) 1747 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: cluster 2024-03-11T22:15:28.641147+0000 mon.a (mon.0) 1742 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: audit 2024-03-11T22:15:28.687062+0000 mgr.y (mgr.14601) 293 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: cluster 2024-03-11T22:15:29.127055+0000 mon.a (mon.0) 1743 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: audit 2024-03-11T22:15:29.129620+0000 mon.a (mon.0) 1744 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-25"}]': finished 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: cluster 2024-03-11T22:15:29.136594+0000 mon.a (mon.0) 1745 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-03-11T22:15:30.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: audit 2024-03-11T22:15:29.140261+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.49:0/634052628' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: audit 2024-03-11T22:15:29.141278+0000 mon.a (mon.0) 1746 : audit 1 from='client.46907 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: audit 2024-03-11T22:15:29.142792+0000 mon.c (mon.2) 445 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:29 smithi049 bash[28804]: audit 2024-03-11T22:15:29.144329+0000 mon.a (mon.0) 1747 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:30.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:30 smithi187 bash[23415]: cluster 2024-03-11T22:15:30.042573+0000 mgr.y (mgr.14601) 294 : cluster 0 pgmap v344: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-11T22:15:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:30 smithi187 bash[23415]: audit 2024-03-11T22:15:30.132395+0000 mon.a (mon.0) 1748 : audit 1 from='client.46907 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:30 smithi187 bash[23415]: audit 2024-03-11T22:15:30.132641+0000 mon.a (mon.0) 1749 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:30 smithi187 bash[23415]: cluster 2024-03-11T22:15:30.140605+0000 mon.a (mon.0) 1750 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-03-11T22:15:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:30 smithi187 bash[23415]: audit 2024-03-11T22:15:30.143775+0000 mon.c (mon.2) 446 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:30 smithi187 bash[23415]: audit 2024-03-11T22:15:30.606146+0000 mon.a (mon.0) 1751 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:31.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[28804]: cluster 2024-03-11T22:15:30.042573+0000 mgr.y (mgr.14601) 294 : cluster 0 pgmap v344: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-11T22:15:31.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[28804]: audit 2024-03-11T22:15:30.132395+0000 mon.a (mon.0) 1748 : audit 1 from='client.46907 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:31.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[28804]: audit 2024-03-11T22:15:30.132641+0000 mon.a (mon.0) 1749 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:31.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[28804]: cluster 2024-03-11T22:15:30.140605+0000 mon.a (mon.0) 1750 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-03-11T22:15:31.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[28804]: audit 2024-03-11T22:15:30.143775+0000 mon.c (mon.2) 446 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:31.017 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[28804]: audit 2024-03-11T22:15:30.606146+0000 mon.a (mon.0) 1751 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:31.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[21434]: cluster 2024-03-11T22:15:30.042573+0000 mgr.y (mgr.14601) 294 : cluster 0 pgmap v344: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-11T22:15:31.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[21434]: audit 2024-03-11T22:15:30.132395+0000 mon.a (mon.0) 1748 : audit 1 from='client.46907 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi049-64063-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:31.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[21434]: audit 2024-03-11T22:15:30.132641+0000 mon.a (mon.0) 1749 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:31.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[21434]: cluster 2024-03-11T22:15:30.140605+0000 mon.a (mon.0) 1750 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-03-11T22:15:31.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[21434]: audit 2024-03-11T22:15:30.143775+0000 mon.c (mon.2) 446 : audit 1 from='client.? v1:172.21.15.49:0/3459002720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:31.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:30 smithi049 bash[21434]: audit 2024-03-11T22:15:30.606146+0000 mon.a (mon.0) 1751 : audit 1 from='client.46901 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]: dispatch 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: audit 2024-03-11T22:15:31.136632+0000 mon.a (mon.0) 1752 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: cluster 2024-03-11T22:15:31.145011+0000 mon.a (mon.0) 1753 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: audit 2024-03-11T22:15:31.145198+0000 mon.b (mon.1) 187 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: audit 2024-03-11T22:15:31.153746+0000 mon.a (mon.0) 1754 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: audit 2024-03-11T22:15:31.189937+0000 mon.a (mon.0) 1755 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: audit 2024-03-11T22:15:31.191429+0000 mon.a (mon.0) 1756 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: audit 2024-03-11T22:15:31.191920+0000 mon.a (mon.0) 1757 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi049-64055-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:32.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:32 smithi187 bash[23415]: cluster 2024-03-11T22:15:32.043554+0000 mgr.y (mgr.14601) 295 : cluster 0 pgmap v347: 292 pgs: 32 unknown, 260 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:15:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: audit 2024-03-11T22:15:31.136632+0000 mon.a (mon.0) 1752 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: cluster 2024-03-11T22:15:31.145011+0000 mon.a (mon.0) 1753 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-03-11T22:15:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: audit 2024-03-11T22:15:31.145198+0000 mon.b (mon.1) 187 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: audit 2024-03-11T22:15:31.153746+0000 mon.a (mon.0) 1754 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: audit 2024-03-11T22:15:31.189937+0000 mon.a (mon.0) 1755 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:32.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: audit 2024-03-11T22:15:31.191429+0000 mon.a (mon.0) 1756 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: audit 2024-03-11T22:15:31.191920+0000 mon.a (mon.0) 1757 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi049-64055-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[21434]: cluster 2024-03-11T22:15:32.043554+0000 mgr.y (mgr.14601) 295 : cluster 0 pgmap v347: 292 pgs: 32 unknown, 260 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: audit 2024-03-11T22:15:31.136632+0000 mon.a (mon.0) 1752 : audit 1 from='client.46901 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi049-64055-34"}]': finished 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: cluster 2024-03-11T22:15:31.145011+0000 mon.a (mon.0) 1753 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: audit 2024-03-11T22:15:31.145198+0000 mon.b (mon.1) 187 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: audit 2024-03-11T22:15:31.153746+0000 mon.a (mon.0) 1754 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: audit 2024-03-11T22:15:31.189937+0000 mon.a (mon.0) 1755 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: audit 2024-03-11T22:15:31.191429+0000 mon.a (mon.0) 1756 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: audit 2024-03-11T22:15:31.191920+0000 mon.a (mon.0) 1757 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi049-64055-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:32.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:32 smithi049 bash[28804]: cluster 2024-03-11T22:15:32.043554+0000 mgr.y (mgr.14601) 295 : cluster 0 pgmap v347: 292 pgs: 32 unknown, 260 active+clean; 583 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:15:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:33 smithi187 bash[23415]: audit 2024-03-11T22:15:32.150373+0000 mon.a (mon.0) 1758 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:33 smithi187 bash[23415]: audit 2024-03-11T22:15:32.150654+0000 mon.a (mon.0) 1759 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi049-64055-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:33 smithi187 bash[23415]: cluster 2024-03-11T22:15:32.161497+0000 mon.a (mon.0) 1760 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-03-11T22:15:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:33 smithi187 bash[23415]: audit 2024-03-11T22:15:32.166097+0000 mon.a (mon.0) 1761 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi049-64055-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:33 smithi187 bash[23415]: audit 2024-03-11T22:15:32.166350+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.49:0/167823672' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:33.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:33 smithi187 bash[23415]: audit 2024-03-11T22:15:32.172436+0000 mon.a (mon.0) 1762 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:34.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[21434]: audit 2024-03-11T22:15:32.150373+0000 mon.a (mon.0) 1758 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:34.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[21434]: audit 2024-03-11T22:15:32.150654+0000 mon.a (mon.0) 1759 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi049-64055-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:34.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[21434]: cluster 2024-03-11T22:15:32.161497+0000 mon.a (mon.0) 1760 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-03-11T22:15:34.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[21434]: audit 2024-03-11T22:15:32.166097+0000 mon.a (mon.0) 1761 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi049-64055-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:34.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[21434]: audit 2024-03-11T22:15:32.166350+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.49:0/167823672' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:34.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[21434]: audit 2024-03-11T22:15:32.172436+0000 mon.a (mon.0) 1762 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:34.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[28804]: audit 2024-03-11T22:15:32.150373+0000 mon.a (mon.0) 1758 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:34.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[28804]: audit 2024-03-11T22:15:32.150654+0000 mon.a (mon.0) 1759 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi049-64055-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:34.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[28804]: cluster 2024-03-11T22:15:32.161497+0000 mon.a (mon.0) 1760 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-03-11T22:15:34.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[28804]: audit 2024-03-11T22:15:32.166097+0000 mon.a (mon.0) 1761 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi049-64055-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:34.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[28804]: audit 2024-03-11T22:15:32.166350+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.49:0/167823672' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:34.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:33 smithi049 bash[28804]: audit 2024-03-11T22:15:32.172436+0000 mon.a (mon.0) 1762 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:34.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:15:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:33.154408+0000 mon.a (mon.0) 1763 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: cluster 2024-03-11T22:15:33.620542+0000 mon.a (mon.0) 1764 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:33.668347+0000 mon.b (mon.1) 188 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:33.675690+0000 mon.a (mon.0) 1765 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: cluster 2024-03-11T22:15:34.046385+0000 mgr.y (mgr.14601) 296 : cluster 0 pgmap v350: 324 pgs: 18 creating+activating, 13 creating+peering, 293 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:34.157644+0000 mon.a (mon.0) 1766 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi049-64055-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:34.157927+0000 mon.a (mon.0) 1767 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:34.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:34.162085+0000 mon.b (mon.1) 189 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:34.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: cluster 2024-03-11T22:15:34.165154+0000 mon.a (mon.0) 1768 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-03-11T22:15:34.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:34.175161+0000 mon.a (mon.0) 1769 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:34.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:34.209672+0000 mon.a (mon.0) 1770 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:34.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:34.211273+0000 mon.a (mon.0) 1771 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:34.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:34 smithi187 bash[23415]: audit 2024-03-11T22:15:34.211679+0000 mon.a (mon.0) 1772 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:35.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:33.154408+0000 mon.a (mon.0) 1763 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: cluster 2024-03-11T22:15:33.620542+0000 mon.a (mon.0) 1764 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:33.668347+0000 mon.b (mon.1) 188 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:33.675690+0000 mon.a (mon.0) 1765 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: cluster 2024-03-11T22:15:34.046385+0000 mgr.y (mgr.14601) 296 : cluster 0 pgmap v350: 324 pgs: 18 creating+activating, 13 creating+peering, 293 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:34.157644+0000 mon.a (mon.0) 1766 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi049-64055-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:34.157927+0000 mon.a (mon.0) 1767 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:34.162085+0000 mon.b (mon.1) 189 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: cluster 2024-03-11T22:15:34.165154+0000 mon.a (mon.0) 1768 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:34.175161+0000 mon.a (mon.0) 1769 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:34.209672+0000 mon.a (mon.0) 1770 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:34.211273+0000 mon.a (mon.0) 1771 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:35.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[21434]: audit 2024-03-11T22:15:34.211679+0000 mon.a (mon.0) 1772 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:33.154408+0000 mon.a (mon.0) 1763 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi049-64063-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: cluster 2024-03-11T22:15:33.620542+0000 mon.a (mon.0) 1764 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:33.668347+0000 mon.b (mon.1) 188 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:33.675690+0000 mon.a (mon.0) 1765 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: cluster 2024-03-11T22:15:34.046385+0000 mgr.y (mgr.14601) 296 : cluster 0 pgmap v350: 324 pgs: 18 creating+activating, 13 creating+peering, 293 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:34.157644+0000 mon.a (mon.0) 1766 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi049-64055-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:34.157927+0000 mon.a (mon.0) 1767 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:34.162085+0000 mon.b (mon.1) 189 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: cluster 2024-03-11T22:15:34.165154+0000 mon.a (mon.0) 1768 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:34.175161+0000 mon.a (mon.0) 1769 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:34.209672+0000 mon.a (mon.0) 1770 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:34.211273+0000 mon.a (mon.0) 1771 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:35.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:34 smithi049 bash[28804]: audit 2024-03-11T22:15:34.211679+0000 mon.a (mon.0) 1772 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:35 smithi187 bash[23415]: cluster 2024-03-11T22:15:34.623127+0000 mon.a (mon.0) 1773 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:35 smithi187 bash[23415]: audit 2024-03-11T22:15:35.160350+0000 mon.a (mon.0) 1774 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]': finished 2024-03-11T22:15:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:35 smithi187 bash[23415]: audit 2024-03-11T22:15:35.160562+0000 mon.a (mon.0) 1775 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:35 smithi187 bash[23415]: audit 2024-03-11T22:15:35.163609+0000 mon.b (mon.1) 190 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]: dispatch 2024-03-11T22:15:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:35 smithi187 bash[23415]: cluster 2024-03-11T22:15:35.167392+0000 mon.a (mon.0) 1776 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-03-11T22:15:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:35 smithi187 bash[23415]: audit 2024-03-11T22:15:35.170060+0000 mon.a (mon.0) 1777 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:35.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:35 smithi187 bash[23415]: audit 2024-03-11T22:15:35.171235+0000 mon.a (mon.0) 1778 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]: dispatch 2024-03-11T22:15:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[21434]: cluster 2024-03-11T22:15:34.623127+0000 mon.a (mon.0) 1773 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[21434]: audit 2024-03-11T22:15:35.160350+0000 mon.a (mon.0) 1774 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]': finished 2024-03-11T22:15:36.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[21434]: audit 2024-03-11T22:15:35.160562+0000 mon.a (mon.0) 1775 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[21434]: audit 2024-03-11T22:15:35.163609+0000 mon.b (mon.1) 190 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]: dispatch 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[21434]: cluster 2024-03-11T22:15:35.167392+0000 mon.a (mon.0) 1776 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[21434]: audit 2024-03-11T22:15:35.170060+0000 mon.a (mon.0) 1777 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[21434]: audit 2024-03-11T22:15:35.171235+0000 mon.a (mon.0) 1778 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]: dispatch 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[28804]: cluster 2024-03-11T22:15:34.623127+0000 mon.a (mon.0) 1773 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[28804]: audit 2024-03-11T22:15:35.160350+0000 mon.a (mon.0) 1774 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-27"}]': finished 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[28804]: audit 2024-03-11T22:15:35.160562+0000 mon.a (mon.0) 1775 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[28804]: audit 2024-03-11T22:15:35.163609+0000 mon.b (mon.1) 190 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]: dispatch 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[28804]: cluster 2024-03-11T22:15:35.167392+0000 mon.a (mon.0) 1776 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[28804]: audit 2024-03-11T22:15:35.170060+0000 mon.a (mon.0) 1777 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:36.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:35 smithi049 bash[28804]: audit 2024-03-11T22:15:35.171235+0000 mon.a (mon.0) 1778 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]: dispatch 2024-03-11T22:15:36.990 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:36 smithi187 bash[23415]: cluster 2024-03-11T22:15:36.047434+0000 mgr.y (mgr.14601) 297 : cluster 0 pgmap v353: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:15:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:36 smithi187 bash[23415]: cluster 2024-03-11T22:15:36.161631+0000 mon.a (mon.0) 1779 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:36 smithi187 bash[23415]: audit 2024-03-11T22:15:36.164051+0000 mon.a (mon.0) 1780 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]': finished 2024-03-11T22:15:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:36 smithi049 bash[21434]: cluster 2024-03-11T22:15:36.047434+0000 mgr.y (mgr.14601) 297 : cluster 0 pgmap v353: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:15:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:36 smithi049 bash[21434]: cluster 2024-03-11T22:15:36.161631+0000 mon.a (mon.0) 1779 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:37.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:36 smithi049 bash[21434]: audit 2024-03-11T22:15:36.164051+0000 mon.a (mon.0) 1780 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]': finished 2024-03-11T22:15:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:36 smithi049 bash[28804]: cluster 2024-03-11T22:15:36.047434+0000 mgr.y (mgr.14601) 297 : cluster 0 pgmap v353: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:15:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:36 smithi049 bash[28804]: cluster 2024-03-11T22:15:36.161631+0000 mon.a (mon.0) 1779 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:37.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:36 smithi049 bash[28804]: audit 2024-03-11T22:15:36.164051+0000 mon.a (mon.0) 1780 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-27", "mode": "writeback"}]': finished 2024-03-11T22:15:37.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: cluster 2024-03-11T22:15:36.631588+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-03-11T22:15:37.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: audit 2024-03-11T22:15:36.633452+0000 mon.a (mon.0) 1782 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:37.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: audit 2024-03-11T22:15:37.167501+0000 mon.a (mon.0) 1783 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:37.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: audit 2024-03-11T22:15:37.167752+0000 mon.a (mon.0) 1784 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:37.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: cluster 2024-03-11T22:15:37.175341+0000 mon.a (mon.0) 1785 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-03-11T22:15:37.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: audit 2024-03-11T22:15:37.180536+0000 mon.a (mon.0) 1786 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:37.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: audit 2024-03-11T22:15:37.236321+0000 mon.b (mon.1) 191 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:37.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:37 smithi187 bash[23415]: audit 2024-03-11T22:15:37.243622+0000 mon.a (mon.0) 1787 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: cluster 2024-03-11T22:15:36.631588+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-03-11T22:15:38.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: audit 2024-03-11T22:15:36.633452+0000 mon.a (mon.0) 1782 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: audit 2024-03-11T22:15:37.167501+0000 mon.a (mon.0) 1783 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: audit 2024-03-11T22:15:37.167752+0000 mon.a (mon.0) 1784 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: cluster 2024-03-11T22:15:37.175341+0000 mon.a (mon.0) 1785 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: audit 2024-03-11T22:15:37.180536+0000 mon.a (mon.0) 1786 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: audit 2024-03-11T22:15:37.236321+0000 mon.b (mon.1) 191 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[21434]: audit 2024-03-11T22:15:37.243622+0000 mon.a (mon.0) 1787 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: cluster 2024-03-11T22:15:36.631588+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-03-11T22:15:38.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: audit 2024-03-11T22:15:36.633452+0000 mon.a (mon.0) 1782 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: audit 2024-03-11T22:15:37.167501+0000 mon.a (mon.0) 1783 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: audit 2024-03-11T22:15:37.167752+0000 mon.a (mon.0) 1784 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: cluster 2024-03-11T22:15:37.175341+0000 mon.a (mon.0) 1785 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-03-11T22:15:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: audit 2024-03-11T22:15:37.180536+0000 mon.a (mon.0) 1786 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]: dispatch 2024-03-11T22:15:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: audit 2024-03-11T22:15:37.236321+0000 mon.b (mon.1) 191 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:37 smithi049 bash[28804]: audit 2024-03-11T22:15:37.243622+0000 mon.a (mon.0) 1787 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:38.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:15:38.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: cluster 2024-03-11T22:15:38.048391+0000 mgr.y (mgr.14601) 298 : cluster 0 pgmap v356: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:38.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: audit 2024-03-11T22:15:38.170929+0000 mon.a (mon.0) 1788 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:38.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: audit 2024-03-11T22:15:38.171118+0000 mon.a (mon.0) 1789 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:38.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: audit 2024-03-11T22:15:38.174321+0000 mon.b (mon.1) 192 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:38.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: cluster 2024-03-11T22:15:38.179694+0000 mon.a (mon.0) 1790 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-03-11T22:15:38.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: audit 2024-03-11T22:15:38.183920+0000 mon.a (mon.0) 1791 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:38.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: audit 2024-03-11T22:15:38.229603+0000 mon.a (mon.0) 1792 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:38.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: audit 2024-03-11T22:15:38.231173+0000 mon.a (mon.0) 1793 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:38.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:38 smithi187 bash[23415]: audit 2024-03-11T22:15:38.231561+0000 mon.a (mon.0) 1794 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi049-64055-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:39.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: cluster 2024-03-11T22:15:38.048391+0000 mgr.y (mgr.14601) 298 : cluster 0 pgmap v356: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: audit 2024-03-11T22:15:38.170929+0000 mon.a (mon.0) 1788 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: audit 2024-03-11T22:15:38.171118+0000 mon.a (mon.0) 1789 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: audit 2024-03-11T22:15:38.174321+0000 mon.b (mon.1) 192 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: cluster 2024-03-11T22:15:38.179694+0000 mon.a (mon.0) 1790 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: audit 2024-03-11T22:15:38.183920+0000 mon.a (mon.0) 1791 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: audit 2024-03-11T22:15:38.229603+0000 mon.a (mon.0) 1792 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: audit 2024-03-11T22:15:38.231173+0000 mon.a (mon.0) 1793 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[21434]: audit 2024-03-11T22:15:38.231561+0000 mon.a (mon.0) 1794 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi049-64055-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: cluster 2024-03-11T22:15:38.048391+0000 mgr.y (mgr.14601) 298 : cluster 0 pgmap v356: 300 pgs: 8 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: audit 2024-03-11T22:15:38.170929+0000 mon.a (mon.0) 1788 : audit 1 from='client.? v1:172.21.15.49:0/3114583791' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi049-64055-35"}]': finished 2024-03-11T22:15:39.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: audit 2024-03-11T22:15:38.171118+0000 mon.a (mon.0) 1789 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:39.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: audit 2024-03-11T22:15:38.174321+0000 mon.b (mon.1) 192 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:39.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: cluster 2024-03-11T22:15:38.179694+0000 mon.a (mon.0) 1790 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-03-11T22:15:39.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: audit 2024-03-11T22:15:38.183920+0000 mon.a (mon.0) 1791 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]: dispatch 2024-03-11T22:15:39.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: audit 2024-03-11T22:15:38.229603+0000 mon.a (mon.0) 1792 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:39.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: audit 2024-03-11T22:15:38.231173+0000 mon.a (mon.0) 1793 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:39.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:38 smithi049 bash[28804]: audit 2024-03-11T22:15:38.231561+0000 mon.a (mon.0) 1794 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi049-64055-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:39.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:39 smithi187 bash[23415]: audit 2024-03-11T22:15:38.696645+0000 mgr.y (mgr.14601) 299 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:39.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:39 smithi187 bash[23415]: cluster 2024-03-11T22:15:39.171540+0000 mon.a (mon.0) 1795 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:39.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:39 smithi187 bash[23415]: audit 2024-03-11T22:15:39.174025+0000 mon.a (mon.0) 1796 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]': finished 2024-03-11T22:15:39.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:39 smithi187 bash[23415]: audit 2024-03-11T22:15:39.174278+0000 mon.a (mon.0) 1797 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi049-64055-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:39.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:39 smithi187 bash[23415]: cluster 2024-03-11T22:15:39.181240+0000 mon.a (mon.0) 1798 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-03-11T22:15:39.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:39 smithi187 bash[23415]: audit 2024-03-11T22:15:39.183321+0000 mon.a (mon.0) 1799 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi049-64055-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:39.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:39 smithi187 bash[23415]: audit 2024-03-11T22:15:39.184542+0000 mon.a (mon.0) 1800 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:40.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[21434]: audit 2024-03-11T22:15:38.696645+0000 mgr.y (mgr.14601) 299 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[21434]: cluster 2024-03-11T22:15:39.171540+0000 mon.a (mon.0) 1795 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[21434]: audit 2024-03-11T22:15:39.174025+0000 mon.a (mon.0) 1796 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]': finished 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[21434]: audit 2024-03-11T22:15:39.174278+0000 mon.a (mon.0) 1797 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi049-64055-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[21434]: cluster 2024-03-11T22:15:39.181240+0000 mon.a (mon.0) 1798 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[21434]: audit 2024-03-11T22:15:39.183321+0000 mon.a (mon.0) 1799 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi049-64055-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[21434]: audit 2024-03-11T22:15:39.184542+0000 mon.a (mon.0) 1800 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[28804]: audit 2024-03-11T22:15:38.696645+0000 mgr.y (mgr.14601) 299 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[28804]: cluster 2024-03-11T22:15:39.171540+0000 mon.a (mon.0) 1795 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[28804]: audit 2024-03-11T22:15:39.174025+0000 mon.a (mon.0) 1796 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-27"}]': finished 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[28804]: audit 2024-03-11T22:15:39.174278+0000 mon.a (mon.0) 1797 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi049-64055-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:40.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[28804]: cluster 2024-03-11T22:15:39.181240+0000 mon.a (mon.0) 1798 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-03-11T22:15:40.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[28804]: audit 2024-03-11T22:15:39.183321+0000 mon.a (mon.0) 1799 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi049-64055-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:40.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:39 smithi049 bash[28804]: audit 2024-03-11T22:15:39.184542+0000 mon.a (mon.0) 1800 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:41.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:41 smithi187 bash[23415]: audit 2024-03-11T22:15:39.974001+0000 mon.c (mon.2) 448 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:41.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:41 smithi187 bash[23415]: cluster 2024-03-11T22:15:40.117321+0000 mon.a (mon.0) 1801 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:41.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:41 smithi187 bash[23415]: audit 2024-03-11T22:15:40.177223+0000 mon.a (mon.0) 1802 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:41.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:41 smithi187 bash[23415]: cluster 2024-03-11T22:15:40.647137+0000 mon.a (mon.0) 1803 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-03-11T22:15:41.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:41 smithi187 bash[23415]: audit 2024-03-11T22:15:40.649219+0000 mon.a (mon.0) 1804 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:41.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[21434]: audit 2024-03-11T22:15:39.974001+0000 mon.c (mon.2) 448 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:41.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[21434]: cluster 2024-03-11T22:15:40.117321+0000 mon.a (mon.0) 1801 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[21434]: audit 2024-03-11T22:15:40.177223+0000 mon.a (mon.0) 1802 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[21434]: cluster 2024-03-11T22:15:40.647137+0000 mon.a (mon.0) 1803 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[21434]: audit 2024-03-11T22:15:40.649219+0000 mon.a (mon.0) 1804 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[28804]: audit 2024-03-11T22:15:39.974001+0000 mon.c (mon.2) 448 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[28804]: cluster 2024-03-11T22:15:40.117321+0000 mon.a (mon.0) 1801 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[28804]: audit 2024-03-11T22:15:40.177223+0000 mon.a (mon.0) 1802 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[28804]: cluster 2024-03-11T22:15:40.647137+0000 mon.a (mon.0) 1803 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-03-11T22:15:41.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:41 smithi049 bash[28804]: audit 2024-03-11T22:15:40.649219+0000 mon.a (mon.0) 1804 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]: dispatch 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: cluster 2024-03-11T22:15:40.049317+0000 mgr.y (mgr.14601) 300 : cluster 0 pgmap v359: 292 pgs: 292 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: audit 2024-03-11T22:15:41.181494+0000 mon.a (mon.0) 1805 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi049-64055-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: audit 2024-03-11T22:15:41.181730+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: cluster 2024-03-11T22:15:41.189032+0000 mon.a (mon.0) 1807 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: audit 2024-03-11T22:15:41.189608+0000 mon.b (mon.1) 193 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: audit 2024-03-11T22:15:41.198672+0000 mon.a (mon.0) 1808 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: audit 2024-03-11T22:15:41.229900+0000 mon.a (mon.0) 1809 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: audit 2024-03-11T22:15:41.231449+0000 mon.a (mon.0) 1810 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:42.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:42 smithi187 bash[23415]: audit 2024-03-11T22:15:41.231805+0000 mon.a (mon.0) 1811 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:42.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: cluster 2024-03-11T22:15:40.049317+0000 mgr.y (mgr.14601) 300 : cluster 0 pgmap v359: 292 pgs: 292 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: audit 2024-03-11T22:15:41.181494+0000 mon.a (mon.0) 1805 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi049-64055-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: audit 2024-03-11T22:15:41.181730+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: cluster 2024-03-11T22:15:41.189032+0000 mon.a (mon.0) 1807 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: audit 2024-03-11T22:15:41.189608+0000 mon.b (mon.1) 193 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: audit 2024-03-11T22:15:41.198672+0000 mon.a (mon.0) 1808 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: audit 2024-03-11T22:15:41.229900+0000 mon.a (mon.0) 1809 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: audit 2024-03-11T22:15:41.231449+0000 mon.a (mon.0) 1810 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:42.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[21434]: audit 2024-03-11T22:15:41.231805+0000 mon.a (mon.0) 1811 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: cluster 2024-03-11T22:15:40.049317+0000 mgr.y (mgr.14601) 300 : cluster 0 pgmap v359: 292 pgs: 292 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: audit 2024-03-11T22:15:41.181494+0000 mon.a (mon.0) 1805 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi049-64055-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: audit 2024-03-11T22:15:41.181730+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.49:0/1001369866' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-46"}]': finished 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: cluster 2024-03-11T22:15:41.189032+0000 mon.a (mon.0) 1807 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: audit 2024-03-11T22:15:41.189608+0000 mon.b (mon.1) 193 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: audit 2024-03-11T22:15:41.198672+0000 mon.a (mon.0) 1808 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: audit 2024-03-11T22:15:41.229900+0000 mon.a (mon.0) 1809 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: audit 2024-03-11T22:15:41.231449+0000 mon.a (mon.0) 1810 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:42.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:42 smithi049 bash[28804]: audit 2024-03-11T22:15:41.231805+0000 mon.a (mon.0) 1811 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:43 smithi187 bash[23415]: cluster 2024-03-11T22:15:42.050378+0000 mgr.y (mgr.14601) 301 : cluster 0 pgmap v362: 300 pgs: 40 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:15:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:43 smithi187 bash[23415]: audit 2024-03-11T22:15:42.190802+0000 mon.a (mon.0) 1812 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:43 smithi187 bash[23415]: audit 2024-03-11T22:15:42.190966+0000 mon.a (mon.0) 1813 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:43 smithi187 bash[23415]: cluster 2024-03-11T22:15:42.197961+0000 mon.a (mon.0) 1814 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-03-11T22:15:43.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:43 smithi187 bash[23415]: audit 2024-03-11T22:15:42.201728+0000 mon.a (mon.0) 1815 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:44.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[21434]: cluster 2024-03-11T22:15:42.050378+0000 mgr.y (mgr.14601) 301 : cluster 0 pgmap v362: 300 pgs: 40 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[21434]: audit 2024-03-11T22:15:42.190802+0000 mon.a (mon.0) 1812 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[21434]: audit 2024-03-11T22:15:42.190966+0000 mon.a (mon.0) 1813 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[21434]: cluster 2024-03-11T22:15:42.197961+0000 mon.a (mon.0) 1814 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[21434]: audit 2024-03-11T22:15:42.201728+0000 mon.a (mon.0) 1815 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[28804]: cluster 2024-03-11T22:15:42.050378+0000 mgr.y (mgr.14601) 301 : cluster 0 pgmap v362: 300 pgs: 40 unknown, 260 active+clean; 584 KiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[28804]: audit 2024-03-11T22:15:42.190802+0000 mon.a (mon.0) 1812 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[28804]: audit 2024-03-11T22:15:42.190966+0000 mon.a (mon.0) 1813 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi049-64063-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[28804]: cluster 2024-03-11T22:15:42.197961+0000 mon.a (mon.0) 1814 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-03-11T22:15:44.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:43 smithi049 bash[28804]: audit 2024-03-11T22:15:42.201728+0000 mon.a (mon.0) 1815 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:44.517 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:15:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: cluster 2024-03-11T22:15:43.667791+0000 mon.a (mon.0) 1816 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: audit 2024-03-11T22:15:43.679276+0000 mon.a (mon.0) 1817 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: audit 2024-03-11T22:15:44.197893+0000 mon.a (mon.0) 1818 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: audit 2024-03-11T22:15:44.198136+0000 mon.a (mon.0) 1819 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: cluster 2024-03-11T22:15:44.205394+0000 mon.a (mon.0) 1820 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: audit 2024-03-11T22:15:44.209364+0000 mon.a (mon.0) 1821 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: audit 2024-03-11T22:15:44.223015+0000 mon.b (mon.1) 194 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:44.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:44 smithi187 bash[23415]: audit 2024-03-11T22:15:44.230598+0000 mon.a (mon.0) 1822 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: cluster 2024-03-11T22:15:43.667791+0000 mon.a (mon.0) 1816 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: audit 2024-03-11T22:15:43.679276+0000 mon.a (mon.0) 1817 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: audit 2024-03-11T22:15:44.197893+0000 mon.a (mon.0) 1818 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: audit 2024-03-11T22:15:44.198136+0000 mon.a (mon.0) 1819 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: cluster 2024-03-11T22:15:44.205394+0000 mon.a (mon.0) 1820 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: audit 2024-03-11T22:15:44.209364+0000 mon.a (mon.0) 1821 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: audit 2024-03-11T22:15:44.223015+0000 mon.b (mon.1) 194 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[21434]: audit 2024-03-11T22:15:44.230598+0000 mon.a (mon.0) 1822 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: cluster 2024-03-11T22:15:43.667791+0000 mon.a (mon.0) 1816 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-03-11T22:15:45.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: audit 2024-03-11T22:15:43.679276+0000 mon.a (mon.0) 1817 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: audit 2024-03-11T22:15:44.197893+0000 mon.a (mon.0) 1818 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi049-64063-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: audit 2024-03-11T22:15:44.198136+0000 mon.a (mon.0) 1819 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: cluster 2024-03-11T22:15:44.205394+0000 mon.a (mon.0) 1820 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-03-11T22:15:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: audit 2024-03-11T22:15:44.209364+0000 mon.a (mon.0) 1821 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]: dispatch 2024-03-11T22:15:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: audit 2024-03-11T22:15:44.223015+0000 mon.b (mon.1) 194 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:45.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:44 smithi049 bash[28804]: audit 2024-03-11T22:15:44.230598+0000 mon.a (mon.0) 1822 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: cluster 2024-03-11T22:15:44.053097+0000 mgr.y (mgr.14601) 302 : cluster 0 pgmap v365: 292 pgs: 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:15:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: cluster 2024-03-11T22:15:45.118685+0000 mon.a (mon.0) 1823 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:45.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: audit 2024-03-11T22:15:45.123933+0000 mon.a (mon.0) 1824 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:45.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: audit 2024-03-11T22:15:45.124099+0000 mon.a (mon.0) 1825 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:45.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: audit 2024-03-11T22:15:45.128551+0000 mon.b (mon.1) 195 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:45.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: cluster 2024-03-11T22:15:45.130948+0000 mon.a (mon.0) 1826 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-03-11T22:15:45.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: audit 2024-03-11T22:15:45.151674+0000 mon.a (mon.0) 1827 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:45.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: audit 2024-03-11T22:15:45.189846+0000 mon.a (mon.0) 1828 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:45.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: audit 2024-03-11T22:15:45.191347+0000 mon.a (mon.0) 1829 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:45.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:45 smithi187 bash[23415]: audit 2024-03-11T22:15:45.191711+0000 mon.a (mon.0) 1830 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: cluster 2024-03-11T22:15:44.053097+0000 mgr.y (mgr.14601) 302 : cluster 0 pgmap v365: 292 pgs: 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: cluster 2024-03-11T22:15:45.118685+0000 mon.a (mon.0) 1823 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: audit 2024-03-11T22:15:45.123933+0000 mon.a (mon.0) 1824 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: audit 2024-03-11T22:15:45.124099+0000 mon.a (mon.0) 1825 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: audit 2024-03-11T22:15:45.128551+0000 mon.b (mon.1) 195 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: cluster 2024-03-11T22:15:45.130948+0000 mon.a (mon.0) 1826 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: audit 2024-03-11T22:15:45.151674+0000 mon.a (mon.0) 1827 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: audit 2024-03-11T22:15:45.189846+0000 mon.a (mon.0) 1828 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: audit 2024-03-11T22:15:45.191347+0000 mon.a (mon.0) 1829 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:46.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[21434]: audit 2024-03-11T22:15:45.191711+0000 mon.a (mon.0) 1830 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: cluster 2024-03-11T22:15:44.053097+0000 mgr.y (mgr.14601) 302 : cluster 0 pgmap v365: 292 pgs: 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: cluster 2024-03-11T22:15:45.118685+0000 mon.a (mon.0) 1823 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: audit 2024-03-11T22:15:45.123933+0000 mon.a (mon.0) 1824 : audit 1 from='client.? v1:172.21.15.49:0/3355637342' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi049-64055-36"}]': finished 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: audit 2024-03-11T22:15:45.124099+0000 mon.a (mon.0) 1825 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: audit 2024-03-11T22:15:45.128551+0000 mon.b (mon.1) 195 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: cluster 2024-03-11T22:15:45.130948+0000 mon.a (mon.0) 1826 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: audit 2024-03-11T22:15:45.151674+0000 mon.a (mon.0) 1827 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: audit 2024-03-11T22:15:45.189846+0000 mon.a (mon.0) 1828 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: audit 2024-03-11T22:15:45.191347+0000 mon.a (mon.0) 1829 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:46.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:45 smithi049 bash[28804]: audit 2024-03-11T22:15:45.191711+0000 mon.a (mon.0) 1830 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:47.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: cluster 2024-03-11T22:15:46.054024+0000 mgr.y (mgr.14601) 303 : cluster 0 pgmap v368: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-03-11T22:15:47.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: audit 2024-03-11T22:15:46.126776+0000 mon.a (mon.0) 1831 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]': finished 2024-03-11T22:15:47.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: audit 2024-03-11T22:15:46.126935+0000 mon.a (mon.0) 1832 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:47.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: audit 2024-03-11T22:15:46.133832+0000 mon.b (mon.1) 196 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]: dispatch 2024-03-11T22:15:47.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: cluster 2024-03-11T22:15:46.134436+0000 mon.a (mon.0) 1833 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-03-11T22:15:47.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: audit 2024-03-11T22:15:46.136097+0000 mon.a (mon.0) 1834 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi049-64055-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:47.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: audit 2024-03-11T22:15:46.138009+0000 mon.a (mon.0) 1835 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:47.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:47 smithi187 bash[23415]: audit 2024-03-11T22:15:46.140896+0000 mon.a (mon.0) 1836 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]: dispatch 2024-03-11T22:15:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: cluster 2024-03-11T22:15:46.054024+0000 mgr.y (mgr.14601) 303 : cluster 0 pgmap v368: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-03-11T22:15:47.517 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: audit 2024-03-11T22:15:46.126776+0000 mon.a (mon.0) 1831 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]': finished 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: audit 2024-03-11T22:15:46.126935+0000 mon.a (mon.0) 1832 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: audit 2024-03-11T22:15:46.133832+0000 mon.b (mon.1) 196 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]: dispatch 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: cluster 2024-03-11T22:15:46.134436+0000 mon.a (mon.0) 1833 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: audit 2024-03-11T22:15:46.136097+0000 mon.a (mon.0) 1834 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi049-64055-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: audit 2024-03-11T22:15:46.138009+0000 mon.a (mon.0) 1835 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[21434]: audit 2024-03-11T22:15:46.140896+0000 mon.a (mon.0) 1836 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]: dispatch 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: cluster 2024-03-11T22:15:46.054024+0000 mgr.y (mgr.14601) 303 : cluster 0 pgmap v368: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: audit 2024-03-11T22:15:46.126776+0000 mon.a (mon.0) 1831 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-29"}]': finished 2024-03-11T22:15:47.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: audit 2024-03-11T22:15:46.126935+0000 mon.a (mon.0) 1832 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: audit 2024-03-11T22:15:46.133832+0000 mon.b (mon.1) 196 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]: dispatch 2024-03-11T22:15:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: cluster 2024-03-11T22:15:46.134436+0000 mon.a (mon.0) 1833 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-03-11T22:15:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: audit 2024-03-11T22:15:46.136097+0000 mon.a (mon.0) 1834 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi049-64055-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: audit 2024-03-11T22:15:46.138009+0000 mon.a (mon.0) 1835 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:47 smithi049 bash[28804]: audit 2024-03-11T22:15:46.140896+0000 mon.a (mon.0) 1836 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]: dispatch 2024-03-11T22:15:48.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:48 smithi187 bash[23415]: cluster 2024-03-11T22:15:47.128804+0000 mon.a (mon.0) 1837 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:48.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:48 smithi187 bash[23415]: audit 2024-03-11T22:15:47.138648+0000 mon.a (mon.0) 1838 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:48.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:48 smithi187 bash[23415]: audit 2024-03-11T22:15:47.138794+0000 mon.a (mon.0) 1839 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]': finished 2024-03-11T22:15:48.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:48 smithi187 bash[23415]: cluster 2024-03-11T22:15:47.636147+0000 mon.a (mon.0) 1840 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-03-11T22:15:48.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:48 smithi187 bash[23415]: audit 2024-03-11T22:15:47.636979+0000 mon.a (mon.0) 1841 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[28804]: cluster 2024-03-11T22:15:47.128804+0000 mon.a (mon.0) 1837 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:48.517 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[28804]: audit 2024-03-11T22:15:47.138648+0000 mon.a (mon.0) 1838 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[28804]: audit 2024-03-11T22:15:47.138794+0000 mon.a (mon.0) 1839 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]': finished 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[28804]: cluster 2024-03-11T22:15:47.636147+0000 mon.a (mon.0) 1840 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[28804]: audit 2024-03-11T22:15:47.636979+0000 mon.a (mon.0) 1841 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[21434]: cluster 2024-03-11T22:15:47.128804+0000 mon.a (mon.0) 1837 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[21434]: audit 2024-03-11T22:15:47.138648+0000 mon.a (mon.0) 1838 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[21434]: audit 2024-03-11T22:15:47.138794+0000 mon.a (mon.0) 1839 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-29", "mode": "writeback"}]': finished 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[21434]: cluster 2024-03-11T22:15:47.636147+0000 mon.a (mon.0) 1840 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-03-11T22:15:48.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:48 smithi049 bash[21434]: audit 2024-03-11T22:15:47.636979+0000 mon.a (mon.0) 1841 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]: dispatch 2024-03-11T22:15:48.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:15:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:15:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: cluster 2024-03-11T22:15:48.055074+0000 mgr.y (mgr.14601) 304 : cluster 0 pgmap v371: 292 pgs: 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.153496+0000 mon.a (mon.0) 1842 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi049-64055-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.153625+0000 mon.a (mon.0) 1843 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: cluster 2024-03-11T22:15:48.158331+0000 mon.a (mon.0) 1844 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-03-11T22:15:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.199463+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.199997+0000 mon.a (mon.0) 1845 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.201156+0000 mon.c (mon.2) 450 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.201580+0000 mon.a (mon.0) 1846 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.202243+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.202637+0000 mon.a (mon.0) 1847 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:49.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:49 smithi187 bash[23415]: audit 2024-03-11T22:15:48.707709+0000 mgr.y (mgr.14601) 305 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: cluster 2024-03-11T22:15:48.055074+0000 mgr.y (mgr.14601) 304 : cluster 0 pgmap v371: 292 pgs: 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.153496+0000 mon.a (mon.0) 1842 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi049-64055-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.153625+0000 mon.a (mon.0) 1843 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: cluster 2024-03-11T22:15:48.158331+0000 mon.a (mon.0) 1844 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.199463+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.199997+0000 mon.a (mon.0) 1845 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.201156+0000 mon.c (mon.2) 450 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.201580+0000 mon.a (mon.0) 1846 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.202243+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.202637+0000 mon.a (mon.0) 1847 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[21434]: audit 2024-03-11T22:15:48.707709+0000 mgr.y (mgr.14601) 305 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: cluster 2024-03-11T22:15:48.055074+0000 mgr.y (mgr.14601) 304 : cluster 0 pgmap v371: 292 pgs: 292 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.153496+0000 mon.a (mon.0) 1842 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi049-64055-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.153625+0000 mon.a (mon.0) 1843 : audit 1 from='client.? v1:172.21.15.49:0/2633586855' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi049-64063-47"}]': finished 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: cluster 2024-03-11T22:15:48.158331+0000 mon.a (mon.0) 1844 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.199463+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.199997+0000 mon.a (mon.0) 1845 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.201156+0000 mon.c (mon.2) 450 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.201580+0000 mon.a (mon.0) 1846 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:49.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.202243+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:49.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.202637+0000 mon.a (mon.0) 1847 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:49.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:49 smithi049 bash[28804]: audit 2024-03-11T22:15:48.707709+0000 mgr.y (mgr.14601) 305 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:50 smithi187 bash[23415]: audit 2024-03-11T22:15:49.165395+0000 mon.a (mon.0) 1848 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:50 smithi187 bash[23415]: cluster 2024-03-11T22:15:49.172151+0000 mon.a (mon.0) 1849 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-03-11T22:15:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:50 smithi187 bash[23415]: audit 2024-03-11T22:15:49.174138+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:50.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:50 smithi187 bash[23415]: audit 2024-03-11T22:15:49.176301+0000 mon.a (mon.0) 1850 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[21434]: audit 2024-03-11T22:15:49.165395+0000 mon.a (mon.0) 1848 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[21434]: cluster 2024-03-11T22:15:49.172151+0000 mon.a (mon.0) 1849 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-03-11T22:15:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[21434]: audit 2024-03-11T22:15:49.174138+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:50.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[21434]: audit 2024-03-11T22:15:49.176301+0000 mon.a (mon.0) 1850 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[28804]: audit 2024-03-11T22:15:49.165395+0000 mon.a (mon.0) 1848 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi049-64063-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:50.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[28804]: cluster 2024-03-11T22:15:49.172151+0000 mon.a (mon.0) 1849 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-03-11T22:15:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[28804]: audit 2024-03-11T22:15:49.174138+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:50.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:50 smithi049 bash[28804]: audit 2024-03-11T22:15:49.176301+0000 mon.a (mon.0) 1850 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:51.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:51 smithi187 bash[23415]: cluster 2024-03-11T22:15:50.056351+0000 mgr.y (mgr.14601) 306 : cluster 0 pgmap v374: 300 pgs: 8 creating+peering, 292 active+clean; 8.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 255 B/s wr, 24 op/s 2024-03-11T22:15:51.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:51 smithi187 bash[23415]: cluster 2024-03-11T22:15:50.167210+0000 mon.a (mon.0) 1851 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:51.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:51 smithi187 bash[23415]: cluster 2024-03-11T22:15:50.647396+0000 mon.a (mon.0) 1852 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-03-11T22:15:51.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:51 smithi187 bash[23415]: audit 2024-03-11T22:15:50.649365+0000 mon.a (mon.0) 1853 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:51.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:51 smithi187 bash[23415]: audit 2024-03-11T22:15:50.728794+0000 mon.b (mon.1) 197 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:51.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:51 smithi187 bash[23415]: audit 2024-03-11T22:15:50.735712+0000 mon.a (mon.0) 1854 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:51.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[21434]: cluster 2024-03-11T22:15:50.056351+0000 mgr.y (mgr.14601) 306 : cluster 0 pgmap v374: 300 pgs: 8 creating+peering, 292 active+clean; 8.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 255 B/s wr, 24 op/s 2024-03-11T22:15:51.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[21434]: cluster 2024-03-11T22:15:50.167210+0000 mon.a (mon.0) 1851 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:51.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[21434]: cluster 2024-03-11T22:15:50.647396+0000 mon.a (mon.0) 1852 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-03-11T22:15:51.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[21434]: audit 2024-03-11T22:15:50.649365+0000 mon.a (mon.0) 1853 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:51.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[21434]: audit 2024-03-11T22:15:50.728794+0000 mon.b (mon.1) 197 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:51.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[21434]: audit 2024-03-11T22:15:50.735712+0000 mon.a (mon.0) 1854 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:51.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[28804]: cluster 2024-03-11T22:15:50.056351+0000 mgr.y (mgr.14601) 306 : cluster 0 pgmap v374: 300 pgs: 8 creating+peering, 292 active+clean; 8.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 255 B/s wr, 24 op/s 2024-03-11T22:15:51.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[28804]: cluster 2024-03-11T22:15:50.167210+0000 mon.a (mon.0) 1851 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:51.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[28804]: cluster 2024-03-11T22:15:50.647396+0000 mon.a (mon.0) 1852 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-03-11T22:15:51.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[28804]: audit 2024-03-11T22:15:50.649365+0000 mon.a (mon.0) 1853 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:51.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[28804]: audit 2024-03-11T22:15:50.728794+0000 mon.b (mon.1) 197 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:51.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:51 smithi049 bash[28804]: audit 2024-03-11T22:15:50.735712+0000 mon.a (mon.0) 1854 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:52.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:52 smithi187 bash[23415]: audit 2024-03-11T22:15:51.183416+0000 mon.a (mon.0) 1855 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:52.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:52 smithi187 bash[23415]: audit 2024-03-11T22:15:51.183671+0000 mon.a (mon.0) 1856 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:52.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:52 smithi187 bash[23415]: audit 2024-03-11T22:15:51.183788+0000 mon.a (mon.0) 1857 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:52.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:52 smithi187 bash[23415]: audit 2024-03-11T22:15:51.187963+0000 mon.b (mon.1) 198 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:52.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:52 smithi187 bash[23415]: cluster 2024-03-11T22:15:51.192054+0000 mon.a (mon.0) 1858 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-03-11T22:15:52.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:52 smithi187 bash[23415]: audit 2024-03-11T22:15:51.193558+0000 mon.a (mon.0) 1859 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:52.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:52 smithi187 bash[23415]: audit 2024-03-11T22:15:51.195459+0000 mon.a (mon.0) 1860 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[21434]: audit 2024-03-11T22:15:51.183416+0000 mon.a (mon.0) 1855 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[21434]: audit 2024-03-11T22:15:51.183671+0000 mon.a (mon.0) 1856 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[21434]: audit 2024-03-11T22:15:51.183788+0000 mon.a (mon.0) 1857 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[21434]: audit 2024-03-11T22:15:51.187963+0000 mon.b (mon.1) 198 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[21434]: cluster 2024-03-11T22:15:51.192054+0000 mon.a (mon.0) 1858 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[21434]: audit 2024-03-11T22:15:51.193558+0000 mon.a (mon.0) 1859 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[21434]: audit 2024-03-11T22:15:51.195459+0000 mon.a (mon.0) 1860 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:52.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[28804]: audit 2024-03-11T22:15:51.183416+0000 mon.a (mon.0) 1855 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi049-64063-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:52.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[28804]: audit 2024-03-11T22:15:51.183671+0000 mon.a (mon.0) 1856 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:52.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[28804]: audit 2024-03-11T22:15:51.183788+0000 mon.a (mon.0) 1857 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:52.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[28804]: audit 2024-03-11T22:15:51.187963+0000 mon.b (mon.1) 198 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:52.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[28804]: cluster 2024-03-11T22:15:51.192054+0000 mon.a (mon.0) 1858 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-03-11T22:15:52.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[28804]: audit 2024-03-11T22:15:51.193558+0000 mon.a (mon.0) 1859 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]: dispatch 2024-03-11T22:15:52.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:52 smithi049 bash[28804]: audit 2024-03-11T22:15:51.195459+0000 mon.a (mon.0) 1860 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]: dispatch 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: cluster 2024-03-11T22:15:52.057328+0000 mgr.y (mgr.14601) 307 : cluster 0 pgmap v377: 300 pgs: 8 unknown, 292 active+clean; 8.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 255 B/s wr, 24 op/s 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: cluster 2024-03-11T22:15:52.185815+0000 mon.a (mon.0) 1861 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: audit 2024-03-11T22:15:52.193523+0000 mon.a (mon.0) 1862 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: audit 2024-03-11T22:15:52.193781+0000 mon.a (mon.0) 1863 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]': finished 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: cluster 2024-03-11T22:15:52.203730+0000 mon.a (mon.0) 1864 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: audit 2024-03-11T22:15:52.251319+0000 mon.a (mon.0) 1865 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: audit 2024-03-11T22:15:52.252866+0000 mon.a (mon.0) 1866 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:53.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:53 smithi187 bash[23415]: audit 2024-03-11T22:15:52.253310+0000 mon.a (mon.0) 1867 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi049-64055-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:53.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: cluster 2024-03-11T22:15:52.057328+0000 mgr.y (mgr.14601) 307 : cluster 0 pgmap v377: 300 pgs: 8 unknown, 292 active+clean; 8.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 255 B/s wr, 24 op/s 2024-03-11T22:15:53.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: cluster 2024-03-11T22:15:52.185815+0000 mon.a (mon.0) 1861 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:53.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: audit 2024-03-11T22:15:52.193523+0000 mon.a (mon.0) 1862 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:53.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: audit 2024-03-11T22:15:52.193781+0000 mon.a (mon.0) 1863 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]': finished 2024-03-11T22:15:53.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: cluster 2024-03-11T22:15:52.203730+0000 mon.a (mon.0) 1864 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-03-11T22:15:53.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: audit 2024-03-11T22:15:52.251319+0000 mon.a (mon.0) 1865 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:53.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: audit 2024-03-11T22:15:52.252866+0000 mon.a (mon.0) 1866 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[21434]: audit 2024-03-11T22:15:52.253310+0000 mon.a (mon.0) 1867 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi049-64055-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: cluster 2024-03-11T22:15:52.057328+0000 mgr.y (mgr.14601) 307 : cluster 0 pgmap v377: 300 pgs: 8 unknown, 292 active+clean; 8.6 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 255 B/s wr, 24 op/s 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: cluster 2024-03-11T22:15:52.185815+0000 mon.a (mon.0) 1861 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: audit 2024-03-11T22:15:52.193523+0000 mon.a (mon.0) 1862 : audit 1 from='client.? v1:172.21.15.49:0/1257313745' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi049-64055-37"}]': finished 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: audit 2024-03-11T22:15:52.193781+0000 mon.a (mon.0) 1863 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-29"}]': finished 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: cluster 2024-03-11T22:15:52.203730+0000 mon.a (mon.0) 1864 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: audit 2024-03-11T22:15:52.251319+0000 mon.a (mon.0) 1865 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: audit 2024-03-11T22:15:52.252866+0000 mon.a (mon.0) 1866 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:53.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:53 smithi049 bash[28804]: audit 2024-03-11T22:15:52.253310+0000 mon.a (mon.0) 1867 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi049-64055-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:54.518 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:15:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:15:54.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:54 smithi187 bash[23415]: audit 2024-03-11T22:15:53.196507+0000 mon.a (mon.0) 1868 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi049-64055-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:54.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:54 smithi187 bash[23415]: cluster 2024-03-11T22:15:53.204118+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-03-11T22:15:54.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:54 smithi187 bash[23415]: audit 2024-03-11T22:15:53.206197+0000 mon.c (mon.2) 453 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:54.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:54 smithi187 bash[23415]: audit 2024-03-11T22:15:53.206718+0000 mon.a (mon.0) 1870 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi049-64055-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:54.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:54 smithi187 bash[23415]: audit 2024-03-11T22:15:53.208362+0000 mon.a (mon.0) 1871 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:54.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:54 smithi187 bash[23415]: audit 2024-03-11T22:15:54.201237+0000 mon.a (mon.0) 1872 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[21434]: audit 2024-03-11T22:15:53.196507+0000 mon.a (mon.0) 1868 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi049-64055-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[21434]: cluster 2024-03-11T22:15:53.204118+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[21434]: audit 2024-03-11T22:15:53.206197+0000 mon.c (mon.2) 453 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[21434]: audit 2024-03-11T22:15:53.206718+0000 mon.a (mon.0) 1870 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi049-64055-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[21434]: audit 2024-03-11T22:15:53.208362+0000 mon.a (mon.0) 1871 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[21434]: audit 2024-03-11T22:15:54.201237+0000 mon.a (mon.0) 1872 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[28804]: audit 2024-03-11T22:15:53.196507+0000 mon.a (mon.0) 1868 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi049-64055-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[28804]: cluster 2024-03-11T22:15:53.204118+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[28804]: audit 2024-03-11T22:15:53.206197+0000 mon.c (mon.2) 453 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:55.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[28804]: audit 2024-03-11T22:15:53.206718+0000 mon.a (mon.0) 1870 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi049-64055-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:55.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[28804]: audit 2024-03-11T22:15:53.208362+0000 mon.a (mon.0) 1871 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:55.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:54 smithi049 bash[28804]: audit 2024-03-11T22:15:54.201237+0000 mon.a (mon.0) 1872 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: cluster 2024-03-11T22:15:54.059735+0000 mgr.y (mgr.14601) 308 : cluster 0 pgmap v380: 260 pgs: 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:54.214959+0000 mon.c (mon.2) 454 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:55.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:54.671341+0000 mon.b (mon.1) 199 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: cluster 2024-03-11T22:15:54.672755+0000 mon.a (mon.0) 1873 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:54.676538+0000 mon.a (mon.0) 1874 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:54.685801+0000 mon.a (mon.0) 1875 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.011089+0000 mon.c (mon.2) 455 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.129819+0000 mon.a (mon.0) 1876 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi049-64055-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.129999+0000 mon.a (mon.0) 1877 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.130121+0000 mon.a (mon.0) 1878 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: cluster 2024-03-11T22:15:55.137848+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.143202+0000 mon.b (mon.1) 200 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.150959+0000 mon.a (mon.0) 1880 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.192802+0000 mon.c (mon.2) 456 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.193212+0000 mon.a (mon.0) 1881 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.194357+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.194803+0000 mon.a (mon.0) 1882 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:55.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.195536+0000 mon.c (mon.2) 458 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:55.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:55 smithi187 bash[23415]: audit 2024-03-11T22:15:55.195882+0000 mon.a (mon.0) 1883 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:56.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: cluster 2024-03-11T22:15:54.059735+0000 mgr.y (mgr.14601) 308 : cluster 0 pgmap v380: 260 pgs: 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:56.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:54.214959+0000 mon.c (mon.2) 454 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:56.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:54.671341+0000 mon.b (mon.1) 199 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: cluster 2024-03-11T22:15:54.672755+0000 mon.a (mon.0) 1873 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:54.676538+0000 mon.a (mon.0) 1874 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:54.685801+0000 mon.a (mon.0) 1875 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.011089+0000 mon.c (mon.2) 455 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.129819+0000 mon.a (mon.0) 1876 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi049-64055-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.129999+0000 mon.a (mon.0) 1877 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.130121+0000 mon.a (mon.0) 1878 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: cluster 2024-03-11T22:15:55.137848+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.143202+0000 mon.b (mon.1) 200 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.150959+0000 mon.a (mon.0) 1880 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.192802+0000 mon.c (mon.2) 456 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.193212+0000 mon.a (mon.0) 1881 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: cluster 2024-03-11T22:15:54.059735+0000 mgr.y (mgr.14601) 308 : cluster 0 pgmap v380: 260 pgs: 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:54.214959+0000 mon.c (mon.2) 454 : audit 1 from='client.? v1:172.21.15.49:0/2655973041' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:54.671341+0000 mon.b (mon.1) 199 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: cluster 2024-03-11T22:15:54.672755+0000 mon.a (mon.0) 1873 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:54.676538+0000 mon.a (mon.0) 1874 : audit 1 from='client.46946 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]: dispatch 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:54.685801+0000 mon.a (mon.0) 1875 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.011089+0000 mon.c (mon.2) 455 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.129819+0000 mon.a (mon.0) 1876 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi049-64055-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.129999+0000 mon.a (mon.0) 1877 : audit 1 from='client.46946 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi049-64063-48"}]': finished 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.130121+0000 mon.a (mon.0) 1878 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: cluster 2024-03-11T22:15:55.137848+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.143202+0000 mon.b (mon.1) 200 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:56.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.150959+0000 mon.a (mon.0) 1880 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.192802+0000 mon.c (mon.2) 456 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.193212+0000 mon.a (mon.0) 1881 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.194357+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.194803+0000 mon.a (mon.0) 1882 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.195536+0000 mon.c (mon.2) 458 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[21434]: audit 2024-03-11T22:15:55.195882+0000 mon.a (mon.0) 1883 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.194357+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.194803+0000 mon.a (mon.0) 1882 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.195536+0000 mon.c (mon.2) 458 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:56.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:55 smithi049 bash[28804]: audit 2024-03-11T22:15:55.195882+0000 mon.a (mon.0) 1883 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: cluster 2024-03-11T22:15:56.060637+0000 mgr.y (mgr.14601) 309 : cluster 0 pgmap v383: 300 pgs: 40 unknown, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: audit 2024-03-11T22:15:56.132585+0000 mon.a (mon.0) 1884 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: audit 2024-03-11T22:15:56.132829+0000 mon.a (mon.0) 1885 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: audit 2024-03-11T22:15:56.136529+0000 mon.b (mon.1) 201 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: cluster 2024-03-11T22:15:56.140326+0000 mon.a (mon.0) 1886 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-03-11T22:15:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: audit 2024-03-11T22:15:56.141659+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:57.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: audit 2024-03-11T22:15:56.142974+0000 mon.a (mon.0) 1887 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: audit 2024-03-11T22:15:56.143566+0000 mon.a (mon.0) 1888 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:57.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:57 smithi187 bash[23415]: cluster 2024-03-11T22:15:56.690257+0000 mon.a (mon.0) 1889 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: cluster 2024-03-11T22:15:56.060637+0000 mgr.y (mgr.14601) 309 : cluster 0 pgmap v383: 300 pgs: 40 unknown, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: audit 2024-03-11T22:15:56.132585+0000 mon.a (mon.0) 1884 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: audit 2024-03-11T22:15:56.132829+0000 mon.a (mon.0) 1885 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: audit 2024-03-11T22:15:56.136529+0000 mon.b (mon.1) 201 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:58.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: cluster 2024-03-11T22:15:56.140326+0000 mon.a (mon.0) 1886 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: audit 2024-03-11T22:15:56.141659+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: audit 2024-03-11T22:15:56.142974+0000 mon.a (mon.0) 1887 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: audit 2024-03-11T22:15:56.143566+0000 mon.a (mon.0) 1888 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[21434]: cluster 2024-03-11T22:15:56.690257+0000 mon.a (mon.0) 1889 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: cluster 2024-03-11T22:15:56.060637+0000 mgr.y (mgr.14601) 309 : cluster 0 pgmap v383: 300 pgs: 40 unknown, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: audit 2024-03-11T22:15:56.132585+0000 mon.a (mon.0) 1884 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: audit 2024-03-11T22:15:56.132829+0000 mon.a (mon.0) 1885 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi049-64063-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: audit 2024-03-11T22:15:56.136529+0000 mon.b (mon.1) 201 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: cluster 2024-03-11T22:15:56.140326+0000 mon.a (mon.0) 1886 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: audit 2024-03-11T22:15:56.141659+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:58.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: audit 2024-03-11T22:15:56.142974+0000 mon.a (mon.0) 1887 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:15:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: audit 2024-03-11T22:15:56.143566+0000 mon.a (mon.0) 1888 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:58.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:57 smithi049 bash[28804]: cluster 2024-03-11T22:15:56.690257+0000 mon.a (mon.0) 1889 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:15:58.991 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:57.136208+0000 mon.a (mon.0) 1890 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]': finished 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:57.140647+0000 mon.b (mon.1) 202 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]: dispatch 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: cluster 2024-03-11T22:15:57.603605+0000 mon.a (mon.0) 1891 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:57.605734+0000 mon.a (mon.0) 1892 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]: dispatch 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:57.616016+0000 mon.a (mon.0) 1893 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: cluster 2024-03-11T22:15:58.136854+0000 mon.a (mon.0) 1894 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:58.139306+0000 mon.a (mon.0) 1895 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:15:58.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:58.139588+0000 mon.a (mon.0) 1896 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]': finished 2024-03-11T22:15:58.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:58.139826+0000 mon.a (mon.0) 1897 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:15:58.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: cluster 2024-03-11T22:15:58.148018+0000 mon.a (mon.0) 1898 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-03-11T22:15:58.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:58.154291+0000 mon.a (mon.0) 1899 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:58.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:58.329831+0000 mon.b (mon.1) 203 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:58.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:58 smithi187 bash[23415]: audit 2024-03-11T22:15:58.336875+0000 mon.a (mon.0) 1900 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:57.136208+0000 mon.a (mon.0) 1890 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]': finished 2024-03-11T22:15:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:57.140647+0000 mon.b (mon.1) 202 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]: dispatch 2024-03-11T22:15:59.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: cluster 2024-03-11T22:15:57.603605+0000 mon.a (mon.0) 1891 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:57.605734+0000 mon.a (mon.0) 1892 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]: dispatch 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:57.616016+0000 mon.a (mon.0) 1893 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: cluster 2024-03-11T22:15:58.136854+0000 mon.a (mon.0) 1894 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:58.139306+0000 mon.a (mon.0) 1895 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:58.139588+0000 mon.a (mon.0) 1896 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]': finished 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:58.139826+0000 mon.a (mon.0) 1897 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: cluster 2024-03-11T22:15:58.148018+0000 mon.a (mon.0) 1898 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:58.154291+0000 mon.a (mon.0) 1899 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:58.329831+0000 mon.b (mon.1) 203 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[21434]: audit 2024-03-11T22:15:58.336875+0000 mon.a (mon.0) 1900 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:57.136208+0000 mon.a (mon.0) 1890 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-31"}]': finished 2024-03-11T22:15:59.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:57.140647+0000 mon.b (mon.1) 202 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]: dispatch 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: cluster 2024-03-11T22:15:57.603605+0000 mon.a (mon.0) 1891 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:57.605734+0000 mon.a (mon.0) 1892 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]: dispatch 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:57.616016+0000 mon.a (mon.0) 1893 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: cluster 2024-03-11T22:15:58.136854+0000 mon.a (mon.0) 1894 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:58.139306+0000 mon.a (mon.0) 1895 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi049-64063-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:58.139588+0000 mon.a (mon.0) 1896 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-31", "mode": "writeback"}]': finished 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:58.139826+0000 mon.a (mon.0) 1897 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: cluster 2024-03-11T22:15:58.148018+0000 mon.a (mon.0) 1898 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:58.154291+0000 mon.a (mon.0) 1899 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]: dispatch 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:58.329831+0000 mon.b (mon.1) 203 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:59.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:58 smithi049 bash[28804]: audit 2024-03-11T22:15:58.336875+0000 mon.a (mon.0) 1900 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: cluster 2024-03-11T22:15:58.061532+0000 mgr.y (mgr.14601) 310 : cluster 0 pgmap v386: 292 pgs: 32 unknown, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:58.716275+0000 mgr.y (mgr.14601) 311 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.143159+0000 mon.a (mon.0) 1901 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.143429+0000 mon.a (mon.0) 1902 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.148793+0000 mon.b (mon.1) 204 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: cluster 2024-03-11T22:15:59.151846+0000 mon.a (mon.0) 1903 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.156010+0000 mon.a (mon.0) 1904 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:15:59.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.196195+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:15:59.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.196963+0000 mon.a (mon.0) 1905 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:15:59.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.197946+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:15:59.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.198237+0000 mon.a (mon.0) 1906 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:15:59.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.198781+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:15:59.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:15:59 smithi187 bash[23415]: audit 2024-03-11T22:15:59.199093+0000 mon.a (mon.0) 1907 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:00.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: cluster 2024-03-11T22:15:58.061532+0000 mgr.y (mgr.14601) 310 : cluster 0 pgmap v386: 292 pgs: 32 unknown, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:00.018 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:58.716275+0000 mgr.y (mgr.14601) 311 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.143159+0000 mon.a (mon.0) 1901 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.143429+0000 mon.a (mon.0) 1902 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.148793+0000 mon.b (mon.1) 204 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: cluster 2024-03-11T22:15:59.151846+0000 mon.a (mon.0) 1903 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.156010+0000 mon.a (mon.0) 1904 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.196195+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.196963+0000 mon.a (mon.0) 1905 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.197946+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.198237+0000 mon.a (mon.0) 1906 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.198781+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[28804]: audit 2024-03-11T22:15:59.199093+0000 mon.a (mon.0) 1907 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:00.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: cluster 2024-03-11T22:15:58.061532+0000 mgr.y (mgr.14601) 310 : cluster 0 pgmap v386: 292 pgs: 32 unknown, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:58.716275+0000 mgr.y (mgr.14601) 311 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.143159+0000 mon.a (mon.0) 1901 : audit 1 from='client.? v1:172.21.15.49:0/1274942581' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi049-64055-38"}]': finished 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.143429+0000 mon.a (mon.0) 1902 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.148793+0000 mon.b (mon.1) 204 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: cluster 2024-03-11T22:15:59.151846+0000 mon.a (mon.0) 1903 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.156010+0000 mon.a (mon.0) 1904 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.196195+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.196963+0000 mon.a (mon.0) 1905 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.197946+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.198237+0000 mon.a (mon.0) 1906 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.198781+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:00.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:15:59 smithi049 bash[21434]: audit 2024-03-11T22:15:59.199093+0000 mon.a (mon.0) 1907 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: cluster 2024-03-11T22:16:00.143526+0000 mon.a (mon.0) 1908 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: audit 2024-03-11T22:16:00.145751+0000 mon.a (mon.0) 1909 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]': finished 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: audit 2024-03-11T22:16:00.145918+0000 mon.a (mon.0) 1910 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: cluster 2024-03-11T22:16:00.154254+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: audit 2024-03-11T22:16:00.154746+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: audit 2024-03-11T22:16:00.156070+0000 mon.a (mon.0) 1912 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: audit 2024-03-11T22:16:00.156175+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:00.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:00 smithi187 bash[23415]: audit 2024-03-11T22:16:00.157364+0000 mon.a (mon.0) 1913 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: cluster 2024-03-11T22:16:00.143526+0000 mon.a (mon.0) 1908 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: audit 2024-03-11T22:16:00.145751+0000 mon.a (mon.0) 1909 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]': finished 2024-03-11T22:16:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: audit 2024-03-11T22:16:00.145918+0000 mon.a (mon.0) 1910 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: cluster 2024-03-11T22:16:00.154254+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-03-11T22:16:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: audit 2024-03-11T22:16:00.154746+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: audit 2024-03-11T22:16:00.156070+0000 mon.a (mon.0) 1912 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:01.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: audit 2024-03-11T22:16:00.156175+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[21434]: audit 2024-03-11T22:16:00.157364+0000 mon.a (mon.0) 1913 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: cluster 2024-03-11T22:16:00.143526+0000 mon.a (mon.0) 1908 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: audit 2024-03-11T22:16:00.145751+0000 mon.a (mon.0) 1909 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-31"}]': finished 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: audit 2024-03-11T22:16:00.145918+0000 mon.a (mon.0) 1910 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi049-64055-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: cluster 2024-03-11T22:16:00.154254+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: audit 2024-03-11T22:16:00.154746+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: audit 2024-03-11T22:16:00.156070+0000 mon.a (mon.0) 1912 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: audit 2024-03-11T22:16:00.156175+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:01.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:00 smithi049 bash[28804]: audit 2024-03-11T22:16:00.157364+0000 mon.a (mon.0) 1913 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:02 smithi187 bash[23415]: cluster 2024-03-11T22:16:00.062440+0000 mgr.y (mgr.14601) 312 : cluster 0 pgmap v389: 300 pgs: 8 creating+peering, 292 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:16:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:02 smithi187 bash[23415]: audit 2024-03-11T22:16:01.149224+0000 mon.a (mon.0) 1914 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:16:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:02 smithi187 bash[23415]: audit 2024-03-11T22:16:01.158177+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:02 smithi187 bash[23415]: cluster 2024-03-11T22:16:01.615549+0000 mon.a (mon.0) 1915 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-03-11T22:16:02.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:02 smithi187 bash[23415]: audit 2024-03-11T22:16:01.616807+0000 mon.a (mon.0) 1916 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:02.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[28804]: cluster 2024-03-11T22:16:00.062440+0000 mgr.y (mgr.14601) 312 : cluster 0 pgmap v389: 300 pgs: 8 creating+peering, 292 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:16:02.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[28804]: audit 2024-03-11T22:16:01.149224+0000 mon.a (mon.0) 1914 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:16:02.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[28804]: audit 2024-03-11T22:16:01.158177+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:02.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[28804]: cluster 2024-03-11T22:16:01.615549+0000 mon.a (mon.0) 1915 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-03-11T22:16:02.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[28804]: audit 2024-03-11T22:16:01.616807+0000 mon.a (mon.0) 1916 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:02.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[21434]: cluster 2024-03-11T22:16:00.062440+0000 mgr.y (mgr.14601) 312 : cluster 0 pgmap v389: 300 pgs: 8 creating+peering, 292 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:16:02.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[21434]: audit 2024-03-11T22:16:01.149224+0000 mon.a (mon.0) 1914 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:16:02.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[21434]: audit 2024-03-11T22:16:01.158177+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.49:0/2192239777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:02.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[21434]: cluster 2024-03-11T22:16:01.615549+0000 mon.a (mon.0) 1915 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-03-11T22:16:02.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:02 smithi049 bash[21434]: audit 2024-03-11T22:16:01.616807+0000 mon.a (mon.0) 1916 : audit 1 from='client.46958 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]: dispatch 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: cluster 2024-03-11T22:16:02.063228+0000 mgr.y (mgr.14601) 313 : cluster 0 pgmap v392: 260 pgs: 260 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: cluster 2024-03-11T22:16:02.149232+0000 mon.a (mon.0) 1917 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.159572+0000 mon.a (mon.0) 1918 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.159868+0000 mon.a (mon.0) 1919 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.166127+0000 mon.b (mon.1) 205 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: cluster 2024-03-11T22:16:02.167316+0000 mon.a (mon.0) 1920 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.174487+0000 mon.a (mon.0) 1921 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.213335+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.213663+0000 mon.a (mon.0) 1922 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.215477+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.215785+0000 mon.a (mon.0) 1923 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.216219+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:03.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:03 smithi187 bash[23415]: audit 2024-03-11T22:16:02.216503+0000 mon.a (mon.0) 1924 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:03.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: cluster 2024-03-11T22:16:02.063228+0000 mgr.y (mgr.14601) 313 : cluster 0 pgmap v392: 260 pgs: 260 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:03.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: cluster 2024-03-11T22:16:02.149232+0000 mon.a (mon.0) 1917 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:03.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.159572+0000 mon.a (mon.0) 1918 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.159868+0000 mon.a (mon.0) 1919 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.166127+0000 mon.b (mon.1) 205 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: cluster 2024-03-11T22:16:02.167316+0000 mon.a (mon.0) 1920 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.174487+0000 mon.a (mon.0) 1921 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.213335+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.213663+0000 mon.a (mon.0) 1922 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.215477+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.215785+0000 mon.a (mon.0) 1923 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.216219+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[21434]: audit 2024-03-11T22:16:02.216503+0000 mon.a (mon.0) 1924 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: cluster 2024-03-11T22:16:02.063228+0000 mgr.y (mgr.14601) 313 : cluster 0 pgmap v392: 260 pgs: 260 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:03.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: cluster 2024-03-11T22:16:02.149232+0000 mon.a (mon.0) 1917 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.159572+0000 mon.a (mon.0) 1918 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi049-64055-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.159868+0000 mon.a (mon.0) 1919 : audit 1 from='client.46958 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi049-64063-49"}]': finished 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.166127+0000 mon.b (mon.1) 205 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: cluster 2024-03-11T22:16:02.167316+0000 mon.a (mon.0) 1920 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.174487+0000 mon.a (mon.0) 1921 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.213335+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.213663+0000 mon.a (mon.0) 1922 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.215477+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.215785+0000 mon.a (mon.0) 1923 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.216219+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:03.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:03 smithi049 bash[28804]: audit 2024-03-11T22:16:02.216503+0000 mon.a (mon.0) 1924 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:04.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:04 smithi187 bash[23415]: audit 2024-03-11T22:16:03.162928+0000 mon.a (mon.0) 1925 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:04.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:04 smithi187 bash[23415]: audit 2024-03-11T22:16:03.163218+0000 mon.a (mon.0) 1926 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:04.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:04 smithi187 bash[23415]: audit 2024-03-11T22:16:03.170897+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:04.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:04 smithi187 bash[23415]: cluster 2024-03-11T22:16:03.171122+0000 mon.a (mon.0) 1927 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-03-11T22:16:04.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:04 smithi187 bash[23415]: audit 2024-03-11T22:16:03.173161+0000 mon.a (mon.0) 1928 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:04.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:04 smithi187 bash[23415]: audit 2024-03-11T22:16:03.176658+0000 mon.b (mon.1) 206 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:04.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:04 smithi187 bash[23415]: audit 2024-03-11T22:16:03.186124+0000 mon.a (mon.0) 1929 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:04.518 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:16:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:16:04.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21434]: audit 2024-03-11T22:16:03.162928+0000 mon.a (mon.0) 1925 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21434]: audit 2024-03-11T22:16:03.163218+0000 mon.a (mon.0) 1926 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21434]: audit 2024-03-11T22:16:03.170897+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21434]: cluster 2024-03-11T22:16:03.171122+0000 mon.a (mon.0) 1927 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21434]: audit 2024-03-11T22:16:03.173161+0000 mon.a (mon.0) 1928 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21434]: audit 2024-03-11T22:16:03.176658+0000 mon.b (mon.1) 206 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[21434]: audit 2024-03-11T22:16:03.186124+0000 mon.a (mon.0) 1929 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[28804]: audit 2024-03-11T22:16:03.162928+0000 mon.a (mon.0) 1925 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[28804]: audit 2024-03-11T22:16:03.163218+0000 mon.a (mon.0) 1926 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi049-64063-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:04.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[28804]: audit 2024-03-11T22:16:03.170897+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:04.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[28804]: cluster 2024-03-11T22:16:03.171122+0000 mon.a (mon.0) 1927 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-03-11T22:16:04.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[28804]: audit 2024-03-11T22:16:03.173161+0000 mon.a (mon.0) 1928 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:04.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[28804]: audit 2024-03-11T22:16:03.176658+0000 mon.b (mon.1) 206 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:04.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:04 smithi049 bash[28804]: audit 2024-03-11T22:16:03.186124+0000 mon.a (mon.0) 1929 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:05.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: cluster 2024-03-11T22:16:04.065829+0000 mgr.y (mgr.14601) 314 : cluster 0 pgmap v395: 300 pgs: 300 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:05.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: audit 2024-03-11T22:16:04.175020+0000 mon.a (mon.0) 1930 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:05.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: audit 2024-03-11T22:16:04.177019+0000 mon.b (mon.1) 207 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:05.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: cluster 2024-03-11T22:16:04.646888+0000 mon.a (mon.0) 1931 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-03-11T22:16:05.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: audit 2024-03-11T22:16:04.647701+0000 mon.a (mon.0) 1932 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:05.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: audit 2024-03-11T22:16:04.648485+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:05.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: audit 2024-03-11T22:16:04.648862+0000 mon.a (mon.0) 1933 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:05.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:05 smithi187 bash[23415]: audit 2024-03-11T22:16:04.912519+0000 mon.c (mon.2) 471 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: cluster 2024-03-11T22:16:04.065829+0000 mgr.y (mgr.14601) 314 : cluster 0 pgmap v395: 300 pgs: 300 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: audit 2024-03-11T22:16:04.175020+0000 mon.a (mon.0) 1930 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: audit 2024-03-11T22:16:04.177019+0000 mon.b (mon.1) 207 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: cluster 2024-03-11T22:16:04.646888+0000 mon.a (mon.0) 1931 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: audit 2024-03-11T22:16:04.647701+0000 mon.a (mon.0) 1932 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: audit 2024-03-11T22:16:04.648485+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: audit 2024-03-11T22:16:04.648862+0000 mon.a (mon.0) 1933 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[28804]: audit 2024-03-11T22:16:04.912519+0000 mon.c (mon.2) 471 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:16:05.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: cluster 2024-03-11T22:16:04.065829+0000 mgr.y (mgr.14601) 314 : cluster 0 pgmap v395: 300 pgs: 300 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:05.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: audit 2024-03-11T22:16:04.175020+0000 mon.a (mon.0) 1930 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:05.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: audit 2024-03-11T22:16:04.177019+0000 mon.b (mon.1) 207 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:05.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: cluster 2024-03-11T22:16:04.646888+0000 mon.a (mon.0) 1931 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-03-11T22:16:05.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: audit 2024-03-11T22:16:04.647701+0000 mon.a (mon.0) 1932 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:05.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: audit 2024-03-11T22:16:04.648485+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:05.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: audit 2024-03-11T22:16:04.648862+0000 mon.a (mon.0) 1933 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:05.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:05 smithi049 bash[21434]: audit 2024-03-11T22:16:04.912519+0000 mon.c (mon.2) 471 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:16:06.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.187262+0000 mon.a (mon.0) 1934 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:06.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.187464+0000 mon.a (mon.0) 1935 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]': finished 2024-03-11T22:16:06.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.187603+0000 mon.a (mon.0) 1936 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:06.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.193319+0000 mon.b (mon.1) 208 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]: dispatch 2024-03-11T22:16:06.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: cluster 2024-03-11T22:16:05.195445+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-03-11T22:16:06.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.204105+0000 mon.a (mon.0) 1938 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]: dispatch 2024-03-11T22:16:06.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.210632+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:06.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.211399+0000 mon.a (mon.0) 1939 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:06.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.655710+0000 mon.c (mon.2) 473 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:16:06.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.657326+0000 mon.c (mon.2) 474 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:16:06.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:06 smithi187 bash[23415]: audit 2024-03-11T22:16:05.668449+0000 mon.a (mon.0) 1940 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.187262+0000 mon.a (mon.0) 1934 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.187464+0000 mon.a (mon.0) 1935 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]': finished 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.187603+0000 mon.a (mon.0) 1936 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.193319+0000 mon.b (mon.1) 208 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]: dispatch 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: cluster 2024-03-11T22:16:05.195445+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.204105+0000 mon.a (mon.0) 1938 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]: dispatch 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.210632+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.211399+0000 mon.a (mon.0) 1939 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.655710+0000 mon.c (mon.2) 473 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:16:06.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.657326+0000 mon.c (mon.2) 474 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[21434]: audit 2024-03-11T22:16:05.668449+0000 mon.a (mon.0) 1940 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.187262+0000 mon.a (mon.0) 1934 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi049-64063-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.187464+0000 mon.a (mon.0) 1935 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-33"}]': finished 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.187603+0000 mon.a (mon.0) 1936 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.193319+0000 mon.b (mon.1) 208 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]: dispatch 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: cluster 2024-03-11T22:16:05.195445+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.204105+0000 mon.a (mon.0) 1938 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]: dispatch 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.210632+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.49:0/2801018766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.211399+0000 mon.a (mon.0) 1939 : audit 1 from='client.46964 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]: dispatch 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.655710+0000 mon.c (mon.2) 473 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.657326+0000 mon.c (mon.2) 474 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:16:06.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:06 smithi049 bash[28804]: audit 2024-03-11T22:16:05.668449+0000 mon.a (mon.0) 1940 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:16:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: cluster 2024-03-11T22:16:06.066749+0000 mgr.y (mgr.14601) 315 : cluster 0 pgmap v398: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: cluster 2024-03-11T22:16:06.189190+0000 mon.a (mon.0) 1941 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.199643+0000 mon.a (mon.0) 1942 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]': finished 2024-03-11T22:16:07.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.199809+0000 mon.a (mon.0) 1943 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: cluster 2024-03-11T22:16:06.206722+0000 mon.a (mon.0) 1944 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.255311+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.256125+0000 mon.a (mon.0) 1945 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.257122+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.257442+0000 mon.a (mon.0) 1946 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.258102+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.258450+0000 mon.a (mon.0) 1947 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.399670+0000 mon.b (mon.1) 209 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:07.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:07 smithi187 bash[23415]: audit 2024-03-11T22:16:06.406268+0000 mon.a (mon.0) 1948 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:07.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: cluster 2024-03-11T22:16:06.066749+0000 mgr.y (mgr.14601) 315 : cluster 0 pgmap v398: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: cluster 2024-03-11T22:16:06.189190+0000 mon.a (mon.0) 1941 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.199643+0000 mon.a (mon.0) 1942 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]': finished 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.199809+0000 mon.a (mon.0) 1943 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: cluster 2024-03-11T22:16:06.206722+0000 mon.a (mon.0) 1944 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.255311+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.256125+0000 mon.a (mon.0) 1945 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.257122+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.257442+0000 mon.a (mon.0) 1946 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.258102+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.258450+0000 mon.a (mon.0) 1947 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.399670+0000 mon.b (mon.1) 209 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:07.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[28804]: audit 2024-03-11T22:16:06.406268+0000 mon.a (mon.0) 1948 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: cluster 2024-03-11T22:16:06.066749+0000 mgr.y (mgr.14601) 315 : cluster 0 pgmap v398: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: cluster 2024-03-11T22:16:06.189190+0000 mon.a (mon.0) 1941 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.199643+0000 mon.a (mon.0) 1942 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-33", "mode": "writeback"}]': finished 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.199809+0000 mon.a (mon.0) 1943 : audit 1 from='client.46964 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi049-64055-39"}]': finished 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: cluster 2024-03-11T22:16:06.206722+0000 mon.a (mon.0) 1944 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.255311+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.256125+0000 mon.a (mon.0) 1945 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.257122+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.257442+0000 mon.a (mon.0) 1946 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.258102+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.258450+0000 mon.a (mon.0) 1947 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:07.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.399670+0000 mon.b (mon.1) 209 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:07.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:07 smithi049 bash[21434]: audit 2024-03-11T22:16:06.406268+0000 mon.a (mon.0) 1948 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:08.991 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:16:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.203688+0000 mon.a (mon.0) 1949 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.203977+0000 mon.a (mon.0) 1950 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.204559+0000 mon.b (mon.1) 210 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: cluster 2024-03-11T22:16:07.210778+0000 mon.a (mon.0) 1951 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-03-11T22:16:08.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.211335+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:08.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.213753+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:08.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.214135+0000 mon.a (mon.0) 1952 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:08.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.214624+0000 mon.a (mon.0) 1953 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:08.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:08 smithi187 bash[23415]: audit 2024-03-11T22:16:07.215295+0000 mon.a (mon.0) 1954 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.203688+0000 mon.a (mon.0) 1949 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:09.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.203977+0000 mon.a (mon.0) 1950 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.204559+0000 mon.b (mon.1) 210 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: cluster 2024-03-11T22:16:07.210778+0000 mon.a (mon.0) 1951 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.211335+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.213753+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.214135+0000 mon.a (mon.0) 1952 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.214624+0000 mon.a (mon.0) 1953 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[21434]: audit 2024-03-11T22:16:07.215295+0000 mon.a (mon.0) 1954 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.203688+0000 mon.a (mon.0) 1949 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi049-64055-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.203977+0000 mon.a (mon.0) 1950 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.204559+0000 mon.b (mon.1) 210 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: cluster 2024-03-11T22:16:07.210778+0000 mon.a (mon.0) 1951 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-03-11T22:16:09.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.211335+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.213753+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.214135+0000 mon.a (mon.0) 1952 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]: dispatch 2024-03-11T22:16:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.214624+0000 mon.a (mon.0) 1953 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:09.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:08 smithi049 bash[28804]: audit 2024-03-11T22:16:07.215295+0000 mon.a (mon.0) 1954 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: cluster 2024-03-11T22:16:08.067661+0000 mgr.y (mgr.14601) 316 : cluster 0 pgmap v401: 292 pgs: 292 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:10.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: cluster 2024-03-11T22:16:08.204741+0000 mon.a (mon.0) 1955 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: cluster 2024-03-11T22:16:08.205598+0000 mon.a (mon.0) 1956 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: audit 2024-03-11T22:16:08.207024+0000 mon.a (mon.0) 1957 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]': finished 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: audit 2024-03-11T22:16:08.207203+0000 mon.a (mon.0) 1958 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: audit 2024-03-11T22:16:08.216006+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: cluster 2024-03-11T22:16:08.672032+0000 mon.a (mon.0) 1959 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: audit 2024-03-11T22:16:08.673561+0000 mon.a (mon.0) 1960 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: audit 2024-03-11T22:16:08.723962+0000 mgr.y (mgr.14601) 317 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: audit 2024-03-11T22:16:09.211207+0000 mon.a (mon.0) 1961 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: audit 2024-03-11T22:16:09.211502+0000 mon.a (mon.0) 1962 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:10.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:10 smithi187 bash[23415]: cluster 2024-03-11T22:16:09.222019+0000 mon.a (mon.0) 1963 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-03-11T22:16:10.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: cluster 2024-03-11T22:16:08.067661+0000 mgr.y (mgr.14601) 316 : cluster 0 pgmap v401: 292 pgs: 292 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: cluster 2024-03-11T22:16:08.204741+0000 mon.a (mon.0) 1955 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: cluster 2024-03-11T22:16:08.205598+0000 mon.a (mon.0) 1956 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: audit 2024-03-11T22:16:08.207024+0000 mon.a (mon.0) 1957 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]': finished 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: audit 2024-03-11T22:16:08.207203+0000 mon.a (mon.0) 1958 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: audit 2024-03-11T22:16:08.216006+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: cluster 2024-03-11T22:16:08.672032+0000 mon.a (mon.0) 1959 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: audit 2024-03-11T22:16:08.673561+0000 mon.a (mon.0) 1960 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: audit 2024-03-11T22:16:08.723962+0000 mgr.y (mgr.14601) 317 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: audit 2024-03-11T22:16:09.211207+0000 mon.a (mon.0) 1961 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: audit 2024-03-11T22:16:09.211502+0000 mon.a (mon.0) 1962 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:10.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[21434]: cluster 2024-03-11T22:16:09.222019+0000 mon.a (mon.0) 1963 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: cluster 2024-03-11T22:16:08.067661+0000 mgr.y (mgr.14601) 316 : cluster 0 pgmap v401: 292 pgs: 292 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: cluster 2024-03-11T22:16:08.204741+0000 mon.a (mon.0) 1955 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: cluster 2024-03-11T22:16:08.205598+0000 mon.a (mon.0) 1956 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: audit 2024-03-11T22:16:08.207024+0000 mon.a (mon.0) 1957 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-33"}]': finished 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: audit 2024-03-11T22:16:08.207203+0000 mon.a (mon.0) 1958 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: audit 2024-03-11T22:16:08.216006+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.49:0/324520598' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: cluster 2024-03-11T22:16:08.672032+0000 mon.a (mon.0) 1959 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: audit 2024-03-11T22:16:08.673561+0000 mon.a (mon.0) 1960 : audit 1 from='client.46970 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]: dispatch 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: audit 2024-03-11T22:16:08.723962+0000 mgr.y (mgr.14601) 317 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: audit 2024-03-11T22:16:09.211207+0000 mon.a (mon.0) 1961 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi049-64055-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: audit 2024-03-11T22:16:09.211502+0000 mon.a (mon.0) 1962 : audit 1 from='client.46970 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi049-64063-50"}]': finished 2024-03-11T22:16:10.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:10 smithi049 bash[28804]: cluster 2024-03-11T22:16:09.222019+0000 mon.a (mon.0) 1963 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-03-11T22:16:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:11 smithi187 bash[23415]: audit 2024-03-11T22:16:10.045959+0000 mon.c (mon.2) 481 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:11 smithi187 bash[23415]: cluster 2024-03-11T22:16:10.068491+0000 mgr.y (mgr.14601) 318 : cluster 0 pgmap v404: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:11 smithi187 bash[23415]: audit 2024-03-11T22:16:10.219299+0000 mon.b (mon.1) 211 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:11 smithi187 bash[23415]: cluster 2024-03-11T22:16:10.222854+0000 mon.a (mon.0) 1964 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-03-11T22:16:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:11 smithi187 bash[23415]: audit 2024-03-11T22:16:10.227846+0000 mon.a (mon.0) 1965 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:11 smithi187 bash[23415]: audit 2024-03-11T22:16:10.233082+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.49:0/3799811474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:11 smithi187 bash[23415]: audit 2024-03-11T22:16:10.234089+0000 mon.a (mon.0) 1966 : audit 1 from='client.46982 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[28804]: audit 2024-03-11T22:16:10.045959+0000 mon.c (mon.2) 481 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:11.518 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[28804]: cluster 2024-03-11T22:16:10.068491+0000 mgr.y (mgr.14601) 318 : cluster 0 pgmap v404: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[28804]: audit 2024-03-11T22:16:10.219299+0000 mon.b (mon.1) 211 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[28804]: cluster 2024-03-11T22:16:10.222854+0000 mon.a (mon.0) 1964 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[28804]: audit 2024-03-11T22:16:10.227846+0000 mon.a (mon.0) 1965 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[28804]: audit 2024-03-11T22:16:10.233082+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.49:0/3799811474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[28804]: audit 2024-03-11T22:16:10.234089+0000 mon.a (mon.0) 1966 : audit 1 from='client.46982 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[21434]: audit 2024-03-11T22:16:10.045959+0000 mon.c (mon.2) 481 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[21434]: cluster 2024-03-11T22:16:10.068491+0000 mgr.y (mgr.14601) 318 : cluster 0 pgmap v404: 268 pgs: 8 unknown, 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[21434]: audit 2024-03-11T22:16:10.219299+0000 mon.b (mon.1) 211 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[21434]: cluster 2024-03-11T22:16:10.222854+0000 mon.a (mon.0) 1964 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[21434]: audit 2024-03-11T22:16:10.227846+0000 mon.a (mon.0) 1965 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[21434]: audit 2024-03-11T22:16:10.233082+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.49:0/3799811474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:11.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:11 smithi049 bash[21434]: audit 2024-03-11T22:16:10.234089+0000 mon.a (mon.0) 1966 : audit 1 from='client.46982 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:12 smithi187 bash[23415]: audit 2024-03-11T22:16:11.218381+0000 mon.a (mon.0) 1967 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:12 smithi187 bash[23415]: audit 2024-03-11T22:16:11.218619+0000 mon.a (mon.0) 1968 : audit 1 from='client.46982 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:12 smithi187 bash[23415]: audit 2024-03-11T22:16:11.225025+0000 mon.b (mon.1) 212 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:12 smithi187 bash[23415]: cluster 2024-03-11T22:16:11.225864+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-03-11T22:16:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:12 smithi187 bash[23415]: audit 2024-03-11T22:16:11.229167+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:12 smithi187 bash[23415]: audit 2024-03-11T22:16:11.230285+0000 mon.a (mon.0) 1970 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:12.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:12 smithi187 bash[23415]: audit 2024-03-11T22:16:11.234319+0000 mon.a (mon.0) 1971 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:12.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[21434]: audit 2024-03-11T22:16:11.218381+0000 mon.a (mon.0) 1967 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[21434]: audit 2024-03-11T22:16:11.218619+0000 mon.a (mon.0) 1968 : audit 1 from='client.46982 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[21434]: audit 2024-03-11T22:16:11.225025+0000 mon.b (mon.1) 212 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[21434]: cluster 2024-03-11T22:16:11.225864+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[21434]: audit 2024-03-11T22:16:11.229167+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[21434]: audit 2024-03-11T22:16:11.230285+0000 mon.a (mon.0) 1970 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[21434]: audit 2024-03-11T22:16:11.234319+0000 mon.a (mon.0) 1971 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[28804]: audit 2024-03-11T22:16:11.218381+0000 mon.a (mon.0) 1967 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[28804]: audit 2024-03-11T22:16:11.218619+0000 mon.a (mon.0) 1968 : audit 1 from='client.46982 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi049-64063-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[28804]: audit 2024-03-11T22:16:11.225025+0000 mon.b (mon.1) 212 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[28804]: cluster 2024-03-11T22:16:11.225864+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-03-11T22:16:12.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[28804]: audit 2024-03-11T22:16:11.229167+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:12.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[28804]: audit 2024-03-11T22:16:11.230285+0000 mon.a (mon.0) 1970 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:12.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:12 smithi049 bash[28804]: audit 2024-03-11T22:16:11.234319+0000 mon.a (mon.0) 1971 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:13.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: cluster 2024-03-11T22:16:12.069429+0000 mgr.y (mgr.14601) 319 : cluster 0 pgmap v407: 324 pgs: 64 unknown, 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.221252+0000 mon.a (mon.0) 1972 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.221517+0000 mon.a (mon.0) 1973 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.223829+0000 mon.b (mon.1) 213 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: cluster 2024-03-11T22:16:12.228613+0000 mon.a (mon.0) 1974 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.230041+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.232001+0000 mon.a (mon.0) 1975 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.232916+0000 mon.a (mon.0) 1976 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.260143+0000 mon.a (mon.0) 1977 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.261627+0000 mon.a (mon.0) 1978 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:12.262046+0000 mon.a (mon.0) 1979 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:13.224596+0000 mon.a (mon.0) 1980 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:13.224860+0000 mon.a (mon.0) 1981 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:13.225097+0000 mon.a (mon.0) 1982 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:13.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: cluster 2024-03-11T22:16:13.231821+0000 mon.a (mon.0) 1983 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-03-11T22:16:13.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:13.232816+0000 mon.a (mon.0) 1984 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi049-64063-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:13 smithi187 bash[23415]: audit 2024-03-11T22:16:13.236192+0000 mon.a (mon.0) 1985 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: cluster 2024-03-11T22:16:12.069429+0000 mgr.y (mgr.14601) 319 : cluster 0 pgmap v407: 324 pgs: 64 unknown, 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.221252+0000 mon.a (mon.0) 1972 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.221517+0000 mon.a (mon.0) 1973 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.223829+0000 mon.b (mon.1) 213 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: cluster 2024-03-11T22:16:12.228613+0000 mon.a (mon.0) 1974 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.230041+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.232001+0000 mon.a (mon.0) 1975 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.232916+0000 mon.a (mon.0) 1976 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.260143+0000 mon.a (mon.0) 1977 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.261627+0000 mon.a (mon.0) 1978 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:12.262046+0000 mon.a (mon.0) 1979 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:13.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:13.224596+0000 mon.a (mon.0) 1980 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:13.224860+0000 mon.a (mon.0) 1981 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:13.225097+0000 mon.a (mon.0) 1982 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: cluster 2024-03-11T22:16:13.231821+0000 mon.a (mon.0) 1983 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: cluster 2024-03-11T22:16:12.069429+0000 mgr.y (mgr.14601) 319 : cluster 0 pgmap v407: 324 pgs: 64 unknown, 260 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.221252+0000 mon.a (mon.0) 1972 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.221517+0000 mon.a (mon.0) 1973 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.223829+0000 mon.b (mon.1) 213 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: cluster 2024-03-11T22:16:12.228613+0000 mon.a (mon.0) 1974 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.230041+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.49:0/809733486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.232001+0000 mon.a (mon.0) 1975 : audit 1 from='client.46976 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]: dispatch 2024-03-11T22:16:13.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.232916+0000 mon.a (mon.0) 1976 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.260143+0000 mon.a (mon.0) 1977 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.261627+0000 mon.a (mon.0) 1978 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:12.262046+0000 mon.a (mon.0) 1979 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:13.224596+0000 mon.a (mon.0) 1980 : audit 1 from='client.46976 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi049-64055-40"}]': finished 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:13.224860+0000 mon.a (mon.0) 1981 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:13.225097+0000 mon.a (mon.0) 1982 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: cluster 2024-03-11T22:16:13.231821+0000 mon.a (mon.0) 1983 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:13.232816+0000 mon.a (mon.0) 1984 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi049-64063-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[21434]: audit 2024-03-11T22:16:13.236192+0000 mon.a (mon.0) 1985 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]: dispatch 2024-03-11T22:16:13.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:13.232816+0000 mon.a (mon.0) 1984 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi049-64063-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:13.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:13 smithi049 bash[28804]: audit 2024-03-11T22:16:13.236192+0000 mon.a (mon.0) 1985 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]: dispatch 2024-03-11T22:16:14.518 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:16:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:16:14.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:13.229282+0000 mon.b (mon.1) 214 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]: dispatch 2024-03-11T22:16:14.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:13.258013+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:14.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:13.258405+0000 mon.a (mon.0) 1986 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:14.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:13.259482+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:14.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:13.259770+0000 mon.a (mon.0) 1987 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:14.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:13.260237+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:14.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:13.260525+0000 mon.a (mon.0) 1988 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:14.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: cluster 2024-03-11T22:16:14.225789+0000 mon.a (mon.0) 1989 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:14.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:14.228108+0000 mon.a (mon.0) 1990 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]': finished 2024-03-11T22:16:14.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: audit 2024-03-11T22:16:14.228287+0000 mon.a (mon.0) 1991 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:14.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:14 smithi187 bash[23415]: cluster 2024-03-11T22:16:14.691903+0000 mon.a (mon.0) 1992 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-03-11T22:16:15.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:13.229282+0000 mon.b (mon.1) 214 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]: dispatch 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:13.258013+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:13.258405+0000 mon.a (mon.0) 1986 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:13.259482+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:13.259770+0000 mon.a (mon.0) 1987 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:13.260237+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:13.260525+0000 mon.a (mon.0) 1988 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: cluster 2024-03-11T22:16:14.225789+0000 mon.a (mon.0) 1989 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:14.228108+0000 mon.a (mon.0) 1990 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]': finished 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: audit 2024-03-11T22:16:14.228287+0000 mon.a (mon.0) 1991 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[21434]: cluster 2024-03-11T22:16:14.691903+0000 mon.a (mon.0) 1992 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-03-11T22:16:15.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:13.229282+0000 mon.b (mon.1) 214 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]: dispatch 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:13.258013+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:13.258405+0000 mon.a (mon.0) 1986 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:13.259482+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:13.259770+0000 mon.a (mon.0) 1987 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:13.260237+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:13.260525+0000 mon.a (mon.0) 1988 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: cluster 2024-03-11T22:16:14.225789+0000 mon.a (mon.0) 1989 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:14.228108+0000 mon.a (mon.0) 1990 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-35", "mode": "writeback"}]': finished 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: audit 2024-03-11T22:16:14.228287+0000 mon.a (mon.0) 1991 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi049-64055-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:15.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:14 smithi049 bash[28804]: cluster 2024-03-11T22:16:14.691903+0000 mon.a (mon.0) 1992 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-03-11T22:16:15.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:15 smithi187 bash[23415]: cluster 2024-03-11T22:16:14.072040+0000 mgr.y (mgr.14601) 320 : cluster 0 pgmap v410: 292 pgs: 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:15.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:15 smithi187 bash[23415]: audit 2024-03-11T22:16:14.236897+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:15 smithi187 bash[23415]: audit 2024-03-11T22:16:14.694446+0000 mon.a (mon.0) 1993 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:15.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:15 smithi187 bash[23415]: audit 2024-03-11T22:16:15.232069+0000 mon.a (mon.0) 1994 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi049-64063-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:15.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:15 smithi187 bash[23415]: cluster 2024-03-11T22:16:15.699483+0000 mon.a (mon.0) 1995 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-03-11T22:16:16.018 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[21434]: cluster 2024-03-11T22:16:14.072040+0000 mgr.y (mgr.14601) 320 : cluster 0 pgmap v410: 292 pgs: 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:16.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[21434]: audit 2024-03-11T22:16:14.236897+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:16.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[21434]: audit 2024-03-11T22:16:14.694446+0000 mon.a (mon.0) 1993 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:16.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[21434]: audit 2024-03-11T22:16:15.232069+0000 mon.a (mon.0) 1994 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi049-64063-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:16.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[21434]: cluster 2024-03-11T22:16:15.699483+0000 mon.a (mon.0) 1995 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-03-11T22:16:16.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[28804]: cluster 2024-03-11T22:16:14.072040+0000 mgr.y (mgr.14601) 320 : cluster 0 pgmap v410: 292 pgs: 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:16.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[28804]: audit 2024-03-11T22:16:14.236897+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:16.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[28804]: audit 2024-03-11T22:16:14.694446+0000 mon.a (mon.0) 1993 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:16.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[28804]: audit 2024-03-11T22:16:15.232069+0000 mon.a (mon.0) 1994 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi049-64063-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:16.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:15 smithi049 bash[28804]: cluster 2024-03-11T22:16:15.699483+0000 mon.a (mon.0) 1995 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-03-11T22:16:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:17 smithi187 bash[23415]: cluster 2024-03-11T22:16:16.072965+0000 mgr.y (mgr.14601) 321 : cluster 0 pgmap v413: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:17 smithi187 bash[23415]: audit 2024-03-11T22:16:16.235111+0000 mon.a (mon.0) 1996 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:17 smithi187 bash[23415]: cluster 2024-03-11T22:16:16.242067+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-03-11T22:16:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:17 smithi187 bash[23415]: audit 2024-03-11T22:16:16.345779+0000 mon.b (mon.1) 215 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:17 smithi187 bash[23415]: audit 2024-03-11T22:16:16.352283+0000 mon.a (mon.0) 1998 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:17.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:17 smithi187 bash[23415]: cluster 2024-03-11T22:16:16.710505+0000 mon.a (mon.0) 1999 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:17.518 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[21434]: cluster 2024-03-11T22:16:16.072965+0000 mgr.y (mgr.14601) 321 : cluster 0 pgmap v413: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[21434]: audit 2024-03-11T22:16:16.235111+0000 mon.a (mon.0) 1996 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[21434]: cluster 2024-03-11T22:16:16.242067+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[21434]: audit 2024-03-11T22:16:16.345779+0000 mon.b (mon.1) 215 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[21434]: audit 2024-03-11T22:16:16.352283+0000 mon.a (mon.0) 1998 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[21434]: cluster 2024-03-11T22:16:16.710505+0000 mon.a (mon.0) 1999 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[28804]: cluster 2024-03-11T22:16:16.072965+0000 mgr.y (mgr.14601) 321 : cluster 0 pgmap v413: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[28804]: audit 2024-03-11T22:16:16.235111+0000 mon.a (mon.0) 1996 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi049-64055-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[28804]: cluster 2024-03-11T22:16:16.242067+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[28804]: audit 2024-03-11T22:16:16.345779+0000 mon.b (mon.1) 215 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[28804]: audit 2024-03-11T22:16:16.352283+0000 mon.a (mon.0) 1998 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:17.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:17 smithi049 bash[28804]: cluster 2024-03-11T22:16:16.710505+0000 mon.a (mon.0) 1999 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: audit 2024-03-11T22:16:17.238069+0000 mon.a (mon.0) 2000 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: cluster 2024-03-11T22:16:17.245707+0000 mon.a (mon.0) 2001 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: audit 2024-03-11T22:16:17.249351+0000 mon.a (mon.0) 2002 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: audit 2024-03-11T22:16:17.259739+0000 mon.b (mon.1) 216 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: audit 2024-03-11T22:16:17.267125+0000 mon.a (mon.0) 2003 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: audit 2024-03-11T22:16:18.240659+0000 mon.a (mon.0) 2004 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: audit 2024-03-11T22:16:18.240851+0000 mon.a (mon.0) 2005 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[21434]: cluster 2024-03-11T22:16:18.248707+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-03-11T22:16:18.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: audit 2024-03-11T22:16:17.238069+0000 mon.a (mon.0) 2000 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: cluster 2024-03-11T22:16:17.245707+0000 mon.a (mon.0) 2001 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-03-11T22:16:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: audit 2024-03-11T22:16:17.249351+0000 mon.a (mon.0) 2002 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: audit 2024-03-11T22:16:17.259739+0000 mon.b (mon.1) 216 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: audit 2024-03-11T22:16:17.267125+0000 mon.a (mon.0) 2003 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: audit 2024-03-11T22:16:18.240659+0000 mon.a (mon.0) 2004 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: audit 2024-03-11T22:16:18.240851+0000 mon.a (mon.0) 2005 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:18.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:18 smithi049 bash[28804]: cluster 2024-03-11T22:16:18.248707+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-03-11T22:16:18.724 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: audit 2024-03-11T22:16:17.238069+0000 mon.a (mon.0) 2000 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:18.724 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: cluster 2024-03-11T22:16:17.245707+0000 mon.a (mon.0) 2001 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-03-11T22:16:18.724 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: audit 2024-03-11T22:16:17.249351+0000 mon.a (mon.0) 2002 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:18.724 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: audit 2024-03-11T22:16:17.259739+0000 mon.b (mon.1) 216 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:18.724 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: audit 2024-03-11T22:16:17.267125+0000 mon.a (mon.0) 2003 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:18.724 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: audit 2024-03-11T22:16:18.240659+0000 mon.a (mon.0) 2004 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:18.725 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: audit 2024-03-11T22:16:18.240851+0000 mon.a (mon.0) 2005 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:18.725 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[23415]: cluster 2024-03-11T22:16:18.248707+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-03-11T22:16:18.991 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:16:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: cluster 2024-03-11T22:16:18.073830+0000 mgr.y (mgr.14601) 322 : cluster 0 pgmap v416: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:18.250203+0000 mon.a (mon.0) 2007 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:18.250859+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:18.252896+0000 mon.a (mon.0) 2008 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:18.735095+0000 mgr.y (mgr.14601) 323 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:19.244262+0000 mon.a (mon.0) 2009 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:19.244497+0000 mon.a (mon.0) 2010 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:19.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: cluster 2024-03-11T22:16:19.250875+0000 mon.a (mon.0) 2011 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:19.254608+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[21434]: audit 2024-03-11T22:16:19.255651+0000 mon.a (mon.0) 2012 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: cluster 2024-03-11T22:16:18.073830+0000 mgr.y (mgr.14601) 322 : cluster 0 pgmap v416: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:18.250203+0000 mon.a (mon.0) 2007 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:18.250859+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:18.252896+0000 mon.a (mon.0) 2008 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:18.735095+0000 mgr.y (mgr.14601) 323 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:19.244262+0000 mon.a (mon.0) 2009 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:19.244497+0000 mon.a (mon.0) 2010 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:19.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: cluster 2024-03-11T22:16:19.250875+0000 mon.a (mon.0) 2011 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-03-11T22:16:19.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:19.254608+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:19 smithi049 bash[28804]: audit 2024-03-11T22:16:19.255651+0000 mon.a (mon.0) 2012 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: cluster 2024-03-11T22:16:18.073830+0000 mgr.y (mgr.14601) 322 : cluster 0 pgmap v416: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:19.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:18.250203+0000 mon.a (mon.0) 2007 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]: dispatch 2024-03-11T22:16:19.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:18.250859+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:18.252896+0000 mon.a (mon.0) 2008 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:18.735095+0000 mgr.y (mgr.14601) 323 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:19.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:19.244262+0000 mon.a (mon.0) 2009 : audit 1 from='client.? v1:172.21.15.49:0/3589185834' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi049-64063-52"}]': finished 2024-03-11T22:16:19.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:19.244497+0000 mon.a (mon.0) 2010 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:19.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: cluster 2024-03-11T22:16:19.250875+0000 mon.a (mon.0) 2011 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-03-11T22:16:19.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:19.254608+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.49:0/2046080220' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:19.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:19 smithi187 bash[23415]: audit 2024-03-11T22:16:19.255651+0000 mon.a (mon.0) 2012 : audit 1 from='client.46994 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]: dispatch 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:19.313335+0000 mon.a (mon.0) 2013 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:19.315615+0000 mon.a (mon.0) 2014 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:19.316308+0000 mon.a (mon.0) 2015 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:19.330108+0000 mon.b (mon.1) 217 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:19.336281+0000 mon.a (mon.0) 2016 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:20.247491+0000 mon.a (mon.0) 2017 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:20.247717+0000 mon.a (mon.0) 2018 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:20.247894+0000 mon.a (mon.0) 2019 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:20.249722+0000 mon.b (mon.1) 218 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:20.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: cluster 2024-03-11T22:16:20.252127+0000 mon.a (mon.0) 2020 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:20.253478+0000 mon.a (mon.0) 2021 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi049-64063-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[21434]: audit 2024-03-11T22:16:20.256237+0000 mon.a (mon.0) 2022 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:19.313335+0000 mon.a (mon.0) 2013 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:19.315615+0000 mon.a (mon.0) 2014 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:19.316308+0000 mon.a (mon.0) 2015 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:19.330108+0000 mon.b (mon.1) 217 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:19.336281+0000 mon.a (mon.0) 2016 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:20.247491+0000 mon.a (mon.0) 2017 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:20.247717+0000 mon.a (mon.0) 2018 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:20.247894+0000 mon.a (mon.0) 2019 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:20.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:20.249722+0000 mon.b (mon.1) 218 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:20.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: cluster 2024-03-11T22:16:20.252127+0000 mon.a (mon.0) 2020 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-03-11T22:16:20.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:20.253478+0000 mon.a (mon.0) 2021 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi049-64063-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:20 smithi049 bash[28804]: audit 2024-03-11T22:16:20.256237+0000 mon.a (mon.0) 2022 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:20.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:19.313335+0000 mon.a (mon.0) 2013 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:19.315615+0000 mon.a (mon.0) 2014 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:19.316308+0000 mon.a (mon.0) 2015 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:19.330108+0000 mon.b (mon.1) 217 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:19.336281+0000 mon.a (mon.0) 2016 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:20.247491+0000 mon.a (mon.0) 2017 : audit 1 from='client.46994 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi049-64055-41"}]': finished 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:20.247717+0000 mon.a (mon.0) 2018 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:20.247894+0000 mon.a (mon.0) 2019 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:20.249722+0000 mon.b (mon.1) 218 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: cluster 2024-03-11T22:16:20.252127+0000 mon.a (mon.0) 2020 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:20.253478+0000 mon.a (mon.0) 2021 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi049-64063-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:20.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:20 smithi187 bash[23415]: audit 2024-03-11T22:16:20.256237+0000 mon.a (mon.0) 2022 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]: dispatch 2024-03-11T22:16:21.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: cluster 2024-03-11T22:16:20.074756+0000 mgr.y (mgr.14601) 324 : cluster 0 pgmap v419: 292 pgs: 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:16:21.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: audit 2024-03-11T22:16:20.286502+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:21.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: audit 2024-03-11T22:16:20.286833+0000 mon.a (mon.0) 2023 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:21.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: audit 2024-03-11T22:16:20.287985+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:21.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: audit 2024-03-11T22:16:20.288295+0000 mon.a (mon.0) 2024 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:21.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: audit 2024-03-11T22:16:20.288764+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:21.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: audit 2024-03-11T22:16:20.289076+0000 mon.a (mon.0) 2025 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:21.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: cluster 2024-03-11T22:16:21.248618+0000 mon.a (mon.0) 2026 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:21.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:21 smithi187 bash[23415]: audit 2024-03-11T22:16:21.251085+0000 mon.a (mon.0) 2027 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: cluster 2024-03-11T22:16:20.074756+0000 mgr.y (mgr.14601) 324 : cluster 0 pgmap v419: 292 pgs: 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: audit 2024-03-11T22:16:20.286502+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: audit 2024-03-11T22:16:20.286833+0000 mon.a (mon.0) 2023 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: audit 2024-03-11T22:16:20.287985+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: audit 2024-03-11T22:16:20.288295+0000 mon.a (mon.0) 2024 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: audit 2024-03-11T22:16:20.288764+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: audit 2024-03-11T22:16:20.289076+0000 mon.a (mon.0) 2025 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: cluster 2024-03-11T22:16:21.248618+0000 mon.a (mon.0) 2026 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[21434]: audit 2024-03-11T22:16:21.251085+0000 mon.a (mon.0) 2027 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:22.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: cluster 2024-03-11T22:16:20.074756+0000 mgr.y (mgr.14601) 324 : cluster 0 pgmap v419: 292 pgs: 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: audit 2024-03-11T22:16:20.286502+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: audit 2024-03-11T22:16:20.286833+0000 mon.a (mon.0) 2023 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: audit 2024-03-11T22:16:20.287985+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: audit 2024-03-11T22:16:20.288295+0000 mon.a (mon.0) 2024 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: audit 2024-03-11T22:16:20.288764+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: audit 2024-03-11T22:16:20.289076+0000 mon.a (mon.0) 2025 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: cluster 2024-03-11T22:16:21.248618+0000 mon.a (mon.0) 2026 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:22.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:21 smithi049 bash[28804]: audit 2024-03-11T22:16:21.251085+0000 mon.a (mon.0) 2027 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-35"}]': finished 2024-03-11T22:16:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:23 smithi187 bash[23415]: audit 2024-03-11T22:16:21.251289+0000 mon.a (mon.0) 2028 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:23 smithi187 bash[23415]: audit 2024-03-11T22:16:21.261226+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:23 smithi187 bash[23415]: cluster 2024-03-11T22:16:21.714518+0000 mon.a (mon.0) 2029 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-03-11T22:16:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:23 smithi187 bash[23415]: audit 2024-03-11T22:16:21.716402+0000 mon.a (mon.0) 2030 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:23.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:23 smithi187 bash[23415]: audit 2024-03-11T22:16:22.254945+0000 mon.a (mon.0) 2031 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi049-64063-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[21434]: audit 2024-03-11T22:16:21.251289+0000 mon.a (mon.0) 2028 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[21434]: audit 2024-03-11T22:16:21.261226+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[21434]: cluster 2024-03-11T22:16:21.714518+0000 mon.a (mon.0) 2029 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[21434]: audit 2024-03-11T22:16:21.716402+0000 mon.a (mon.0) 2030 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[21434]: audit 2024-03-11T22:16:22.254945+0000 mon.a (mon.0) 2031 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi049-64063-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[28804]: audit 2024-03-11T22:16:21.251289+0000 mon.a (mon.0) 2028 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi049-64055-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[28804]: audit 2024-03-11T22:16:21.261226+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[28804]: cluster 2024-03-11T22:16:21.714518+0000 mon.a (mon.0) 2029 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-03-11T22:16:23.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[28804]: audit 2024-03-11T22:16:21.716402+0000 mon.a (mon.0) 2030 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:23.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:23 smithi049 bash[28804]: audit 2024-03-11T22:16:22.254945+0000 mon.a (mon.0) 2031 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi049-64063-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:24 smithi187 bash[23415]: cluster 2024-03-11T22:16:22.075745+0000 mgr.y (mgr.14601) 325 : cluster 0 pgmap v422: 292 pgs: 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:16:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:24 smithi187 bash[23415]: cluster 2024-03-11T22:16:22.727485+0000 mon.a (mon.0) 2032 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-03-11T22:16:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:24 smithi187 bash[23415]: audit 2024-03-11T22:16:23.258602+0000 mon.a (mon.0) 2033 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:24 smithi187 bash[23415]: cluster 2024-03-11T22:16:23.264960+0000 mon.a (mon.0) 2034 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-03-11T22:16:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:24 smithi187 bash[23415]: audit 2024-03-11T22:16:23.265358+0000 mon.b (mon.1) 219 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:24.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:24 smithi187 bash[23415]: audit 2024-03-11T22:16:23.278153+0000 mon.a (mon.0) 2035 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:24.518 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:16:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[21434]: cluster 2024-03-11T22:16:22.075745+0000 mgr.y (mgr.14601) 325 : cluster 0 pgmap v422: 292 pgs: 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[21434]: cluster 2024-03-11T22:16:22.727485+0000 mon.a (mon.0) 2032 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[21434]: audit 2024-03-11T22:16:23.258602+0000 mon.a (mon.0) 2033 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[21434]: cluster 2024-03-11T22:16:23.264960+0000 mon.a (mon.0) 2034 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[21434]: audit 2024-03-11T22:16:23.265358+0000 mon.b (mon.1) 219 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[21434]: audit 2024-03-11T22:16:23.278153+0000 mon.a (mon.0) 2035 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[28804]: cluster 2024-03-11T22:16:22.075745+0000 mgr.y (mgr.14601) 325 : cluster 0 pgmap v422: 292 pgs: 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:16:24.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[28804]: cluster 2024-03-11T22:16:22.727485+0000 mon.a (mon.0) 2032 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-03-11T22:16:24.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[28804]: audit 2024-03-11T22:16:23.258602+0000 mon.a (mon.0) 2033 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi049-64055-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:24.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[28804]: cluster 2024-03-11T22:16:23.264960+0000 mon.a (mon.0) 2034 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-03-11T22:16:24.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[28804]: audit 2024-03-11T22:16:23.265358+0000 mon.b (mon.1) 219 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:24.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:24 smithi049 bash[28804]: audit 2024-03-11T22:16:23.278153+0000 mon.a (mon.0) 2035 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: cluster 2024-03-11T22:16:24.078590+0000 mgr.y (mgr.14601) 326 : cluster 0 pgmap v425: 308 pgs: 40 creating+peering, 268 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 0 op/s 2024-03-11T22:16:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: cluster 2024-03-11T22:16:24.260276+0000 mon.a (mon.0) 2036 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:25.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:24.262092+0000 mon.a (mon.0) 2037 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: cluster 2024-03-11T22:16:24.269775+0000 mon.a (mon.0) 2038 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:24.270995+0000 mon.b (mon.1) 220 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:24.275835+0000 mon.a (mon.0) 2039 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:24.286235+0000 mon.a (mon.0) 2040 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:25.157984+0000 mon.a (mon.0) 2041 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:25.158156+0000 mon.a (mon.0) 2042 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:25.161626+0000 mon.b (mon.1) 221 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: cluster 2024-03-11T22:16:25.165218+0000 mon.a (mon.0) 2043 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:25.168113+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:25.168344+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:25.168809+0000 mon.a (mon.0) 2045 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:25.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:25 smithi187 bash[23415]: audit 2024-03-11T22:16:25.169299+0000 mon.a (mon.0) 2046 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: cluster 2024-03-11T22:16:24.078590+0000 mgr.y (mgr.14601) 326 : cluster 0 pgmap v425: 308 pgs: 40 creating+peering, 268 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 0 op/s 2024-03-11T22:16:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: cluster 2024-03-11T22:16:24.260276+0000 mon.a (mon.0) 2036 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:24.262092+0000 mon.a (mon.0) 2037 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: cluster 2024-03-11T22:16:24.269775+0000 mon.a (mon.0) 2038 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-03-11T22:16:25.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:24.270995+0000 mon.b (mon.1) 220 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:24.275835+0000 mon.a (mon.0) 2039 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:24.286235+0000 mon.a (mon.0) 2040 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:25.157984+0000 mon.a (mon.0) 2041 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:25.158156+0000 mon.a (mon.0) 2042 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:25.161626+0000 mon.b (mon.1) 221 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: cluster 2024-03-11T22:16:25.165218+0000 mon.a (mon.0) 2043 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:25.168113+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:25.168344+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:25.168809+0000 mon.a (mon.0) 2045 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[28804]: audit 2024-03-11T22:16:25.169299+0000 mon.a (mon.0) 2046 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: cluster 2024-03-11T22:16:24.078590+0000 mgr.y (mgr.14601) 326 : cluster 0 pgmap v425: 308 pgs: 40 creating+peering, 268 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 0 op/s 2024-03-11T22:16:25.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: cluster 2024-03-11T22:16:24.260276+0000 mon.a (mon.0) 2036 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:24.262092+0000 mon.a (mon.0) 2037 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: cluster 2024-03-11T22:16:24.269775+0000 mon.a (mon.0) 2038 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:24.270995+0000 mon.b (mon.1) 220 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:24.275835+0000 mon.a (mon.0) 2039 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:24.286235+0000 mon.a (mon.0) 2040 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:25.157984+0000 mon.a (mon.0) 2041 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:25.158156+0000 mon.a (mon.0) 2042 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:25.161626+0000 mon.b (mon.1) 221 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: cluster 2024-03-11T22:16:25.165218+0000 mon.a (mon.0) 2043 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:25.168113+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:25.168344+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]: dispatch 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:25.168809+0000 mon.a (mon.0) 2045 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:25 smithi049 bash[21434]: audit 2024-03-11T22:16:25.169299+0000 mon.a (mon.0) 2046 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:25.188236+0000 mon.c (mon.2) 496 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:26.161403+0000 mon.a (mon.0) 2047 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:26.161581+0000 mon.a (mon.0) 2048 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]': finished 2024-03-11T22:16:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:26.161719+0000 mon.a (mon.0) 2049 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:26.165126+0000 mon.b (mon.1) 222 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]: dispatch 2024-03-11T22:16:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: cluster 2024-03-11T22:16:26.168709+0000 mon.a (mon.0) 2050 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-03-11T22:16:26.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:26.169816+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:26.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:26.171501+0000 mon.a (mon.0) 2051 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:26.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:26 smithi187 bash[23415]: audit 2024-03-11T22:16:26.172421+0000 mon.a (mon.0) 2052 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]: dispatch 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:25.188236+0000 mon.c (mon.2) 496 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:26.161403+0000 mon.a (mon.0) 2047 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:26.161581+0000 mon.a (mon.0) 2048 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]': finished 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:26.161719+0000 mon.a (mon.0) 2049 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:26.165126+0000 mon.b (mon.1) 222 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]: dispatch 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: cluster 2024-03-11T22:16:26.168709+0000 mon.a (mon.0) 2050 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:26.169816+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:26.171501+0000 mon.a (mon.0) 2051 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:26.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[21434]: audit 2024-03-11T22:16:26.172421+0000 mon.a (mon.0) 2052 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]: dispatch 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:25.188236+0000 mon.c (mon.2) 496 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:26.161403+0000 mon.a (mon.0) 2047 : audit 1 from='client.? v1:172.21.15.49:0/621914228' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi049-64063-53"}]': finished 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:26.161581+0000 mon.a (mon.0) 2048 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-37"}]': finished 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:26.161719+0000 mon.a (mon.0) 2049 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:26.165126+0000 mon.b (mon.1) 222 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]: dispatch 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: cluster 2024-03-11T22:16:26.168709+0000 mon.a (mon.0) 2050 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:26.169816+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.49:0/3970294183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:26.171501+0000 mon.a (mon.0) 2051 : audit 1 from='client.47006 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]: dispatch 2024-03-11T22:16:26.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:26 smithi049 bash[28804]: audit 2024-03-11T22:16:26.172421+0000 mon.a (mon.0) 2052 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]: dispatch 2024-03-11T22:16:27.171 INFO:tasks.workunit.client.0.smithi049.stdout:e 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7033 ms) 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6996 ms) 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6986 ms) 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7498 ms) 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6560 ms) 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7049 ms) 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-03-11T22:16:27.172 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7047 ms) 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6923 ms) 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7050 ms) 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6956 ms) 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7057 ms) 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6946 ms) 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7055 ms) 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-03-11T22:16:27.173 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7023 ms) 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7020 ms) 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6920 ms) 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112120 ms total) 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [----------] Global test environment tear-down 2024-03-11T22:16:27.174 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (235000 ms total) 2024-03-11T22:16:27.175 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio: [ PASSED ] 42 tests. 2024-03-11T22:16:27.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: cluster 2024-03-11T22:16:26.079571+0000 mgr.y (mgr.14601) 327 : cluster 0 pgmap v428: 292 pgs: 32 creating+peering, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-11T22:16:27.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: audit 2024-03-11T22:16:26.204476+0000 mon.a (mon.0) 2053 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: audit 2024-03-11T22:16:26.205824+0000 mon.a (mon.0) 2054 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: audit 2024-03-11T22:16:26.206216+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi049-64063-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:27.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: cluster 2024-03-11T22:16:27.162483+0000 mon.a (mon.0) 2056 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:27.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: audit 2024-03-11T22:16:27.164893+0000 mon.a (mon.0) 2057 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:27.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: audit 2024-03-11T22:16:27.165124+0000 mon.a (mon.0) 2058 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]': finished 2024-03-11T22:16:27.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: audit 2024-03-11T22:16:27.165359+0000 mon.a (mon.0) 2059 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi049-64063-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:27.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: cluster 2024-03-11T22:16:27.172312+0000 mon.a (mon.0) 2060 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-03-11T22:16:27.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:27 smithi187 bash[23415]: audit 2024-03-11T22:16:27.176908+0000 mon.a (mon.0) 2061 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi049-64063-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: cluster 2024-03-11T22:16:26.079571+0000 mgr.y (mgr.14601) 327 : cluster 0 pgmap v428: 292 pgs: 32 creating+peering, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: audit 2024-03-11T22:16:26.204476+0000 mon.a (mon.0) 2053 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: audit 2024-03-11T22:16:26.205824+0000 mon.a (mon.0) 2054 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: audit 2024-03-11T22:16:26.206216+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi049-64063-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: cluster 2024-03-11T22:16:27.162483+0000 mon.a (mon.0) 2056 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: audit 2024-03-11T22:16:27.164893+0000 mon.a (mon.0) 2057 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: audit 2024-03-11T22:16:27.165124+0000 mon.a (mon.0) 2058 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]': finished 2024-03-11T22:16:27.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: audit 2024-03-11T22:16:27.165359+0000 mon.a (mon.0) 2059 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi049-64063-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: cluster 2024-03-11T22:16:27.172312+0000 mon.a (mon.0) 2060 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[21434]: audit 2024-03-11T22:16:27.176908+0000 mon.a (mon.0) 2061 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi049-64063-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: cluster 2024-03-11T22:16:26.079571+0000 mgr.y (mgr.14601) 327 : cluster 0 pgmap v428: 292 pgs: 32 creating+peering, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: audit 2024-03-11T22:16:26.204476+0000 mon.a (mon.0) 2053 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: audit 2024-03-11T22:16:26.205824+0000 mon.a (mon.0) 2054 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: audit 2024-03-11T22:16:26.206216+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi049-64063-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: cluster 2024-03-11T22:16:27.162483+0000 mon.a (mon.0) 2056 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: audit 2024-03-11T22:16:27.164893+0000 mon.a (mon.0) 2057 : audit 1 from='client.47006 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi049-64055-42"}]': finished 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: audit 2024-03-11T22:16:27.165124+0000 mon.a (mon.0) 2058 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-37", "mode": "writeback"}]': finished 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: audit 2024-03-11T22:16:27.165359+0000 mon.a (mon.0) 2059 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi049-64063-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: cluster 2024-03-11T22:16:27.172312+0000 mon.a (mon.0) 2060 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-03-11T22:16:27.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:27 smithi049 bash[28804]: audit 2024-03-11T22:16:27.176908+0000 mon.a (mon.0) 2061 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi049-64063-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:28 smithi187 bash[23415]: audit 2024-03-11T22:16:27.272851+0000 mon.b (mon.1) 223 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:28 smithi187 bash[23415]: audit 2024-03-11T22:16:27.279397+0000 mon.a (mon.0) 2062 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:28.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:28 smithi187 bash[23415]: audit 2024-03-11T22:16:28.168512+0000 mon.a (mon.0) 2063 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:28.991 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:16:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:16:29.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:28 smithi049 bash[21434]: audit 2024-03-11T22:16:27.272851+0000 mon.b (mon.1) 223 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:29.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:28 smithi049 bash[21434]: audit 2024-03-11T22:16:27.279397+0000 mon.a (mon.0) 2062 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:29.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:28 smithi049 bash[21434]: audit 2024-03-11T22:16:28.168512+0000 mon.a (mon.0) 2063 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:29.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:28 smithi049 bash[28804]: audit 2024-03-11T22:16:27.272851+0000 mon.b (mon.1) 223 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:29.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:28 smithi049 bash[28804]: audit 2024-03-11T22:16:27.279397+0000 mon.a (mon.0) 2062 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:29.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:28 smithi049 bash[28804]: audit 2024-03-11T22:16:28.168512+0000 mon.a (mon.0) 2063 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: cluster 2024-03-11T22:16:28.080472+0000 mgr.y (mgr.14601) 328 : cluster 0 pgmap v431: 292 pgs: 32 creating+peering, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: audit 2024-03-11T22:16:28.171175+0000 mon.b (mon.1) 224 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:29.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: cluster 2024-03-11T22:16:28.634454+0000 mon.a (mon.0) 2064 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-03-11T22:16:29.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: audit 2024-03-11T22:16:28.636460+0000 mon.a (mon.0) 2065 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:29.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: audit 2024-03-11T22:16:28.743753+0000 mgr.y (mgr.14601) 329 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:29.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: cluster 2024-03-11T22:16:29.169397+0000 mon.a (mon.0) 2066 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:29.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: audit 2024-03-11T22:16:29.172149+0000 mon.a (mon.0) 2067 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi049-64063-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:29.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: audit 2024-03-11T22:16:29.172391+0000 mon.a (mon.0) 2068 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]': finished 2024-03-11T22:16:29.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:29 smithi187 bash[23415]: cluster 2024-03-11T22:16:29.182924+0000 mon.a (mon.0) 2069 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-03-11T22:16:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: cluster 2024-03-11T22:16:28.080472+0000 mgr.y (mgr.14601) 328 : cluster 0 pgmap v431: 292 pgs: 32 creating+peering, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: audit 2024-03-11T22:16:28.171175+0000 mon.b (mon.1) 224 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: cluster 2024-03-11T22:16:28.634454+0000 mon.a (mon.0) 2064 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-03-11T22:16:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: audit 2024-03-11T22:16:28.636460+0000 mon.a (mon.0) 2065 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: audit 2024-03-11T22:16:28.743753+0000 mgr.y (mgr.14601) 329 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: cluster 2024-03-11T22:16:29.169397+0000 mon.a (mon.0) 2066 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:30.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: audit 2024-03-11T22:16:29.172149+0000 mon.a (mon.0) 2067 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi049-64063-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: audit 2024-03-11T22:16:29.172391+0000 mon.a (mon.0) 2068 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]': finished 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[28804]: cluster 2024-03-11T22:16:29.182924+0000 mon.a (mon.0) 2069 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: cluster 2024-03-11T22:16:28.080472+0000 mgr.y (mgr.14601) 328 : cluster 0 pgmap v431: 292 pgs: 32 creating+peering, 260 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: audit 2024-03-11T22:16:28.171175+0000 mon.b (mon.1) 224 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: cluster 2024-03-11T22:16:28.634454+0000 mon.a (mon.0) 2064 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: audit 2024-03-11T22:16:28.636460+0000 mon.a (mon.0) 2065 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]: dispatch 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: audit 2024-03-11T22:16:28.743753+0000 mgr.y (mgr.14601) 329 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: cluster 2024-03-11T22:16:29.169397+0000 mon.a (mon.0) 2066 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: audit 2024-03-11T22:16:29.172149+0000 mon.a (mon.0) 2067 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi049-64063-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: audit 2024-03-11T22:16:29.172391+0000 mon.a (mon.0) 2068 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-37"}]': finished 2024-03-11T22:16:30.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:29 smithi049 bash[21434]: cluster 2024-03-11T22:16:29.182924+0000 mon.a (mon.0) 2069 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-03-11T22:16:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:30 smithi187 bash[23415]: cluster 2024-03-11T22:16:30.157215+0000 mon.a (mon.0) 2070 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:30.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:30 smithi187 bash[23415]: cluster 2024-03-11T22:16:30.181965+0000 mon.a (mon.0) 2071 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-03-11T22:16:31.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:30 smithi049 bash[21434]: cluster 2024-03-11T22:16:30.157215+0000 mon.a (mon.0) 2070 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:31.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:30 smithi049 bash[21434]: cluster 2024-03-11T22:16:30.181965+0000 mon.a (mon.0) 2071 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-03-11T22:16:31.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:30 smithi049 bash[28804]: cluster 2024-03-11T22:16:30.157215+0000 mon.a (mon.0) 2070 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:31.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:30 smithi049 bash[28804]: cluster 2024-03-11T22:16:30.181965+0000 mon.a (mon.0) 2071 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-03-11T22:16:31.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:31 smithi187 bash[23415]: cluster 2024-03-11T22:16:30.081443+0000 mgr.y (mgr.14601) 330 : cluster 0 pgmap v434: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-11T22:16:31.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:31 smithi187 bash[23415]: cluster 2024-03-11T22:16:31.185246+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-03-11T22:16:31.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:31 smithi187 bash[23415]: audit 2024-03-11T22:16:31.190606+0000 mon.b (mon.1) 225 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:31.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:31 smithi187 bash[23415]: audit 2024-03-11T22:16:31.196750+0000 mon.a (mon.0) 2073 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:31.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:31 smithi187 bash[23415]: audit 2024-03-11T22:16:31.198082+0000 mon.a (mon.0) 2074 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:32.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[21434]: cluster 2024-03-11T22:16:30.081443+0000 mgr.y (mgr.14601) 330 : cluster 0 pgmap v434: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-11T22:16:32.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[21434]: cluster 2024-03-11T22:16:31.185246+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-03-11T22:16:32.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[21434]: audit 2024-03-11T22:16:31.190606+0000 mon.b (mon.1) 225 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:32.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[21434]: audit 2024-03-11T22:16:31.196750+0000 mon.a (mon.0) 2073 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:32.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[21434]: audit 2024-03-11T22:16:31.198082+0000 mon.a (mon.0) 2074 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:32.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[28804]: cluster 2024-03-11T22:16:30.081443+0000 mgr.y (mgr.14601) 330 : cluster 0 pgmap v434: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-11T22:16:32.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[28804]: cluster 2024-03-11T22:16:31.185246+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-03-11T22:16:32.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[28804]: audit 2024-03-11T22:16:31.190606+0000 mon.b (mon.1) 225 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:32.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[28804]: audit 2024-03-11T22:16:31.196750+0000 mon.a (mon.0) 2073 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:32.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:31 smithi049 bash[28804]: audit 2024-03-11T22:16:31.198082+0000 mon.a (mon.0) 2074 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:33 smithi187 bash[23415]: cluster 2024-03-11T22:16:32.082297+0000 mgr.y (mgr.14601) 331 : cluster 0 pgmap v437: 292 pgs: 32 unknown, 260 active+clean; 4.6 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:16:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:33 smithi187 bash[23415]: audit 2024-03-11T22:16:32.181644+0000 mon.a (mon.0) 2075 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:33.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:33 smithi187 bash[23415]: audit 2024-03-11T22:16:32.181853+0000 mon.a (mon.0) 2076 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:33.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:33 smithi187 bash[23415]: audit 2024-03-11T22:16:32.187120+0000 mon.b (mon.1) 226 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:33.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:33 smithi187 bash[23415]: cluster 2024-03-11T22:16:32.189916+0000 mon.a (mon.0) 2077 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-03-11T22:16:33.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:33 smithi187 bash[23415]: audit 2024-03-11T22:16:32.190874+0000 mon.a (mon.0) 2078 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:33.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:33 smithi187 bash[23415]: audit 2024-03-11T22:16:32.194284+0000 mon.a (mon.0) 2079 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[21434]: cluster 2024-03-11T22:16:32.082297+0000 mgr.y (mgr.14601) 331 : cluster 0 pgmap v437: 292 pgs: 32 unknown, 260 active+clean; 4.6 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[21434]: audit 2024-03-11T22:16:32.181644+0000 mon.a (mon.0) 2075 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[21434]: audit 2024-03-11T22:16:32.181853+0000 mon.a (mon.0) 2076 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[21434]: audit 2024-03-11T22:16:32.187120+0000 mon.b (mon.1) 226 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[21434]: cluster 2024-03-11T22:16:32.189916+0000 mon.a (mon.0) 2077 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[21434]: audit 2024-03-11T22:16:32.190874+0000 mon.a (mon.0) 2078 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[21434]: audit 2024-03-11T22:16:32.194284+0000 mon.a (mon.0) 2079 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[28804]: cluster 2024-03-11T22:16:32.082297+0000 mgr.y (mgr.14601) 331 : cluster 0 pgmap v437: 292 pgs: 32 unknown, 260 active+clean; 4.6 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[28804]: audit 2024-03-11T22:16:32.181644+0000 mon.a (mon.0) 2075 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[28804]: audit 2024-03-11T22:16:32.181853+0000 mon.a (mon.0) 2076 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:33.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[28804]: audit 2024-03-11T22:16:32.187120+0000 mon.b (mon.1) 226 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:33.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[28804]: cluster 2024-03-11T22:16:32.189916+0000 mon.a (mon.0) 2077 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-03-11T22:16:33.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[28804]: audit 2024-03-11T22:16:32.190874+0000 mon.a (mon.0) 2078 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]: dispatch 2024-03-11T22:16:33.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:33 smithi049 bash[28804]: audit 2024-03-11T22:16:32.194284+0000 mon.a (mon.0) 2079 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:34.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.185019+0000 mon.a (mon.0) 2080 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.185229+0000 mon.a (mon.0) 2081 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.189601+0000 mon.b (mon.1) 227 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: cluster 2024-03-11T22:16:33.192642+0000 mon.a (mon.0) 2082 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.203394+0000 mon.a (mon.0) 2083 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.228166+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.228521+0000 mon.a (mon.0) 2084 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.229962+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.230265+0000 mon.a (mon.0) 2085 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.230792+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:34.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:34 smithi187 bash[23415]: audit 2024-03-11T22:16:33.231109+0000 mon.a (mon.0) 2086 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:34.519 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:16:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:16:34.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.185019+0000 mon.a (mon.0) 2080 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:34.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.185229+0000 mon.a (mon.0) 2081 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:34.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.189601+0000 mon.b (mon.1) 227 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:34.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: cluster 2024-03-11T22:16:33.192642+0000 mon.a (mon.0) 2082 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-03-11T22:16:34.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.203394+0000 mon.a (mon.0) 2083 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:34.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.228166+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.228521+0000 mon.a (mon.0) 2084 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.229962+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.230265+0000 mon.a (mon.0) 2085 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.230792+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[28804]: audit 2024-03-11T22:16:33.231109+0000 mon.a (mon.0) 2086 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.185019+0000 mon.a (mon.0) 2080 : audit 1 from='client.? v1:172.21.15.49:0/2712945848' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi049-64063-54"}]': finished 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.185229+0000 mon.a (mon.0) 2081 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.189601+0000 mon.b (mon.1) 227 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: cluster 2024-03-11T22:16:33.192642+0000 mon.a (mon.0) 2082 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.203394+0000 mon.a (mon.0) 2083 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:34.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.228166+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.228521+0000 mon.a (mon.0) 2084 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.229962+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.230265+0000 mon.a (mon.0) 2085 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:34.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.230792+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:34.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:34 smithi049 bash[21434]: audit 2024-03-11T22:16:33.231109+0000 mon.a (mon.0) 2086 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:35.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: cluster 2024-03-11T22:16:34.084938+0000 mgr.y (mgr.14601) 332 : cluster 0 pgmap v440: 292 pgs: 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:35.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: audit 2024-03-11T22:16:34.208471+0000 mon.a (mon.0) 2087 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]': finished 2024-03-11T22:16:35.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: audit 2024-03-11T22:16:34.208641+0000 mon.a (mon.0) 2088 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:35.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: audit 2024-03-11T22:16:34.212551+0000 mon.b (mon.1) 228 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]: dispatch 2024-03-11T22:16:35.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: cluster 2024-03-11T22:16:34.215245+0000 mon.a (mon.0) 2089 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-03-11T22:16:35.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: audit 2024-03-11T22:16:34.218064+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:35.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: audit 2024-03-11T22:16:34.218821+0000 mon.a (mon.0) 2090 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:35.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:35 smithi187 bash[23415]: audit 2024-03-11T22:16:34.219392+0000 mon.a (mon.0) 2091 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]: dispatch 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: cluster 2024-03-11T22:16:34.084938+0000 mgr.y (mgr.14601) 332 : cluster 0 pgmap v440: 292 pgs: 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: audit 2024-03-11T22:16:34.208471+0000 mon.a (mon.0) 2087 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]': finished 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: audit 2024-03-11T22:16:34.208641+0000 mon.a (mon.0) 2088 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: audit 2024-03-11T22:16:34.212551+0000 mon.b (mon.1) 228 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]: dispatch 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: cluster 2024-03-11T22:16:34.215245+0000 mon.a (mon.0) 2089 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: audit 2024-03-11T22:16:34.218064+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: audit 2024-03-11T22:16:34.218821+0000 mon.a (mon.0) 2090 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:36.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[21434]: audit 2024-03-11T22:16:34.219392+0000 mon.a (mon.0) 2091 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]: dispatch 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: cluster 2024-03-11T22:16:34.084938+0000 mgr.y (mgr.14601) 332 : cluster 0 pgmap v440: 292 pgs: 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: audit 2024-03-11T22:16:34.208471+0000 mon.a (mon.0) 2087 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-39"}]': finished 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: audit 2024-03-11T22:16:34.208641+0000 mon.a (mon.0) 2088 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi049-64063-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: audit 2024-03-11T22:16:34.212551+0000 mon.b (mon.1) 228 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]: dispatch 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: cluster 2024-03-11T22:16:34.215245+0000 mon.a (mon.0) 2089 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: audit 2024-03-11T22:16:34.218064+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: audit 2024-03-11T22:16:34.218821+0000 mon.a (mon.0) 2090 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:36.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:35 smithi049 bash[28804]: audit 2024-03-11T22:16:34.219392+0000 mon.a (mon.0) 2091 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]: dispatch 2024-03-11T22:16:36.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: cluster 2024-03-11T22:16:35.209823+0000 mon.a (mon.0) 2092 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: audit 2024-03-11T22:16:35.212185+0000 mon.a (mon.0) 2093 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]': finished 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: audit 2024-03-11T22:16:35.593081+0000 mon.b (mon.1) 229 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: cluster 2024-03-11T22:16:35.687647+0000 mon.a (mon.0) 2094 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: audit 2024-03-11T22:16:35.689107+0000 mon.a (mon.0) 2095 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: audit 2024-03-11T22:16:36.215295+0000 mon.a (mon.0) 2096 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: audit 2024-03-11T22:16:36.215609+0000 mon.a (mon.0) 2097 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: audit 2024-03-11T22:16:36.220140+0000 mon.b (mon.1) 230 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: cluster 2024-03-11T22:16:36.222723+0000 mon.a (mon.0) 2098 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-03-11T22:16:36.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:36 smithi187 bash[23415]: audit 2024-03-11T22:16:36.226943+0000 mon.a (mon.0) 2099 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: cluster 2024-03-11T22:16:35.209823+0000 mon.a (mon.0) 2092 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: audit 2024-03-11T22:16:35.212185+0000 mon.a (mon.0) 2093 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]': finished 2024-03-11T22:16:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: audit 2024-03-11T22:16:35.593081+0000 mon.b (mon.1) 229 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: cluster 2024-03-11T22:16:35.687647+0000 mon.a (mon.0) 2094 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-03-11T22:16:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: audit 2024-03-11T22:16:35.689107+0000 mon.a (mon.0) 2095 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: audit 2024-03-11T22:16:36.215295+0000 mon.a (mon.0) 2096 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:37.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: audit 2024-03-11T22:16:36.215609+0000 mon.a (mon.0) 2097 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: audit 2024-03-11T22:16:36.220140+0000 mon.b (mon.1) 230 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: cluster 2024-03-11T22:16:36.222723+0000 mon.a (mon.0) 2098 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[21434]: audit 2024-03-11T22:16:36.226943+0000 mon.a (mon.0) 2099 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: cluster 2024-03-11T22:16:35.209823+0000 mon.a (mon.0) 2092 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: audit 2024-03-11T22:16:35.212185+0000 mon.a (mon.0) 2093 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-39", "mode": "writeback"}]': finished 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: audit 2024-03-11T22:16:35.593081+0000 mon.b (mon.1) 229 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: cluster 2024-03-11T22:16:35.687647+0000 mon.a (mon.0) 2094 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: audit 2024-03-11T22:16:35.689107+0000 mon.a (mon.0) 2095 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: audit 2024-03-11T22:16:36.215295+0000 mon.a (mon.0) 2096 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi049-64063-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: audit 2024-03-11T22:16:36.215609+0000 mon.a (mon.0) 2097 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: audit 2024-03-11T22:16:36.220140+0000 mon.b (mon.1) 230 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:37.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: cluster 2024-03-11T22:16:36.222723+0000 mon.a (mon.0) 2098 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-03-11T22:16:37.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:36 smithi049 bash[28804]: audit 2024-03-11T22:16:36.226943+0000 mon.a (mon.0) 2099 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]: dispatch 2024-03-11T22:16:37.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:37 smithi187 bash[23415]: cluster 2024-03-11T22:16:36.085772+0000 mgr.y (mgr.14601) 333 : cluster 0 pgmap v443: 292 pgs: 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:37.991 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:37 smithi187 bash[23415]: cluster 2024-03-11T22:16:37.215280+0000 mon.a (mon.0) 2100 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:37.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:37 smithi187 bash[23415]: audit 2024-03-11T22:16:37.217479+0000 mon.a (mon.0) 2101 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]': finished 2024-03-11T22:16:37.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:37 smithi187 bash[23415]: cluster 2024-03-11T22:16:37.223564+0000 mon.a (mon.0) 2102 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[21434]: cluster 2024-03-11T22:16:36.085772+0000 mgr.y (mgr.14601) 333 : cluster 0 pgmap v443: 292 pgs: 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[21434]: cluster 2024-03-11T22:16:37.215280+0000 mon.a (mon.0) 2100 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[21434]: audit 2024-03-11T22:16:37.217479+0000 mon.a (mon.0) 2101 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]': finished 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[21434]: cluster 2024-03-11T22:16:37.223564+0000 mon.a (mon.0) 2102 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[28804]: cluster 2024-03-11T22:16:36.085772+0000 mgr.y (mgr.14601) 333 : cluster 0 pgmap v443: 292 pgs: 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[28804]: cluster 2024-03-11T22:16:37.215280+0000 mon.a (mon.0) 2100 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[28804]: audit 2024-03-11T22:16:37.217479+0000 mon.a (mon.0) 2101 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-39"}]': finished 2024-03-11T22:16:38.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:37 smithi049 bash[28804]: cluster 2024-03-11T22:16:37.223564+0000 mon.a (mon.0) 2102 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-03-11T22:16:38.217 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-03-11T22:16:38.217 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-03-11T22:16:38.217 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-03-11T22:16:38.217 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: seed 64247 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (1649 ms) 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (20092 ms) 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (4 ms) 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (21745 ms total) 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (12779 ms) 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (10082 ms) 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-03-11T22:16:38.218 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9994 ms) 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: my_snaps [3] 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: my_snaps [4,3] 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: my_snaps [5,4,3] 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: promoting some heads 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: promoting from clones for snap 6 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: promoting from clones for snap 5 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: promoting from clones for snap 4 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: promoting from clones for snap 3 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: waiting for scrubs... 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: done waiting 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46892 ms) 2024-03-11T22:16:38.219 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9537 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8012 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8015 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8037 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10060 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8954 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10504 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12558 ms) 2024-03-11T22:16:38.220 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8410 ms) 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7620 ms) 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13492 ms) 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7456 ms) 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-03-11T22:16:38.221 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8045 ms) 2024-03-11T22:16:39.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:16:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:16:39.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:39 smithi187 bash[23415]: cluster 2024-03-11T22:16:38.086686+0000 mgr.y (mgr.14601) 334 : cluster 0 pgmap v446: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:39.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:39 smithi187 bash[23415]: cluster 2024-03-11T22:16:38.226338+0000 mon.a (mon.0) 2103 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-03-11T22:16:39.491 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:39 smithi187 bash[23415]: audit 2024-03-11T22:16:38.230914+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:39.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:39 smithi187 bash[23415]: audit 2024-03-11T22:16:38.690463+0000 mon.a (mon.0) 2104 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:39.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:39 smithi187 bash[23415]: cluster 2024-03-11T22:16:38.702425+0000 mon.a (mon.0) 2105 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:39.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:39 smithi187 bash[23415]: audit 2024-03-11T22:16:38.752781+0000 mgr.y (mgr.14601) 335 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:39.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[28804]: cluster 2024-03-11T22:16:38.086686+0000 mgr.y (mgr.14601) 334 : cluster 0 pgmap v446: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:39.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[28804]: cluster 2024-03-11T22:16:38.226338+0000 mon.a (mon.0) 2103 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-03-11T22:16:39.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[28804]: audit 2024-03-11T22:16:38.230914+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:39.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[28804]: audit 2024-03-11T22:16:38.690463+0000 mon.a (mon.0) 2104 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:39.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[28804]: cluster 2024-03-11T22:16:38.702425+0000 mon.a (mon.0) 2105 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:39.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[28804]: audit 2024-03-11T22:16:38.752781+0000 mgr.y (mgr.14601) 335 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:39.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[21434]: cluster 2024-03-11T22:16:38.086686+0000 mgr.y (mgr.14601) 334 : cluster 0 pgmap v446: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:39.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[21434]: cluster 2024-03-11T22:16:38.226338+0000 mon.a (mon.0) 2103 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-03-11T22:16:39.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[21434]: audit 2024-03-11T22:16:38.230914+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:39.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[21434]: audit 2024-03-11T22:16:38.690463+0000 mon.a (mon.0) 2104 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:39.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[21434]: cluster 2024-03-11T22:16:38.702425+0000 mon.a (mon.0) 2105 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:39.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:39 smithi049 bash[21434]: audit 2024-03-11T22:16:38.752781+0000 mgr.y (mgr.14601) 335 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:40.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:39.223587+0000 mon.a (mon.0) 2106 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:40.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:39.228751+0000 mon.b (mon.1) 231 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:40.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: cluster 2024-03-11T22:16:39.230764+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-03-11T22:16:40.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:39.232327+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:39.236632+0000 mon.a (mon.0) 2108 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:39.240003+0000 mon.a (mon.0) 2109 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:40.227114+0000 mon.a (mon.0) 2110 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:40.227342+0000 mon.a (mon.0) 2111 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: audit 2024-03-11T22:16:40.231863+0000 mon.c (mon.2) 504 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[21434]: cluster 2024-03-11T22:16:40.235740+0000 mon.a (mon.0) 2112 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:39.223587+0000 mon.a (mon.0) 2106 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:39.228751+0000 mon.b (mon.1) 231 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: cluster 2024-03-11T22:16:39.230764+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:39.232327+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:39.236632+0000 mon.a (mon.0) 2108 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:40.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:39.240003+0000 mon.a (mon.0) 2109 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:40.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:40.227114+0000 mon.a (mon.0) 2110 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:40.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:40.227342+0000 mon.a (mon.0) 2111 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:40.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: audit 2024-03-11T22:16:40.231863+0000 mon.c (mon.2) 504 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:40.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:40 smithi049 bash[28804]: cluster 2024-03-11T22:16:40.235740+0000 mon.a (mon.0) 2112 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-03-11T22:16:40.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:39.223587+0000 mon.a (mon.0) 2106 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:39.228751+0000 mon.b (mon.1) 231 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: cluster 2024-03-11T22:16:39.230764+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:39.232327+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.49:0/1660806989' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:39.236632+0000 mon.a (mon.0) 2108 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:39.240003+0000 mon.a (mon.0) 2109 : audit 1 from='client.47018 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]: dispatch 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:40.227114+0000 mon.a (mon.0) 2110 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:40.227342+0000 mon.a (mon.0) 2111 : audit 1 from='client.47018 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi049-64063-55"}]': finished 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: audit 2024-03-11T22:16:40.231863+0000 mon.c (mon.2) 504 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:40.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:40 smithi187 bash[23415]: cluster 2024-03-11T22:16:40.235740+0000 mon.a (mon.0) 2112 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-03-11T22:16:41.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: cluster 2024-03-11T22:16:40.087596+0000 mgr.y (mgr.14601) 336 : cluster 0 pgmap v449: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:16:41.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:40.253329+0000 mon.b (mon.1) 232 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:40.284332+0000 mon.a (mon.0) 2113 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:40.286175+0000 mon.a (mon.0) 2114 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:40.289146+0000 mon.a (mon.0) 2115 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:40.289583+0000 mon.a (mon.0) 2116 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi049-64063-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:41.229633+0000 mon.a (mon.0) 2117 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:41.229828+0000 mon.a (mon.0) 2118 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi049-64063-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:41.232518+0000 mon.b (mon.1) 233 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: cluster 2024-03-11T22:16:41.234579+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:41.236265+0000 mon.a (mon.0) 2120 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi049-64063-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[21434]: audit 2024-03-11T22:16:41.238966+0000 mon.a (mon.0) 2121 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:16:41.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: cluster 2024-03-11T22:16:40.087596+0000 mgr.y (mgr.14601) 336 : cluster 0 pgmap v449: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:16:41.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:40.253329+0000 mon.b (mon.1) 232 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:41.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:40.284332+0000 mon.a (mon.0) 2113 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:41.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:40.286175+0000 mon.a (mon.0) 2114 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:40.289146+0000 mon.a (mon.0) 2115 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:40.289583+0000 mon.a (mon.0) 2116 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi049-64063-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:41.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:41.229633+0000 mon.a (mon.0) 2117 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:41.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:41.229828+0000 mon.a (mon.0) 2118 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi049-64063-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:41.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:41.232518+0000 mon.b (mon.1) 233 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:16:41.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: cluster 2024-03-11T22:16:41.234579+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-03-11T22:16:41.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:41.236265+0000 mon.a (mon.0) 2120 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi049-64063-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:41 smithi049 bash[28804]: audit 2024-03-11T22:16:41.238966+0000 mon.a (mon.0) 2121 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: cluster 2024-03-11T22:16:40.087596+0000 mgr.y (mgr.14601) 336 : cluster 0 pgmap v449: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:40.253329+0000 mon.b (mon.1) 232 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:40.284332+0000 mon.a (mon.0) 2113 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:40.286175+0000 mon.a (mon.0) 2114 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:40.289146+0000 mon.a (mon.0) 2115 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:40.289583+0000 mon.a (mon.0) 2116 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi049-64063-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:41.229633+0000 mon.a (mon.0) 2117 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:41.229828+0000 mon.a (mon.0) 2118 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi049-64063-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:41.232518+0000 mon.b (mon.1) 233 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: cluster 2024-03-11T22:16:41.234579+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-03-11T22:16:41.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:41.236265+0000 mon.a (mon.0) 2120 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi049-64063-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:41.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:41 smithi187 bash[23415]: audit 2024-03-11T22:16:41.238966+0000 mon.a (mon.0) 2121 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:16:43.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:43 smithi187 bash[23415]: cluster 2024-03-11T22:16:42.088615+0000 mgr.y (mgr.14601) 337 : cluster 0 pgmap v452: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:16:43.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:43 smithi187 bash[23415]: audit 2024-03-11T22:16:42.233325+0000 mon.a (mon.0) 2122 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:16:43.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:43 smithi187 bash[23415]: audit 2024-03-11T22:16:42.235453+0000 mon.b (mon.1) 234 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:43.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:43 smithi187 bash[23415]: cluster 2024-03-11T22:16:42.703942+0000 mon.a (mon.0) 2123 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-03-11T22:16:43.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:43 smithi187 bash[23415]: audit 2024-03-11T22:16:42.705625+0000 mon.a (mon.0) 2124 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[21434]: cluster 2024-03-11T22:16:42.088615+0000 mgr.y (mgr.14601) 337 : cluster 0 pgmap v452: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:16:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[21434]: audit 2024-03-11T22:16:42.233325+0000 mon.a (mon.0) 2122 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:16:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[21434]: audit 2024-03-11T22:16:42.235453+0000 mon.b (mon.1) 234 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[21434]: cluster 2024-03-11T22:16:42.703942+0000 mon.a (mon.0) 2123 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-03-11T22:16:43.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[21434]: audit 2024-03-11T22:16:42.705625+0000 mon.a (mon.0) 2124 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:43.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[28804]: cluster 2024-03-11T22:16:42.088615+0000 mgr.y (mgr.14601) 337 : cluster 0 pgmap v452: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:16:43.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[28804]: audit 2024-03-11T22:16:42.233325+0000 mon.a (mon.0) 2122 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:16:43.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[28804]: audit 2024-03-11T22:16:42.235453+0000 mon.b (mon.1) 234 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:43.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[28804]: cluster 2024-03-11T22:16:42.703942+0000 mon.a (mon.0) 2123 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-03-11T22:16:43.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:43 smithi049 bash[28804]: audit 2024-03-11T22:16:42.705625+0000 mon.a (mon.0) 2124 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:44.519 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:16:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:16:44.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[21434]: audit 2024-03-11T22:16:43.246103+0000 mon.a (mon.0) 2125 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi049-64063-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:44.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[21434]: audit 2024-03-11T22:16:43.246309+0000 mon.a (mon.0) 2126 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[21434]: audit 2024-03-11T22:16:43.247980+0000 mon.b (mon.1) 235 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[21434]: cluster 2024-03-11T22:16:43.253820+0000 mon.a (mon.0) 2127 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[21434]: audit 2024-03-11T22:16:43.258562+0000 mon.a (mon.0) 2128 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[28804]: audit 2024-03-11T22:16:43.246103+0000 mon.a (mon.0) 2125 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi049-64063-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[28804]: audit 2024-03-11T22:16:43.246309+0000 mon.a (mon.0) 2126 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[28804]: audit 2024-03-11T22:16:43.247980+0000 mon.b (mon.1) 235 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[28804]: cluster 2024-03-11T22:16:43.253820+0000 mon.a (mon.0) 2127 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-03-11T22:16:44.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:44 smithi049 bash[28804]: audit 2024-03-11T22:16:43.258562+0000 mon.a (mon.0) 2128 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:16:44.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:44 smithi187 bash[23415]: audit 2024-03-11T22:16:43.246103+0000 mon.a (mon.0) 2125 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi049-64063-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:44.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:44 smithi187 bash[23415]: audit 2024-03-11T22:16:43.246309+0000 mon.a (mon.0) 2126 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:16:44.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:44 smithi187 bash[23415]: audit 2024-03-11T22:16:43.247980+0000 mon.b (mon.1) 235 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:16:44.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:44 smithi187 bash[23415]: cluster 2024-03-11T22:16:43.253820+0000 mon.a (mon.0) 2127 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-03-11T22:16:44.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:44 smithi187 bash[23415]: audit 2024-03-11T22:16:43.258562+0000 mon.a (mon.0) 2128 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:16:45.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[21434]: cluster 2024-03-11T22:16:44.091296+0000 mgr.y (mgr.14601) 338 : cluster 0 pgmap v455: 300 pgs: 8 creating+peering, 292 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:45.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[21434]: cluster 2024-03-11T22:16:44.246011+0000 mon.a (mon.0) 2129 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:45.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[21434]: audit 2024-03-11T22:16:44.255096+0000 mon.a (mon.0) 2130 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:16:45.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[21434]: cluster 2024-03-11T22:16:44.264529+0000 mon.a (mon.0) 2131 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-03-11T22:16:45.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[28804]: cluster 2024-03-11T22:16:44.091296+0000 mgr.y (mgr.14601) 338 : cluster 0 pgmap v455: 300 pgs: 8 creating+peering, 292 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:45.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[28804]: cluster 2024-03-11T22:16:44.246011+0000 mon.a (mon.0) 2129 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:45.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[28804]: audit 2024-03-11T22:16:44.255096+0000 mon.a (mon.0) 2130 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:16:45.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:45 smithi049 bash[28804]: cluster 2024-03-11T22:16:44.264529+0000 mon.a (mon.0) 2131 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-03-11T22:16:45.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:45 smithi187 bash[23415]: cluster 2024-03-11T22:16:44.091296+0000 mgr.y (mgr.14601) 338 : cluster 0 pgmap v455: 300 pgs: 8 creating+peering, 292 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:45.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:45 smithi187 bash[23415]: cluster 2024-03-11T22:16:44.246011+0000 mon.a (mon.0) 2129 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:45.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:45 smithi187 bash[23415]: audit 2024-03-11T22:16:44.255096+0000 mon.a (mon.0) 2130 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:16:45.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:45 smithi187 bash[23415]: cluster 2024-03-11T22:16:44.264529+0000 mon.a (mon.0) 2131 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-03-11T22:16:46.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[21434]: cluster 2024-03-11T22:16:45.273654+0000 mon.a (mon.0) 2132 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-03-11T22:16:46.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[21434]: audit 2024-03-11T22:16:45.277561+0000 mon.a (mon.0) 2133 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:46.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[21434]: audit 2024-03-11T22:16:45.372036+0000 mon.b (mon.1) 236 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:46.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[21434]: audit 2024-03-11T22:16:45.374277+0000 mon.b (mon.1) 237 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]: dispatch 2024-03-11T22:16:46.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[21434]: audit 2024-03-11T22:16:45.378527+0000 mon.a (mon.0) 2134 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:46.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[21434]: audit 2024-03-11T22:16:45.380522+0000 mon.a (mon.0) 2135 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]: dispatch 2024-03-11T22:16:46.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[28804]: cluster 2024-03-11T22:16:45.273654+0000 mon.a (mon.0) 2132 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-03-11T22:16:46.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[28804]: audit 2024-03-11T22:16:45.277561+0000 mon.a (mon.0) 2133 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:46.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[28804]: audit 2024-03-11T22:16:45.372036+0000 mon.b (mon.1) 236 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:46.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[28804]: audit 2024-03-11T22:16:45.374277+0000 mon.b (mon.1) 237 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]: dispatch 2024-03-11T22:16:46.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[28804]: audit 2024-03-11T22:16:45.378527+0000 mon.a (mon.0) 2134 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:46.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:46 smithi049 bash[28804]: audit 2024-03-11T22:16:45.380522+0000 mon.a (mon.0) 2135 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]: dispatch 2024-03-11T22:16:46.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:46 smithi187 bash[23415]: cluster 2024-03-11T22:16:45.273654+0000 mon.a (mon.0) 2132 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-03-11T22:16:46.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:46 smithi187 bash[23415]: audit 2024-03-11T22:16:45.277561+0000 mon.a (mon.0) 2133 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:46.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:46 smithi187 bash[23415]: audit 2024-03-11T22:16:45.372036+0000 mon.b (mon.1) 236 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:46.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:46 smithi187 bash[23415]: audit 2024-03-11T22:16:45.374277+0000 mon.b (mon.1) 237 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]: dispatch 2024-03-11T22:16:46.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:46 smithi187 bash[23415]: audit 2024-03-11T22:16:45.378527+0000 mon.a (mon.0) 2134 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:46.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:46 smithi187 bash[23415]: audit 2024-03-11T22:16:45.380522+0000 mon.a (mon.0) 2135 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]: dispatch 2024-03-11T22:16:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[28804]: cluster 2024-03-11T22:16:46.092146+0000 mgr.y (mgr.14601) 339 : cluster 0 pgmap v458: 292 pgs: 292 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[28804]: audit 2024-03-11T22:16:46.276125+0000 mon.a (mon.0) 2136 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[28804]: audit 2024-03-11T22:16:46.276277+0000 mon.a (mon.0) 2137 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]': finished 2024-03-11T22:16:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[28804]: cluster 2024-03-11T22:16:46.285675+0000 mon.a (mon.0) 2138 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-03-11T22:16:47.519 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[28804]: audit 2024-03-11T22:16:46.287062+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:47.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[21434]: cluster 2024-03-11T22:16:46.092146+0000 mgr.y (mgr.14601) 339 : cluster 0 pgmap v458: 292 pgs: 292 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:47.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[21434]: audit 2024-03-11T22:16:46.276125+0000 mon.a (mon.0) 2136 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:47.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[21434]: audit 2024-03-11T22:16:46.276277+0000 mon.a (mon.0) 2137 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]': finished 2024-03-11T22:16:47.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[21434]: cluster 2024-03-11T22:16:46.285675+0000 mon.a (mon.0) 2138 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-03-11T22:16:47.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:47 smithi049 bash[21434]: audit 2024-03-11T22:16:46.287062+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:47 smithi187 bash[23415]: cluster 2024-03-11T22:16:46.092146+0000 mgr.y (mgr.14601) 339 : cluster 0 pgmap v458: 292 pgs: 292 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:47.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:47 smithi187 bash[23415]: audit 2024-03-11T22:16:46.276125+0000 mon.a (mon.0) 2136 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:47.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:47 smithi187 bash[23415]: audit 2024-03-11T22:16:46.276277+0000 mon.a (mon.0) 2137 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-41"}]': finished 2024-03-11T22:16:47.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:47 smithi187 bash[23415]: cluster 2024-03-11T22:16:46.285675+0000 mon.a (mon.0) 2138 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-03-11T22:16:47.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:47 smithi187 bash[23415]: audit 2024-03-11T22:16:46.287062+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]: dispatch 2024-03-11T22:16:48.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: audit 2024-03-11T22:16:47.287113+0000 mon.a (mon.0) 2140 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:48.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: cluster 2024-03-11T22:16:47.293870+0000 mon.a (mon.0) 2141 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-03-11T22:16:48.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: audit 2024-03-11T22:16:47.327735+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: audit 2024-03-11T22:16:47.754636+0000 mon.a (mon.0) 2142 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: audit 2024-03-11T22:16:47.755765+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: audit 2024-03-11T22:16:47.756258+0000 mon.a (mon.0) 2143 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: audit 2024-03-11T22:16:47.756870+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:48.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[23415]: audit 2024-03-11T22:16:47.757409+0000 mon.a (mon.0) 2144 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:48.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: audit 2024-03-11T22:16:47.287113+0000 mon.a (mon.0) 2140 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:48.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: cluster 2024-03-11T22:16:47.293870+0000 mon.a (mon.0) 2141 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-03-11T22:16:48.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: audit 2024-03-11T22:16:47.327735+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: audit 2024-03-11T22:16:47.754636+0000 mon.a (mon.0) 2142 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: audit 2024-03-11T22:16:47.755765+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: audit 2024-03-11T22:16:47.756258+0000 mon.a (mon.0) 2143 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: audit 2024-03-11T22:16:47.756870+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[21434]: audit 2024-03-11T22:16:47.757409+0000 mon.a (mon.0) 2144 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: audit 2024-03-11T22:16:47.287113+0000 mon.a (mon.0) 2140 : audit 1 from='client.? v1:172.21.15.49:0/916398702' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi049-64063-56"}]': finished 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: cluster 2024-03-11T22:16:47.293870+0000 mon.a (mon.0) 2141 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: audit 2024-03-11T22:16:47.327735+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: audit 2024-03-11T22:16:47.754636+0000 mon.a (mon.0) 2142 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: audit 2024-03-11T22:16:47.755765+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: audit 2024-03-11T22:16:47.756258+0000 mon.a (mon.0) 2143 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:48.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: audit 2024-03-11T22:16:47.756870+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:48.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:48 smithi049 bash[28804]: audit 2024-03-11T22:16:47.757409+0000 mon.a (mon.0) 2144 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:49.241 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:16:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: cluster 2024-03-11T22:16:48.093029+0000 mgr.y (mgr.14601) 340 : cluster 0 pgmap v461: 260 pgs: 260 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: audit 2024-03-11T22:16:48.290893+0000 mon.a (mon.0) 2145 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: audit 2024-03-11T22:16:48.300862+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: cluster 2024-03-11T22:16:48.302235+0000 mon.a (mon.0) 2146 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: audit 2024-03-11T22:16:48.308614+0000 mon.a (mon.0) 2147 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: audit 2024-03-11T22:16:48.320481+0000 mon.b (mon.1) 238 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: audit 2024-03-11T22:16:48.338169+0000 mon.a (mon.0) 2148 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:50.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: audit 2024-03-11T22:16:48.763679+0000 mgr.y (mgr.14601) 341 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: audit 2024-03-11T22:16:49.294543+0000 mon.a (mon.0) 2149 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[21434]: cluster 2024-03-11T22:16:49.763233+0000 mon.a (mon.0) 2150 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: cluster 2024-03-11T22:16:48.093029+0000 mgr.y (mgr.14601) 340 : cluster 0 pgmap v461: 260 pgs: 260 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: audit 2024-03-11T22:16:48.290893+0000 mon.a (mon.0) 2145 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: audit 2024-03-11T22:16:48.300862+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: cluster 2024-03-11T22:16:48.302235+0000 mon.a (mon.0) 2146 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: audit 2024-03-11T22:16:48.308614+0000 mon.a (mon.0) 2147 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: audit 2024-03-11T22:16:48.320481+0000 mon.b (mon.1) 238 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: audit 2024-03-11T22:16:48.338169+0000 mon.a (mon.0) 2148 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: audit 2024-03-11T22:16:48.763679+0000 mgr.y (mgr.14601) 341 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: audit 2024-03-11T22:16:49.294543+0000 mon.a (mon.0) 2149 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:50.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:49 smithi049 bash[28804]: cluster 2024-03-11T22:16:49.763233+0000 mon.a (mon.0) 2150 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-03-11T22:16:50.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: cluster 2024-03-11T22:16:48.093029+0000 mgr.y (mgr.14601) 340 : cluster 0 pgmap v461: 260 pgs: 260 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:50.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: audit 2024-03-11T22:16:48.290893+0000 mon.a (mon.0) 2145 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi049-64063-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:50.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: audit 2024-03-11T22:16:48.300862+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:50.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: cluster 2024-03-11T22:16:48.302235+0000 mon.a (mon.0) 2146 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-03-11T22:16:50.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: audit 2024-03-11T22:16:48.308614+0000 mon.a (mon.0) 2147 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:50.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: audit 2024-03-11T22:16:48.320481+0000 mon.b (mon.1) 238 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:50.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: audit 2024-03-11T22:16:48.338169+0000 mon.a (mon.0) 2148 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:50.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: audit 2024-03-11T22:16:48.763679+0000 mgr.y (mgr.14601) 341 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:50.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: audit 2024-03-11T22:16:49.294543+0000 mon.a (mon.0) 2149 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:50.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:49 smithi187 bash[23415]: cluster 2024-03-11T22:16:49.763233+0000 mon.a (mon.0) 2150 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-03-11T22:16:51.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: audit 2024-03-11T22:16:49.299332+0000 mon.b (mon.1) 239 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi049-64247-6","var": "pg_num","format": "json"}]: dispatch 2024-03-11T22:16:51.019 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: audit 2024-03-11T22:16:49.300974+0000 mon.b (mon.1) 240 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: audit 2024-03-11T22:16:49.764805+0000 mon.a (mon.0) 2151 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: cluster 2024-03-11T22:16:50.167623+0000 mon.a (mon.0) 2152 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: audit 2024-03-11T22:16:50.297618+0000 mon.a (mon.0) 2153 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: audit 2024-03-11T22:16:50.297847+0000 mon.a (mon.0) 2154 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: audit 2024-03-11T22:16:50.302069+0000 mon.b (mon.1) 241 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: cluster 2024-03-11T22:16:50.305396+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[28804]: audit 2024-03-11T22:16:50.309315+0000 mon.a (mon.0) 2156 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: audit 2024-03-11T22:16:49.299332+0000 mon.b (mon.1) 239 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi049-64247-6","var": "pg_num","format": "json"}]: dispatch 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: audit 2024-03-11T22:16:49.300974+0000 mon.b (mon.1) 240 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: audit 2024-03-11T22:16:49.764805+0000 mon.a (mon.0) 2151 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: cluster 2024-03-11T22:16:50.167623+0000 mon.a (mon.0) 2152 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: audit 2024-03-11T22:16:50.297618+0000 mon.a (mon.0) 2153 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: audit 2024-03-11T22:16:50.297847+0000 mon.a (mon.0) 2154 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:51.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: audit 2024-03-11T22:16:50.302069+0000 mon.b (mon.1) 241 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-11T22:16:51.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: cluster 2024-03-11T22:16:50.305396+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-03-11T22:16:51.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:50 smithi049 bash[21434]: audit 2024-03-11T22:16:50.309315+0000 mon.a (mon.0) 2156 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: audit 2024-03-11T22:16:49.299332+0000 mon.b (mon.1) 239 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi049-64247-6","var": "pg_num","format": "json"}]: dispatch 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: audit 2024-03-11T22:16:49.300974+0000 mon.b (mon.1) 240 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: audit 2024-03-11T22:16:49.764805+0000 mon.a (mon.0) 2151 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: cluster 2024-03-11T22:16:50.167623+0000 mon.a (mon.0) 2152 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: audit 2024-03-11T22:16:50.297618+0000 mon.a (mon.0) 2153 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi049-64063-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: audit 2024-03-11T22:16:50.297847+0000 mon.a (mon.0) 2154 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: audit 2024-03-11T22:16:50.302069+0000 mon.b (mon.1) 241 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: cluster 2024-03-11T22:16:50.305396+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-03-11T22:16:51.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:50 smithi187 bash[23415]: audit 2024-03-11T22:16:50.309315+0000 mon.a (mon.0) 2156 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-11T22:16:52.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:51 smithi187 bash[23415]: cluster 2024-03-11T22:16:50.093948+0000 mgr.y (mgr.14601) 342 : cluster 0 pgmap v464: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:52.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:51 smithi187 bash[23415]: audit 2024-03-11T22:16:51.300412+0000 mon.a (mon.0) 2157 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]': finished 2024-03-11T22:16:52.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:51 smithi187 bash[23415]: audit 2024-03-11T22:16:51.303869+0000 mon.b (mon.1) 242 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:52.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:51 smithi187 bash[23415]: cluster 2024-03-11T22:16:51.307180+0000 mon.a (mon.0) 2158 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-03-11T22:16:52.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:51 smithi187 bash[23415]: audit 2024-03-11T22:16:51.310919+0000 mon.a (mon.0) 2159 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:52.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[28804]: cluster 2024-03-11T22:16:50.093948+0000 mgr.y (mgr.14601) 342 : cluster 0 pgmap v464: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:52.269 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[28804]: audit 2024-03-11T22:16:51.300412+0000 mon.a (mon.0) 2157 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]': finished 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[28804]: audit 2024-03-11T22:16:51.303869+0000 mon.b (mon.1) 242 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[28804]: cluster 2024-03-11T22:16:51.307180+0000 mon.a (mon.0) 2158 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[28804]: audit 2024-03-11T22:16:51.310919+0000 mon.a (mon.0) 2159 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[21434]: cluster 2024-03-11T22:16:50.093948+0000 mgr.y (mgr.14601) 342 : cluster 0 pgmap v464: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[21434]: audit 2024-03-11T22:16:51.300412+0000 mon.a (mon.0) 2157 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_count","val": "8"}]': finished 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[21434]: audit 2024-03-11T22:16:51.303869+0000 mon.b (mon.1) 242 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[21434]: cluster 2024-03-11T22:16:51.307180+0000 mon.a (mon.0) 2158 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-03-11T22:16:52.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:51 smithi049 bash[21434]: audit 2024-03-11T22:16:51.310919+0000 mon.a (mon.0) 2159 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:16:53.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:53 smithi187 bash[23415]: cluster 2024-03-11T22:16:52.094886+0000 mgr.y (mgr.14601) 343 : cluster 0 pgmap v467: 300 pgs: 8 unknown, 32 creating+peering, 260 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:53.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:53 smithi187 bash[23415]: audit 2024-03-11T22:16:52.303079+0000 mon.a (mon.0) 2160 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:16:53.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:53 smithi187 bash[23415]: audit 2024-03-11T22:16:52.306281+0000 mon.b (mon.1) 243 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-11T22:16:53.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:53 smithi187 bash[23415]: cluster 2024-03-11T22:16:52.310857+0000 mon.a (mon.0) 2161 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-03-11T22:16:53.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:53 smithi187 bash[23415]: audit 2024-03-11T22:16:52.313564+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:53.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:53 smithi187 bash[23415]: audit 2024-03-11T22:16:52.314921+0000 mon.a (mon.0) 2162 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-11T22:16:53.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:53 smithi187 bash[23415]: audit 2024-03-11T22:16:52.316616+0000 mon.a (mon.0) 2163 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:53.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[28804]: cluster 2024-03-11T22:16:52.094886+0000 mgr.y (mgr.14601) 343 : cluster 0 pgmap v467: 300 pgs: 8 unknown, 32 creating+peering, 260 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:53.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[28804]: audit 2024-03-11T22:16:52.303079+0000 mon.a (mon.0) 2160 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:16:53.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[28804]: audit 2024-03-11T22:16:52.306281+0000 mon.b (mon.1) 243 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[28804]: cluster 2024-03-11T22:16:52.310857+0000 mon.a (mon.0) 2161 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[28804]: audit 2024-03-11T22:16:52.313564+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[28804]: audit 2024-03-11T22:16:52.314921+0000 mon.a (mon.0) 2162 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[28804]: audit 2024-03-11T22:16:52.316616+0000 mon.a (mon.0) 2163 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[21434]: cluster 2024-03-11T22:16:52.094886+0000 mgr.y (mgr.14601) 343 : cluster 0 pgmap v467: 300 pgs: 8 unknown, 32 creating+peering, 260 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[21434]: audit 2024-03-11T22:16:52.303079+0000 mon.a (mon.0) 2160 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[21434]: audit 2024-03-11T22:16:52.306281+0000 mon.b (mon.1) 243 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[21434]: cluster 2024-03-11T22:16:52.310857+0000 mon.a (mon.0) 2161 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[21434]: audit 2024-03-11T22:16:52.313564+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[21434]: audit 2024-03-11T22:16:52.314921+0000 mon.a (mon.0) 2162 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-11T22:16:53.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:53 smithi049 bash[21434]: audit 2024-03-11T22:16:52.316616+0000 mon.a (mon.0) 2163 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:53.962 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-03-11T22:16:53.962 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: hmm, no HitSet yet 2024-03-11T22:16:53.962 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: ok, hit_set contains 267:602f83fe:::foo:head 2024-03-11T22:16:53.962 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9070 ms) 2024-03-11T22:16:53.962 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-03-11T22:16:53.962 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg_num = 32 2024-03-11T22:16:53.962 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 0 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 1 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 2 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 3 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 4 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 5 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 6 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 7 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 8 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 9 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 10 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 11 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 12 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 13 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 14 ls 1710195414,0 2024-03-11T22:16:53.963 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 15 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 16 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 17 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 18 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 19 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 20 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 21 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 22 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 23 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 24 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 25 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 26 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 27 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 28 ls 1710195414,0 2024-03-11T22:16:53.964 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 29 ls 1710195414,0 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 30 ls 1710195414,0 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg 31 ls 1710195414,0 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: pg_num = 32 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6cac518f:::0:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:02547ec2:::1:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f905c69b:::2:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:cfc208b3:::3:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d83876eb:::4:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b29083e3:::5:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c4fdafeb:::6:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:5c6b0b28:::7:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:bd63b0f1:::8:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:e960b815:::9:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:52ea6a34:::10:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:89d3ae78:::11:head 2024-03-11T22:16:53.965 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:de5d7c5f:::12:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:566253c9:::13:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:62a1935d:::14:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:863748b0:::15:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:3958e169:::16:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:4d4dabf9:::17:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:8391935d:::18:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:28883081:::19:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:69259c59:::20:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:4bdb80b7:::21:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a11c5d71:::22:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:271af37b:::23:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:95b121be:::24:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:58d1031b:::25:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:0a050783:::26:head 2024-03-11T22:16:53.966 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c709704c:::27:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:cbe56eaf:::28:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:86b4b162:::29:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:70d89383:::30:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:dd450c7c:::31:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6d5729b1:::32:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c388f3fb:::33:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:56cfea31:::34:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:9dbc1bf7:::35:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:40b74ccd:::36:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:4d5aaf42:::37:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:920f362c:::38:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6cc53222:::39:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:9cad833f:::40:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:1ea84d41:::41:head 2024-03-11T22:16:53.967 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c4480ef6:::42:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a694361e:::43:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d1bd33e9:::44:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:ddc2cd5d:::45:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:2b782207:::46:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:7b187fca:::47:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:90ecdf6f:::48:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a5ed95fe:::49:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:ea0eaa55:::50:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f33ef17b:::51:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a0d1b2f6:::52:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:60c5229e:::53:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:edcbc575:::54:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:102cf253:::55:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:efb7fb0b:::56:head 2024-03-11T22:16:53.968 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:50d0a326:::57:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d4dc5daf:::58:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:3a130462:::59:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:ec87ed71:::60:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d5bc9454:::61:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:3ddfe313:::62:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:7c2816b9:::63:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:47e00e4d:::64:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c6410c18:::65:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b48ed237:::66:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:cd63ad31:::67:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b179e92b:::68:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:0d9f741a:::69:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6d3352ae:::70:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c6d5c19e:::71:head 2024-03-11T22:16:53.969 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:bc4729c3:::72:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:77e930b9:::73:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:0abeecfd:::74:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b7c37e15:::75:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b6378398:::76:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:02bd68de:::77:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:cc795d2d:::78:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:630d4fea:::79:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:e0d29ef5:::80:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:fd6f13d2:::81:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:606461d5:::82:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:eadbdc43:::83:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:8761d0bb:::84:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:9ef0186f:::85:head 2024-03-11T22:16:53.970 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:e0d41294:::86:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:961de695:::87:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:1423148f:::88:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:633a8fa2:::89:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a8653809:::90:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:3dac8b33:::91:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:35aad435:::92:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f6dcc343:::93:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:dbbdad87:::94:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:1cb48ce0:::95:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:03cd461c:::96:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:17a4ea99:::97:head 2024-03-11T22:16:53.971 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:9993c9a7:::98:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6394211c:::99:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:94c7ae57:::100:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6fdee5bb:::101:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:9a477fd1:::102:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:eb850916:::103:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:affc56b9:::104:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b42dc814:::105:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f319f8f0:::106:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:9a40b9de:::107:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:8b524f28:::108:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:e3de589f:::109:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:90f90a5b:::110:head 2024-03-11T22:16:53.972 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a7b4f1d7:::111:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:af51766e:::112:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b6f90bd1:::113:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:e0261208:::114:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c9569ef7:::115:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:61bebe50:::116:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:fe93412b:::117:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d3d38bee:::118:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:3100ba0c:::119:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d0560ada:::120:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f0ea8b35:::121:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:766f231a:::122:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a07a2582:::123:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:bd7c6b3a:::124:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:fb2ddaff:::125:head 2024-03-11T22:16:53.973 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:4408e1fe:::126:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:ee1df7a7:::127:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c3002909:::128:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:4f48ffa9:::129:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:edf38733:::130:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c08425c0:::131:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:5f902d98:::132:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:41ea2c93:::133:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:813cee13:::134:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:0131818d:::135:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:26ba5a85:::136:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:381b8a5a:::137:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:28797e47:::138:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:bfca7f22:::139:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:36807075:::140:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:80b03975:::141:head 2024-03-11T22:16:53.974 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:5c15709b:::142:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f39ea15e:::143:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:ea992956:::144:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:48887b1c:::145:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:9f24a9dd:::146:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:987f100b:::147:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d2dd3581:::148:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:7fed1808:::149:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c80b70e9:::150:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:85ed90f9:::151:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:36428b24:::152:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d044c34a:::153:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:7c18bf58:::154:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d1c21232:::155:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a7a3c575:::156:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:87da0633:::157:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d5ac3822:::158:head 2024-03-11T22:16:53.975 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:3f20522d:::159:head 2024-03-11T22:16:53.976 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6ca26563:::160:head 2024-03-11T22:16:53.976 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:532ce135:::161:head 2024-03-11T22:16:53.976 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:c78863e6:::162:head 2024-03-11T22:16:54.519 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:16:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:16:54.519 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21434]: audit 2024-03-11T22:16:53.305724+0000 mon.a (mon.0) 2164 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21434]: audit 2024-03-11T22:16:53.305988+0000 mon.a (mon.0) 2165 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21434]: cluster 2024-03-11T22:16:53.312981+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21434]: audit 2024-03-11T22:16:53.314309+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21434]: audit 2024-03-11T22:16:53.316309+0000 mon.a (mon.0) 2167 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21434]: audit 2024-03-11T22:16:53.966761+0000 mon.b (mon.1) 244 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi049-64247-43","var": "pg_num","format": "json"}]: dispatch 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[21434]: audit 2024-03-11T22:16:54.309570+0000 mon.a (mon.0) 2168 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[28804]: audit 2024-03-11T22:16:53.305724+0000 mon.a (mon.0) 2164 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[28804]: audit 2024-03-11T22:16:53.305988+0000 mon.a (mon.0) 2165 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[28804]: cluster 2024-03-11T22:16:53.312981+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[28804]: audit 2024-03-11T22:16:53.314309+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:54.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[28804]: audit 2024-03-11T22:16:53.316309+0000 mon.a (mon.0) 2167 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[28804]: audit 2024-03-11T22:16:53.966761+0000 mon.b (mon.1) 244 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi049-64247-43","var": "pg_num","format": "json"}]: dispatch 2024-03-11T22:16:54.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:54 smithi049 bash[28804]: audit 2024-03-11T22:16:54.309570+0000 mon.a (mon.0) 2168 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:54.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:54 smithi187 bash[23415]: audit 2024-03-11T22:16:53.305724+0000 mon.a (mon.0) 2164 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-03-11T22:16:54.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:54 smithi187 bash[23415]: audit 2024-03-11T22:16:53.305988+0000 mon.a (mon.0) 2165 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:54.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:54 smithi187 bash[23415]: cluster 2024-03-11T22:16:53.312981+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-03-11T22:16:54.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:54 smithi187 bash[23415]: audit 2024-03-11T22:16:53.314309+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.49:0/2782212650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:54.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:54 smithi187 bash[23415]: audit 2024-03-11T22:16:53.316309+0000 mon.a (mon.0) 2167 : audit 1 from='client.47024 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]: dispatch 2024-03-11T22:16:54.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:54 smithi187 bash[23415]: audit 2024-03-11T22:16:53.966761+0000 mon.b (mon.1) 244 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi049-64247-43","var": "pg_num","format": "json"}]: dispatch 2024-03-11T22:16:54.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:54 smithi187 bash[23415]: audit 2024-03-11T22:16:54.309570+0000 mon.a (mon.0) 2168 : audit 1 from='client.47024 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi049-64063-57"}]': finished 2024-03-11T22:16:55.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: cluster 2024-03-11T22:16:54.097654+0000 mgr.y (mgr.14601) 344 : cluster 0 pgmap v470: 292 pgs: 292 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-03-11T22:16:55.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.315590+0000 mon.b (mon.1) 245 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:55.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: cluster 2024-03-11T22:16:54.317160+0000 mon.a (mon.0) 2169 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-03-11T22:16:55.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.323898+0000 mon.b (mon.1) 246 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]: dispatch 2024-03-11T22:16:55.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.328119+0000 mon.a (mon.0) 2170 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.340481+0000 mon.a (mon.0) 2171 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.362077+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.362424+0000 mon.a (mon.0) 2172 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.363540+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.363831+0000 mon.a (mon.0) 2173 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.364344+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:54.364644+0000 mon.a (mon.0) 2174 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:55.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:55 smithi187 bash[23415]: audit 2024-03-11T22:16:55.265097+0000 mon.c (mon.2) 514 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: cluster 2024-03-11T22:16:54.097654+0000 mgr.y (mgr.14601) 344 : cluster 0 pgmap v470: 292 pgs: 292 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.315590+0000 mon.b (mon.1) 245 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: cluster 2024-03-11T22:16:54.317160+0000 mon.a (mon.0) 2169 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.323898+0000 mon.b (mon.1) 246 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]: dispatch 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.328119+0000 mon.a (mon.0) 2170 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.340481+0000 mon.a (mon.0) 2171 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]: dispatch 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.362077+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.362424+0000 mon.a (mon.0) 2172 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.363540+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.363831+0000 mon.a (mon.0) 2173 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.364344+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:54.364644+0000 mon.a (mon.0) 2174 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[28804]: audit 2024-03-11T22:16:55.265097+0000 mon.c (mon.2) 514 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: cluster 2024-03-11T22:16:54.097654+0000 mgr.y (mgr.14601) 344 : cluster 0 pgmap v470: 292 pgs: 292 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.315590+0000 mon.b (mon.1) 245 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: cluster 2024-03-11T22:16:54.317160+0000 mon.a (mon.0) 2169 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.323898+0000 mon.b (mon.1) 246 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.328119+0000 mon.a (mon.0) 2170 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.340481+0000 mon.a (mon.0) 2171 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.362077+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.362424+0000 mon.a (mon.0) 2172 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.363540+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.363831+0000 mon.a (mon.0) 2173 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:55.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.364344+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:55.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:54.364644+0000 mon.a (mon.0) 2174 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:16:55.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:55 smithi049 bash[21434]: audit 2024-03-11T22:16:55.265097+0000 mon.c (mon.2) 514 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:16:56.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:56 smithi187 bash[23415]: audit 2024-03-11T22:16:55.344938+0000 mon.a (mon.0) 2175 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]': finished 2024-03-11T22:16:56.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:56 smithi187 bash[23415]: audit 2024-03-11T22:16:55.345284+0000 mon.a (mon.0) 2176 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:56.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:56 smithi187 bash[23415]: cluster 2024-03-11T22:16:55.351994+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-03-11T22:16:56.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:56 smithi187 bash[23415]: audit 2024-03-11T22:16:55.353942+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:56.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:56 smithi187 bash[23415]: audit 2024-03-11T22:16:55.356010+0000 mon.a (mon.0) 2178 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:56.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[21434]: audit 2024-03-11T22:16:55.344938+0000 mon.a (mon.0) 2175 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]': finished 2024-03-11T22:16:56.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[21434]: audit 2024-03-11T22:16:55.345284+0000 mon.a (mon.0) 2176 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:56.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[21434]: cluster 2024-03-11T22:16:55.351994+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-03-11T22:16:56.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[21434]: audit 2024-03-11T22:16:55.353942+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:56.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[21434]: audit 2024-03-11T22:16:55.356010+0000 mon.a (mon.0) 2178 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[28804]: audit 2024-03-11T22:16:55.344938+0000 mon.a (mon.0) 2175 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-43"}]': finished 2024-03-11T22:16:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[28804]: audit 2024-03-11T22:16:55.345284+0000 mon.a (mon.0) 2176 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi049-64063-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:16:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[28804]: cluster 2024-03-11T22:16:55.351994+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-03-11T22:16:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[28804]: audit 2024-03-11T22:16:55.353942+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:56.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:56 smithi049 bash[28804]: audit 2024-03-11T22:16:55.356010+0000 mon.a (mon.0) 2178 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:16:57.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:57 smithi187 bash[23415]: cluster 2024-03-11T22:16:56.098562+0000 mgr.y (mgr.14601) 345 : cluster 0 pgmap v473: 292 pgs: 292 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-03-11T22:16:57.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:57 smithi187 bash[23415]: cluster 2024-03-11T22:16:56.819756+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-03-11T22:16:57.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:57 smithi049 bash[21434]: cluster 2024-03-11T22:16:56.098562+0000 mgr.y (mgr.14601) 345 : cluster 0 pgmap v473: 292 pgs: 292 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-03-11T22:16:57.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:57 smithi049 bash[21434]: cluster 2024-03-11T22:16:56.819756+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-03-11T22:16:57.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:57 smithi049 bash[28804]: cluster 2024-03-11T22:16:56.098562+0000 mgr.y (mgr.14601) 345 : cluster 0 pgmap v473: 292 pgs: 292 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-03-11T22:16:57.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:57 smithi049 bash[28804]: cluster 2024-03-11T22:16:56.819756+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-03-11T22:16:58.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:58 smithi187 bash[23415]: audit 2024-03-11T22:16:57.368075+0000 mon.a (mon.0) 2180 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:16:58.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:58 smithi187 bash[23415]: audit 2024-03-11T22:16:57.374532+0000 mon.b (mon.1) 247 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:58.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:58 smithi187 bash[23415]: cluster 2024-03-11T22:16:57.376055+0000 mon.a (mon.0) 2181 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-03-11T22:16:58.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:58 smithi187 bash[23415]: audit 2024-03-11T22:16:57.383047+0000 mon.a (mon.0) 2182 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:58.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[21434]: audit 2024-03-11T22:16:57.368075+0000 mon.a (mon.0) 2180 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:16:58.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[21434]: audit 2024-03-11T22:16:57.374532+0000 mon.b (mon.1) 247 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:58.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[21434]: cluster 2024-03-11T22:16:57.376055+0000 mon.a (mon.0) 2181 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-03-11T22:16:58.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[21434]: audit 2024-03-11T22:16:57.383047+0000 mon.a (mon.0) 2182 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:58.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[28804]: audit 2024-03-11T22:16:57.368075+0000 mon.a (mon.0) 2180 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi049-64063-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:16:58.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[28804]: audit 2024-03-11T22:16:57.374532+0000 mon.b (mon.1) 247 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:58.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[28804]: cluster 2024-03-11T22:16:57.376055+0000 mon.a (mon.0) 2181 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-03-11T22:16:58.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:58 smithi049 bash[28804]: audit 2024-03-11T22:16:57.383047+0000 mon.a (mon.0) 2182 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:16:59.241 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:16:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:16:59.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:59 smithi187 bash[23415]: cluster 2024-03-11T22:16:58.099470+0000 mgr.y (mgr.14601) 346 : cluster 0 pgmap v476: 300 pgs: 40 unknown, 260 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:59.795 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:59 smithi187 bash[23415]: cluster 2024-03-11T22:16:58.368041+0000 mon.a (mon.0) 2183 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:59.795 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:59 smithi187 bash[23415]: audit 2024-03-11T22:16:58.378470+0000 mon.a (mon.0) 2184 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:59.795 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:59 smithi187 bash[23415]: audit 2024-03-11T22:16:58.384553+0000 mon.b (mon.1) 248 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:59.795 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:59 smithi187 bash[23415]: cluster 2024-03-11T22:16:58.386751+0000 mon.a (mon.0) 2185 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-03-11T22:16:59.795 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:59 smithi187 bash[23415]: audit 2024-03-11T22:16:58.391308+0000 mon.a (mon.0) 2186 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:59.795 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:16:59 smithi187 bash[23415]: audit 2024-03-11T22:16:58.771776+0000 mgr.y (mgr.14601) 347 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:59.796 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[28804]: cluster 2024-03-11T22:16:58.099470+0000 mgr.y (mgr.14601) 346 : cluster 0 pgmap v476: 300 pgs: 40 unknown, 260 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:59.796 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[28804]: cluster 2024-03-11T22:16:58.368041+0000 mon.a (mon.0) 2183 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:59.796 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[28804]: audit 2024-03-11T22:16:58.378470+0000 mon.a (mon.0) 2184 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:59.796 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[28804]: audit 2024-03-11T22:16:58.384553+0000 mon.b (mon.1) 248 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:59.796 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[28804]: cluster 2024-03-11T22:16:58.386751+0000 mon.a (mon.0) 2185 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-03-11T22:16:59.796 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[28804]: audit 2024-03-11T22:16:58.391308+0000 mon.a (mon.0) 2186 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:59.796 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[28804]: audit 2024-03-11T22:16:58.771776+0000 mgr.y (mgr.14601) 347 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:16:59.797 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[21434]: cluster 2024-03-11T22:16:58.099470+0000 mgr.y (mgr.14601) 346 : cluster 0 pgmap v476: 300 pgs: 40 unknown, 260 active+clean; 8.4 MiB data, 597 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:16:59.797 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[21434]: cluster 2024-03-11T22:16:58.368041+0000 mon.a (mon.0) 2183 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:16:59.797 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[21434]: audit 2024-03-11T22:16:58.378470+0000 mon.a (mon.0) 2184 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:16:59.797 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[21434]: audit 2024-03-11T22:16:58.384553+0000 mon.b (mon.1) 248 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:59.797 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[21434]: cluster 2024-03-11T22:16:58.386751+0000 mon.a (mon.0) 2185 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-03-11T22:16:59.797 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[21434]: audit 2024-03-11T22:16:58.391308+0000 mon.a (mon.0) 2186 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:16:59.797 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:16:59 smithi049 bash[21434]: audit 2024-03-11T22:16:58.771776+0000 mgr.y (mgr.14601) 347 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:00.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:00 smithi187 bash[23415]: audit 2024-03-11T22:16:59.387901+0000 mon.a (mon.0) 2187 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:00.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:00 smithi187 bash[23415]: audit 2024-03-11T22:16:59.389919+0000 mon.b (mon.1) 249 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:17:00.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:00 smithi187 bash[23415]: cluster 2024-03-11T22:16:59.392389+0000 mon.a (mon.0) 2188 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-03-11T22:17:00.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:00 smithi187 bash[23415]: audit 2024-03-11T22:16:59.398229+0000 mon.a (mon.0) 2189 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:17:00.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:00 smithi187 bash[23415]: audit 2024-03-11T22:16:59.398404+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:00.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:00 smithi187 bash[23415]: audit 2024-03-11T22:16:59.399256+0000 mon.a (mon.0) 2190 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[28804]: audit 2024-03-11T22:16:59.387901+0000 mon.a (mon.0) 2187 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[28804]: audit 2024-03-11T22:16:59.389919+0000 mon.b (mon.1) 249 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[28804]: cluster 2024-03-11T22:16:59.392389+0000 mon.a (mon.0) 2188 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[28804]: audit 2024-03-11T22:16:59.398229+0000 mon.a (mon.0) 2189 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[28804]: audit 2024-03-11T22:16:59.398404+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[28804]: audit 2024-03-11T22:16:59.399256+0000 mon.a (mon.0) 2190 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[21434]: audit 2024-03-11T22:16:59.387901+0000 mon.a (mon.0) 2187 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[21434]: audit 2024-03-11T22:16:59.389919+0000 mon.b (mon.1) 249 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:17:00.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[21434]: cluster 2024-03-11T22:16:59.392389+0000 mon.a (mon.0) 2188 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-03-11T22:17:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[21434]: audit 2024-03-11T22:16:59.398229+0000 mon.a (mon.0) 2189 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:17:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[21434]: audit 2024-03-11T22:16:59.398404+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:00.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:00 smithi049 bash[21434]: audit 2024-03-11T22:16:59.399256+0000 mon.a (mon.0) 2190 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:01.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: cluster 2024-03-11T22:17:00.100374+0000 mgr.y (mgr.14601) 348 : cluster 0 pgmap v479: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:01.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:00.390601+0000 mon.a (mon.0) 2191 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]': finished 2024-03-11T22:17:01.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:00.390813+0000 mon.a (mon.0) 2192 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:17:01.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:00.393564+0000 mon.b (mon.1) 250 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:17:01.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: cluster 2024-03-11T22:17:00.397655+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-03-11T22:17:01.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:00.400260+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:01.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:00.401752+0000 mon.a (mon.0) 2194 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:17:01.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:00.402654+0000 mon.a (mon.0) 2195 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:01.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:01.393997+0000 mon.a (mon.0) 2196 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]': finished 2024-03-11T22:17:01.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:01 smithi187 bash[23415]: audit 2024-03-11T22:17:01.394234+0000 mon.a (mon.0) 2197 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: cluster 2024-03-11T22:17:00.100374+0000 mgr.y (mgr.14601) 348 : cluster 0 pgmap v479: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:00.390601+0000 mon.a (mon.0) 2191 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]': finished 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:00.390813+0000 mon.a (mon.0) 2192 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:00.393564+0000 mon.b (mon.1) 250 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: cluster 2024-03-11T22:17:00.397655+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:00.400260+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:00.401752+0000 mon.a (mon.0) 2194 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:00.402654+0000 mon.a (mon.0) 2195 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:01.393997+0000 mon.a (mon.0) 2196 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]': finished 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[21434]: audit 2024-03-11T22:17:01.394234+0000 mon.a (mon.0) 2197 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:17:01.745 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: cluster 2024-03-11T22:17:00.100374+0000 mgr.y (mgr.14601) 348 : cluster 0 pgmap v479: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:00.390601+0000 mon.a (mon.0) 2191 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_count","val": "3"}]': finished 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:00.390813+0000 mon.a (mon.0) 2192 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:00.393564+0000 mon.b (mon.1) 250 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: cluster 2024-03-11T22:17:00.397655+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:00.400260+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.49:0/3024107485' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:00.401752+0000 mon.a (mon.0) 2194 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:00.402654+0000 mon.a (mon.0) 2195 : audit 1 from='client.47030 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]: dispatch 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:01.393997+0000 mon.a (mon.0) 2196 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_period","val": "3"}]': finished 2024-03-11T22:17:01.746 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:01 smithi049 bash[28804]: audit 2024-03-11T22:17:01.394234+0000 mon.a (mon.0) 2197 : audit 1 from='client.47030 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi049-64063-58"}]': finished 2024-03-11T22:17:02.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.400167+0000 mon.b (mon.1) 251 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:02.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: cluster 2024-03-11T22:17:01.401545+0000 mon.a (mon.0) 2198 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-03-11T22:17:02.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.414406+0000 mon.a (mon.0) 2199 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:02.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.432882+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.433211+0000 mon.a (mon.0) 2200 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.434339+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.434612+0000 mon.a (mon.0) 2201 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.435119+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:02.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:02 smithi187 bash[23415]: audit 2024-03-11T22:17:01.435448+0000 mon.a (mon.0) 2202 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.400167+0000 mon.b (mon.1) 251 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: cluster 2024-03-11T22:17:01.401545+0000 mon.a (mon.0) 2198 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.414406+0000 mon.a (mon.0) 2199 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.432882+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.433211+0000 mon.a (mon.0) 2200 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.434339+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.434612+0000 mon.a (mon.0) 2201 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.435119+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[21434]: audit 2024-03-11T22:17:01.435448+0000 mon.a (mon.0) 2202 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.400167+0000 mon.b (mon.1) 251 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:02.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: cluster 2024-03-11T22:17:01.401545+0000 mon.a (mon.0) 2198 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-03-11T22:17:02.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.414406+0000 mon.a (mon.0) 2199 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:02.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.432882+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.433211+0000 mon.a (mon.0) 2200 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.434339+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.434612+0000 mon.a (mon.0) 2201 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:02.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.435119+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:02.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:02 smithi049 bash[28804]: audit 2024-03-11T22:17:01.435448+0000 mon.a (mon.0) 2202 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:04.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: cluster 2024-03-11T22:17:02.101491+0000 mgr.y (mgr.14601) 349 : cluster 0 pgmap v482: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:04.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: audit 2024-03-11T22:17:02.409527+0000 mon.a (mon.0) 2203 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:04.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: audit 2024-03-11T22:17:02.410015+0000 mon.a (mon.0) 2204 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:04.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: audit 2024-03-11T22:17:02.414732+0000 mon.b (mon.1) 252 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: audit 2024-03-11T22:17:02.420149+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: cluster 2024-03-11T22:17:02.421464+0000 mon.a (mon.0) 2205 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: audit 2024-03-11T22:17:02.423807+0000 mon.a (mon.0) 2206 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: audit 2024-03-11T22:17:02.432743+0000 mon.a (mon.0) 2207 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[21434]: audit 2024-03-11T22:17:03.412830+0000 mon.a (mon.0) 2208 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: cluster 2024-03-11T22:17:02.101491+0000 mgr.y (mgr.14601) 349 : cluster 0 pgmap v482: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: audit 2024-03-11T22:17:02.409527+0000 mon.a (mon.0) 2203 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: audit 2024-03-11T22:17:02.410015+0000 mon.a (mon.0) 2204 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: audit 2024-03-11T22:17:02.414732+0000 mon.b (mon.1) 252 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:17:04.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: audit 2024-03-11T22:17:02.420149+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:04.226 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: cluster 2024-03-11T22:17:02.421464+0000 mon.a (mon.0) 2205 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-03-11T22:17:04.226 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: audit 2024-03-11T22:17:02.423807+0000 mon.a (mon.0) 2206 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:04.226 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: audit 2024-03-11T22:17:02.432743+0000 mon.a (mon.0) 2207 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:17:04.226 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:03 smithi049 bash[28804]: audit 2024-03-11T22:17:03.412830+0000 mon.a (mon.0) 2208 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-11T22:17:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: cluster 2024-03-11T22:17:02.101491+0000 mgr.y (mgr.14601) 349 : cluster 0 pgmap v482: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: audit 2024-03-11T22:17:02.409527+0000 mon.a (mon.0) 2203 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: audit 2024-03-11T22:17:02.410015+0000 mon.a (mon.0) 2204 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: audit 2024-03-11T22:17:02.414732+0000 mon.b (mon.1) 252 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:17:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: audit 2024-03-11T22:17:02.420149+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: cluster 2024-03-11T22:17:02.421464+0000 mon.a (mon.0) 2205 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-03-11T22:17:04.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: audit 2024-03-11T22:17:02.423807+0000 mon.a (mon.0) 2206 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:04.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: audit 2024-03-11T22:17:02.432743+0000 mon.a (mon.0) 2207 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:17:04.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:03 smithi187 bash[23415]: audit 2024-03-11T22:17:03.412830+0000 mon.a (mon.0) 2208 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-11T22:17:04.519 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:17:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:17:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:17:05.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:04 smithi187 bash[23415]: cluster 2024-03-11T22:17:03.875627+0000 mon.a (mon.0) 2209 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-03-11T22:17:05.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:04 smithi187 bash[23415]: audit 2024-03-11T22:17:04.415989+0000 mon.a (mon.0) 2210 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:05.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:04 smithi187 bash[23415]: cluster 2024-03-11T22:17:04.424311+0000 mon.a (mon.0) 2211 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-03-11T22:17:05.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:04 smithi049 bash[21434]: cluster 2024-03-11T22:17:03.875627+0000 mon.a (mon.0) 2209 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-03-11T22:17:05.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:04 smithi049 bash[21434]: audit 2024-03-11T22:17:04.415989+0000 mon.a (mon.0) 2210 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:05.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:04 smithi049 bash[21434]: cluster 2024-03-11T22:17:04.424311+0000 mon.a (mon.0) 2211 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-03-11T22:17:05.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:04 smithi049 bash[28804]: cluster 2024-03-11T22:17:03.875627+0000 mon.a (mon.0) 2209 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-03-11T22:17:05.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:04 smithi049 bash[28804]: audit 2024-03-11T22:17:04.415989+0000 mon.a (mon.0) 2210 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi049-64063-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:05.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:04 smithi049 bash[28804]: cluster 2024-03-11T22:17:04.424311+0000 mon.a (mon.0) 2211 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-03-11T22:17:06.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:05 smithi187 bash[23415]: cluster 2024-03-11T22:17:04.104342+0000 mgr.y (mgr.14601) 350 : cluster 0 pgmap v485: 292 pgs: 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:06.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:05 smithi187 bash[23415]: cluster 2024-03-11T22:17:05.176246+0000 mon.a (mon.0) 2212 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:06.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:05 smithi187 bash[23415]: cluster 2024-03-11T22:17:05.425291+0000 mon.a (mon.0) 2213 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-03-11T22:17:06.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:05 smithi187 bash[23415]: audit 2024-03-11T22:17:05.764371+0000 mon.c (mon.2) 522 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:17:06.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[21434]: cluster 2024-03-11T22:17:04.104342+0000 mgr.y (mgr.14601) 350 : cluster 0 pgmap v485: 292 pgs: 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:06.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[21434]: cluster 2024-03-11T22:17:05.176246+0000 mon.a (mon.0) 2212 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:06.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[21434]: cluster 2024-03-11T22:17:05.425291+0000 mon.a (mon.0) 2213 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-03-11T22:17:06.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[21434]: audit 2024-03-11T22:17:05.764371+0000 mon.c (mon.2) 522 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:17:06.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[28804]: cluster 2024-03-11T22:17:04.104342+0000 mgr.y (mgr.14601) 350 : cluster 0 pgmap v485: 292 pgs: 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:06.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[28804]: cluster 2024-03-11T22:17:05.176246+0000 mon.a (mon.0) 2212 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:06.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[28804]: cluster 2024-03-11T22:17:05.425291+0000 mon.a (mon.0) 2213 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-03-11T22:17:06.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:05 smithi049 bash[28804]: audit 2024-03-11T22:17:05.764371+0000 mon.c (mon.2) 522 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:17:07.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:07 smithi187 bash[23415]: cluster 2024-03-11T22:17:06.105315+0000 mgr.y (mgr.14601) 351 : cluster 0 pgmap v488: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:07.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:07 smithi187 bash[23415]: cluster 2024-03-11T22:17:06.423919+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-03-11T22:17:07.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:07 smithi187 bash[23415]: audit 2024-03-11T22:17:06.426316+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:07.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:07 smithi187 bash[23415]: audit 2024-03-11T22:17:06.426969+0000 mon.a (mon.0) 2215 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:07.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:07 smithi187 bash[23415]: audit 2024-03-11T22:17:06.509211+0000 mon.c (mon.2) 524 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:17:07.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:07 smithi187 bash[23415]: audit 2024-03-11T22:17:06.510857+0000 mon.c (mon.2) 525 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:17:07.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:07 smithi187 bash[23415]: audit 2024-03-11T22:17:06.520251+0000 mon.a (mon.0) 2216 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:17:07.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[21434]: cluster 2024-03-11T22:17:06.105315+0000 mgr.y (mgr.14601) 351 : cluster 0 pgmap v488: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[21434]: cluster 2024-03-11T22:17:06.423919+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[21434]: audit 2024-03-11T22:17:06.426316+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[21434]: audit 2024-03-11T22:17:06.426969+0000 mon.a (mon.0) 2215 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[21434]: audit 2024-03-11T22:17:06.509211+0000 mon.c (mon.2) 524 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[21434]: audit 2024-03-11T22:17:06.510857+0000 mon.c (mon.2) 525 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[21434]: audit 2024-03-11T22:17:06.520251+0000 mon.a (mon.0) 2216 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[28804]: cluster 2024-03-11T22:17:06.105315+0000 mgr.y (mgr.14601) 351 : cluster 0 pgmap v488: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[28804]: cluster 2024-03-11T22:17:06.423919+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[28804]: audit 2024-03-11T22:17:06.426316+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[28804]: audit 2024-03-11T22:17:06.426969+0000 mon.a (mon.0) 2215 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[28804]: audit 2024-03-11T22:17:06.509211+0000 mon.c (mon.2) 524 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:17:07.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[28804]: audit 2024-03-11T22:17:06.510857+0000 mon.c (mon.2) 525 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:17:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:07 smithi049 bash[28804]: audit 2024-03-11T22:17:06.520251+0000 mon.a (mon.0) 2216 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:7462ddf6::io.RoundTripAppendPP (2972 ms) 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3011 ms) 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3465 ms) 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (2568 ms) 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: setting pool EIO 2024-03-11T22:17:08.450 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: max_success 96, min_failed 97 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4434 ms) 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (2545 ms) 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (148909 ms total) 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3025 ms) 2024-03-11T22:17:08.451 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9053 ms) 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14975 ms) 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3009 ms) 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30063 ms total) 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3021 ms) 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3021 ms total) 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-03-11T22:17:08.452 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13991 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6984 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7026 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7052 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3006 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7025 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6918 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7023 ms) 2024-03-11T22:17:08.453 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7061 ms) 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7042 ms) 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7032 ms) 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7075 ms) 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-03-11T22:17:08.454 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7052 ms) 2024-03-11T22:17:08.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:08 smithi187 bash[23415]: audit 2024-03-11T22:17:07.433100+0000 mon.a (mon.0) 2217 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:08.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:08 smithi187 bash[23415]: cluster 2024-03-11T22:17:07.440131+0000 mon.a (mon.0) 2218 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-03-11T22:17:08.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:08 smithi187 bash[23415]: audit 2024-03-11T22:17:07.441566+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:08.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:08 smithi187 bash[23415]: audit 2024-03-11T22:17:07.443443+0000 mon.a (mon.0) 2219 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:08.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[28804]: audit 2024-03-11T22:17:07.433100+0000 mon.a (mon.0) 2217 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:08.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[28804]: cluster 2024-03-11T22:17:07.440131+0000 mon.a (mon.0) 2218 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-03-11T22:17:08.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[28804]: audit 2024-03-11T22:17:07.441566+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:08.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[28804]: audit 2024-03-11T22:17:07.443443+0000 mon.a (mon.0) 2219 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:08.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[21434]: audit 2024-03-11T22:17:07.433100+0000 mon.a (mon.0) 2217 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:08.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[21434]: cluster 2024-03-11T22:17:07.440131+0000 mon.a (mon.0) 2218 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-03-11T22:17:08.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[21434]: audit 2024-03-11T22:17:07.441566+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.49:0/1613991553' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:08.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:08 smithi049 bash[21434]: audit 2024-03-11T22:17:07.443443+0000 mon.a (mon.0) 2219 : audit 1 from='client.47036 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]: dispatch 2024-03-11T22:17:09.242 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:17:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:17:09.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:09 smithi187 bash[23415]: cluster 2024-03-11T22:17:08.106155+0000 mgr.y (mgr.14601) 352 : cluster 0 pgmap v491: 292 pgs: 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:09.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:09 smithi187 bash[23415]: audit 2024-03-11T22:17:08.445250+0000 mon.a (mon.0) 2220 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:09.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:09 smithi187 bash[23415]: cluster 2024-03-11T22:17:08.455291+0000 mon.a (mon.0) 2221 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-03-11T22:17:09.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:09 smithi187 bash[23415]: audit 2024-03-11T22:17:08.780196+0000 mgr.y (mgr.14601) 353 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:09.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[28804]: cluster 2024-03-11T22:17:08.106155+0000 mgr.y (mgr.14601) 352 : cluster 0 pgmap v491: 292 pgs: 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:09.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[28804]: audit 2024-03-11T22:17:08.445250+0000 mon.a (mon.0) 2220 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:09.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[28804]: cluster 2024-03-11T22:17:08.455291+0000 mon.a (mon.0) 2221 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-03-11T22:17:09.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[28804]: audit 2024-03-11T22:17:08.780196+0000 mgr.y (mgr.14601) 353 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:09.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[21434]: cluster 2024-03-11T22:17:08.106155+0000 mgr.y (mgr.14601) 352 : cluster 0 pgmap v491: 292 pgs: 292 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:09.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[21434]: audit 2024-03-11T22:17:08.445250+0000 mon.a (mon.0) 2220 : audit 1 from='client.47036 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi049-64063-59"}]': finished 2024-03-11T22:17:09.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[21434]: cluster 2024-03-11T22:17:08.455291+0000 mon.a (mon.0) 2221 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-03-11T22:17:09.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:09 smithi049 bash[21434]: audit 2024-03-11T22:17:08.780196+0000 mgr.y (mgr.14601) 353 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:10.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:10 smithi187 bash[23415]: cluster 2024-03-11T22:17:09.465187+0000 mon.a (mon.0) 2222 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-03-11T22:17:10.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:10 smithi187 bash[23415]: audit 2024-03-11T22:17:09.474626+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.49:0/4222665227' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:10.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:10 smithi187 bash[23415]: audit 2024-03-11T22:17:09.475961+0000 mon.a (mon.0) 2223 : audit 1 from='client.47042 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:10.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:10 smithi187 bash[23415]: audit 2024-03-11T22:17:10.294770+0000 mon.c (mon.2) 528 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:10.769 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[28804]: cluster 2024-03-11T22:17:09.465187+0000 mon.a (mon.0) 2222 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-03-11T22:17:10.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[28804]: audit 2024-03-11T22:17:09.474626+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.49:0/4222665227' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:10.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[28804]: audit 2024-03-11T22:17:09.475961+0000 mon.a (mon.0) 2223 : audit 1 from='client.47042 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:10.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[28804]: audit 2024-03-11T22:17:10.294770+0000 mon.c (mon.2) 528 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:10.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[21434]: cluster 2024-03-11T22:17:09.465187+0000 mon.a (mon.0) 2222 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-03-11T22:17:10.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[21434]: audit 2024-03-11T22:17:09.474626+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.49:0/4222665227' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:10.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[21434]: audit 2024-03-11T22:17:09.475961+0000 mon.a (mon.0) 2223 : audit 1 from='client.47042 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:10.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:10 smithi049 bash[21434]: audit 2024-03-11T22:17:10.294770+0000 mon.c (mon.2) 528 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:11.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:11 smithi187 bash[23415]: cluster 2024-03-11T22:17:10.107076+0000 mgr.y (mgr.14601) 354 : cluster 0 pgmap v494: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:17:11.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:11 smithi187 bash[23415]: cluster 2024-03-11T22:17:10.457783+0000 mon.a (mon.0) 2224 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:11.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:11 smithi187 bash[23415]: audit 2024-03-11T22:17:10.467016+0000 mon.a (mon.0) 2225 : audit 1 from='client.47042 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:11.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:11 smithi187 bash[23415]: cluster 2024-03-11T22:17:10.476810+0000 mon.a (mon.0) 2226 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[21434]: cluster 2024-03-11T22:17:10.107076+0000 mgr.y (mgr.14601) 354 : cluster 0 pgmap v494: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[21434]: cluster 2024-03-11T22:17:10.457783+0000 mon.a (mon.0) 2224 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[21434]: audit 2024-03-11T22:17:10.467016+0000 mon.a (mon.0) 2225 : audit 1 from='client.47042 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[21434]: cluster 2024-03-11T22:17:10.476810+0000 mon.a (mon.0) 2226 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[28804]: cluster 2024-03-11T22:17:10.107076+0000 mgr.y (mgr.14601) 354 : cluster 0 pgmap v494: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[28804]: cluster 2024-03-11T22:17:10.457783+0000 mon.a (mon.0) 2224 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[28804]: audit 2024-03-11T22:17:10.467016+0000 mon.a (mon.0) 2225 : audit 1 from='client.47042 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi049-64063-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:11.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:11 smithi049 bash[28804]: cluster 2024-03-11T22:17:10.476810+0000 mon.a (mon.0) 2226 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-03-11T22:17:12.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:12 smithi187 bash[23415]: cluster 2024-03-11T22:17:11.484692+0000 mon.a (mon.0) 2227 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-03-11T22:17:12.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:12 smithi187 bash[23415]: audit 2024-03-11T22:17:11.525110+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.742 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:12 smithi187 bash[23415]: audit 2024-03-11T22:17:11.525480+0000 mon.a (mon.0) 2228 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:12 smithi187 bash[23415]: audit 2024-03-11T22:17:11.526899+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:12 smithi187 bash[23415]: audit 2024-03-11T22:17:11.527269+0000 mon.a (mon.0) 2229 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:12 smithi187 bash[23415]: audit 2024-03-11T22:17:11.527795+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:12.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:12 smithi187 bash[23415]: audit 2024-03-11T22:17:11.528100+0000 mon.a (mon.0) 2230 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:12.769 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[21434]: cluster 2024-03-11T22:17:11.484692+0000 mon.a (mon.0) 2227 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[21434]: audit 2024-03-11T22:17:11.525110+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[21434]: audit 2024-03-11T22:17:11.525480+0000 mon.a (mon.0) 2228 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[21434]: audit 2024-03-11T22:17:11.526899+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[21434]: audit 2024-03-11T22:17:11.527269+0000 mon.a (mon.0) 2229 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[21434]: audit 2024-03-11T22:17:11.527795+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[21434]: audit 2024-03-11T22:17:11.528100+0000 mon.a (mon.0) 2230 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[28804]: cluster 2024-03-11T22:17:11.484692+0000 mon.a (mon.0) 2227 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[28804]: audit 2024-03-11T22:17:11.525110+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[28804]: audit 2024-03-11T22:17:11.525480+0000 mon.a (mon.0) 2228 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[28804]: audit 2024-03-11T22:17:11.526899+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.770 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[28804]: audit 2024-03-11T22:17:11.527269+0000 mon.a (mon.0) 2229 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:12.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[28804]: audit 2024-03-11T22:17:11.527795+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:12.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:12 smithi049 bash[28804]: audit 2024-03-11T22:17:11.528100+0000 mon.a (mon.0) 2230 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:14.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[28804]: cluster 2024-03-11T22:17:12.107986+0000 mgr.y (mgr.14601) 355 : cluster 0 pgmap v497: 292 pgs: 292 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:17:14.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[28804]: audit 2024-03-11T22:17:12.480839+0000 mon.a (mon.0) 2231 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:14.224 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[28804]: cluster 2024-03-11T22:17:12.489140+0000 mon.a (mon.0) 2232 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-03-11T22:17:14.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[28804]: audit 2024-03-11T22:17:12.490238+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:14.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[28804]: audit 2024-03-11T22:17:12.491495+0000 mon.a (mon.0) 2233 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[21434]: cluster 2024-03-11T22:17:12.107986+0000 mgr.y (mgr.14601) 355 : cluster 0 pgmap v497: 292 pgs: 292 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:17:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[21434]: audit 2024-03-11T22:17:12.480839+0000 mon.a (mon.0) 2231 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[21434]: cluster 2024-03-11T22:17:12.489140+0000 mon.a (mon.0) 2232 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-03-11T22:17:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[21434]: audit 2024-03-11T22:17:12.490238+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:13 smithi049 bash[21434]: audit 2024-03-11T22:17:12.491495+0000 mon.a (mon.0) 2233 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:14.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:13 smithi187 bash[23415]: cluster 2024-03-11T22:17:12.107986+0000 mgr.y (mgr.14601) 355 : cluster 0 pgmap v497: 292 pgs: 292 active+clean; 8.4 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:17:14.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:13 smithi187 bash[23415]: audit 2024-03-11T22:17:12.480839+0000 mon.a (mon.0) 2231 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi049-64063-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:14.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:13 smithi187 bash[23415]: cluster 2024-03-11T22:17:12.489140+0000 mon.a (mon.0) 2232 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-03-11T22:17:14.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:13 smithi187 bash[23415]: audit 2024-03-11T22:17:12.490238+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:14.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:13 smithi187 bash[23415]: audit 2024-03-11T22:17:12.491495+0000 mon.a (mon.0) 2233 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:14.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:17:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:17:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:17:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:14 smithi187 bash[23415]: cluster 2024-03-11T22:17:13.949175+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-03-11T22:17:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:14 smithi187 bash[23415]: audit 2024-03-11T22:17:14.487263+0000 mon.a (mon.0) 2235 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:15.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:14 smithi187 bash[23415]: cluster 2024-03-11T22:17:14.495620+0000 mon.a (mon.0) 2236 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-03-11T22:17:15.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:14 smithi049 bash[21434]: cluster 2024-03-11T22:17:13.949175+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-03-11T22:17:15.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:14 smithi049 bash[21434]: audit 2024-03-11T22:17:14.487263+0000 mon.a (mon.0) 2235 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:15.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:14 smithi049 bash[21434]: cluster 2024-03-11T22:17:14.495620+0000 mon.a (mon.0) 2236 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-03-11T22:17:15.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:14 smithi049 bash[28804]: cluster 2024-03-11T22:17:13.949175+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-03-11T22:17:15.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:14 smithi049 bash[28804]: audit 2024-03-11T22:17:14.487263+0000 mon.a (mon.0) 2235 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi049-64063-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:15.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:14 smithi049 bash[28804]: cluster 2024-03-11T22:17:14.495620+0000 mon.a (mon.0) 2236 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-03-11T22:17:16.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:15 smithi187 bash[23415]: cluster 2024-03-11T22:17:14.110579+0000 mgr.y (mgr.14601) 356 : cluster 0 pgmap v500: 292 pgs: 292 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-11T22:17:16.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:15 smithi187 bash[23415]: cluster 2024-03-11T22:17:15.496448+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-03-11T22:17:16.269 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:15 smithi049 bash[21434]: cluster 2024-03-11T22:17:14.110579+0000 mgr.y (mgr.14601) 356 : cluster 0 pgmap v500: 292 pgs: 292 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-11T22:17:16.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:15 smithi049 bash[21434]: cluster 2024-03-11T22:17:15.496448+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-03-11T22:17:16.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:15 smithi049 bash[28804]: cluster 2024-03-11T22:17:14.110579+0000 mgr.y (mgr.14601) 356 : cluster 0 pgmap v500: 292 pgs: 292 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-11T22:17:16.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:15 smithi049 bash[28804]: cluster 2024-03-11T22:17:15.496448+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-03-11T22:17:17.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: audit 2024-03-11T22:17:15.969980+0000 mon.b (mon.1) 253 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:17.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: audit 2024-03-11T22:17:15.972291+0000 mon.b (mon.1) 254 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]: dispatch 2024-03-11T22:17:17.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: audit 2024-03-11T22:17:15.976419+0000 mon.a (mon.0) 2238 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: audit 2024-03-11T22:17:15.978681+0000 mon.a (mon.0) 2239 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]: dispatch 2024-03-11T22:17:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: audit 2024-03-11T22:17:16.492409+0000 mon.a (mon.0) 2240 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]': finished 2024-03-11T22:17:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: cluster 2024-03-11T22:17:16.499871+0000 mon.a (mon.0) 2241 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-03-11T22:17:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: audit 2024-03-11T22:17:16.505014+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:16 smithi187 bash[23415]: audit 2024-03-11T22:17:16.506758+0000 mon.a (mon.0) 2242 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: audit 2024-03-11T22:17:15.969980+0000 mon.b (mon.1) 253 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: audit 2024-03-11T22:17:15.972291+0000 mon.b (mon.1) 254 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]: dispatch 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: audit 2024-03-11T22:17:15.976419+0000 mon.a (mon.0) 2238 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: audit 2024-03-11T22:17:15.978681+0000 mon.a (mon.0) 2239 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]: dispatch 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: audit 2024-03-11T22:17:16.492409+0000 mon.a (mon.0) 2240 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]': finished 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: cluster 2024-03-11T22:17:16.499871+0000 mon.a (mon.0) 2241 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: audit 2024-03-11T22:17:16.505014+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:17.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[21434]: audit 2024-03-11T22:17:16.506758+0000 mon.a (mon.0) 2242 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: audit 2024-03-11T22:17:15.969980+0000 mon.b (mon.1) 253 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: audit 2024-03-11T22:17:15.972291+0000 mon.b (mon.1) 254 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]: dispatch 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: audit 2024-03-11T22:17:15.976419+0000 mon.a (mon.0) 2238 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: audit 2024-03-11T22:17:15.978681+0000 mon.a (mon.0) 2239 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]: dispatch 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: audit 2024-03-11T22:17:16.492409+0000 mon.a (mon.0) 2240 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-45"}]': finished 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: cluster 2024-03-11T22:17:16.499871+0000 mon.a (mon.0) 2241 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: audit 2024-03-11T22:17:16.505014+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:16 smithi049 bash[28804]: audit 2024-03-11T22:17:16.506758+0000 mon.a (mon.0) 2242 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: cluster 2024-03-11T22:17:16.111570+0000 mgr.y (mgr.14601) 357 : cluster 0 pgmap v503: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: cluster 2024-03-11T22:17:16.963532+0000 mon.a (mon.0) 2243 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.495072+0000 mon.a (mon.0) 2244 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: cluster 2024-03-11T22:17:17.502082+0000 mon.a (mon.0) 2245 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.507389+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.829843+0000 mon.c (mon.2) 535 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.830625+0000 mon.c (mon.2) 536 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.831047+0000 mon.c (mon.2) 537 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.831457+0000 mon.c (mon.2) 538 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.969483+0000 mon.a (mon.0) 2246 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.969877+0000 mon.a (mon.0) 2247 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.970217+0000 mon.a (mon.0) 2248 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.970552+0000 mon.a (mon.0) 2249 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:17 smithi187 bash[23415]: audit 2024-03-11T22:17:17.970879+0000 mon.a (mon.0) 2250 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: cluster 2024-03-11T22:17:16.111570+0000 mgr.y (mgr.14601) 357 : cluster 0 pgmap v503: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: cluster 2024-03-11T22:17:16.963532+0000 mon.a (mon.0) 2243 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.495072+0000 mon.a (mon.0) 2244 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: cluster 2024-03-11T22:17:17.502082+0000 mon.a (mon.0) 2245 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.507389+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.829843+0000 mon.c (mon.2) 535 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.830625+0000 mon.c (mon.2) 536 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.831047+0000 mon.c (mon.2) 537 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.831457+0000 mon.c (mon.2) 538 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.969483+0000 mon.a (mon.0) 2246 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.969877+0000 mon.a (mon.0) 2247 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.970217+0000 mon.a (mon.0) 2248 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.970552+0000 mon.a (mon.0) 2249 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[21434]: audit 2024-03-11T22:17:17.970879+0000 mon.a (mon.0) 2250 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: cluster 2024-03-11T22:17:16.111570+0000 mgr.y (mgr.14601) 357 : cluster 0 pgmap v503: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: cluster 2024-03-11T22:17:16.963532+0000 mon.a (mon.0) 2243 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.495072+0000 mon.a (mon.0) 2244 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: cluster 2024-03-11T22:17:17.502082+0000 mon.a (mon.0) 2245 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.507389+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.49:0/3195815242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.829843+0000 mon.c (mon.2) 535 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.830625+0000 mon.c (mon.2) 536 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.831047+0000 mon.c (mon.2) 537 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.831457+0000 mon.c (mon.2) 538 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]: dispatch 2024-03-11T22:17:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.969483+0000 mon.a (mon.0) 2246 : audit 1 from='client.47048 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]: dispatch 2024-03-11T22:17:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.969877+0000 mon.a (mon.0) 2247 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.970217+0000 mon.a (mon.0) 2248 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.970552+0000 mon.a (mon.0) 2249 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-03-11T22:17:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:17 smithi049 bash[28804]: audit 2024-03-11T22:17:17.970879+0000 mon.a (mon.0) 2250 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]: dispatch 2024-03-11T22:17:19.242 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:17:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:17:19.770 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: cluster 2024-03-11T22:17:18.112446+0000 mgr.y (mgr.14601) 358 : cluster 0 pgmap v506: 260 pgs: 260 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.499582+0000 mon.a (mon.0) 2251 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.499918+0000 mon.a (mon.0) 2252 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]': finished 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.500172+0000 mon.a (mon.0) 2253 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]': finished 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.500411+0000 mon.a (mon.0) 2254 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.500653+0000 mon.a (mon.0) 2255 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]': finished 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.505792+0000 mon.b (mon.1) 255 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: cluster 2024-03-11T22:17:18.507945+0000 mon.a (mon.0) 2256 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.512854+0000 mon.a (mon.0) 2257 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.553809+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.554209+0000 mon.a (mon.0) 2258 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.555348+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.555638+0000 mon.a (mon.0) 2259 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.556101+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.556377+0000 mon.a (mon.0) 2260 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[21434]: audit 2024-03-11T22:17:18.784705+0000 mgr.y (mgr.14601) 359 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: cluster 2024-03-11T22:17:18.112446+0000 mgr.y (mgr.14601) 358 : cluster 0 pgmap v506: 260 pgs: 260 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.499582+0000 mon.a (mon.0) 2251 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.499918+0000 mon.a (mon.0) 2252 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]': finished 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.500172+0000 mon.a (mon.0) 2253 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]': finished 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.500411+0000 mon.a (mon.0) 2254 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.500653+0000 mon.a (mon.0) 2255 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]': finished 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.505792+0000 mon.b (mon.1) 255 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: cluster 2024-03-11T22:17:18.507945+0000 mon.a (mon.0) 2256 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-03-11T22:17:19.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.512854+0000 mon.a (mon.0) 2257 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.553809+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.554209+0000 mon.a (mon.0) 2258 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.555348+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.555638+0000 mon.a (mon.0) 2259 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.556101+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.556377+0000 mon.a (mon.0) 2260 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:19 smithi049 bash[28804]: audit 2024-03-11T22:17:18.784705+0000 mgr.y (mgr.14601) 359 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: cluster 2024-03-11T22:17:18.112446+0000 mgr.y (mgr.14601) 358 : cluster 0 pgmap v506: 260 pgs: 260 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.499582+0000 mon.a (mon.0) 2251 : audit 1 from='client.47048 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi049-64063-61"}]': finished 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.499918+0000 mon.a (mon.0) 2252 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.5", "id": [3, 1]}]': finished 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.500172+0000 mon.a (mon.0) 2253 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.e", "id": [3, 1]}]': finished 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.500411+0000 mon.a (mon.0) 2254 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.500653+0000 mon.a (mon.0) 2255 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "95.16", "id": [1, 4]}]': finished 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.505792+0000 mon.b (mon.1) 255 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: cluster 2024-03-11T22:17:18.507945+0000 mon.a (mon.0) 2256 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.512854+0000 mon.a (mon.0) 2257 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.553809+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.554209+0000 mon.a (mon.0) 2258 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.555348+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.555638+0000 mon.a (mon.0) 2259 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:19.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.556101+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:19.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.556377+0000 mon.a (mon.0) 2260 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:19.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:19 smithi187 bash[23415]: audit 2024-03-11T22:17:18.784705+0000 mgr.y (mgr.14601) 359 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:21.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:20 smithi187 bash[23415]: audit 2024-03-11T22:17:19.502395+0000 mon.a (mon.0) 2261 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:21.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:20 smithi187 bash[23415]: audit 2024-03-11T22:17:19.502608+0000 mon.a (mon.0) 2262 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:21.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:20 smithi187 bash[23415]: cluster 2024-03-11T22:17:19.510993+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-03-11T22:17:21.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:20 smithi187 bash[23415]: audit 2024-03-11T22:17:19.517101+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:21.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:20 smithi187 bash[23415]: audit 2024-03-11T22:17:19.533501+0000 mon.a (mon.0) 2264 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:21.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:20 smithi187 bash[23415]: audit 2024-03-11T22:17:19.598705+0000 mon.b (mon.1) 256 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:21.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:20 smithi187 bash[23415]: audit 2024-03-11T22:17:19.604971+0000 mon.a (mon.0) 2265 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:21.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[21434]: audit 2024-03-11T22:17:19.502395+0000 mon.a (mon.0) 2261 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:21.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[21434]: audit 2024-03-11T22:17:19.502608+0000 mon.a (mon.0) 2262 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:21.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[21434]: cluster 2024-03-11T22:17:19.510993+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[21434]: audit 2024-03-11T22:17:19.517101+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[21434]: audit 2024-03-11T22:17:19.533501+0000 mon.a (mon.0) 2264 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[21434]: audit 2024-03-11T22:17:19.598705+0000 mon.b (mon.1) 256 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[21434]: audit 2024-03-11T22:17:19.604971+0000 mon.a (mon.0) 2265 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[28804]: audit 2024-03-11T22:17:19.502395+0000 mon.a (mon.0) 2261 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[28804]: audit 2024-03-11T22:17:19.502608+0000 mon.a (mon.0) 2262 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[28804]: cluster 2024-03-11T22:17:19.510993+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[28804]: audit 2024-03-11T22:17:19.517101+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[28804]: audit 2024-03-11T22:17:19.533501+0000 mon.a (mon.0) 2264 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[28804]: audit 2024-03-11T22:17:19.598705+0000 mon.b (mon.1) 256 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:20 smithi049 bash[28804]: audit 2024-03-11T22:17:19.604971+0000 mon.a (mon.0) 2265 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:22.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: cluster 2024-03-11T22:17:20.113397+0000 mgr.y (mgr.14601) 360 : cluster 0 pgmap v509: 292 pgs: 1 peering, 18 creating+peering, 14 unknown, 259 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: audit 2024-03-11T22:17:20.522055+0000 mon.a (mon.0) 2266 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: audit 2024-03-11T22:17:20.524748+0000 mon.b (mon.1) 257 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: cluster 2024-03-11T22:17:20.983949+0000 mon.a (mon.0) 2267 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: audit 2024-03-11T22:17:20.992290+0000 mon.a (mon.0) 2268 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: audit 2024-03-11T22:17:21.525404+0000 mon.a (mon.0) 2269 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: audit 2024-03-11T22:17:21.525609+0000 mon.a (mon.0) 2270 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]': finished 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: audit 2024-03-11T22:17:21.528083+0000 mon.b (mon.1) 258 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]: dispatch 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: cluster 2024-03-11T22:17:21.533552+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-03-11T22:17:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:21 smithi187 bash[23415]: audit 2024-03-11T22:17:21.537454+0000 mon.a (mon.0) 2272 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]: dispatch 2024-03-11T22:17:22.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: cluster 2024-03-11T22:17:20.113397+0000 mgr.y (mgr.14601) 360 : cluster 0 pgmap v509: 292 pgs: 1 peering, 18 creating+peering, 14 unknown, 259 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: audit 2024-03-11T22:17:20.522055+0000 mon.a (mon.0) 2266 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: audit 2024-03-11T22:17:20.524748+0000 mon.b (mon.1) 257 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: cluster 2024-03-11T22:17:20.983949+0000 mon.a (mon.0) 2267 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: audit 2024-03-11T22:17:20.992290+0000 mon.a (mon.0) 2268 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: audit 2024-03-11T22:17:21.525404+0000 mon.a (mon.0) 2269 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: audit 2024-03-11T22:17:21.525609+0000 mon.a (mon.0) 2270 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]': finished 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: audit 2024-03-11T22:17:21.528083+0000 mon.b (mon.1) 258 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]: dispatch 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: cluster 2024-03-11T22:17:21.533552+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[21434]: audit 2024-03-11T22:17:21.537454+0000 mon.a (mon.0) 2272 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]: dispatch 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: cluster 2024-03-11T22:17:20.113397+0000 mgr.y (mgr.14601) 360 : cluster 0 pgmap v509: 292 pgs: 1 peering, 18 creating+peering, 14 unknown, 259 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:22.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: audit 2024-03-11T22:17:20.522055+0000 mon.a (mon.0) 2266 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: audit 2024-03-11T22:17:20.524748+0000 mon.b (mon.1) 257 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: cluster 2024-03-11T22:17:20.983949+0000 mon.a (mon.0) 2267 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: audit 2024-03-11T22:17:20.992290+0000 mon.a (mon.0) 2268 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: audit 2024-03-11T22:17:21.525404+0000 mon.a (mon.0) 2269 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi049-64063-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: audit 2024-03-11T22:17:21.525609+0000 mon.a (mon.0) 2270 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-47"}]': finished 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: audit 2024-03-11T22:17:21.528083+0000 mon.b (mon.1) 258 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]: dispatch 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: cluster 2024-03-11T22:17:21.533552+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-03-11T22:17:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:21 smithi049 bash[28804]: audit 2024-03-11T22:17:21.537454+0000 mon.a (mon.0) 2272 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]: dispatch 2024-03-11T22:17:23.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:22 smithi187 bash[23415]: cluster 2024-03-11T22:17:22.525860+0000 mon.a (mon.0) 2273 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:23.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:22 smithi187 bash[23415]: audit 2024-03-11T22:17:22.528286+0000 mon.a (mon.0) 2274 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]': finished 2024-03-11T22:17:23.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:22 smithi187 bash[23415]: audit 2024-03-11T22:17:22.531171+0000 mon.b (mon.1) 259 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:23.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:22 smithi187 bash[23415]: cluster 2024-03-11T22:17:22.535090+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-03-11T22:17:23.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:22 smithi187 bash[23415]: audit 2024-03-11T22:17:22.539116+0000 mon.a (mon.0) 2276 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:23.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:22 smithi049 bash[21434]: cluster 2024-03-11T22:17:22.525860+0000 mon.a (mon.0) 2273 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:23.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:22 smithi049 bash[21434]: audit 2024-03-11T22:17:22.528286+0000 mon.a (mon.0) 2274 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]': finished 2024-03-11T22:17:23.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:22 smithi049 bash[21434]: audit 2024-03-11T22:17:22.531171+0000 mon.b (mon.1) 259 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:23.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:22 smithi049 bash[21434]: cluster 2024-03-11T22:17:22.535090+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-03-11T22:17:23.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:22 smithi049 bash[21434]: audit 2024-03-11T22:17:22.539116+0000 mon.a (mon.0) 2276 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:23 smithi049 bash[28804]: cluster 2024-03-11T22:17:22.525860+0000 mon.a (mon.0) 2273 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:23 smithi049 bash[28804]: audit 2024-03-11T22:17:22.528286+0000 mon.a (mon.0) 2274 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-47", "mode": "writeback"}]': finished 2024-03-11T22:17:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:23 smithi049 bash[28804]: audit 2024-03-11T22:17:22.531171+0000 mon.b (mon.1) 259 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:23 smithi049 bash[28804]: cluster 2024-03-11T22:17:22.535090+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-03-11T22:17:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:23 smithi049 bash[28804]: audit 2024-03-11T22:17:22.539116+0000 mon.a (mon.0) 2276 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:24.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: cluster 2024-03-11T22:17:22.114403+0000 mgr.y (mgr.14601) 361 : cluster 0 pgmap v512: 300 pgs: 1 peering, 18 creating+peering, 22 unknown, 259 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:24.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: cluster 2024-03-11T22:17:22.988632+0000 mon.a (mon.0) 2277 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:24.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: audit 2024-03-11T22:17:23.531231+0000 mon.a (mon.0) 2278 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:17:24.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: audit 2024-03-11T22:17:23.533897+0000 mon.b (mon.1) 260 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:24.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: cluster 2024-03-11T22:17:23.538529+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-03-11T22:17:24.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: audit 2024-03-11T22:17:23.540561+0000 mon.a (mon.0) 2280 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:24.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: audit 2024-03-11T22:17:23.542016+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:24.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:23 smithi187 bash[23415]: audit 2024-03-11T22:17:23.542677+0000 mon.a (mon.0) 2281 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:24.270 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:17:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:17:24.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: cluster 2024-03-11T22:17:22.114403+0000 mgr.y (mgr.14601) 361 : cluster 0 pgmap v512: 300 pgs: 1 peering, 18 creating+peering, 22 unknown, 259 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:24.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: cluster 2024-03-11T22:17:22.988632+0000 mon.a (mon.0) 2277 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:24.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: audit 2024-03-11T22:17:23.531231+0000 mon.a (mon.0) 2278 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:17:24.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: audit 2024-03-11T22:17:23.533897+0000 mon.b (mon.1) 260 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:24.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: cluster 2024-03-11T22:17:23.538529+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: audit 2024-03-11T22:17:23.540561+0000 mon.a (mon.0) 2280 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: audit 2024-03-11T22:17:23.542016+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[21434]: audit 2024-03-11T22:17:23.542677+0000 mon.a (mon.0) 2281 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: cluster 2024-03-11T22:17:22.114403+0000 mgr.y (mgr.14601) 361 : cluster 0 pgmap v512: 300 pgs: 1 peering, 18 creating+peering, 22 unknown, 259 active+clean; 8.4 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: cluster 2024-03-11T22:17:22.988632+0000 mon.a (mon.0) 2277 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: audit 2024-03-11T22:17:23.531231+0000 mon.a (mon.0) 2278 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: audit 2024-03-11T22:17:23.533897+0000 mon.b (mon.1) 260 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: cluster 2024-03-11T22:17:23.538529+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: audit 2024-03-11T22:17:23.540561+0000 mon.a (mon.0) 2280 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: audit 2024-03-11T22:17:23.542016+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:24.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:24 smithi049 bash[28804]: audit 2024-03-11T22:17:23.542677+0000 mon.a (mon.0) 2281 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:25.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: cluster 2024-03-11T22:17:24.116209+0000 mgr.y (mgr.14601) 362 : cluster 0 pgmap v515: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s; 5 B/s, 2 objects/s recovering 2024-03-11T22:17:25.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:24.533905+0000 mon.a (mon.0) 2282 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:24.534102+0000 mon.a (mon.0) 2283 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:24.538839+0000 mon.b (mon.1) 261 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: cluster 2024-03-11T22:17:24.540303+0000 mon.a (mon.0) 2284 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:24.542176+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:24.544529+0000 mon.a (mon.0) 2285 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:24.545846+0000 mon.a (mon.0) 2286 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:25.340285+0000 mon.a (mon.0) 2287 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:17:25.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:25 smithi187 bash[23415]: audit 2024-03-11T22:17:25.343393+0000 mon.c (mon.2) 545 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:26.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: cluster 2024-03-11T22:17:24.116209+0000 mgr.y (mgr.14601) 362 : cluster 0 pgmap v515: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s; 5 B/s, 2 objects/s recovering 2024-03-11T22:17:26.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:24.533905+0000 mon.a (mon.0) 2282 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:17:26.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:24.534102+0000 mon.a (mon.0) 2283 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:26.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:24.538839+0000 mon.b (mon.1) 261 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:26.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: cluster 2024-03-11T22:17:24.540303+0000 mon.a (mon.0) 2284 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-03-11T22:17:26.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:24.542176+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:26.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:24.544529+0000 mon.a (mon.0) 2285 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:24.545846+0000 mon.a (mon.0) 2286 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:25.340285+0000 mon.a (mon.0) 2287 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[21434]: audit 2024-03-11T22:17:25.343393+0000 mon.c (mon.2) 545 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: cluster 2024-03-11T22:17:24.116209+0000 mgr.y (mgr.14601) 362 : cluster 0 pgmap v515: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s; 5 B/s, 2 objects/s recovering 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:24.533905+0000 mon.a (mon.0) 2282 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:24.534102+0000 mon.a (mon.0) 2283 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:24.538839+0000 mon.b (mon.1) 261 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: cluster 2024-03-11T22:17:24.540303+0000 mon.a (mon.0) 2284 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:24.542176+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.49:0/3243805941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:24.544529+0000 mon.a (mon.0) 2285 : audit 1 from='client.47054 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]: dispatch 2024-03-11T22:17:26.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:24.545846+0000 mon.a (mon.0) 2286 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:25.340285+0000 mon.a (mon.0) 2287 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:17:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:25 smithi049 bash[28804]: audit 2024-03-11T22:17:25.343393+0000 mon.c (mon.2) 545 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: cluster 2024-03-11T22:17:25.535762+0000 mon.a (mon.0) 2288 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.547114+0000 mon.a (mon.0) 2289 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.547339+0000 mon.a (mon.0) 2290 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.550957+0000 mon.b (mon.1) 262 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: cluster 2024-03-11T22:17:25.553735+0000 mon.a (mon.0) 2291 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.558099+0000 mon.a (mon.0) 2292 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.592934+0000 mon.c (mon.2) 546 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.593337+0000 mon.a (mon.0) 2293 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:26.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.594556+0000 mon.c (mon.2) 547 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:26.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.594837+0000 mon.a (mon.0) 2294 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:26.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.595369+0000 mon.c (mon.2) 548 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:26.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:26 smithi187 bash[23415]: audit 2024-03-11T22:17:25.595657+0000 mon.a (mon.0) 2295 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:27.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: cluster 2024-03-11T22:17:25.535762+0000 mon.a (mon.0) 2288 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:27.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.547114+0000 mon.a (mon.0) 2289 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:27.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.547339+0000 mon.a (mon.0) 2290 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:27.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.550957+0000 mon.b (mon.1) 262 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:27.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: cluster 2024-03-11T22:17:25.553735+0000 mon.a (mon.0) 2291 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-03-11T22:17:27.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.558099+0000 mon.a (mon.0) 2292 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.592934+0000 mon.c (mon.2) 546 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.593337+0000 mon.a (mon.0) 2293 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.594556+0000 mon.c (mon.2) 547 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.594837+0000 mon.a (mon.0) 2294 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.595369+0000 mon.c (mon.2) 548 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[21434]: audit 2024-03-11T22:17:25.595657+0000 mon.a (mon.0) 2295 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: cluster 2024-03-11T22:17:25.535762+0000 mon.a (mon.0) 2288 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.547114+0000 mon.a (mon.0) 2289 : audit 1 from='client.47054 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi049-64063-62"}]': finished 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.547339+0000 mon.a (mon.0) 2290 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.550957+0000 mon.b (mon.1) 262 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: cluster 2024-03-11T22:17:25.553735+0000 mon.a (mon.0) 2291 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.558099+0000 mon.a (mon.0) 2292 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.592934+0000 mon.c (mon.2) 546 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.593337+0000 mon.a (mon.0) 2293 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.594556+0000 mon.c (mon.2) 547 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.594837+0000 mon.a (mon.0) 2294 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.595369+0000 mon.c (mon.2) 548 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:26 smithi049 bash[28804]: audit 2024-03-11T22:17:25.595657+0000 mon.a (mon.0) 2295 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:28.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: cluster 2024-03-11T22:17:26.117334+0000 mgr.y (mgr.14601) 363 : cluster 0 pgmap v518: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s; 5 B/s, 2 objects/s recovering 2024-03-11T22:17:28.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: audit 2024-03-11T22:17:26.556494+0000 mon.a (mon.0) 2296 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:17:28.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: audit 2024-03-11T22:17:26.556723+0000 mon.a (mon.0) 2297 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:28.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: audit 2024-03-11T22:17:26.562249+0000 mon.b (mon.1) 263 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:17:28.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: cluster 2024-03-11T22:17:26.563249+0000 mon.a (mon.0) 2298 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-03-11T22:17:28.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: audit 2024-03-11T22:17:26.564627+0000 mon.c (mon.2) 549 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:28.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: audit 2024-03-11T22:17:26.565545+0000 mon.a (mon.0) 2299 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:28.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[23415]: audit 2024-03-11T22:17:26.568565+0000 mon.a (mon.0) 2300 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: cluster 2024-03-11T22:17:26.117334+0000 mgr.y (mgr.14601) 363 : cluster 0 pgmap v518: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s; 5 B/s, 2 objects/s recovering 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: audit 2024-03-11T22:17:26.556494+0000 mon.a (mon.0) 2296 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: audit 2024-03-11T22:17:26.556723+0000 mon.a (mon.0) 2297 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: audit 2024-03-11T22:17:26.562249+0000 mon.b (mon.1) 263 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: cluster 2024-03-11T22:17:26.563249+0000 mon.a (mon.0) 2298 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: audit 2024-03-11T22:17:26.564627+0000 mon.c (mon.2) 549 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: audit 2024-03-11T22:17:26.565545+0000 mon.a (mon.0) 2299 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:28.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[21434]: audit 2024-03-11T22:17:26.568565+0000 mon.a (mon.0) 2300 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: cluster 2024-03-11T22:17:26.117334+0000 mgr.y (mgr.14601) 363 : cluster 0 pgmap v518: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s; 5 B/s, 2 objects/s recovering 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: audit 2024-03-11T22:17:26.556494+0000 mon.a (mon.0) 2296 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: audit 2024-03-11T22:17:26.556723+0000 mon.a (mon.0) 2297 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi049-64063-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: audit 2024-03-11T22:17:26.562249+0000 mon.b (mon.1) 263 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: cluster 2024-03-11T22:17:26.563249+0000 mon.a (mon.0) 2298 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: audit 2024-03-11T22:17:26.564627+0000 mon.c (mon.2) 549 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: audit 2024-03-11T22:17:26.565545+0000 mon.a (mon.0) 2299 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:28.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:28 smithi049 bash[28804]: audit 2024-03-11T22:17:26.568565+0000 mon.a (mon.0) 2300 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:17:29.242 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:17:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: audit 2024-03-11T22:17:27.561216+0000 mon.a (mon.0) 2301 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: audit 2024-03-11T22:17:27.568099+0000 mon.b (mon.1) 264 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: cluster 2024-03-11T22:17:28.032050+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: audit 2024-03-11T22:17:28.044727+0000 mon.a (mon.0) 2303 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: audit 2024-03-11T22:17:28.564368+0000 mon.a (mon.0) 2304 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: audit 2024-03-11T22:17:28.564620+0000 mon.a (mon.0) 2305 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: cluster 2024-03-11T22:17:28.572577+0000 mon.a (mon.0) 2306 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: audit 2024-03-11T22:17:28.641497+0000 mon.b (mon.1) 265 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:29.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:29 smithi187 bash[23415]: audit 2024-03-11T22:17:28.647787+0000 mon.a (mon.0) 2307 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:29.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: audit 2024-03-11T22:17:27.561216+0000 mon.a (mon.0) 2301 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-11T22:17:29.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: audit 2024-03-11T22:17:27.568099+0000 mon.b (mon.1) 264 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:17:29.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: cluster 2024-03-11T22:17:28.032050+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: audit 2024-03-11T22:17:28.044727+0000 mon.a (mon.0) 2303 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: audit 2024-03-11T22:17:28.564368+0000 mon.a (mon.0) 2304 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: audit 2024-03-11T22:17:28.564620+0000 mon.a (mon.0) 2305 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: cluster 2024-03-11T22:17:28.572577+0000 mon.a (mon.0) 2306 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: audit 2024-03-11T22:17:28.641497+0000 mon.b (mon.1) 265 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[21434]: audit 2024-03-11T22:17:28.647787+0000 mon.a (mon.0) 2307 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: audit 2024-03-11T22:17:27.561216+0000 mon.a (mon.0) 2301 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: audit 2024-03-11T22:17:27.568099+0000 mon.b (mon.1) 264 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: cluster 2024-03-11T22:17:28.032050+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: audit 2024-03-11T22:17:28.044727+0000 mon.a (mon.0) 2303 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: audit 2024-03-11T22:17:28.564368+0000 mon.a (mon.0) 2304 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi049-64063-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:29.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: audit 2024-03-11T22:17:28.564620+0000 mon.a (mon.0) 2305 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-11T22:17:29.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: cluster 2024-03-11T22:17:28.572577+0000 mon.a (mon.0) 2306 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-03-11T22:17:29.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: audit 2024-03-11T22:17:28.641497+0000 mon.b (mon.1) 265 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:29.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:29 smithi049 bash[28804]: audit 2024-03-11T22:17:28.647787+0000 mon.a (mon.0) 2307 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:30.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:30 smithi187 bash[23415]: cluster 2024-03-11T22:17:28.118213+0000 mgr.y (mgr.14601) 364 : cluster 0 pgmap v521: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:30.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:30 smithi187 bash[23415]: audit 2024-03-11T22:17:28.795810+0000 mgr.y (mgr.14601) 365 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:30.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:30 smithi187 bash[23415]: audit 2024-03-11T22:17:29.567304+0000 mon.a (mon.0) 2308 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:17:30.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:30 smithi187 bash[23415]: audit 2024-03-11T22:17:29.570472+0000 mon.b (mon.1) 266 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:30.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:30 smithi187 bash[23415]: cluster 2024-03-11T22:17:29.575574+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-03-11T22:17:30.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:30 smithi187 bash[23415]: audit 2024-03-11T22:17:29.578540+0000 mon.a (mon.0) 2310 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:30.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[21434]: cluster 2024-03-11T22:17:28.118213+0000 mgr.y (mgr.14601) 364 : cluster 0 pgmap v521: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:30.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[21434]: audit 2024-03-11T22:17:28.795810+0000 mgr.y (mgr.14601) 365 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:30.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[21434]: audit 2024-03-11T22:17:29.567304+0000 mon.a (mon.0) 2308 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:17:30.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[21434]: audit 2024-03-11T22:17:29.570472+0000 mon.b (mon.1) 266 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:30.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[21434]: cluster 2024-03-11T22:17:29.575574+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-03-11T22:17:30.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[21434]: audit 2024-03-11T22:17:29.578540+0000 mon.a (mon.0) 2310 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:30.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[28804]: cluster 2024-03-11T22:17:28.118213+0000 mgr.y (mgr.14601) 364 : cluster 0 pgmap v521: 292 pgs: 292 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:30.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[28804]: audit 2024-03-11T22:17:28.795810+0000 mgr.y (mgr.14601) 365 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:30.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[28804]: audit 2024-03-11T22:17:29.567304+0000 mon.a (mon.0) 2308 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:17:30.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[28804]: audit 2024-03-11T22:17:29.570472+0000 mon.b (mon.1) 266 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:30.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[28804]: cluster 2024-03-11T22:17:29.575574+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-03-11T22:17:30.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:30 smithi049 bash[28804]: audit 2024-03-11T22:17:29.578540+0000 mon.a (mon.0) 2310 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: cluster 2024-03-11T22:17:30.182974+0000 mon.a (mon.0) 2311 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: audit 2024-03-11T22:17:30.569880+0000 mon.a (mon.0) 2312 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]': finished 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: cluster 2024-03-11T22:17:30.578084+0000 mon.a (mon.0) 2313 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: audit 2024-03-11T22:17:30.581983+0000 mon.c (mon.2) 550 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: audit 2024-03-11T22:17:30.585154+0000 mon.a (mon.0) 2314 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: audit 2024-03-11T22:17:30.656232+0000 mon.b (mon.1) 267 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: audit 2024-03-11T22:17:30.658466+0000 mon.b (mon.1) 268 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: audit 2024-03-11T22:17:30.662760+0000 mon.a (mon.0) 2315 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:31.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:31 smithi187 bash[23415]: audit 2024-03-11T22:17:30.664868+0000 mon.a (mon.0) 2316 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:31.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: cluster 2024-03-11T22:17:30.182974+0000 mon.a (mon.0) 2311 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:31.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: audit 2024-03-11T22:17:30.569880+0000 mon.a (mon.0) 2312 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]': finished 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: cluster 2024-03-11T22:17:30.578084+0000 mon.a (mon.0) 2313 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: audit 2024-03-11T22:17:30.581983+0000 mon.c (mon.2) 550 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: audit 2024-03-11T22:17:30.585154+0000 mon.a (mon.0) 2314 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: audit 2024-03-11T22:17:30.656232+0000 mon.b (mon.1) 267 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: audit 2024-03-11T22:17:30.658466+0000 mon.b (mon.1) 268 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: audit 2024-03-11T22:17:30.662760+0000 mon.a (mon.0) 2315 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[21434]: audit 2024-03-11T22:17:30.664868+0000 mon.a (mon.0) 2316 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: cluster 2024-03-11T22:17:30.182974+0000 mon.a (mon.0) 2311 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: audit 2024-03-11T22:17:30.569880+0000 mon.a (mon.0) 2312 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]': finished 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: cluster 2024-03-11T22:17:30.578084+0000 mon.a (mon.0) 2313 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: audit 2024-03-11T22:17:30.581983+0000 mon.c (mon.2) 550 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:31.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: audit 2024-03-11T22:17:30.585154+0000 mon.a (mon.0) 2314 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: audit 2024-03-11T22:17:30.656232+0000 mon.b (mon.1) 267 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: audit 2024-03-11T22:17:30.658466+0000 mon.b (mon.1) 268 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: audit 2024-03-11T22:17:30.662760+0000 mon.a (mon.0) 2315 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:31 smithi049 bash[28804]: audit 2024-03-11T22:17:30.664868+0000 mon.a (mon.0) 2316 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-47"}]: dispatch 2024-03-11T22:17:32.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:32 smithi187 bash[23415]: cluster 2024-03-11T22:17:30.119150+0000 mgr.y (mgr.14601) 366 : cluster 0 pgmap v524: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:32.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:32 smithi187 bash[23415]: audit 2024-03-11T22:17:31.572523+0000 mon.a (mon.0) 2317 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:32.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:32 smithi187 bash[23415]: cluster 2024-03-11T22:17:31.579954+0000 mon.a (mon.0) 2318 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-03-11T22:17:32.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:32 smithi187 bash[23415]: audit 2024-03-11T22:17:31.580752+0000 mon.c (mon.2) 551 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:32.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:32 smithi187 bash[23415]: audit 2024-03-11T22:17:31.586091+0000 mon.a (mon.0) 2319 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:32.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[21434]: cluster 2024-03-11T22:17:30.119150+0000 mgr.y (mgr.14601) 366 : cluster 0 pgmap v524: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:32.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[21434]: audit 2024-03-11T22:17:31.572523+0000 mon.a (mon.0) 2317 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:32.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[21434]: cluster 2024-03-11T22:17:31.579954+0000 mon.a (mon.0) 2318 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-03-11T22:17:32.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[21434]: audit 2024-03-11T22:17:31.580752+0000 mon.c (mon.2) 551 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:32.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[21434]: audit 2024-03-11T22:17:31.586091+0000 mon.a (mon.0) 2319 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:32.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[28804]: cluster 2024-03-11T22:17:30.119150+0000 mgr.y (mgr.14601) 366 : cluster 0 pgmap v524: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:32.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[28804]: audit 2024-03-11T22:17:31.572523+0000 mon.a (mon.0) 2317 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:32.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[28804]: cluster 2024-03-11T22:17:31.579954+0000 mon.a (mon.0) 2318 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-03-11T22:17:32.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[28804]: audit 2024-03-11T22:17:31.580752+0000 mon.c (mon.2) 551 : audit 1 from='client.? v1:172.21.15.49:0/3285145705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:32.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:32 smithi049 bash[28804]: audit 2024-03-11T22:17:31.586091+0000 mon.a (mon.0) 2319 : audit 1 from='client.47060 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]: dispatch 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: cluster 2024-03-11T22:17:32.119929+0000 mgr.y (mgr.14601) 367 : cluster 0 pgmap v527: 260 pgs: 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: audit 2024-03-11T22:17:32.577572+0000 mon.a (mon.0) 2320 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: cluster 2024-03-11T22:17:32.585022+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: audit 2024-03-11T22:17:32.588271+0000 mon.b (mon.1) 269 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: audit 2024-03-11T22:17:32.595224+0000 mon.a (mon.0) 2322 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: audit 2024-03-11T22:17:32.631578+0000 mon.a (mon.0) 2323 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: audit 2024-03-11T22:17:32.632998+0000 mon.a (mon.0) 2324 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:33.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:33 smithi187 bash[23415]: audit 2024-03-11T22:17:32.633423+0000 mon.a (mon.0) 2325 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi049-64063-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:34.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: cluster 2024-03-11T22:17:32.119929+0000 mgr.y (mgr.14601) 367 : cluster 0 pgmap v527: 260 pgs: 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:34.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: audit 2024-03-11T22:17:32.577572+0000 mon.a (mon.0) 2320 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:34.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: cluster 2024-03-11T22:17:32.585022+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-03-11T22:17:34.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: audit 2024-03-11T22:17:32.588271+0000 mon.b (mon.1) 269 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:34.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: audit 2024-03-11T22:17:32.595224+0000 mon.a (mon.0) 2322 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:34.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: audit 2024-03-11T22:17:32.631578+0000 mon.a (mon.0) 2323 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:34.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: audit 2024-03-11T22:17:32.632998+0000 mon.a (mon.0) 2324 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[21434]: audit 2024-03-11T22:17:32.633423+0000 mon.a (mon.0) 2325 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi049-64063-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: cluster 2024-03-11T22:17:32.119929+0000 mgr.y (mgr.14601) 367 : cluster 0 pgmap v527: 260 pgs: 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: audit 2024-03-11T22:17:32.577572+0000 mon.a (mon.0) 2320 : audit 1 from='client.47060 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi049-64063-63"}]': finished 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: cluster 2024-03-11T22:17:32.585022+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: audit 2024-03-11T22:17:32.588271+0000 mon.b (mon.1) 269 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: audit 2024-03-11T22:17:32.595224+0000 mon.a (mon.0) 2322 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: audit 2024-03-11T22:17:32.631578+0000 mon.a (mon.0) 2323 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: audit 2024-03-11T22:17:32.632998+0000 mon.a (mon.0) 2324 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:34.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:33 smithi049 bash[28804]: audit 2024-03-11T22:17:32.633423+0000 mon.a (mon.0) 2325 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi049-64063-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:34.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:17:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:17:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:17:35.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:35 smithi187 bash[23415]: audit 2024-03-11T22:17:33.580742+0000 mon.a (mon.0) 2326 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:35.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:35 smithi187 bash[23415]: audit 2024-03-11T22:17:33.580959+0000 mon.a (mon.0) 2327 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi049-64063-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:35.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:35 smithi187 bash[23415]: cluster 2024-03-11T22:17:33.588731+0000 mon.a (mon.0) 2328 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-03-11T22:17:35.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:35 smithi187 bash[23415]: audit 2024-03-11T22:17:33.591481+0000 mon.a (mon.0) 2329 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi049-64063-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:35.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:35 smithi187 bash[23415]: audit 2024-03-11T22:17:33.638700+0000 mon.b (mon.1) 270 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:35.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:35 smithi187 bash[23415]: audit 2024-03-11T22:17:33.645696+0000 mon.a (mon.0) 2330 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:35.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:35 smithi187 bash[23415]: audit 2024-03-11T22:17:34.584472+0000 mon.a (mon.0) 2331 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:35.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[21434]: audit 2024-03-11T22:17:33.580742+0000 mon.a (mon.0) 2326 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:35.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[21434]: audit 2024-03-11T22:17:33.580959+0000 mon.a (mon.0) 2327 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi049-64063-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:35.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[21434]: cluster 2024-03-11T22:17:33.588731+0000 mon.a (mon.0) 2328 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-03-11T22:17:35.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[21434]: audit 2024-03-11T22:17:33.591481+0000 mon.a (mon.0) 2329 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi049-64063-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:35.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[21434]: audit 2024-03-11T22:17:33.638700+0000 mon.b (mon.1) 270 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:35.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[21434]: audit 2024-03-11T22:17:33.645696+0000 mon.a (mon.0) 2330 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[21434]: audit 2024-03-11T22:17:34.584472+0000 mon.a (mon.0) 2331 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[28804]: audit 2024-03-11T22:17:33.580742+0000 mon.a (mon.0) 2326 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[28804]: audit 2024-03-11T22:17:33.580959+0000 mon.a (mon.0) 2327 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi049-64063-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[28804]: cluster 2024-03-11T22:17:33.588731+0000 mon.a (mon.0) 2328 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[28804]: audit 2024-03-11T22:17:33.591481+0000 mon.a (mon.0) 2329 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi049-64063-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[28804]: audit 2024-03-11T22:17:33.638700+0000 mon.b (mon.1) 270 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[28804]: audit 2024-03-11T22:17:33.645696+0000 mon.a (mon.0) 2330 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:35 smithi049 bash[28804]: audit 2024-03-11T22:17:34.584472+0000 mon.a (mon.0) 2331 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: cluster 2024-03-11T22:17:34.120837+0000 mgr.y (mgr.14601) 368 : cluster 0 pgmap v530: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: audit 2024-03-11T22:17:34.589987+0000 mon.b (mon.1) 271 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: cluster 2024-03-11T22:17:35.051980+0000 mon.a (mon.0) 2332 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: audit 2024-03-11T22:17:35.053893+0000 mon.a (mon.0) 2333 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: audit 2024-03-11T22:17:35.587662+0000 mon.a (mon.0) 2334 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi049-64063-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: audit 2024-03-11T22:17:35.587895+0000 mon.a (mon.0) 2335 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]': finished 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: audit 2024-03-11T22:17:35.590446+0000 mon.b (mon.1) 272 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]: dispatch 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: cluster 2024-03-11T22:17:35.595001+0000 mon.a (mon.0) 2336 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-03-11T22:17:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:36 smithi187 bash[23415]: audit 2024-03-11T22:17:35.599786+0000 mon.a (mon.0) 2337 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]: dispatch 2024-03-11T22:17:36.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: cluster 2024-03-11T22:17:34.120837+0000 mgr.y (mgr.14601) 368 : cluster 0 pgmap v530: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:17:36.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: audit 2024-03-11T22:17:34.589987+0000 mon.b (mon.1) 271 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:36.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: cluster 2024-03-11T22:17:35.051980+0000 mon.a (mon.0) 2332 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: audit 2024-03-11T22:17:35.053893+0000 mon.a (mon.0) 2333 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: audit 2024-03-11T22:17:35.587662+0000 mon.a (mon.0) 2334 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi049-64063-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: audit 2024-03-11T22:17:35.587895+0000 mon.a (mon.0) 2335 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]': finished 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: audit 2024-03-11T22:17:35.590446+0000 mon.b (mon.1) 272 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]: dispatch 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: cluster 2024-03-11T22:17:35.595001+0000 mon.a (mon.0) 2336 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[28804]: audit 2024-03-11T22:17:35.599786+0000 mon.a (mon.0) 2337 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]: dispatch 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: cluster 2024-03-11T22:17:34.120837+0000 mgr.y (mgr.14601) 368 : cluster 0 pgmap v530: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: audit 2024-03-11T22:17:34.589987+0000 mon.b (mon.1) 271 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: cluster 2024-03-11T22:17:35.051980+0000 mon.a (mon.0) 2332 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: audit 2024-03-11T22:17:35.053893+0000 mon.a (mon.0) 2333 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: audit 2024-03-11T22:17:35.587662+0000 mon.a (mon.0) 2334 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi049-64063-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: audit 2024-03-11T22:17:35.587895+0000 mon.a (mon.0) 2335 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-49"}]': finished 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: audit 2024-03-11T22:17:35.590446+0000 mon.b (mon.1) 272 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]: dispatch 2024-03-11T22:17:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: cluster 2024-03-11T22:17:35.595001+0000 mon.a (mon.0) 2336 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-03-11T22:17:36.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:36 smithi049 bash[21434]: audit 2024-03-11T22:17:35.599786+0000 mon.a (mon.0) 2337 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]: dispatch 2024-03-11T22:17:37.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:37 smithi187 bash[23415]: cluster 2024-03-11T22:17:36.588040+0000 mon.a (mon.0) 2338 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:37.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:37 smithi187 bash[23415]: audit 2024-03-11T22:17:36.590451+0000 mon.a (mon.0) 2339 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]': finished 2024-03-11T22:17:37.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:37 smithi187 bash[23415]: cluster 2024-03-11T22:17:36.597744+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-03-11T22:17:37.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:37 smithi049 bash[28804]: cluster 2024-03-11T22:17:36.588040+0000 mon.a (mon.0) 2338 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:37.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:37 smithi049 bash[28804]: audit 2024-03-11T22:17:36.590451+0000 mon.a (mon.0) 2339 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]': finished 2024-03-11T22:17:37.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:37 smithi049 bash[28804]: cluster 2024-03-11T22:17:36.597744+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-03-11T22:17:37.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:37 smithi049 bash[21434]: cluster 2024-03-11T22:17:36.588040+0000 mon.a (mon.0) 2338 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:37.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:37 smithi049 bash[21434]: audit 2024-03-11T22:17:36.590451+0000 mon.a (mon.0) 2339 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-49", "mode": "readproxy"}]': finished 2024-03-11T22:17:37.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:37 smithi049 bash[21434]: cluster 2024-03-11T22:17:36.597744+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-03-11T22:17:38.492 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:38 smithi187 bash[23415]: cluster 2024-03-11T22:17:36.121831+0000 mgr.y (mgr.14601) 369 : cluster 0 pgmap v533: 300 pgs: 8 unknown, 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:17:38.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:38 smithi187 bash[23415]: cluster 2024-03-11T22:17:37.068438+0000 mon.a (mon.0) 2341 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:38.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:38 smithi187 bash[23415]: cluster 2024-03-11T22:17:37.599302+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-03-11T22:17:38.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:38 smithi187 bash[23415]: audit 2024-03-11T22:17:37.605487+0000 mon.a (mon.0) 2343 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:38.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[21434]: cluster 2024-03-11T22:17:36.121831+0000 mgr.y (mgr.14601) 369 : cluster 0 pgmap v533: 300 pgs: 8 unknown, 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:17:38.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[21434]: cluster 2024-03-11T22:17:37.068438+0000 mon.a (mon.0) 2341 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:38.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[21434]: cluster 2024-03-11T22:17:37.599302+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-03-11T22:17:38.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[21434]: audit 2024-03-11T22:17:37.605487+0000 mon.a (mon.0) 2343 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:38.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[28804]: cluster 2024-03-11T22:17:36.121831+0000 mgr.y (mgr.14601) 369 : cluster 0 pgmap v533: 300 pgs: 8 unknown, 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:17:38.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[28804]: cluster 2024-03-11T22:17:37.068438+0000 mon.a (mon.0) 2341 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:38.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[28804]: cluster 2024-03-11T22:17:37.599302+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-03-11T22:17:38.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:38 smithi049 bash[28804]: audit 2024-03-11T22:17:37.605487+0000 mon.a (mon.0) 2343 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:39.242 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:17:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:17:39.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:39 smithi187 bash[23415]: cluster 2024-03-11T22:17:38.122745+0000 mgr.y (mgr.14601) 370 : cluster 0 pgmap v536: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:39.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:39 smithi187 bash[23415]: audit 2024-03-11T22:17:38.595995+0000 mon.a (mon.0) 2344 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:39.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:39 smithi187 bash[23415]: cluster 2024-03-11T22:17:38.602919+0000 mon.a (mon.0) 2345 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-03-11T22:17:39.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:39 smithi187 bash[23415]: audit 2024-03-11T22:17:38.604650+0000 mon.a (mon.0) 2346 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:39.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:39 smithi187 bash[23415]: audit 2024-03-11T22:17:38.803918+0000 mgr.y (mgr.14601) 371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:40.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[21434]: cluster 2024-03-11T22:17:38.122745+0000 mgr.y (mgr.14601) 370 : cluster 0 pgmap v536: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:40.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[21434]: audit 2024-03-11T22:17:38.595995+0000 mon.a (mon.0) 2344 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:40.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[21434]: cluster 2024-03-11T22:17:38.602919+0000 mon.a (mon.0) 2345 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-03-11T22:17:40.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[21434]: audit 2024-03-11T22:17:38.604650+0000 mon.a (mon.0) 2346 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:40.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[21434]: audit 2024-03-11T22:17:38.803918+0000 mgr.y (mgr.14601) 371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:40.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[28804]: cluster 2024-03-11T22:17:38.122745+0000 mgr.y (mgr.14601) 370 : cluster 0 pgmap v536: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:40.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[28804]: audit 2024-03-11T22:17:38.595995+0000 mon.a (mon.0) 2344 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:40.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[28804]: cluster 2024-03-11T22:17:38.602919+0000 mon.a (mon.0) 2345 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-03-11T22:17:40.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[28804]: audit 2024-03-11T22:17:38.604650+0000 mon.a (mon.0) 2346 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]: dispatch 2024-03-11T22:17:40.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:39 smithi049 bash[28804]: audit 2024-03-11T22:17:38.803918+0000 mgr.y (mgr.14601) 371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:39.607280+0000 mon.a (mon.0) 2347 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: cluster 2024-03-11T22:17:39.614215+0000 mon.a (mon.0) 2348 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:39.647878+0000 mon.c (mon.2) 552 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:39.648232+0000 mon.a (mon.0) 2349 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:39.649540+0000 mon.c (mon.2) 553 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:39.649843+0000 mon.a (mon.0) 2350 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:39.650354+0000 mon.c (mon.2) 554 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:39.650680+0000 mon.a (mon.0) 2351 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:40.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:40 smithi187 bash[23415]: audit 2024-03-11T22:17:40.378273+0000 mon.c (mon.2) 555 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:41.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:39.607280+0000 mon.a (mon.0) 2347 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:41.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: cluster 2024-03-11T22:17:39.614215+0000 mon.a (mon.0) 2348 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-03-11T22:17:41.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:39.647878+0000 mon.c (mon.2) 552 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:39.648232+0000 mon.a (mon.0) 2349 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:39.649540+0000 mon.c (mon.2) 553 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:39.649843+0000 mon.a (mon.0) 2350 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:39.650354+0000 mon.c (mon.2) 554 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:39.650680+0000 mon.a (mon.0) 2351 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[21434]: audit 2024-03-11T22:17:40.378273+0000 mon.c (mon.2) 555 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:39.607280+0000 mon.a (mon.0) 2347 : audit 1 from='client.? v1:172.21.15.49:0/7100503' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi049-64063-64"}]': finished 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: cluster 2024-03-11T22:17:39.614215+0000 mon.a (mon.0) 2348 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:39.647878+0000 mon.c (mon.2) 552 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:39.648232+0000 mon.a (mon.0) 2349 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:39.649540+0000 mon.c (mon.2) 553 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:39.649843+0000 mon.a (mon.0) 2350 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:39.650354+0000 mon.c (mon.2) 554 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:41.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:39.650680+0000 mon.a (mon.0) 2351 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:41.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:40 smithi049 bash[28804]: audit 2024-03-11T22:17:40.378273+0000 mon.c (mon.2) 555 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:42.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:42 smithi187 bash[23415]: cluster 2024-03-11T22:17:40.123719+0000 mgr.y (mgr.14601) 372 : cluster 0 pgmap v539: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:17:42.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:42 smithi187 bash[23415]: audit 2024-03-11T22:17:40.616992+0000 mon.a (mon.0) 2352 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:42.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:42 smithi187 bash[23415]: cluster 2024-03-11T22:17:40.628074+0000 mon.a (mon.0) 2353 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-03-11T22:17:42.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:42 smithi187 bash[23415]: audit 2024-03-11T22:17:40.630053+0000 mon.c (mon.2) 556 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:42.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:42 smithi187 bash[23415]: audit 2024-03-11T22:17:40.630844+0000 mon.a (mon.0) 2354 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:42.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[21434]: cluster 2024-03-11T22:17:40.123719+0000 mgr.y (mgr.14601) 372 : cluster 0 pgmap v539: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:17:42.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[21434]: audit 2024-03-11T22:17:40.616992+0000 mon.a (mon.0) 2352 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:42.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[21434]: cluster 2024-03-11T22:17:40.628074+0000 mon.a (mon.0) 2353 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-03-11T22:17:42.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[21434]: audit 2024-03-11T22:17:40.630053+0000 mon.c (mon.2) 556 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:42.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[21434]: audit 2024-03-11T22:17:40.630844+0000 mon.a (mon.0) 2354 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:42.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[28804]: cluster 2024-03-11T22:17:40.123719+0000 mgr.y (mgr.14601) 372 : cluster 0 pgmap v539: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:17:42.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[28804]: audit 2024-03-11T22:17:40.616992+0000 mon.a (mon.0) 2352 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi049-64063-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:42.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[28804]: cluster 2024-03-11T22:17:40.628074+0000 mon.a (mon.0) 2353 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-03-11T22:17:42.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[28804]: audit 2024-03-11T22:17:40.630053+0000 mon.c (mon.2) 556 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:42.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:42 smithi049 bash[28804]: audit 2024-03-11T22:17:40.630844+0000 mon.a (mon.0) 2354 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:43.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:43 smithi187 bash[23415]: cluster 2024-03-11T22:17:42.082968+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-03-11T22:17:43.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:43 smithi187 bash[23415]: cluster 2024-03-11T22:17:42.124744+0000 mgr.y (mgr.14601) 373 : cluster 0 pgmap v542: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:17:43.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:43 smithi187 bash[23415]: audit 2024-03-11T22:17:42.623457+0000 mon.a (mon.0) 2356 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:43.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:43 smithi187 bash[23415]: cluster 2024-03-11T22:17:42.630372+0000 mon.a (mon.0) 2357 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-03-11T22:17:43.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[28804]: cluster 2024-03-11T22:17:42.082968+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-03-11T22:17:43.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[28804]: cluster 2024-03-11T22:17:42.124744+0000 mgr.y (mgr.14601) 373 : cluster 0 pgmap v542: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:17:43.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[28804]: audit 2024-03-11T22:17:42.623457+0000 mon.a (mon.0) 2356 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:43.520 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[28804]: cluster 2024-03-11T22:17:42.630372+0000 mon.a (mon.0) 2357 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-03-11T22:17:43.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[21434]: cluster 2024-03-11T22:17:42.082968+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-03-11T22:17:43.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[21434]: cluster 2024-03-11T22:17:42.124744+0000 mgr.y (mgr.14601) 373 : cluster 0 pgmap v542: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:17:43.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[21434]: audit 2024-03-11T22:17:42.623457+0000 mon.a (mon.0) 2356 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi049-64063-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:43.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:43 smithi049 bash[21434]: cluster 2024-03-11T22:17:42.630372+0000 mon.a (mon.0) 2357 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-03-11T22:17:44.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:17:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:17:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:17:44.992 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:44 smithi187 bash[23415]: cluster 2024-03-11T22:17:43.634278+0000 mon.a (mon.0) 2358 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-03-11T22:17:45.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:44 smithi049 bash[21434]: cluster 2024-03-11T22:17:43.634278+0000 mon.a (mon.0) 2358 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-03-11T22:17:45.020 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:44 smithi049 bash[28804]: cluster 2024-03-11T22:17:43.634278+0000 mon.a (mon.0) 2358 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-03-11T22:17:45.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:45 smithi187 bash[23415]: cluster 2024-03-11T22:17:44.125724+0000 mgr.y (mgr.14601) 374 : cluster 0 pgmap v545: 300 pgs: 8 creating+peering, 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:45.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:45 smithi187 bash[23415]: cluster 2024-03-11T22:17:44.627543+0000 mon.a (mon.0) 2359 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:45.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:45 smithi187 bash[23415]: cluster 2024-03-11T22:17:44.636053+0000 mon.a (mon.0) 2360 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-03-11T22:17:45.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:45 smithi187 bash[23415]: audit 2024-03-11T22:17:44.641253+0000 mon.c (mon.2) 557 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:45.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:45 smithi187 bash[23415]: audit 2024-03-11T22:17:44.653103+0000 mon.a (mon.0) 2361 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:46.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[21434]: cluster 2024-03-11T22:17:44.125724+0000 mgr.y (mgr.14601) 374 : cluster 0 pgmap v545: 300 pgs: 8 creating+peering, 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:46.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[21434]: cluster 2024-03-11T22:17:44.627543+0000 mon.a (mon.0) 2359 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[21434]: cluster 2024-03-11T22:17:44.636053+0000 mon.a (mon.0) 2360 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[21434]: audit 2024-03-11T22:17:44.641253+0000 mon.c (mon.2) 557 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[21434]: audit 2024-03-11T22:17:44.653103+0000 mon.a (mon.0) 2361 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[28804]: cluster 2024-03-11T22:17:44.125724+0000 mgr.y (mgr.14601) 374 : cluster 0 pgmap v545: 300 pgs: 8 creating+peering, 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[28804]: cluster 2024-03-11T22:17:44.627543+0000 mon.a (mon.0) 2359 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[28804]: cluster 2024-03-11T22:17:44.636053+0000 mon.a (mon.0) 2360 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[28804]: audit 2024-03-11T22:17:44.641253+0000 mon.c (mon.2) 557 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:46.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:45 smithi049 bash[28804]: audit 2024-03-11T22:17:44.653103+0000 mon.a (mon.0) 2361 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:46.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:46 smithi187 bash[23415]: audit 2024-03-11T22:17:45.653767+0000 mon.a (mon.0) 2362 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:46.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:46 smithi187 bash[23415]: cluster 2024-03-11T22:17:45.660982+0000 mon.a (mon.0) 2363 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-03-11T22:17:46.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:46 smithi187 bash[23415]: audit 2024-03-11T22:17:45.661578+0000 mon.c (mon.2) 558 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:46.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:46 smithi187 bash[23415]: audit 2024-03-11T22:17:45.663715+0000 mon.a (mon.0) 2364 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[21434]: audit 2024-03-11T22:17:45.653767+0000 mon.a (mon.0) 2362 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[21434]: cluster 2024-03-11T22:17:45.660982+0000 mon.a (mon.0) 2363 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-03-11T22:17:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[21434]: audit 2024-03-11T22:17:45.661578+0000 mon.c (mon.2) 558 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[21434]: audit 2024-03-11T22:17:45.663715+0000 mon.a (mon.0) 2364 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:47.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[28804]: audit 2024-03-11T22:17:45.653767+0000 mon.a (mon.0) 2362 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:47.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[28804]: cluster 2024-03-11T22:17:45.660982+0000 mon.a (mon.0) 2363 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-03-11T22:17:47.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[28804]: audit 2024-03-11T22:17:45.661578+0000 mon.c (mon.2) 558 : audit 1 from='client.? v1:172.21.15.49:0/2512144199' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:47.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:46 smithi049 bash[28804]: audit 2024-03-11T22:17:45.663715+0000 mon.a (mon.0) 2364 : audit 1 from='client.47072 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]: dispatch 2024-03-11T22:17:47.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: cluster 2024-03-11T22:17:46.126652+0000 mgr.y (mgr.14601) 375 : cluster 0 pgmap v548: 292 pgs: 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:47.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:46.663764+0000 mon.a (mon.0) 2365 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:47.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: cluster 2024-03-11T22:17:46.673331+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-03-11T22:17:47.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:46.716734+0000 mon.c (mon.2) 559 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:47.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:46.717121+0000 mon.a (mon.0) 2367 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:47.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:46.718392+0000 mon.c (mon.2) 560 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:47.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:46.718768+0000 mon.a (mon.0) 2368 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:47.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:46.719346+0000 mon.c (mon.2) 561 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:47.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:46.719705+0000 mon.a (mon.0) 2369 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:47.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:47.226316+0000 mon.b (mon.1) 273 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:47.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:47 smithi187 bash[23415]: audit 2024-03-11T22:17:47.232857+0000 mon.a (mon.0) 2370 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:48.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: cluster 2024-03-11T22:17:46.126652+0000 mgr.y (mgr.14601) 375 : cluster 0 pgmap v548: 292 pgs: 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:46.663764+0000 mon.a (mon.0) 2365 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: cluster 2024-03-11T22:17:46.673331+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:46.716734+0000 mon.c (mon.2) 559 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:46.717121+0000 mon.a (mon.0) 2367 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:46.718392+0000 mon.c (mon.2) 560 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:46.718768+0000 mon.a (mon.0) 2368 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:46.719346+0000 mon.c (mon.2) 561 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:46.719705+0000 mon.a (mon.0) 2369 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:47.226316+0000 mon.b (mon.1) 273 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[21434]: audit 2024-03-11T22:17:47.232857+0000 mon.a (mon.0) 2370 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: cluster 2024-03-11T22:17:46.126652+0000 mgr.y (mgr.14601) 375 : cluster 0 pgmap v548: 292 pgs: 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:48.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:46.663764+0000 mon.a (mon.0) 2365 : audit 1 from='client.47072 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi049-64063-65"}]': finished 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: cluster 2024-03-11T22:17:46.673331+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:46.716734+0000 mon.c (mon.2) 559 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:46.717121+0000 mon.a (mon.0) 2367 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:46.718392+0000 mon.c (mon.2) 560 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:46.718768+0000 mon.a (mon.0) 2368 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:46.719346+0000 mon.c (mon.2) 561 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:46.719705+0000 mon.a (mon.0) 2369 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:47.226316+0000 mon.b (mon.1) 273 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:47 smithi049 bash[28804]: audit 2024-03-11T22:17:47.232857+0000 mon.a (mon.0) 2370 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:49.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:17:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:17:49.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:49 smithi187 bash[23415]: audit 2024-03-11T22:17:47.666368+0000 mon.a (mon.0) 2371 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:49.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:49 smithi187 bash[23415]: audit 2024-03-11T22:17:47.666602+0000 mon.a (mon.0) 2372 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:17:49.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:49 smithi187 bash[23415]: audit 2024-03-11T22:17:47.670943+0000 mon.b (mon.1) 274 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:49.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:49 smithi187 bash[23415]: cluster 2024-03-11T22:17:47.673248+0000 mon.a (mon.0) 2373 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-03-11T22:17:49.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:49 smithi187 bash[23415]: audit 2024-03-11T22:17:47.677500+0000 mon.c (mon.2) 562 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:49.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:49 smithi187 bash[23415]: audit 2024-03-11T22:17:47.688187+0000 mon.a (mon.0) 2374 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:49.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:49 smithi187 bash[23415]: audit 2024-03-11T22:17:47.689375+0000 mon.a (mon.0) 2375 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:49.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[21434]: audit 2024-03-11T22:17:47.666368+0000 mon.a (mon.0) 2371 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:49.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[21434]: audit 2024-03-11T22:17:47.666602+0000 mon.a (mon.0) 2372 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:17:49.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[21434]: audit 2024-03-11T22:17:47.670943+0000 mon.b (mon.1) 274 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[21434]: cluster 2024-03-11T22:17:47.673248+0000 mon.a (mon.0) 2373 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[21434]: audit 2024-03-11T22:17:47.677500+0000 mon.c (mon.2) 562 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[21434]: audit 2024-03-11T22:17:47.688187+0000 mon.a (mon.0) 2374 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[21434]: audit 2024-03-11T22:17:47.689375+0000 mon.a (mon.0) 2375 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[28804]: audit 2024-03-11T22:17:47.666368+0000 mon.a (mon.0) 2371 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi049-64063-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[28804]: audit 2024-03-11T22:17:47.666602+0000 mon.a (mon.0) 2372 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[28804]: audit 2024-03-11T22:17:47.670943+0000 mon.b (mon.1) 274 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[28804]: cluster 2024-03-11T22:17:47.673248+0000 mon.a (mon.0) 2373 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[28804]: audit 2024-03-11T22:17:47.677500+0000 mon.c (mon.2) 562 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[28804]: audit 2024-03-11T22:17:47.688187+0000 mon.a (mon.0) 2374 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:49.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:49 smithi049 bash[28804]: audit 2024-03-11T22:17:47.689375+0000 mon.a (mon.0) 2375 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2:163:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:5d165639:::164:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f43765fc:::165:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b4c720e9:::166:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:e694b040:::167:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:afa38db2:::168:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:77ba9f53:::169:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:87495034:::170:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:7c96bf0e:::171:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:dbe346cc:::172:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:e943ec24:::173:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f97a9c0c:::174:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:6f26e74d:::175:head 2024-03-11T22:17:49.688 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:4f95e106:::176:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:0e6f2f8f:::177:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:05db05f1:::178:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:38a78d66:::179:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:d095610b:::180:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:a1a9d709:::181:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:1e5d39db:::182:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:f7df4fb9:::183:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:03a7f161:::184:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:ba70721e:::185:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:28e5662d:::186:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:973d52de:::187:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:4303eb1c:::188:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:b990b48e:::189:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:29b8165b:::190:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:3547f197:::191:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:7e260936:::192:head 2024-03-11T22:17:49.689 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:1abec7b1:::193:head 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:10fdda93:::194:head 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:15817eea:::195:head 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:770bab57:::196:head 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:ed9e13e7:::197:head 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:71471a8f:::198:head 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: checking for 269:10fb1d02:::199:head 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (9521 ms) 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,0 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: first is 1710195424 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,0 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,0 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,0 2024-03-11T22:17:49.690 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,1710195429,1710195430,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,1710195429,1710195430,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,1710195429,1710195430,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,1710195429,1710195430,1710195432,1710195433,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,1710195429,1710195430,1710195432,1710195433,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195424,1710195426,1710195427,1710195429,1710195430,1710195432,1710195433,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195427,1710195429,1710195430,1710195432,1710195433,1710195435,1710195436,0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: first now 1710195427, trimmed 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (20683 ms) 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: foo0 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14083 ms) 2024-03-11T22:17:49.691 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-03-11T22:17:50.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: cluster 2024-03-11T22:17:48.127587+0000 mgr.y (mgr.14601) 376 : cluster 0 pgmap v551: 292 pgs: 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:50.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: cluster 2024-03-11T22:17:48.681796+0000 mon.a (mon.0) 2376 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:50.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: audit 2024-03-11T22:17:48.684244+0000 mon.a (mon.0) 2377 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]': finished 2024-03-11T22:17:50.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: audit 2024-03-11T22:17:48.811846+0000 mgr.y (mgr.14601) 377 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:50.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: cluster 2024-03-11T22:17:49.144758+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-03-11T22:17:50.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: audit 2024-03-11T22:17:49.200236+0000 mon.b (mon.1) 275 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:50.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: audit 2024-03-11T22:17:49.201957+0000 mon.b (mon.1) 276 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:50.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: audit 2024-03-11T22:17:49.206602+0000 mon.a (mon.0) 2379 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:50.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: audit 2024-03-11T22:17:49.208209+0000 mon.a (mon.0) 2380 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:50.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: audit 2024-03-11T22:17:49.687334+0000 mon.a (mon.0) 2381 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:50.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:50 smithi187 bash[23415]: cluster 2024-03-11T22:17:49.694409+0000 mon.a (mon.0) 2382 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-03-11T22:17:50.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: cluster 2024-03-11T22:17:48.127587+0000 mgr.y (mgr.14601) 376 : cluster 0 pgmap v551: 292 pgs: 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: cluster 2024-03-11T22:17:48.681796+0000 mon.a (mon.0) 2376 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: audit 2024-03-11T22:17:48.684244+0000 mon.a (mon.0) 2377 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]': finished 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: audit 2024-03-11T22:17:48.811846+0000 mgr.y (mgr.14601) 377 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: cluster 2024-03-11T22:17:49.144758+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: audit 2024-03-11T22:17:49.200236+0000 mon.b (mon.1) 275 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: audit 2024-03-11T22:17:49.201957+0000 mon.b (mon.1) 276 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: audit 2024-03-11T22:17:49.206602+0000 mon.a (mon.0) 2379 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: audit 2024-03-11T22:17:49.208209+0000 mon.a (mon.0) 2380 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: audit 2024-03-11T22:17:49.687334+0000 mon.a (mon.0) 2381 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[21434]: cluster 2024-03-11T22:17:49.694409+0000 mon.a (mon.0) 2382 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-03-11T22:17:50.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: cluster 2024-03-11T22:17:48.127587+0000 mgr.y (mgr.14601) 376 : cluster 0 pgmap v551: 292 pgs: 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: cluster 2024-03-11T22:17:48.681796+0000 mon.a (mon.0) 2376 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: audit 2024-03-11T22:17:48.684244+0000 mon.a (mon.0) 2377 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]': finished 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: audit 2024-03-11T22:17:48.811846+0000 mgr.y (mgr.14601) 377 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: cluster 2024-03-11T22:17:49.144758+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: audit 2024-03-11T22:17:49.200236+0000 mon.b (mon.1) 275 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: audit 2024-03-11T22:17:49.201957+0000 mon.b (mon.1) 276 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: audit 2024-03-11T22:17:49.206602+0000 mon.a (mon.0) 2379 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: audit 2024-03-11T22:17:49.208209+0000 mon.a (mon.0) 2380 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-49"}]: dispatch 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: audit 2024-03-11T22:17:49.687334+0000 mon.a (mon.0) 2381 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi049-64063-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:50 smithi049 bash[28804]: cluster 2024-03-11T22:17:49.694409+0000 mon.a (mon.0) 2382 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-03-11T22:17:51.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:51 smithi187 bash[23415]: cluster 2024-03-11T22:17:50.128466+0000 mgr.y (mgr.14601) 378 : cluster 0 pgmap v554: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:51.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:51 smithi187 bash[23415]: cluster 2024-03-11T22:17:50.188110+0000 mon.a (mon.0) 2383 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:51.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:51 smithi187 bash[23415]: audit 2024-03-11T22:17:50.704095+0000 mon.b (mon.1) 277 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:51.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:51 smithi187 bash[23415]: cluster 2024-03-11T22:17:50.704876+0000 mon.a (mon.0) 2384 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-03-11T22:17:51.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:51 smithi187 bash[23415]: audit 2024-03-11T22:17:50.711573+0000 mon.a (mon.0) 2385 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:51.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[21434]: cluster 2024-03-11T22:17:50.128466+0000 mgr.y (mgr.14601) 378 : cluster 0 pgmap v554: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:51.520 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[21434]: cluster 2024-03-11T22:17:50.188110+0000 mon.a (mon.0) 2383 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[21434]: audit 2024-03-11T22:17:50.704095+0000 mon.b (mon.1) 277 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[21434]: cluster 2024-03-11T22:17:50.704876+0000 mon.a (mon.0) 2384 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[21434]: audit 2024-03-11T22:17:50.711573+0000 mon.a (mon.0) 2385 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[28804]: cluster 2024-03-11T22:17:50.128466+0000 mgr.y (mgr.14601) 378 : cluster 0 pgmap v554: 268 pgs: 8 unknown, 260 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[28804]: cluster 2024-03-11T22:17:50.188110+0000 mon.a (mon.0) 2383 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[28804]: audit 2024-03-11T22:17:50.704095+0000 mon.b (mon.1) 277 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[28804]: cluster 2024-03-11T22:17:50.704876+0000 mon.a (mon.0) 2384 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-03-11T22:17:51.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:51 smithi049 bash[28804]: audit 2024-03-11T22:17:50.711573+0000 mon.a (mon.0) 2385 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:17:52.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:52 smithi187 bash[23415]: audit 2024-03-11T22:17:51.700100+0000 mon.a (mon.0) 2386 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:52.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:52 smithi187 bash[23415]: cluster 2024-03-11T22:17:51.708389+0000 mon.a (mon.0) 2387 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-03-11T22:17:52.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:52 smithi187 bash[23415]: audit 2024-03-11T22:17:51.714111+0000 mon.c (mon.2) 563 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:52.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:52 smithi187 bash[23415]: audit 2024-03-11T22:17:51.715600+0000 mon.a (mon.0) 2388 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:52.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:52 smithi187 bash[23415]: audit 2024-03-11T22:17:51.765599+0000 mon.b (mon.1) 278 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:52.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:52 smithi187 bash[23415]: audit 2024-03-11T22:17:51.771932+0000 mon.a (mon.0) 2389 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:53.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[21434]: audit 2024-03-11T22:17:51.700100+0000 mon.a (mon.0) 2386 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:53.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[21434]: cluster 2024-03-11T22:17:51.708389+0000 mon.a (mon.0) 2387 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-03-11T22:17:53.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[21434]: audit 2024-03-11T22:17:51.714111+0000 mon.c (mon.2) 563 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[21434]: audit 2024-03-11T22:17:51.715600+0000 mon.a (mon.0) 2388 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[21434]: audit 2024-03-11T22:17:51.765599+0000 mon.b (mon.1) 278 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[21434]: audit 2024-03-11T22:17:51.771932+0000 mon.a (mon.0) 2389 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[28804]: audit 2024-03-11T22:17:51.700100+0000 mon.a (mon.0) 2386 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[28804]: cluster 2024-03-11T22:17:51.708389+0000 mon.a (mon.0) 2387 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[28804]: audit 2024-03-11T22:17:51.714111+0000 mon.c (mon.2) 563 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[28804]: audit 2024-03-11T22:17:51.715600+0000 mon.a (mon.0) 2388 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[28804]: audit 2024-03-11T22:17:51.765599+0000 mon.b (mon.1) 278 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:53.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:52 smithi049 bash[28804]: audit 2024-03-11T22:17:51.771932+0000 mon.a (mon.0) 2389 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:17:53.727 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3030 ms) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7022 ms) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7046 ms) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7033 ms) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7026 ms) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7059 ms) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7051 ms) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139557 ms total) 2024-03-11T22:17:53.728 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: 2024-03-11T22:17:53.729 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-03-11T22:17:53.729 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (321550 ms total) 2024-03-11T22:17:53.729 INFO:tasks.workunit.client.0.smithi049.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-03-11T22:17:53.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: cluster 2024-03-11T22:17:52.129394+0000 mgr.y (mgr.14601) 379 : cluster 0 pgmap v557: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:53.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: audit 2024-03-11T22:17:52.709381+0000 mon.a (mon.0) 2390 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:53.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: audit 2024-03-11T22:17:52.709578+0000 mon.a (mon.0) 2391 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:53.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: audit 2024-03-11T22:17:52.713905+0000 mon.b (mon.1) 279 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:17:53.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: cluster 2024-03-11T22:17:52.718289+0000 mon.a (mon.0) 2392 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-03-11T22:17:53.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: audit 2024-03-11T22:17:52.720766+0000 mon.a (mon.0) 2393 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:17:53.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: audit 2024-03-11T22:17:52.722080+0000 mon.c (mon.2) 564 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:53.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:53 smithi187 bash[23415]: audit 2024-03-11T22:17:52.722730+0000 mon.a (mon.0) 2394 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:54.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: cluster 2024-03-11T22:17:52.129394+0000 mgr.y (mgr.14601) 379 : cluster 0 pgmap v557: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: audit 2024-03-11T22:17:52.709381+0000 mon.a (mon.0) 2390 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: audit 2024-03-11T22:17:52.709578+0000 mon.a (mon.0) 2391 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: audit 2024-03-11T22:17:52.713905+0000 mon.b (mon.1) 279 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: cluster 2024-03-11T22:17:52.718289+0000 mon.a (mon.0) 2392 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: audit 2024-03-11T22:17:52.720766+0000 mon.a (mon.0) 2393 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: audit 2024-03-11T22:17:52.722080+0000 mon.c (mon.2) 564 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[21434]: audit 2024-03-11T22:17:52.722730+0000 mon.a (mon.0) 2394 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: cluster 2024-03-11T22:17:52.129394+0000 mgr.y (mgr.14601) 379 : cluster 0 pgmap v557: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: audit 2024-03-11T22:17:52.709381+0000 mon.a (mon.0) 2390 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:54.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: audit 2024-03-11T22:17:52.709578+0000 mon.a (mon.0) 2391 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:17:54.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: audit 2024-03-11T22:17:52.713905+0000 mon.b (mon.1) 279 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:17:54.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: cluster 2024-03-11T22:17:52.718289+0000 mon.a (mon.0) 2392 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-03-11T22:17:54.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: audit 2024-03-11T22:17:52.720766+0000 mon.a (mon.0) 2393 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:17:54.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: audit 2024-03-11T22:17:52.722080+0000 mon.c (mon.2) 564 : audit 1 from='client.? v1:172.21.15.49:0/674210884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:54.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:53 smithi049 bash[28804]: audit 2024-03-11T22:17:52.722730+0000 mon.a (mon.0) 2394 : audit 1 from='client.47078 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]: dispatch 2024-03-11T22:17:54.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:17:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:17:54.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: audit 2024-03-11T22:17:53.712739+0000 mon.a (mon.0) 2395 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]': finished 2024-03-11T22:17:54.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: audit 2024-03-11T22:17:53.712907+0000 mon.a (mon.0) 2396 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:54.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: audit 2024-03-11T22:17:53.715230+0000 mon.b (mon.1) 280 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]: dispatch 2024-03-11T22:17:54.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: cluster 2024-03-11T22:17:53.720093+0000 mon.a (mon.0) 2397 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-03-11T22:17:54.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: audit 2024-03-11T22:17:53.723127+0000 mon.a (mon.0) 2398 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]: dispatch 2024-03-11T22:17:54.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: cluster 2024-03-11T22:17:54.713208+0000 mon.a (mon.0) 2399 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:54.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: audit 2024-03-11T22:17:54.715757+0000 mon.a (mon.0) 2400 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]': finished 2024-03-11T22:17:54.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:54 smithi187 bash[23415]: cluster 2024-03-11T22:17:54.722761+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: audit 2024-03-11T22:17:53.712739+0000 mon.a (mon.0) 2395 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]': finished 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: audit 2024-03-11T22:17:53.712907+0000 mon.a (mon.0) 2396 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: audit 2024-03-11T22:17:53.715230+0000 mon.b (mon.1) 280 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]: dispatch 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: cluster 2024-03-11T22:17:53.720093+0000 mon.a (mon.0) 2397 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: audit 2024-03-11T22:17:53.723127+0000 mon.a (mon.0) 2398 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]: dispatch 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: cluster 2024-03-11T22:17:54.713208+0000 mon.a (mon.0) 2399 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: audit 2024-03-11T22:17:54.715757+0000 mon.a (mon.0) 2400 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]': finished 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[21434]: cluster 2024-03-11T22:17:54.722761+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: audit 2024-03-11T22:17:53.712739+0000 mon.a (mon.0) 2395 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-51"}]': finished 2024-03-11T22:17:55.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: audit 2024-03-11T22:17:53.712907+0000 mon.a (mon.0) 2396 : audit 1 from='client.47078 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi049-64063-66"}]': finished 2024-03-11T22:17:55.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: audit 2024-03-11T22:17:53.715230+0000 mon.b (mon.1) 280 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]: dispatch 2024-03-11T22:17:55.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: cluster 2024-03-11T22:17:53.720093+0000 mon.a (mon.0) 2397 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-03-11T22:17:55.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: audit 2024-03-11T22:17:53.723127+0000 mon.a (mon.0) 2398 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]: dispatch 2024-03-11T22:17:55.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: cluster 2024-03-11T22:17:54.713208+0000 mon.a (mon.0) 2399 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:17:55.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: audit 2024-03-11T22:17:54.715757+0000 mon.a (mon.0) 2400 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-51", "mode": "writeback"}]': finished 2024-03-11T22:17:55.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:54 smithi049 bash[28804]: cluster 2024-03-11T22:17:54.722761+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-03-11T22:17:55.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:55 smithi187 bash[23415]: cluster 2024-03-11T22:17:54.130258+0000 mgr.y (mgr.14601) 380 : cluster 0 pgmap v560: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:17:55.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:55 smithi187 bash[23415]: audit 2024-03-11T22:17:54.818428+0000 mon.b (mon.1) 281 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:55.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:55 smithi187 bash[23415]: audit 2024-03-11T22:17:54.824926+0000 mon.a (mon.0) 2402 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:55.993 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:55 smithi187 bash[23415]: audit 2024-03-11T22:17:55.413795+0000 mon.c (mon.2) 565 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:56.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[21434]: cluster 2024-03-11T22:17:54.130258+0000 mgr.y (mgr.14601) 380 : cluster 0 pgmap v560: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:17:56.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[21434]: audit 2024-03-11T22:17:54.818428+0000 mon.b (mon.1) 281 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:56.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[21434]: audit 2024-03-11T22:17:54.824926+0000 mon.a (mon.0) 2402 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:56.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[21434]: audit 2024-03-11T22:17:55.413795+0000 mon.c (mon.2) 565 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[28804]: cluster 2024-03-11T22:17:54.130258+0000 mgr.y (mgr.14601) 380 : cluster 0 pgmap v560: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:17:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[28804]: audit 2024-03-11T22:17:54.818428+0000 mon.b (mon.1) 281 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[28804]: audit 2024-03-11T22:17:54.824926+0000 mon.a (mon.0) 2402 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:17:56.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:55 smithi049 bash[28804]: audit 2024-03-11T22:17:55.413795+0000 mon.c (mon.2) 565 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:17:57.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[21434]: audit 2024-03-11T22:17:55.753079+0000 mon.a (mon.0) 2403 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:17:57.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[21434]: audit 2024-03-11T22:17:55.758970+0000 mon.b (mon.1) 282 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:57.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[21434]: cluster 2024-03-11T22:17:55.759618+0000 mon.a (mon.0) 2404 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-03-11T22:17:57.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[21434]: audit 2024-03-11T22:17:55.765852+0000 mon.a (mon.0) 2405 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:57.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[28804]: audit 2024-03-11T22:17:55.753079+0000 mon.a (mon.0) 2403 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:17:57.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[28804]: audit 2024-03-11T22:17:55.758970+0000 mon.b (mon.1) 282 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:57.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[28804]: cluster 2024-03-11T22:17:55.759618+0000 mon.a (mon.0) 2404 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-03-11T22:17:57.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:56 smithi049 bash[28804]: audit 2024-03-11T22:17:55.765852+0000 mon.a (mon.0) 2405 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:57.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:56 smithi187 bash[23415]: audit 2024-03-11T22:17:55.753079+0000 mon.a (mon.0) 2403 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:17:57.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:56 smithi187 bash[23415]: audit 2024-03-11T22:17:55.758970+0000 mon.b (mon.1) 282 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:57.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:56 smithi187 bash[23415]: cluster 2024-03-11T22:17:55.759618+0000 mon.a (mon.0) 2404 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-03-11T22:17:57.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:56 smithi187 bash[23415]: audit 2024-03-11T22:17:55.765852+0000 mon.a (mon.0) 2405 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[28804]: cluster 2024-03-11T22:17:56.131292+0000 mgr.y (mgr.14601) 381 : cluster 0 pgmap v563: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[28804]: audit 2024-03-11T22:17:56.755742+0000 mon.a (mon.0) 2406 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[28804]: audit 2024-03-11T22:17:56.760133+0000 mon.b (mon.1) 283 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[28804]: cluster 2024-03-11T22:17:56.762805+0000 mon.a (mon.0) 2407 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[28804]: audit 2024-03-11T22:17:56.775784+0000 mon.a (mon.0) 2408 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[21434]: cluster 2024-03-11T22:17:56.131292+0000 mgr.y (mgr.14601) 381 : cluster 0 pgmap v563: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[21434]: audit 2024-03-11T22:17:56.755742+0000 mon.a (mon.0) 2406 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[21434]: audit 2024-03-11T22:17:56.760133+0000 mon.b (mon.1) 283 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[21434]: cluster 2024-03-11T22:17:56.762805+0000 mon.a (mon.0) 2407 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-03-11T22:17:58.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:57 smithi049 bash[21434]: audit 2024-03-11T22:17:56.775784+0000 mon.a (mon.0) 2408 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:58.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:57 smithi187 bash[23415]: cluster 2024-03-11T22:17:56.131292+0000 mgr.y (mgr.14601) 381 : cluster 0 pgmap v563: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:17:58.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:57 smithi187 bash[23415]: audit 2024-03-11T22:17:56.755742+0000 mon.a (mon.0) 2406 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:17:58.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:57 smithi187 bash[23415]: audit 2024-03-11T22:17:56.760133+0000 mon.b (mon.1) 283 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:58.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:57 smithi187 bash[23415]: cluster 2024-03-11T22:17:56.762805+0000 mon.a (mon.0) 2407 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-03-11T22:17:58.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:57 smithi187 bash[23415]: audit 2024-03-11T22:17:56.775784+0000 mon.a (mon.0) 2408 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:17:59.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[21434]: cluster 2024-03-11T22:17:57.767772+0000 mon.a (mon.0) 2409 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[21434]: audit 2024-03-11T22:17:57.777985+0000 mon.a (mon.0) 2410 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[21434]: audit 2024-03-11T22:17:57.780604+0000 mon.b (mon.1) 284 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[21434]: cluster 2024-03-11T22:17:57.784868+0000 mon.a (mon.0) 2411 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[21434]: audit 2024-03-11T22:17:57.788075+0000 mon.a (mon.0) 2412 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[28804]: cluster 2024-03-11T22:17:57.767772+0000 mon.a (mon.0) 2409 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[28804]: audit 2024-03-11T22:17:57.777985+0000 mon.a (mon.0) 2410 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[28804]: audit 2024-03-11T22:17:57.780604+0000 mon.b (mon.1) 284 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[28804]: cluster 2024-03-11T22:17:57.784868+0000 mon.a (mon.0) 2411 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-03-11T22:17:59.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:58 smithi049 bash[28804]: audit 2024-03-11T22:17:57.788075+0000 mon.a (mon.0) 2412 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:59.243 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:17:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:17:59.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:58 smithi187 bash[23415]: cluster 2024-03-11T22:17:57.767772+0000 mon.a (mon.0) 2409 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:17:59.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:58 smithi187 bash[23415]: audit 2024-03-11T22:17:57.777985+0000 mon.a (mon.0) 2410 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:17:59.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:58 smithi187 bash[23415]: audit 2024-03-11T22:17:57.780604+0000 mon.b (mon.1) 284 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:17:59.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:58 smithi187 bash[23415]: cluster 2024-03-11T22:17:57.784868+0000 mon.a (mon.0) 2411 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-03-11T22:17:59.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:58 smithi187 bash[23415]: audit 2024-03-11T22:17:57.788075+0000 mon.a (mon.0) 2412 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:18:00.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:59 smithi187 bash[23415]: cluster 2024-03-11T22:17:58.132234+0000 mgr.y (mgr.14601) 382 : cluster 0 pgmap v566: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:00.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:59 smithi187 bash[23415]: audit 2024-03-11T22:17:58.786146+0000 mon.a (mon.0) 2413 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:18:00.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:59 smithi187 bash[23415]: audit 2024-03-11T22:17:58.790452+0000 mon.b (mon.1) 285 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:18:00.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:59 smithi187 bash[23415]: cluster 2024-03-11T22:17:58.793993+0000 mon.a (mon.0) 2414 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-03-11T22:18:00.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:59 smithi187 bash[23415]: audit 2024-03-11T22:17:58.797460+0000 mon.a (mon.0) 2415 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:18:00.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:17:59 smithi187 bash[23415]: audit 2024-03-11T22:17:58.819913+0000 mgr.y (mgr.14601) 383 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[21434]: cluster 2024-03-11T22:17:58.132234+0000 mgr.y (mgr.14601) 382 : cluster 0 pgmap v566: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[21434]: audit 2024-03-11T22:17:58.786146+0000 mon.a (mon.0) 2413 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[21434]: audit 2024-03-11T22:17:58.790452+0000 mon.b (mon.1) 285 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[21434]: cluster 2024-03-11T22:17:58.793993+0000 mon.a (mon.0) 2414 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[21434]: audit 2024-03-11T22:17:58.797460+0000 mon.a (mon.0) 2415 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[21434]: audit 2024-03-11T22:17:58.819913+0000 mgr.y (mgr.14601) 383 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[28804]: cluster 2024-03-11T22:17:58.132234+0000 mgr.y (mgr.14601) 382 : cluster 0 pgmap v566: 292 pgs: 292 active+clean; 8.4 MiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[28804]: audit 2024-03-11T22:17:58.786146+0000 mon.a (mon.0) 2413 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[28804]: audit 2024-03-11T22:17:58.790452+0000 mon.b (mon.1) 285 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[28804]: cluster 2024-03-11T22:17:58.793993+0000 mon.a (mon.0) 2414 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-03-11T22:18:00.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[28804]: audit 2024-03-11T22:17:58.797460+0000 mon.a (mon.0) 2415 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:18:00.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:17:59 smithi049 bash[28804]: audit 2024-03-11T22:17:58.819913+0000 mgr.y (mgr.14601) 383 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:01.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:00 smithi187 bash[23415]: audit 2024-03-11T22:17:59.788953+0000 mon.a (mon.0) 2416 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]': finished 2024-03-11T22:18:01.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:00 smithi187 bash[23415]: cluster 2024-03-11T22:17:59.796717+0000 mon.a (mon.0) 2417 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-03-11T22:18:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:00 smithi049 bash[21434]: audit 2024-03-11T22:17:59.788953+0000 mon.a (mon.0) 2416 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]': finished 2024-03-11T22:18:01.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:00 smithi049 bash[21434]: cluster 2024-03-11T22:17:59.796717+0000 mon.a (mon.0) 2417 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-03-11T22:18:01.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:00 smithi049 bash[28804]: audit 2024-03-11T22:17:59.788953+0000 mon.a (mon.0) 2416 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-51","var": "target_max_objects","val": "1"}]': finished 2024-03-11T22:18:01.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:00 smithi049 bash[28804]: cluster 2024-03-11T22:17:59.796717+0000 mon.a (mon.0) 2417 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-03-11T22:18:02.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:01 smithi187 bash[23415]: cluster 2024-03-11T22:18:00.133285+0000 mgr.y (mgr.14601) 384 : cluster 0 pgmap v569: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:18:02.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:01 smithi187 bash[23415]: cluster 2024-03-11T22:18:00.803731+0000 mon.a (mon.0) 2418 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-11T22:18:02.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:01 smithi049 bash[21434]: cluster 2024-03-11T22:18:00.133285+0000 mgr.y (mgr.14601) 384 : cluster 0 pgmap v569: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:18:02.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:01 smithi049 bash[21434]: cluster 2024-03-11T22:18:00.803731+0000 mon.a (mon.0) 2418 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-11T22:18:02.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:01 smithi049 bash[28804]: cluster 2024-03-11T22:18:00.133285+0000 mgr.y (mgr.14601) 384 : cluster 0 pgmap v569: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:18:02.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:01 smithi049 bash[28804]: cluster 2024-03-11T22:18:00.803731+0000 mon.a (mon.0) 2418 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-11T22:18:04.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:03 smithi049 bash[21434]: cluster 2024-03-11T22:18:02.134213+0000 mgr.y (mgr.14601) 385 : cluster 0 pgmap v570: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:18:04.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:03 smithi049 bash[28804]: cluster 2024-03-11T22:18:02.134213+0000 mgr.y (mgr.14601) 385 : cluster 0 pgmap v570: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:18:04.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:03 smithi187 bash[23415]: cluster 2024-03-11T22:18:02.134213+0000 mgr.y (mgr.14601) 385 : cluster 0 pgmap v570: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:18:04.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:18:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:18:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:18:06.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:05 smithi187 bash[23415]: cluster 2024-03-11T22:18:04.136917+0000 mgr.y (mgr.14601) 386 : cluster 0 pgmap v571: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:18:06.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:05 smithi049 bash[21434]: cluster 2024-03-11T22:18:04.136917+0000 mgr.y (mgr.14601) 386 : cluster 0 pgmap v571: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:18:06.270 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:05 smithi049 bash[28804]: cluster 2024-03-11T22:18:04.136917+0000 mgr.y (mgr.14601) 386 : cluster 0 pgmap v571: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:18:07.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:06 smithi187 bash[23415]: audit 2024-03-11T22:18:06.614634+0000 mon.c (mon.2) 566 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:18:07.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:06 smithi049 bash[21434]: audit 2024-03-11T22:18:06.614634+0000 mon.c (mon.2) 566 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:18:07.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:06 smithi049 bash[28804]: audit 2024-03-11T22:18:06.614634+0000 mon.c (mon.2) 566 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:18:08.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:07 smithi187 bash[23415]: cluster 2024-03-11T22:18:06.137848+0000 mgr.y (mgr.14601) 387 : cluster 0 pgmap v572: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:18:08.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:07 smithi187 bash[23415]: audit 2024-03-11T22:18:07.346096+0000 mon.c (mon.2) 567 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:18:08.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:07 smithi187 bash[23415]: audit 2024-03-11T22:18:07.347780+0000 mon.c (mon.2) 568 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:18:08.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:07 smithi187 bash[23415]: audit 2024-03-11T22:18:07.360396+0000 mon.a (mon.0) 2419 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:08.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[21434]: cluster 2024-03-11T22:18:06.137848+0000 mgr.y (mgr.14601) 387 : cluster 0 pgmap v572: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:18:08.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[21434]: audit 2024-03-11T22:18:07.346096+0000 mon.c (mon.2) 567 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:18:08.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[21434]: audit 2024-03-11T22:18:07.347780+0000 mon.c (mon.2) 568 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:18:08.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[21434]: audit 2024-03-11T22:18:07.360396+0000 mon.a (mon.0) 2419 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:08.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[28804]: cluster 2024-03-11T22:18:06.137848+0000 mgr.y (mgr.14601) 387 : cluster 0 pgmap v572: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:18:08.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[28804]: audit 2024-03-11T22:18:07.346096+0000 mon.c (mon.2) 567 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:18:08.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[28804]: audit 2024-03-11T22:18:07.347780+0000 mon.c (mon.2) 568 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:18:08.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:07 smithi049 bash[28804]: audit 2024-03-11T22:18:07.360396+0000 mon.a (mon.0) 2419 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:09.243 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:18:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:18:10.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:09 smithi187 bash[23415]: cluster 2024-03-11T22:18:08.138736+0000 mgr.y (mgr.14601) 388 : cluster 0 pgmap v573: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 547 B/s rd, 0 B/s wr, 0 op/s 2024-03-11T22:18:10.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:09 smithi187 bash[23415]: audit 2024-03-11T22:18:08.827973+0000 mgr.y (mgr.14601) 389 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:10.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:09 smithi187 bash[23415]: audit 2024-03-11T22:18:09.823974+0000 mon.b (mon.1) 286 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:10.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:09 smithi187 bash[23415]: audit 2024-03-11T22:18:09.830530+0000 mon.a (mon.0) 2420 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[28804]: cluster 2024-03-11T22:18:08.138736+0000 mgr.y (mgr.14601) 388 : cluster 0 pgmap v573: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 547 B/s rd, 0 B/s wr, 0 op/s 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[28804]: audit 2024-03-11T22:18:08.827973+0000 mgr.y (mgr.14601) 389 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[28804]: audit 2024-03-11T22:18:09.823974+0000 mon.b (mon.1) 286 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[28804]: audit 2024-03-11T22:18:09.830530+0000 mon.a (mon.0) 2420 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[21434]: cluster 2024-03-11T22:18:08.138736+0000 mgr.y (mgr.14601) 388 : cluster 0 pgmap v573: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 547 B/s rd, 0 B/s wr, 0 op/s 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[21434]: audit 2024-03-11T22:18:08.827973+0000 mgr.y (mgr.14601) 389 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[21434]: audit 2024-03-11T22:18:09.823974+0000 mon.b (mon.1) 286 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:10.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:09 smithi049 bash[21434]: audit 2024-03-11T22:18:09.830530+0000 mon.a (mon.0) 2420 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:11.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: audit 2024-03-11T22:18:09.837983+0000 mon.a (mon.0) 2421 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:18:11.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: audit 2024-03-11T22:18:09.841234+0000 mon.b (mon.1) 287 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:11.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: cluster 2024-03-11T22:18:09.846028+0000 mon.a (mon.0) 2422 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-03-11T22:18:11.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: audit 2024-03-11T22:18:09.848864+0000 mon.a (mon.0) 2423 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:11.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: audit 2024-03-11T22:18:10.456112+0000 mon.a (mon.0) 2424 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:11.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: audit 2024-03-11T22:18:10.459013+0000 mon.c (mon.2) 569 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:11.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: audit 2024-03-11T22:18:10.840676+0000 mon.a (mon.0) 2425 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]': finished 2024-03-11T22:18:11.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:10 smithi187 bash[23415]: cluster 2024-03-11T22:18:10.847080+0000 mon.a (mon.0) 2426 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: audit 2024-03-11T22:18:09.837983+0000 mon.a (mon.0) 2421 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: audit 2024-03-11T22:18:09.841234+0000 mon.b (mon.1) 287 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: cluster 2024-03-11T22:18:09.846028+0000 mon.a (mon.0) 2422 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: audit 2024-03-11T22:18:09.848864+0000 mon.a (mon.0) 2423 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: audit 2024-03-11T22:18:10.456112+0000 mon.a (mon.0) 2424 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: audit 2024-03-11T22:18:10.459013+0000 mon.c (mon.2) 569 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: audit 2024-03-11T22:18:10.840676+0000 mon.a (mon.0) 2425 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]': finished 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[28804]: cluster 2024-03-11T22:18:10.847080+0000 mon.a (mon.0) 2426 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: audit 2024-03-11T22:18:09.837983+0000 mon.a (mon.0) 2421 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: audit 2024-03-11T22:18:09.841234+0000 mon.b (mon.1) 287 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:11.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: cluster 2024-03-11T22:18:09.846028+0000 mon.a (mon.0) 2422 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-03-11T22:18:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: audit 2024-03-11T22:18:09.848864+0000 mon.a (mon.0) 2423 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: audit 2024-03-11T22:18:10.456112+0000 mon.a (mon.0) 2424 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: audit 2024-03-11T22:18:10.459013+0000 mon.c (mon.2) 569 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: audit 2024-03-11T22:18:10.840676+0000 mon.a (mon.0) 2425 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]': finished 2024-03-11T22:18:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:10 smithi049 bash[21434]: cluster 2024-03-11T22:18:10.847080+0000 mon.a (mon.0) 2426 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-03-11T22:18:12.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:11 smithi187 bash[23415]: cluster 2024-03-11T22:18:10.140002+0000 mgr.y (mgr.14601) 390 : cluster 0 pgmap v575: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:12.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:11 smithi187 bash[23415]: audit 2024-03-11T22:18:10.923164+0000 mon.b (mon.1) 288 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:12.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:11 smithi187 bash[23415]: audit 2024-03-11T22:18:10.925080+0000 mon.b (mon.1) 289 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:12.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:11 smithi187 bash[23415]: audit 2024-03-11T22:18:10.929691+0000 mon.a (mon.0) 2427 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:12.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:11 smithi187 bash[23415]: audit 2024-03-11T22:18:10.931509+0000 mon.a (mon.0) 2428 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[21434]: cluster 2024-03-11T22:18:10.140002+0000 mgr.y (mgr.14601) 390 : cluster 0 pgmap v575: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[21434]: audit 2024-03-11T22:18:10.923164+0000 mon.b (mon.1) 288 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[21434]: audit 2024-03-11T22:18:10.925080+0000 mon.b (mon.1) 289 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[21434]: audit 2024-03-11T22:18:10.929691+0000 mon.a (mon.0) 2427 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[21434]: audit 2024-03-11T22:18:10.931509+0000 mon.a (mon.0) 2428 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[28804]: cluster 2024-03-11T22:18:10.140002+0000 mgr.y (mgr.14601) 390 : cluster 0 pgmap v575: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[28804]: audit 2024-03-11T22:18:10.923164+0000 mon.b (mon.1) 288 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[28804]: audit 2024-03-11T22:18:10.925080+0000 mon.b (mon.1) 289 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[28804]: audit 2024-03-11T22:18:10.929691+0000 mon.a (mon.0) 2427 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:12.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:11 smithi049 bash[28804]: audit 2024-03-11T22:18:10.931509+0000 mon.a (mon.0) 2428 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-51"}]: dispatch 2024-03-11T22:18:13.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:12 smithi187 bash[23415]: cluster 2024-03-11T22:18:11.876272+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-03-11T22:18:13.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:12 smithi049 bash[21434]: cluster 2024-03-11T22:18:11.876272+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-03-11T22:18:13.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:12 smithi049 bash[28804]: cluster 2024-03-11T22:18:11.876272+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[28804]: cluster 2024-03-11T22:18:12.140885+0000 mgr.y (mgr.14601) 391 : cluster 0 pgmap v578: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[28804]: cluster 2024-03-11T22:18:12.878892+0000 mon.a (mon.0) 2430 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[28804]: audit 2024-03-11T22:18:12.896708+0000 mon.b (mon.1) 290 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[28804]: cluster 2024-03-11T22:18:12.899691+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[28804]: audit 2024-03-11T22:18:12.906070+0000 mon.a (mon.0) 2432 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[21434]: cluster 2024-03-11T22:18:12.140885+0000 mgr.y (mgr.14601) 391 : cluster 0 pgmap v578: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[21434]: cluster 2024-03-11T22:18:12.878892+0000 mon.a (mon.0) 2430 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[21434]: audit 2024-03-11T22:18:12.896708+0000 mon.b (mon.1) 290 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[21434]: cluster 2024-03-11T22:18:12.899691+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-03-11T22:18:14.225 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:13 smithi049 bash[21434]: audit 2024-03-11T22:18:12.906070+0000 mon.a (mon.0) 2432 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:14.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:13 smithi187 bash[23415]: cluster 2024-03-11T22:18:12.140885+0000 mgr.y (mgr.14601) 391 : cluster 0 pgmap v578: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-11T22:18:14.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:13 smithi187 bash[23415]: cluster 2024-03-11T22:18:12.878892+0000 mon.a (mon.0) 2430 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-11T22:18:14.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:13 smithi187 bash[23415]: audit 2024-03-11T22:18:12.896708+0000 mon.b (mon.1) 290 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:14.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:13 smithi187 bash[23415]: cluster 2024-03-11T22:18:12.899691+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-03-11T22:18:14.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:13 smithi187 bash[23415]: audit 2024-03-11T22:18:12.906070+0000 mon.a (mon.0) 2432 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:14.520 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:18:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:18:15.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:14 smithi187 bash[23415]: audit 2024-03-11T22:18:13.901742+0000 mon.a (mon.0) 2433 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:15.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:14 smithi187 bash[23415]: cluster 2024-03-11T22:18:13.909020+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-03-11T22:18:15.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:14 smithi187 bash[23415]: audit 2024-03-11T22:18:13.985240+0000 mon.b (mon.1) 291 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:14 smithi187 bash[23415]: audit 2024-03-11T22:18:13.986783+0000 mon.b (mon.1) 292 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-53"}]: dispatch 2024-03-11T22:18:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:14 smithi187 bash[23415]: audit 2024-03-11T22:18:13.991629+0000 mon.a (mon.0) 2435 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:15.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:14 smithi187 bash[23415]: audit 2024-03-11T22:18:13.992970+0000 mon.a (mon.0) 2436 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-53"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[21434]: audit 2024-03-11T22:18:13.901742+0000 mon.a (mon.0) 2433 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[21434]: cluster 2024-03-11T22:18:13.909020+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[21434]: audit 2024-03-11T22:18:13.985240+0000 mon.b (mon.1) 291 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[21434]: audit 2024-03-11T22:18:13.986783+0000 mon.b (mon.1) 292 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-53"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[21434]: audit 2024-03-11T22:18:13.991629+0000 mon.a (mon.0) 2435 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[21434]: audit 2024-03-11T22:18:13.992970+0000 mon.a (mon.0) 2436 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-53"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[28804]: audit 2024-03-11T22:18:13.901742+0000 mon.a (mon.0) 2433 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[28804]: cluster 2024-03-11T22:18:13.909020+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[28804]: audit 2024-03-11T22:18:13.985240+0000 mon.b (mon.1) 291 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[28804]: audit 2024-03-11T22:18:13.986783+0000 mon.b (mon.1) 292 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-53"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[28804]: audit 2024-03-11T22:18:13.991629+0000 mon.a (mon.0) 2435 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:15.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:14 smithi049 bash[28804]: audit 2024-03-11T22:18:13.992970+0000 mon.a (mon.0) 2436 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-53"}]: dispatch 2024-03-11T22:18:16.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:15 smithi187 bash[23415]: cluster 2024-03-11T22:18:14.141797+0000 mgr.y (mgr.14601) 392 : cluster 0 pgmap v581: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:18:16.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:15 smithi187 bash[23415]: cluster 2024-03-11T22:18:14.922312+0000 mon.a (mon.0) 2437 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-03-11T22:18:16.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:15 smithi049 bash[21434]: cluster 2024-03-11T22:18:14.141797+0000 mgr.y (mgr.14601) 392 : cluster 0 pgmap v581: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:18:16.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:15 smithi049 bash[21434]: cluster 2024-03-11T22:18:14.922312+0000 mon.a (mon.0) 2437 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-03-11T22:18:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:15 smithi049 bash[28804]: cluster 2024-03-11T22:18:14.141797+0000 mgr.y (mgr.14601) 392 : cluster 0 pgmap v581: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:18:16.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:15 smithi049 bash[28804]: cluster 2024-03-11T22:18:14.922312+0000 mon.a (mon.0) 2437 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-03-11T22:18:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:16 smithi187 bash[23415]: audit 2024-03-11T22:18:15.931236+0000 mon.b (mon.1) 293 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:16 smithi187 bash[23415]: cluster 2024-03-11T22:18:15.932621+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-03-11T22:18:17.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:16 smithi187 bash[23415]: audit 2024-03-11T22:18:15.937834+0000 mon.a (mon.0) 2439 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:17.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:16 smithi049 bash[21434]: audit 2024-03-11T22:18:15.931236+0000 mon.b (mon.1) 293 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:17.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:16 smithi049 bash[21434]: cluster 2024-03-11T22:18:15.932621+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-03-11T22:18:17.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:16 smithi049 bash[21434]: audit 2024-03-11T22:18:15.937834+0000 mon.a (mon.0) 2439 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:16 smithi049 bash[28804]: audit 2024-03-11T22:18:15.931236+0000 mon.b (mon.1) 293 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:16 smithi049 bash[28804]: cluster 2024-03-11T22:18:15.932621+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-03-11T22:18:17.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:16 smithi049 bash[28804]: audit 2024-03-11T22:18:15.937834+0000 mon.a (mon.0) 2439 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: cluster 2024-03-11T22:18:16.142665+0000 mgr.y (mgr.14601) 393 : cluster 0 pgmap v584: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: cluster 2024-03-11T22:18:16.925596+0000 mon.a (mon.0) 2440 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: audit 2024-03-11T22:18:16.934628+0000 mon.a (mon.0) 2441 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: audit 2024-03-11T22:18:16.942730+0000 mon.b (mon.1) 294 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: cluster 2024-03-11T22:18:16.944426+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-03-11T22:18:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: audit 2024-03-11T22:18:17.038703+0000 mon.b (mon.1) 295 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: audit 2024-03-11T22:18:17.040473+0000 mon.b (mon.1) 296 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-55"}]: dispatch 2024-03-11T22:18:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: audit 2024-03-11T22:18:17.045128+0000 mon.a (mon.0) 2443 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:18.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:17 smithi187 bash[23415]: audit 2024-03-11T22:18:17.046796+0000 mon.a (mon.0) 2444 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-55"}]: dispatch 2024-03-11T22:18:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: cluster 2024-03-11T22:18:16.142665+0000 mgr.y (mgr.14601) 393 : cluster 0 pgmap v584: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:18:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: cluster 2024-03-11T22:18:16.925596+0000 mon.a (mon.0) 2440 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: audit 2024-03-11T22:18:16.934628+0000 mon.a (mon.0) 2441 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: audit 2024-03-11T22:18:16.942730+0000 mon.b (mon.1) 294 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: cluster 2024-03-11T22:18:16.944426+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-03-11T22:18:18.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: audit 2024-03-11T22:18:17.038703+0000 mon.b (mon.1) 295 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: audit 2024-03-11T22:18:17.040473+0000 mon.b (mon.1) 296 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-55"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: audit 2024-03-11T22:18:17.045128+0000 mon.a (mon.0) 2443 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[21434]: audit 2024-03-11T22:18:17.046796+0000 mon.a (mon.0) 2444 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-55"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: cluster 2024-03-11T22:18:16.142665+0000 mgr.y (mgr.14601) 393 : cluster 0 pgmap v584: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: cluster 2024-03-11T22:18:16.925596+0000 mon.a (mon.0) 2440 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: audit 2024-03-11T22:18:16.934628+0000 mon.a (mon.0) 2441 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: audit 2024-03-11T22:18:16.942730+0000 mon.b (mon.1) 294 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: cluster 2024-03-11T22:18:16.944426+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: audit 2024-03-11T22:18:17.038703+0000 mon.b (mon.1) 295 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: audit 2024-03-11T22:18:17.040473+0000 mon.b (mon.1) 296 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-55"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: audit 2024-03-11T22:18:17.045128+0000 mon.a (mon.0) 2443 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:17 smithi049 bash[28804]: audit 2024-03-11T22:18:17.046796+0000 mon.a (mon.0) 2444 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-55"}]: dispatch 2024-03-11T22:18:19.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:18 smithi187 bash[23415]: cluster 2024-03-11T22:18:17.953096+0000 mon.a (mon.0) 2445 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-03-11T22:18:19.244 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:18:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:18:19.270 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:18 smithi049 bash[21434]: cluster 2024-03-11T22:18:17.953096+0000 mon.a (mon.0) 2445 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-03-11T22:18:19.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:18 smithi049 bash[28804]: cluster 2024-03-11T22:18:17.953096+0000 mon.a (mon.0) 2445 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-03-11T22:18:20.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:19 smithi187 bash[23415]: cluster 2024-03-11T22:18:18.143479+0000 mgr.y (mgr.14601) 394 : cluster 0 pgmap v587: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:20.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:19 smithi187 bash[23415]: audit 2024-03-11T22:18:18.837092+0000 mgr.y (mgr.14601) 395 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:20.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:19 smithi187 bash[23415]: audit 2024-03-11T22:18:18.965900+0000 mon.b (mon.1) 297 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:20.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:19 smithi187 bash[23415]: cluster 2024-03-11T22:18:18.968124+0000 mon.a (mon.0) 2446 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-03-11T22:18:20.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:19 smithi187 bash[23415]: audit 2024-03-11T22:18:18.974026+0000 mon.a (mon.0) 2447 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[21434]: cluster 2024-03-11T22:18:18.143479+0000 mgr.y (mgr.14601) 394 : cluster 0 pgmap v587: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[21434]: audit 2024-03-11T22:18:18.837092+0000 mgr.y (mgr.14601) 395 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[21434]: audit 2024-03-11T22:18:18.965900+0000 mon.b (mon.1) 297 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[21434]: cluster 2024-03-11T22:18:18.968124+0000 mon.a (mon.0) 2446 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[21434]: audit 2024-03-11T22:18:18.974026+0000 mon.a (mon.0) 2447 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[28804]: cluster 2024-03-11T22:18:18.143479+0000 mgr.y (mgr.14601) 394 : cluster 0 pgmap v587: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[28804]: audit 2024-03-11T22:18:18.837092+0000 mgr.y (mgr.14601) 395 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:20.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[28804]: audit 2024-03-11T22:18:18.965900+0000 mon.b (mon.1) 297 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:20.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[28804]: cluster 2024-03-11T22:18:18.968124+0000 mon.a (mon.0) 2446 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-03-11T22:18:20.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:19 smithi049 bash[28804]: audit 2024-03-11T22:18:18.974026+0000 mon.a (mon.0) 2447 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:21.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:20 smithi187 bash[23415]: audit 2024-03-11T22:18:19.962488+0000 mon.a (mon.0) 2448 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:21.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:20 smithi187 bash[23415]: cluster 2024-03-11T22:18:19.969991+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-03-11T22:18:21.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:20 smithi187 bash[23415]: audit 2024-03-11T22:18:20.063720+0000 mon.b (mon.1) 298 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:21.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:20 smithi187 bash[23415]: audit 2024-03-11T22:18:20.065513+0000 mon.b (mon.1) 299 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-57"}]: dispatch 2024-03-11T22:18:21.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:20 smithi187 bash[23415]: audit 2024-03-11T22:18:20.070171+0000 mon.a (mon.0) 2450 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:21.244 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:20 smithi187 bash[23415]: audit 2024-03-11T22:18:20.071806+0000 mon.a (mon.0) 2451 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-57"}]: dispatch 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[21434]: audit 2024-03-11T22:18:19.962488+0000 mon.a (mon.0) 2448 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[21434]: cluster 2024-03-11T22:18:19.969991+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[21434]: audit 2024-03-11T22:18:20.063720+0000 mon.b (mon.1) 298 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[21434]: audit 2024-03-11T22:18:20.065513+0000 mon.b (mon.1) 299 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-57"}]: dispatch 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[21434]: audit 2024-03-11T22:18:20.070171+0000 mon.a (mon.0) 2450 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[21434]: audit 2024-03-11T22:18:20.071806+0000 mon.a (mon.0) 2451 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-57"}]: dispatch 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[28804]: audit 2024-03-11T22:18:19.962488+0000 mon.a (mon.0) 2448 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[28804]: cluster 2024-03-11T22:18:19.969991+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-03-11T22:18:21.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[28804]: audit 2024-03-11T22:18:20.063720+0000 mon.b (mon.1) 298 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:21.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[28804]: audit 2024-03-11T22:18:20.065513+0000 mon.b (mon.1) 299 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-57"}]: dispatch 2024-03-11T22:18:21.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[28804]: audit 2024-03-11T22:18:20.070171+0000 mon.a (mon.0) 2450 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:21.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:20 smithi049 bash[28804]: audit 2024-03-11T22:18:20.071806+0000 mon.a (mon.0) 2451 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-57"}]: dispatch 2024-03-11T22:18:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:21 smithi187 bash[23415]: cluster 2024-03-11T22:18:20.144373+0000 mgr.y (mgr.14601) 396 : cluster 0 pgmap v590: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:22.243 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:21 smithi187 bash[23415]: cluster 2024-03-11T22:18:20.995329+0000 mon.a (mon.0) 2452 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-03-11T22:18:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:21 smithi049 bash[21434]: cluster 2024-03-11T22:18:20.144373+0000 mgr.y (mgr.14601) 396 : cluster 0 pgmap v590: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:22.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:21 smithi049 bash[21434]: cluster 2024-03-11T22:18:20.995329+0000 mon.a (mon.0) 2452 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-03-11T22:18:22.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:21 smithi049 bash[28804]: cluster 2024-03-11T22:18:20.144373+0000 mgr.y (mgr.14601) 396 : cluster 0 pgmap v590: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:22.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:21 smithi049 bash[28804]: cluster 2024-03-11T22:18:20.995329+0000 mon.a (mon.0) 2452 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-03-11T22:18:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:23 smithi049 bash[21434]: cluster 2024-03-11T22:18:22.007436+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-03-11T22:18:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:23 smithi049 bash[21434]: audit 2024-03-11T22:18:22.008088+0000 mon.b (mon.1) 300 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:23.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:23 smithi049 bash[21434]: audit 2024-03-11T22:18:22.016204+0000 mon.a (mon.0) 2454 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:23 smithi049 bash[28804]: cluster 2024-03-11T22:18:22.007436+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-03-11T22:18:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:23 smithi049 bash[28804]: audit 2024-03-11T22:18:22.008088+0000 mon.b (mon.1) 300 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:23.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:23 smithi049 bash[28804]: audit 2024-03-11T22:18:22.016204+0000 mon.a (mon.0) 2454 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:23.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:23 smithi187 bash[23415]: cluster 2024-03-11T22:18:22.007436+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-03-11T22:18:23.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:23 smithi187 bash[23415]: audit 2024-03-11T22:18:22.008088+0000 mon.b (mon.1) 300 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:23.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:23 smithi187 bash[23415]: audit 2024-03-11T22:18:22.016204+0000 mon.a (mon.0) 2454 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:24.270 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:18:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:18:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: cluster 2024-03-11T22:18:22.145319+0000 mgr.y (mgr.14601) 397 : cluster 0 pgmap v593: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: cluster 2024-03-11T22:18:23.001233+0000 mon.a (mon.0) 2455 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: audit 2024-03-11T22:18:23.011208+0000 mon.a (mon.0) 2456 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: cluster 2024-03-11T22:18:23.019575+0000 mon.a (mon.0) 2457 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-03-11T22:18:24.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: audit 2024-03-11T22:18:23.020524+0000 mon.b (mon.1) 301 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: audit 2024-03-11T22:18:23.113782+0000 mon.b (mon.1) 302 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: audit 2024-03-11T22:18:23.115469+0000 mon.b (mon.1) 303 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-59"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: audit 2024-03-11T22:18:23.120253+0000 mon.a (mon.0) 2458 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[21434]: audit 2024-03-11T22:18:23.121803+0000 mon.a (mon.0) 2459 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-59"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: cluster 2024-03-11T22:18:22.145319+0000 mgr.y (mgr.14601) 397 : cluster 0 pgmap v593: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: cluster 2024-03-11T22:18:23.001233+0000 mon.a (mon.0) 2455 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: audit 2024-03-11T22:18:23.011208+0000 mon.a (mon.0) 2456 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: cluster 2024-03-11T22:18:23.019575+0000 mon.a (mon.0) 2457 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: audit 2024-03-11T22:18:23.020524+0000 mon.b (mon.1) 301 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: audit 2024-03-11T22:18:23.113782+0000 mon.b (mon.1) 302 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: audit 2024-03-11T22:18:23.115469+0000 mon.b (mon.1) 303 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-59"}]: dispatch 2024-03-11T22:18:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: audit 2024-03-11T22:18:23.120253+0000 mon.a (mon.0) 2458 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:24.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:24 smithi049 bash[28804]: audit 2024-03-11T22:18:23.121803+0000 mon.a (mon.0) 2459 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-59"}]: dispatch 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: cluster 2024-03-11T22:18:22.145319+0000 mgr.y (mgr.14601) 397 : cluster 0 pgmap v593: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: cluster 2024-03-11T22:18:23.001233+0000 mon.a (mon.0) 2455 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: audit 2024-03-11T22:18:23.011208+0000 mon.a (mon.0) 2456 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: cluster 2024-03-11T22:18:23.019575+0000 mon.a (mon.0) 2457 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: audit 2024-03-11T22:18:23.020524+0000 mon.b (mon.1) 301 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: audit 2024-03-11T22:18:23.113782+0000 mon.b (mon.1) 302 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: audit 2024-03-11T22:18:23.115469+0000 mon.b (mon.1) 303 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-59"}]: dispatch 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: audit 2024-03-11T22:18:23.120253+0000 mon.a (mon.0) 2458 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:24.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:24 smithi187 bash[23415]: audit 2024-03-11T22:18:23.121803+0000 mon.a (mon.0) 2459 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-59"}]: dispatch 2024-03-11T22:18:25.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:25 smithi187 bash[23415]: cluster 2024-03-11T22:18:24.030181+0000 mon.a (mon.0) 2460 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-03-11T22:18:25.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:25 smithi049 bash[21434]: cluster 2024-03-11T22:18:24.030181+0000 mon.a (mon.0) 2460 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-03-11T22:18:25.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:25 smithi049 bash[28804]: cluster 2024-03-11T22:18:24.030181+0000 mon.a (mon.0) 2460 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-03-11T22:18:26.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:26 smithi187 bash[23415]: cluster 2024-03-11T22:18:24.146025+0000 mgr.y (mgr.14601) 398 : cluster 0 pgmap v596: 260 pgs: 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-11T22:18:26.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:26 smithi187 bash[23415]: audit 2024-03-11T22:18:25.041421+0000 mon.b (mon.1) 304 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:26.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:26 smithi187 bash[23415]: cluster 2024-03-11T22:18:25.042536+0000 mon.a (mon.0) 2461 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-03-11T22:18:26.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:26 smithi187 bash[23415]: audit 2024-03-11T22:18:25.048729+0000 mon.a (mon.0) 2462 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:26.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:26 smithi187 bash[23415]: audit 2024-03-11T22:18:25.499764+0000 mon.a (mon.0) 2463 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:26.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:26 smithi187 bash[23415]: audit 2024-03-11T22:18:25.502769+0000 mon.c (mon.2) 570 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:26.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[21434]: cluster 2024-03-11T22:18:24.146025+0000 mgr.y (mgr.14601) 398 : cluster 0 pgmap v596: 260 pgs: 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-11T22:18:26.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[21434]: audit 2024-03-11T22:18:25.041421+0000 mon.b (mon.1) 304 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:26.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[21434]: cluster 2024-03-11T22:18:25.042536+0000 mon.a (mon.0) 2461 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-03-11T22:18:26.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[21434]: audit 2024-03-11T22:18:25.048729+0000 mon.a (mon.0) 2462 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:26.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[21434]: audit 2024-03-11T22:18:25.499764+0000 mon.a (mon.0) 2463 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:26.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[21434]: audit 2024-03-11T22:18:25.502769+0000 mon.c (mon.2) 570 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:26.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[28804]: cluster 2024-03-11T22:18:24.146025+0000 mgr.y (mgr.14601) 398 : cluster 0 pgmap v596: 260 pgs: 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-11T22:18:26.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[28804]: audit 2024-03-11T22:18:25.041421+0000 mon.b (mon.1) 304 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:26.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[28804]: cluster 2024-03-11T22:18:25.042536+0000 mon.a (mon.0) 2461 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-03-11T22:18:26.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[28804]: audit 2024-03-11T22:18:25.048729+0000 mon.a (mon.0) 2462 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:26.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[28804]: audit 2024-03-11T22:18:25.499764+0000 mon.a (mon.0) 2463 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:18:26.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:26 smithi049 bash[28804]: audit 2024-03-11T22:18:25.502769+0000 mon.c (mon.2) 570 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:27.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:27 smithi187 bash[23415]: audit 2024-03-11T22:18:26.037949+0000 mon.a (mon.0) 2464 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:27.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:27 smithi187 bash[23415]: audit 2024-03-11T22:18:26.044386+0000 mon.b (mon.1) 305 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:27.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:27 smithi187 bash[23415]: cluster 2024-03-11T22:18:26.045326+0000 mon.a (mon.0) 2465 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-03-11T22:18:27.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:27 smithi187 bash[23415]: audit 2024-03-11T22:18:26.080930+0000 mon.b (mon.1) 306 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:27.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:27 smithi187 bash[23415]: audit 2024-03-11T22:18:26.089521+0000 mon.a (mon.0) 2466 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:27.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[21434]: audit 2024-03-11T22:18:26.037949+0000 mon.a (mon.0) 2464 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:27.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[21434]: audit 2024-03-11T22:18:26.044386+0000 mon.b (mon.1) 305 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:27.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[21434]: cluster 2024-03-11T22:18:26.045326+0000 mon.a (mon.0) 2465 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-03-11T22:18:27.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[21434]: audit 2024-03-11T22:18:26.080930+0000 mon.b (mon.1) 306 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:27.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[21434]: audit 2024-03-11T22:18:26.089521+0000 mon.a (mon.0) 2466 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:27.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[28804]: audit 2024-03-11T22:18:26.037949+0000 mon.a (mon.0) 2464 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:27.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[28804]: audit 2024-03-11T22:18:26.044386+0000 mon.b (mon.1) 305 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:27.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[28804]: cluster 2024-03-11T22:18:26.045326+0000 mon.a (mon.0) 2465 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-03-11T22:18:27.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[28804]: audit 2024-03-11T22:18:26.080930+0000 mon.b (mon.1) 306 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:27.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:27 smithi049 bash[28804]: audit 2024-03-11T22:18:26.089521+0000 mon.a (mon.0) 2466 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:28.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[23415]: cluster 2024-03-11T22:18:26.146928+0000 mgr.y (mgr.14601) 399 : cluster 0 pgmap v599: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-11T22:18:28.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[23415]: audit 2024-03-11T22:18:27.064103+0000 mon.a (mon.0) 2467 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:18:28.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[23415]: cluster 2024-03-11T22:18:27.073781+0000 mon.a (mon.0) 2468 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-03-11T22:18:28.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[23415]: audit 2024-03-11T22:18:27.159225+0000 mon.b (mon.1) 307 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:28.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[23415]: audit 2024-03-11T22:18:27.161089+0000 mon.b (mon.1) 308 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-61"}]: dispatch 2024-03-11T22:18:28.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[23415]: audit 2024-03-11T22:18:27.165868+0000 mon.a (mon.0) 2469 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:28.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[23415]: audit 2024-03-11T22:18:27.167671+0000 mon.a (mon.0) 2470 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-61"}]: dispatch 2024-03-11T22:18:28.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[21434]: cluster 2024-03-11T22:18:26.146928+0000 mgr.y (mgr.14601) 399 : cluster 0 pgmap v599: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-11T22:18:28.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[21434]: audit 2024-03-11T22:18:27.064103+0000 mon.a (mon.0) 2467 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:18:28.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[21434]: cluster 2024-03-11T22:18:27.073781+0000 mon.a (mon.0) 2468 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-03-11T22:18:28.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[21434]: audit 2024-03-11T22:18:27.159225+0000 mon.b (mon.1) 307 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:28.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[21434]: audit 2024-03-11T22:18:27.161089+0000 mon.b (mon.1) 308 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-61"}]: dispatch 2024-03-11T22:18:28.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[21434]: audit 2024-03-11T22:18:27.165868+0000 mon.a (mon.0) 2469 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:28.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[21434]: audit 2024-03-11T22:18:27.167671+0000 mon.a (mon.0) 2470 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-61"}]: dispatch 2024-03-11T22:18:28.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[28804]: cluster 2024-03-11T22:18:26.146928+0000 mgr.y (mgr.14601) 399 : cluster 0 pgmap v599: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-11T22:18:28.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[28804]: audit 2024-03-11T22:18:27.064103+0000 mon.a (mon.0) 2467 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:18:28.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[28804]: cluster 2024-03-11T22:18:27.073781+0000 mon.a (mon.0) 2468 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-03-11T22:18:28.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[28804]: audit 2024-03-11T22:18:27.159225+0000 mon.b (mon.1) 307 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:28.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[28804]: audit 2024-03-11T22:18:27.161089+0000 mon.b (mon.1) 308 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-61"}]: dispatch 2024-03-11T22:18:28.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[28804]: audit 2024-03-11T22:18:27.165868+0000 mon.a (mon.0) 2469 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:18:28.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:28 smithi049 bash[28804]: audit 2024-03-11T22:18:27.167671+0000 mon.a (mon.0) 2470 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-61"}]: dispatch 2024-03-11T22:18:29.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:18:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:18:29.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:29 smithi187 bash[23415]: cluster 2024-03-11T22:18:28.082084+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-03-11T22:18:29.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:29 smithi049 bash[21434]: cluster 2024-03-11T22:18:28.082084+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-03-11T22:18:29.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:29 smithi049 bash[28804]: cluster 2024-03-11T22:18:28.082084+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-03-11T22:18:30.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:30 smithi187 bash[23415]: cluster 2024-03-11T22:18:28.147755+0000 mgr.y (mgr.14601) 400 : cluster 0 pgmap v602: 260 pgs: 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:30.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:30 smithi187 bash[23415]: audit 2024-03-11T22:18:28.848457+0000 mgr.y (mgr.14601) 401 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:30.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:30 smithi187 bash[23415]: audit 2024-03-11T22:18:29.085285+0000 mon.b (mon.1) 309 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:30.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:30 smithi187 bash[23415]: cluster 2024-03-11T22:18:29.087449+0000 mon.a (mon.0) 2472 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-03-11T22:18:30.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:30 smithi187 bash[23415]: audit 2024-03-11T22:18:29.114374+0000 mon.a (mon.0) 2473 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:30.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:30 smithi187 bash[23415]: audit 2024-03-11T22:18:30.081481+0000 mon.a (mon.0) 2474 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:30.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:30 smithi187 bash[23415]: cluster 2024-03-11T22:18:30.089476+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-03-11T22:18:30.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[21434]: cluster 2024-03-11T22:18:28.147755+0000 mgr.y (mgr.14601) 400 : cluster 0 pgmap v602: 260 pgs: 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:30.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[21434]: audit 2024-03-11T22:18:28.848457+0000 mgr.y (mgr.14601) 401 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:30.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[21434]: audit 2024-03-11T22:18:29.085285+0000 mon.b (mon.1) 309 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:30.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[21434]: cluster 2024-03-11T22:18:29.087449+0000 mon.a (mon.0) 2472 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-03-11T22:18:30.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[21434]: audit 2024-03-11T22:18:29.114374+0000 mon.a (mon.0) 2473 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:30.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[21434]: audit 2024-03-11T22:18:30.081481+0000 mon.a (mon.0) 2474 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:30.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[21434]: cluster 2024-03-11T22:18:30.089476+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-03-11T22:18:30.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[28804]: cluster 2024-03-11T22:18:28.147755+0000 mgr.y (mgr.14601) 400 : cluster 0 pgmap v602: 260 pgs: 260 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:18:30.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[28804]: audit 2024-03-11T22:18:28.848457+0000 mgr.y (mgr.14601) 401 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:30.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[28804]: audit 2024-03-11T22:18:29.085285+0000 mon.b (mon.1) 309 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:30.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[28804]: cluster 2024-03-11T22:18:29.087449+0000 mon.a (mon.0) 2472 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-03-11T22:18:30.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[28804]: audit 2024-03-11T22:18:29.114374+0000 mon.a (mon.0) 2473 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:18:30.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[28804]: audit 2024-03-11T22:18:30.081481+0000 mon.a (mon.0) 2474 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:18:30.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:30 smithi049 bash[28804]: cluster 2024-03-11T22:18:30.089476+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-03-11T22:18:31.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:31 smithi187 bash[23415]: audit 2024-03-11T22:18:30.086560+0000 mon.b (mon.1) 310 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:31.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:31 smithi187 bash[23415]: audit 2024-03-11T22:18:30.103612+0000 mon.b (mon.1) 311 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:31.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:31 smithi187 bash[23415]: audit 2024-03-11T22:18:30.129948+0000 mon.a (mon.0) 2476 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:31.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:31 smithi187 bash[23415]: cluster 2024-03-11T22:18:30.149016+0000 mgr.y (mgr.14601) 402 : cluster 0 pgmap v605: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 511 B/s wr, 176 op/s 2024-03-11T22:18:31.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:31 smithi187 bash[23415]: cluster 2024-03-11T22:18:30.396600+0000 mon.a (mon.0) 2477 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[21434]: audit 2024-03-11T22:18:30.086560+0000 mon.b (mon.1) 310 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[21434]: audit 2024-03-11T22:18:30.103612+0000 mon.b (mon.1) 311 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[21434]: audit 2024-03-11T22:18:30.129948+0000 mon.a (mon.0) 2476 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[21434]: cluster 2024-03-11T22:18:30.149016+0000 mgr.y (mgr.14601) 402 : cluster 0 pgmap v605: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 511 B/s wr, 176 op/s 2024-03-11T22:18:31.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[21434]: cluster 2024-03-11T22:18:30.396600+0000 mon.a (mon.0) 2477 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:31.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[28804]: audit 2024-03-11T22:18:30.086560+0000 mon.b (mon.1) 310 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:18:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[28804]: audit 2024-03-11T22:18:30.103612+0000 mon.b (mon.1) 311 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[28804]: audit 2024-03-11T22:18:30.129948+0000 mon.a (mon.0) 2476 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:18:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[28804]: cluster 2024-03-11T22:18:30.149016+0000 mgr.y (mgr.14601) 402 : cluster 0 pgmap v605: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 511 B/s wr, 176 op/s 2024-03-11T22:18:31.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:31 smithi049 bash[28804]: cluster 2024-03-11T22:18:30.396600+0000 mon.a (mon.0) 2477 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:18:32.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:32 smithi187 bash[23415]: audit 2024-03-11T22:18:31.116381+0000 mon.a (mon.0) 2478 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:18:32.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:32 smithi187 bash[23415]: cluster 2024-03-11T22:18:31.125583+0000 mon.a (mon.0) 2479 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-03-11T22:18:32.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:32 smithi049 bash[21434]: audit 2024-03-11T22:18:31.116381+0000 mon.a (mon.0) 2478 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:18:32.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:32 smithi049 bash[21434]: cluster 2024-03-11T22:18:31.125583+0000 mon.a (mon.0) 2479 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-03-11T22:18:32.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:32 smithi049 bash[28804]: audit 2024-03-11T22:18:31.116381+0000 mon.a (mon.0) 2478 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:18:32.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:32 smithi049 bash[28804]: cluster 2024-03-11T22:18:31.125583+0000 mon.a (mon.0) 2479 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-03-11T22:18:33.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:33 smithi187 bash[23415]: cluster 2024-03-11T22:18:32.133748+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-03-11T22:18:33.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:33 smithi187 bash[23415]: cluster 2024-03-11T22:18:32.150006+0000 mgr.y (mgr.14601) 403 : cluster 0 pgmap v608: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 511 B/s wr, 176 op/s 2024-03-11T22:18:33.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:33 smithi049 bash[21434]: cluster 2024-03-11T22:18:32.133748+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-03-11T22:18:33.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:33 smithi049 bash[21434]: cluster 2024-03-11T22:18:32.150006+0000 mgr.y (mgr.14601) 403 : cluster 0 pgmap v608: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 511 B/s wr, 176 op/s 2024-03-11T22:18:33.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:33 smithi049 bash[28804]: cluster 2024-03-11T22:18:32.133748+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-03-11T22:18:33.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:33 smithi049 bash[28804]: cluster 2024-03-11T22:18:32.150006+0000 mgr.y (mgr.14601) 403 : cluster 0 pgmap v608: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 511 B/s wr, 176 op/s 2024-03-11T22:18:34.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:34 smithi187 bash[23415]: cluster 2024-03-11T22:18:33.137582+0000 mon.a (mon.0) 2481 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-03-11T22:18:34.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:18:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:18:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:18:34.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:34 smithi049 bash[28804]: cluster 2024-03-11T22:18:33.137582+0000 mon.a (mon.0) 2481 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-03-11T22:18:34.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:34 smithi049 bash[21434]: cluster 2024-03-11T22:18:33.137582+0000 mon.a (mon.0) 2481 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-03-11T22:18:35.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:35 smithi187 bash[23415]: cluster 2024-03-11T22:18:34.151546+0000 mgr.y (mgr.14601) 404 : cluster 0 pgmap v611: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-03-11T22:18:35.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:35 smithi187 bash[23415]: cluster 2024-03-11T22:18:34.151644+0000 mon.a (mon.0) 2482 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-03-11T22:18:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:35 smithi049 bash[28804]: cluster 2024-03-11T22:18:34.151546+0000 mgr.y (mgr.14601) 404 : cluster 0 pgmap v611: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-03-11T22:18:35.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:35 smithi049 bash[28804]: cluster 2024-03-11T22:18:34.151644+0000 mon.a (mon.0) 2482 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-03-11T22:18:35.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:35 smithi049 bash[21434]: cluster 2024-03-11T22:18:34.151546+0000 mgr.y (mgr.14601) 404 : cluster 0 pgmap v611: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-03-11T22:18:35.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:35 smithi049 bash[21434]: cluster 2024-03-11T22:18:34.151644+0000 mon.a (mon.0) 2482 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-03-11T22:18:36.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:36 smithi187 bash[23415]: cluster 2024-03-11T22:18:35.173386+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-03-11T22:18:36.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:36 smithi049 bash[28804]: cluster 2024-03-11T22:18:35.173386+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-03-11T22:18:36.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:36 smithi049 bash[21434]: cluster 2024-03-11T22:18:35.173386+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-03-11T22:18:37.493 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:37 smithi187 bash[23415]: cluster 2024-03-11T22:18:36.152417+0000 mgr.y (mgr.14601) 405 : cluster 0 pgmap v613: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-03-11T22:18:37.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:37 smithi049 bash[28804]: cluster 2024-03-11T22:18:36.152417+0000 mgr.y (mgr.14601) 405 : cluster 0 pgmap v613: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-03-11T22:18:37.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:37 smithi049 bash[21434]: cluster 2024-03-11T22:18:36.152417+0000 mgr.y (mgr.14601) 405 : cluster 0 pgmap v613: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-03-11T22:18:39.173 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:18:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:18:39.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:39 smithi187 bash[23415]: cluster 2024-03-11T22:18:38.153341+0000 mgr.y (mgr.14601) 406 : cluster 0 pgmap v614: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:39.494 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:39 smithi187 bash[23415]: audit 2024-03-11T22:18:38.853910+0000 mgr.y (mgr.14601) 407 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:39.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:39 smithi049 bash[21434]: cluster 2024-03-11T22:18:38.153341+0000 mgr.y (mgr.14601) 406 : cluster 0 pgmap v614: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:39.521 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:39 smithi049 bash[21434]: audit 2024-03-11T22:18:38.853910+0000 mgr.y (mgr.14601) 407 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:39.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:39 smithi049 bash[28804]: cluster 2024-03-11T22:18:38.153341+0000 mgr.y (mgr.14601) 406 : cluster 0 pgmap v614: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-11T22:18:39.521 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:39 smithi049 bash[28804]: audit 2024-03-11T22:18:38.853910+0000 mgr.y (mgr.14601) 407 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:41.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:41 smithi187 bash[23415]: cluster 2024-03-11T22:18:40.156135+0000 mgr.y (mgr.14601) 408 : cluster 0 pgmap v615: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-11T22:18:41.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:41 smithi187 bash[23415]: cluster 2024-03-11T22:18:40.409033+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-03-11T22:18:41.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:41 smithi187 bash[23415]: audit 2024-03-11T22:18:40.538930+0000 mon.c (mon.2) 571 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:41.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:41 smithi049 bash[21434]: cluster 2024-03-11T22:18:40.156135+0000 mgr.y (mgr.14601) 408 : cluster 0 pgmap v615: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-11T22:18:41.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:41 smithi049 bash[21434]: cluster 2024-03-11T22:18:40.409033+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-03-11T22:18:41.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:41 smithi049 bash[21434]: audit 2024-03-11T22:18:40.538930+0000 mon.c (mon.2) 571 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:41.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:41 smithi049 bash[28804]: cluster 2024-03-11T22:18:40.156135+0000 mgr.y (mgr.14601) 408 : cluster 0 pgmap v615: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-11T22:18:41.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:41 smithi049 bash[28804]: cluster 2024-03-11T22:18:40.409033+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-03-11T22:18:41.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:41 smithi049 bash[28804]: audit 2024-03-11T22:18:40.538930+0000 mon.c (mon.2) 571 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:43.743 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:43 smithi187 bash[23415]: cluster 2024-03-11T22:18:42.157034+0000 mgr.y (mgr.14601) 409 : cluster 0 pgmap v617: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:18:43.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:43 smithi049 bash[28804]: cluster 2024-03-11T22:18:42.157034+0000 mgr.y (mgr.14601) 409 : cluster 0 pgmap v617: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:18:43.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:43 smithi049 bash[21434]: cluster 2024-03-11T22:18:42.157034+0000 mgr.y (mgr.14601) 409 : cluster 0 pgmap v617: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:18:44.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:18:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:18:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:18:45.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:45 smithi187 bash[23415]: cluster 2024-03-11T22:18:44.159722+0000 mgr.y (mgr.14601) 410 : cluster 0 pgmap v618: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 227 B/s wr, 2 op/s 2024-03-11T22:18:45.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:45 smithi049 bash[21434]: cluster 2024-03-11T22:18:44.159722+0000 mgr.y (mgr.14601) 410 : cluster 0 pgmap v618: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 227 B/s wr, 2 op/s 2024-03-11T22:18:45.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:45 smithi049 bash[28804]: cluster 2024-03-11T22:18:44.159722+0000 mgr.y (mgr.14601) 410 : cluster 0 pgmap v618: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 227 B/s wr, 2 op/s 2024-03-11T22:18:46.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:46 smithi187 bash[23415]: cluster 2024-03-11T22:18:45.426584+0000 mon.a (mon.0) 2485 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-03-11T22:18:46.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:46 smithi049 bash[21434]: cluster 2024-03-11T22:18:45.426584+0000 mon.a (mon.0) 2485 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-03-11T22:18:46.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:46 smithi049 bash[28804]: cluster 2024-03-11T22:18:45.426584+0000 mon.a (mon.0) 2485 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-03-11T22:18:47.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:47 smithi187 bash[23415]: cluster 2024-03-11T22:18:46.160583+0000 mgr.y (mgr.14601) 411 : cluster 0 pgmap v620: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:18:47.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:47 smithi049 bash[21434]: cluster 2024-03-11T22:18:46.160583+0000 mgr.y (mgr.14601) 411 : cluster 0 pgmap v620: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:18:47.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:47 smithi049 bash[28804]: cluster 2024-03-11T22:18:46.160583+0000 mgr.y (mgr.14601) 411 : cluster 0 pgmap v620: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:18:49.244 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:18:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:18:49.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:49 smithi187 bash[23415]: cluster 2024-03-11T22:18:48.161499+0000 mgr.y (mgr.14601) 412 : cluster 0 pgmap v621: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:18:49.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:49 smithi187 bash[23415]: audit 2024-03-11T22:18:48.865454+0000 mgr.y (mgr.14601) 413 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:49 smithi049 bash[21434]: cluster 2024-03-11T22:18:48.161499+0000 mgr.y (mgr.14601) 412 : cluster 0 pgmap v621: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:18:49.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:49 smithi049 bash[21434]: audit 2024-03-11T22:18:48.865454+0000 mgr.y (mgr.14601) 413 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:49.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:49 smithi049 bash[28804]: cluster 2024-03-11T22:18:48.161499+0000 mgr.y (mgr.14601) 412 : cluster 0 pgmap v621: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:18:49.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:49 smithi049 bash[28804]: audit 2024-03-11T22:18:48.865454+0000 mgr.y (mgr.14601) 413 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:51.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:51 smithi187 bash[23415]: cluster 2024-03-11T22:18:50.164202+0000 mgr.y (mgr.14601) 414 : cluster 0 pgmap v622: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:51.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:51 smithi049 bash[21434]: cluster 2024-03-11T22:18:50.164202+0000 mgr.y (mgr.14601) 414 : cluster 0 pgmap v622: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:51.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:51 smithi049 bash[28804]: cluster 2024-03-11T22:18:50.164202+0000 mgr.y (mgr.14601) 414 : cluster 0 pgmap v622: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:53.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:53 smithi187 bash[23415]: cluster 2024-03-11T22:18:52.165141+0000 mgr.y (mgr.14601) 415 : cluster 0 pgmap v623: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:53.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:53 smithi049 bash[21434]: cluster 2024-03-11T22:18:52.165141+0000 mgr.y (mgr.14601) 415 : cluster 0 pgmap v623: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:53.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:53 smithi049 bash[28804]: cluster 2024-03-11T22:18:52.165141+0000 mgr.y (mgr.14601) 415 : cluster 0 pgmap v623: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:54.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:18:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:18:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:18:55.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:55 smithi187 bash[23415]: cluster 2024-03-11T22:18:54.167935+0000 mgr.y (mgr.14601) 416 : cluster 0 pgmap v624: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:55.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:55 smithi187 bash[23415]: cluster 2024-03-11T22:18:55.413712+0000 mon.a (mon.0) 2486 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-03-11T22:18:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:55 smithi049 bash[21434]: cluster 2024-03-11T22:18:54.167935+0000 mgr.y (mgr.14601) 416 : cluster 0 pgmap v624: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:55.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:55 smithi049 bash[21434]: cluster 2024-03-11T22:18:55.413712+0000 mon.a (mon.0) 2486 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-03-11T22:18:55.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:55 smithi049 bash[28804]: cluster 2024-03-11T22:18:54.167935+0000 mgr.y (mgr.14601) 416 : cluster 0 pgmap v624: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:55.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:55 smithi049 bash[28804]: cluster 2024-03-11T22:18:55.413712+0000 mon.a (mon.0) 2486 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-03-11T22:18:56.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:56 smithi187 bash[23415]: audit 2024-03-11T22:18:55.573329+0000 mon.c (mon.2) 572 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:56.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:56 smithi187 bash[23415]: cluster 2024-03-11T22:18:56.416175+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-03-11T22:18:56.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:56 smithi049 bash[21434]: audit 2024-03-11T22:18:55.573329+0000 mon.c (mon.2) 572 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:56.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:56 smithi049 bash[21434]: cluster 2024-03-11T22:18:56.416175+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-03-11T22:18:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:56 smithi049 bash[28804]: audit 2024-03-11T22:18:55.573329+0000 mon.c (mon.2) 572 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:18:56.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:56 smithi049 bash[28804]: cluster 2024-03-11T22:18:56.416175+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-03-11T22:18:57.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:57 smithi187 bash[23415]: cluster 2024-03-11T22:18:56.169019+0000 mgr.y (mgr.14601) 417 : cluster 0 pgmap v626: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:57.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:57 smithi049 bash[21434]: cluster 2024-03-11T22:18:56.169019+0000 mgr.y (mgr.14601) 417 : cluster 0 pgmap v626: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:57.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:57 smithi049 bash[28804]: cluster 2024-03-11T22:18:56.169019+0000 mgr.y (mgr.14601) 417 : cluster 0 pgmap v626: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:18:59.244 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:18:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:18:59.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:59 smithi187 bash[23415]: cluster 2024-03-11T22:18:58.170057+0000 mgr.y (mgr.14601) 418 : cluster 0 pgmap v628: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:18:59.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:18:59 smithi187 bash[23415]: audit 2024-03-11T22:18:58.876328+0000 mgr.y (mgr.14601) 419 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:59 smithi049 bash[21434]: cluster 2024-03-11T22:18:58.170057+0000 mgr.y (mgr.14601) 418 : cluster 0 pgmap v628: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:18:59.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:18:59 smithi049 bash[21434]: audit 2024-03-11T22:18:58.876328+0000 mgr.y (mgr.14601) 419 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:18:59.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:59 smithi049 bash[28804]: cluster 2024-03-11T22:18:58.170057+0000 mgr.y (mgr.14601) 418 : cluster 0 pgmap v628: 292 pgs: 292 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:18:59.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:18:59 smithi049 bash[28804]: audit 2024-03-11T22:18:58.876328+0000 mgr.y (mgr.14601) 419 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:01.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:01 smithi187 bash[23415]: cluster 2024-03-11T22:19:00.172730+0000 mgr.y (mgr.14601) 420 : cluster 0 pgmap v629: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:19:01.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:01 smithi049 bash[21434]: cluster 2024-03-11T22:19:00.172730+0000 mgr.y (mgr.14601) 420 : cluster 0 pgmap v629: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:19:01.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:01 smithi049 bash[28804]: cluster 2024-03-11T22:19:00.172730+0000 mgr.y (mgr.14601) 420 : cluster 0 pgmap v629: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:19:03.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:03 smithi187 bash[23415]: cluster 2024-03-11T22:19:02.173627+0000 mgr.y (mgr.14601) 421 : cluster 0 pgmap v630: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:19:03.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:03 smithi049 bash[21434]: cluster 2024-03-11T22:19:02.173627+0000 mgr.y (mgr.14601) 421 : cluster 0 pgmap v630: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:19:03.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:03 smithi049 bash[28804]: cluster 2024-03-11T22:19:02.173627+0000 mgr.y (mgr.14601) 421 : cluster 0 pgmap v630: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:19:04.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:19:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:19:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:19:05.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:05 smithi187 bash[23415]: cluster 2024-03-11T22:19:04.176300+0000 mgr.y (mgr.14601) 422 : cluster 0 pgmap v631: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-11T22:19:05.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:05 smithi187 bash[23415]: cluster 2024-03-11T22:19:05.416740+0000 mon.a (mon.0) 2488 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-03-11T22:19:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:05 smithi049 bash[21434]: cluster 2024-03-11T22:19:04.176300+0000 mgr.y (mgr.14601) 422 : cluster 0 pgmap v631: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-11T22:19:05.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:05 smithi049 bash[21434]: cluster 2024-03-11T22:19:05.416740+0000 mon.a (mon.0) 2488 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-03-11T22:19:05.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:05 smithi049 bash[28804]: cluster 2024-03-11T22:19:04.176300+0000 mgr.y (mgr.14601) 422 : cluster 0 pgmap v631: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-11T22:19:05.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:05 smithi049 bash[28804]: cluster 2024-03-11T22:19:05.416740+0000 mon.a (mon.0) 2488 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-03-11T22:19:06.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:06 smithi187 bash[23415]: audit 2024-03-11T22:19:06.451688+0000 mon.b (mon.1) 312 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:06.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:06 smithi187 bash[23415]: audit 2024-03-11T22:19:06.454001+0000 mon.b (mon.1) 313 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-63"}]: dispatch 2024-03-11T22:19:06.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:06 smithi187 bash[23415]: audit 2024-03-11T22:19:06.458774+0000 mon.a (mon.0) 2489 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:06.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:06 smithi187 bash[23415]: audit 2024-03-11T22:19:06.460999+0000 mon.a (mon.0) 2490 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-63"}]: dispatch 2024-03-11T22:19:06.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[21434]: audit 2024-03-11T22:19:06.451688+0000 mon.b (mon.1) 312 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:06.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[21434]: audit 2024-03-11T22:19:06.454001+0000 mon.b (mon.1) 313 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-63"}]: dispatch 2024-03-11T22:19:06.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[21434]: audit 2024-03-11T22:19:06.458774+0000 mon.a (mon.0) 2489 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:06.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[21434]: audit 2024-03-11T22:19:06.460999+0000 mon.a (mon.0) 2490 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-63"}]: dispatch 2024-03-11T22:19:06.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[28804]: audit 2024-03-11T22:19:06.451688+0000 mon.b (mon.1) 312 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:06.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[28804]: audit 2024-03-11T22:19:06.454001+0000 mon.b (mon.1) 313 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-63"}]: dispatch 2024-03-11T22:19:06.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[28804]: audit 2024-03-11T22:19:06.458774+0000 mon.a (mon.0) 2489 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:06.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:06 smithi049 bash[28804]: audit 2024-03-11T22:19:06.460999+0000 mon.a (mon.0) 2490 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-63"}]: dispatch 2024-03-11T22:19:07.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:07 smithi187 bash[23415]: cluster 2024-03-11T22:19:06.177247+0000 mgr.y (mgr.14601) 423 : cluster 0 pgmap v633: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:19:07.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:07 smithi187 bash[23415]: audit 2024-03-11T22:19:07.446680+0000 mon.c (mon.2) 573 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:19:07.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:07 smithi049 bash[21434]: cluster 2024-03-11T22:19:06.177247+0000 mgr.y (mgr.14601) 423 : cluster 0 pgmap v633: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:19:07.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:07 smithi049 bash[21434]: audit 2024-03-11T22:19:07.446680+0000 mon.c (mon.2) 573 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:19:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:07 smithi049 bash[28804]: cluster 2024-03-11T22:19:06.177247+0000 mgr.y (mgr.14601) 423 : cluster 0 pgmap v633: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:19:07.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:07 smithi049 bash[28804]: audit 2024-03-11T22:19:07.446680+0000 mon.c (mon.2) 573 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:19:08.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[21434]: cluster 2024-03-11T22:19:07.500787+0000 mon.a (mon.0) 2491 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-03-11T22:19:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[21434]: audit 2024-03-11T22:19:08.182560+0000 mon.c (mon.2) 574 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:19:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[21434]: audit 2024-03-11T22:19:08.184206+0000 mon.c (mon.2) 575 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:19:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[21434]: audit 2024-03-11T22:19:08.197468+0000 mon.a (mon.0) 2492 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:19:08.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[28804]: cluster 2024-03-11T22:19:07.500787+0000 mon.a (mon.0) 2491 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-03-11T22:19:08.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[28804]: audit 2024-03-11T22:19:08.182560+0000 mon.c (mon.2) 574 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:19:08.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[28804]: audit 2024-03-11T22:19:08.184206+0000 mon.c (mon.2) 575 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:19:08.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:08 smithi049 bash[28804]: audit 2024-03-11T22:19:08.197468+0000 mon.a (mon.0) 2492 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:19:08.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:08 smithi187 bash[23415]: cluster 2024-03-11T22:19:07.500787+0000 mon.a (mon.0) 2491 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-03-11T22:19:08.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:08 smithi187 bash[23415]: audit 2024-03-11T22:19:08.182560+0000 mon.c (mon.2) 574 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:19:08.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:08 smithi187 bash[23415]: audit 2024-03-11T22:19:08.184206+0000 mon.c (mon.2) 575 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:19:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:08 smithi187 bash[23415]: audit 2024-03-11T22:19:08.197468+0000 mon.a (mon.0) 2492 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:19:09.244 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:19:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:19:09.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[28804]: cluster 2024-03-11T22:19:08.178059+0000 mgr.y (mgr.14601) 424 : cluster 0 pgmap v635: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[28804]: audit 2024-03-11T22:19:08.511663+0000 mon.b (mon.1) 314 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[28804]: cluster 2024-03-11T22:19:08.514672+0000 mon.a (mon.0) 2493 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[28804]: audit 2024-03-11T22:19:08.519558+0000 mon.a (mon.0) 2494 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[28804]: audit 2024-03-11T22:19:08.887847+0000 mgr.y (mgr.14601) 425 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[21434]: cluster 2024-03-11T22:19:08.178059+0000 mgr.y (mgr.14601) 424 : cluster 0 pgmap v635: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[21434]: audit 2024-03-11T22:19:08.511663+0000 mon.b (mon.1) 314 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[21434]: cluster 2024-03-11T22:19:08.514672+0000 mon.a (mon.0) 2493 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[21434]: audit 2024-03-11T22:19:08.519558+0000 mon.a (mon.0) 2494 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:09 smithi049 bash[21434]: audit 2024-03-11T22:19:08.887847+0000 mgr.y (mgr.14601) 425 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:09.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:09 smithi187 bash[23415]: cluster 2024-03-11T22:19:08.178059+0000 mgr.y (mgr.14601) 424 : cluster 0 pgmap v635: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:09.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:09 smithi187 bash[23415]: audit 2024-03-11T22:19:08.511663+0000 mon.b (mon.1) 314 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:09.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:09 smithi187 bash[23415]: cluster 2024-03-11T22:19:08.514672+0000 mon.a (mon.0) 2493 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-03-11T22:19:09.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:09 smithi187 bash[23415]: audit 2024-03-11T22:19:08.519558+0000 mon.a (mon.0) 2494 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:09.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:09 smithi187 bash[23415]: audit 2024-03-11T22:19:08.887847+0000 mgr.y (mgr.14601) 425 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:10.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:10 smithi187 bash[23415]: audit 2024-03-11T22:19:09.507661+0000 mon.a (mon.0) 2495 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:10.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:10 smithi187 bash[23415]: audit 2024-03-11T22:19:09.514412+0000 mon.b (mon.1) 315 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:10.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:10 smithi187 bash[23415]: cluster 2024-03-11T22:19:09.515267+0000 mon.a (mon.0) 2496 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-03-11T22:19:10.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:10 smithi187 bash[23415]: audit 2024-03-11T22:19:09.542824+0000 mon.b (mon.1) 316 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:10.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:10 smithi187 bash[23415]: audit 2024-03-11T22:19:09.550673+0000 mon.a (mon.0) 2497 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:11.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[28804]: audit 2024-03-11T22:19:09.507661+0000 mon.a (mon.0) 2495 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:11.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[28804]: audit 2024-03-11T22:19:09.514412+0000 mon.b (mon.1) 315 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:11.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[28804]: cluster 2024-03-11T22:19:09.515267+0000 mon.a (mon.0) 2496 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-03-11T22:19:11.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[28804]: audit 2024-03-11T22:19:09.542824+0000 mon.b (mon.1) 316 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:11.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[28804]: audit 2024-03-11T22:19:09.550673+0000 mon.a (mon.0) 2497 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:11.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[21434]: audit 2024-03-11T22:19:09.507661+0000 mon.a (mon.0) 2495 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:11.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[21434]: audit 2024-03-11T22:19:09.514412+0000 mon.b (mon.1) 315 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:11.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[21434]: cluster 2024-03-11T22:19:09.515267+0000 mon.a (mon.0) 2496 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-03-11T22:19:11.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[21434]: audit 2024-03-11T22:19:09.542824+0000 mon.b (mon.1) 316 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:11.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:10 smithi049 bash[21434]: audit 2024-03-11T22:19:09.550673+0000 mon.a (mon.0) 2497 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:11.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:11 smithi187 bash[23415]: cluster 2024-03-11T22:19:10.178883+0000 mgr.y (mgr.14601) 426 : cluster 0 pgmap v638: 292 pgs: 25 creating+peering, 7 unknown, 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:11.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:11 smithi187 bash[23415]: audit 2024-03-11T22:19:10.533734+0000 mon.a (mon.0) 2498 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:19:11.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:11 smithi187 bash[23415]: cluster 2024-03-11T22:19:10.542443+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-03-11T22:19:11.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:11 smithi187 bash[23415]: audit 2024-03-11T22:19:10.608636+0000 mon.c (mon.2) 576 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:12.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[28804]: cluster 2024-03-11T22:19:10.178883+0000 mgr.y (mgr.14601) 426 : cluster 0 pgmap v638: 292 pgs: 25 creating+peering, 7 unknown, 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:12.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[28804]: audit 2024-03-11T22:19:10.533734+0000 mon.a (mon.0) 2498 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:19:12.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[28804]: cluster 2024-03-11T22:19:10.542443+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-03-11T22:19:12.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[28804]: audit 2024-03-11T22:19:10.608636+0000 mon.c (mon.2) 576 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:12.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[21434]: cluster 2024-03-11T22:19:10.178883+0000 mgr.y (mgr.14601) 426 : cluster 0 pgmap v638: 292 pgs: 25 creating+peering, 7 unknown, 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:12.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[21434]: audit 2024-03-11T22:19:10.533734+0000 mon.a (mon.0) 2498 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:19:12.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[21434]: cluster 2024-03-11T22:19:10.542443+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-03-11T22:19:12.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:11 smithi049 bash[21434]: audit 2024-03-11T22:19:10.608636+0000 mon.c (mon.2) 576 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:12.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:12 smithi187 bash[23415]: cluster 2024-03-11T22:19:11.542681+0000 mon.a (mon.0) 2500 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-03-11T22:19:13.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:12 smithi049 bash[21434]: cluster 2024-03-11T22:19:11.542681+0000 mon.a (mon.0) 2500 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-03-11T22:19:13.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:12 smithi049 bash[28804]: cluster 2024-03-11T22:19:11.542681+0000 mon.a (mon.0) 2500 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-03-11T22:19:13.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:13 smithi187 bash[23415]: cluster 2024-03-11T22:19:12.179763+0000 mgr.y (mgr.14601) 427 : cluster 0 pgmap v641: 292 pgs: 25 creating+peering, 7 unknown, 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:19:13.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:13 smithi187 bash[23415]: cluster 2024-03-11T22:19:12.559389+0000 mon.a (mon.0) 2501 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-03-11T22:19:14.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:13 smithi049 bash[21434]: cluster 2024-03-11T22:19:12.179763+0000 mgr.y (mgr.14601) 427 : cluster 0 pgmap v641: 292 pgs: 25 creating+peering, 7 unknown, 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:19:14.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:13 smithi049 bash[21434]: cluster 2024-03-11T22:19:12.559389+0000 mon.a (mon.0) 2501 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-03-11T22:19:14.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:13 smithi049 bash[28804]: cluster 2024-03-11T22:19:12.179763+0000 mgr.y (mgr.14601) 427 : cluster 0 pgmap v641: 292 pgs: 25 creating+peering, 7 unknown, 260 active+clean; 8.4 MiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:19:14.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:13 smithi049 bash[28804]: cluster 2024-03-11T22:19:12.559389+0000 mon.a (mon.0) 2501 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-03-11T22:19:14.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:19:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:19:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:19:14.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:14 smithi187 bash[23415]: cluster 2024-03-11T22:19:13.579190+0000 mon.a (mon.0) 2502 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-03-11T22:19:15.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:14 smithi049 bash[21434]: cluster 2024-03-11T22:19:13.579190+0000 mon.a (mon.0) 2502 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-03-11T22:19:15.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:14 smithi049 bash[28804]: cluster 2024-03-11T22:19:13.579190+0000 mon.a (mon.0) 2502 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-03-11T22:19:15.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:15 smithi187 bash[23415]: cluster 2024-03-11T22:19:14.181062+0000 mgr.y (mgr.14601) 428 : cluster 0 pgmap v644: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-03-11T22:19:16.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:15 smithi049 bash[21434]: cluster 2024-03-11T22:19:14.181062+0000 mgr.y (mgr.14601) 428 : cluster 0 pgmap v644: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-03-11T22:19:16.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:15 smithi049 bash[28804]: cluster 2024-03-11T22:19:14.181062+0000 mgr.y (mgr.14601) 428 : cluster 0 pgmap v644: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-03-11T22:19:17.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:17 smithi187 bash[23415]: cluster 2024-03-11T22:19:16.181999+0000 mgr.y (mgr.14601) 429 : cluster 0 pgmap v645: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-11T22:19:18.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:17 smithi049 bash[21434]: cluster 2024-03-11T22:19:16.181999+0000 mgr.y (mgr.14601) 429 : cluster 0 pgmap v645: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-11T22:19:18.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:17 smithi049 bash[28804]: cluster 2024-03-11T22:19:16.181999+0000 mgr.y (mgr.14601) 429 : cluster 0 pgmap v645: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-11T22:19:19.244 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:19:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:19:19.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:19 smithi187 bash[23415]: cluster 2024-03-11T22:19:18.183005+0000 mgr.y (mgr.14601) 430 : cluster 0 pgmap v646: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:19:19.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:19 smithi187 bash[23415]: audit 2024-03-11T22:19:18.899269+0000 mgr.y (mgr.14601) 431 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:20.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:19 smithi049 bash[21434]: cluster 2024-03-11T22:19:18.183005+0000 mgr.y (mgr.14601) 430 : cluster 0 pgmap v646: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:19:20.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:19 smithi049 bash[21434]: audit 2024-03-11T22:19:18.899269+0000 mgr.y (mgr.14601) 431 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:20.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:19 smithi049 bash[28804]: cluster 2024-03-11T22:19:18.183005+0000 mgr.y (mgr.14601) 430 : cluster 0 pgmap v646: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:19:20.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:19 smithi049 bash[28804]: audit 2024-03-11T22:19:18.899269+0000 mgr.y (mgr.14601) 431 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:21.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:21 smithi187 bash[23415]: cluster 2024-03-11T22:19:20.185830+0000 mgr.y (mgr.14601) 432 : cluster 0 pgmap v647: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-11T22:19:22.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:21 smithi049 bash[21434]: cluster 2024-03-11T22:19:20.185830+0000 mgr.y (mgr.14601) 432 : cluster 0 pgmap v647: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-11T22:19:22.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:21 smithi049 bash[28804]: cluster 2024-03-11T22:19:20.185830+0000 mgr.y (mgr.14601) 432 : cluster 0 pgmap v647: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-11T22:19:23.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:23 smithi187 bash[23415]: cluster 2024-03-11T22:19:22.186890+0000 mgr.y (mgr.14601) 433 : cluster 0 pgmap v648: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-03-11T22:19:24.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:23 smithi049 bash[21434]: cluster 2024-03-11T22:19:22.186890+0000 mgr.y (mgr.14601) 433 : cluster 0 pgmap v648: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-03-11T22:19:24.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:23 smithi049 bash[28804]: cluster 2024-03-11T22:19:22.186890+0000 mgr.y (mgr.14601) 433 : cluster 0 pgmap v648: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-03-11T22:19:24.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:19:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:19:24.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:24 smithi187 bash[23415]: audit 2024-03-11T22:19:23.617017+0000 mon.b (mon.1) 317 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:24.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:24 smithi187 bash[23415]: audit 2024-03-11T22:19:23.619076+0000 mon.b (mon.1) 318 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-65"}]: dispatch 2024-03-11T22:19:24.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:24 smithi187 bash[23415]: audit 2024-03-11T22:19:23.624127+0000 mon.a (mon.0) 2503 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:24.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:24 smithi187 bash[23415]: audit 2024-03-11T22:19:23.626125+0000 mon.a (mon.0) 2504 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-65"}]: dispatch 2024-03-11T22:19:25.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[21434]: audit 2024-03-11T22:19:23.617017+0000 mon.b (mon.1) 317 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:25.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[21434]: audit 2024-03-11T22:19:23.619076+0000 mon.b (mon.1) 318 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-65"}]: dispatch 2024-03-11T22:19:25.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[21434]: audit 2024-03-11T22:19:23.624127+0000 mon.a (mon.0) 2503 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:25.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[21434]: audit 2024-03-11T22:19:23.626125+0000 mon.a (mon.0) 2504 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-65"}]: dispatch 2024-03-11T22:19:25.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[28804]: audit 2024-03-11T22:19:23.617017+0000 mon.b (mon.1) 317 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:25.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[28804]: audit 2024-03-11T22:19:23.619076+0000 mon.b (mon.1) 318 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-65"}]: dispatch 2024-03-11T22:19:25.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[28804]: audit 2024-03-11T22:19:23.624127+0000 mon.a (mon.0) 2503 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:25.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:24 smithi049 bash[28804]: audit 2024-03-11T22:19:23.626125+0000 mon.a (mon.0) 2504 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-65"}]: dispatch 2024-03-11T22:19:25.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:25 smithi187 bash[23415]: cluster 2024-03-11T22:19:24.189645+0000 mgr.y (mgr.14601) 434 : cluster 0 pgmap v649: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:19:25.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:25 smithi187 bash[23415]: cluster 2024-03-11T22:19:24.608916+0000 mon.a (mon.0) 2505 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-03-11T22:19:25.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:25 smithi187 bash[23415]: cluster 2024-03-11T22:19:25.443643+0000 mon.a (mon.0) 2506 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-03-11T22:19:25.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:25 smithi187 bash[23415]: audit 2024-03-11T22:19:25.448189+0000 mon.b (mon.1) 319 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:25.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:25 smithi187 bash[23415]: audit 2024-03-11T22:19:25.455532+0000 mon.a (mon.0) 2507 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:26.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[21434]: cluster 2024-03-11T22:19:24.189645+0000 mgr.y (mgr.14601) 434 : cluster 0 pgmap v649: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[21434]: cluster 2024-03-11T22:19:24.608916+0000 mon.a (mon.0) 2505 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[21434]: cluster 2024-03-11T22:19:25.443643+0000 mon.a (mon.0) 2506 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[21434]: audit 2024-03-11T22:19:25.448189+0000 mon.b (mon.1) 319 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[21434]: audit 2024-03-11T22:19:25.455532+0000 mon.a (mon.0) 2507 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[28804]: cluster 2024-03-11T22:19:24.189645+0000 mgr.y (mgr.14601) 434 : cluster 0 pgmap v649: 292 pgs: 292 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[28804]: cluster 2024-03-11T22:19:24.608916+0000 mon.a (mon.0) 2505 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[28804]: cluster 2024-03-11T22:19:25.443643+0000 mon.a (mon.0) 2506 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[28804]: audit 2024-03-11T22:19:25.448189+0000 mon.b (mon.1) 319 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:26.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:25 smithi049 bash[28804]: audit 2024-03-11T22:19:25.455532+0000 mon.a (mon.0) 2507 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:26.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:26 smithi187 bash[23415]: audit 2024-03-11T22:19:25.643291+0000 mon.c (mon.2) 577 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:26.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:26 smithi187 bash[23415]: audit 2024-03-11T22:19:26.432706+0000 mon.a (mon.0) 2508 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:26.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:26 smithi187 bash[23415]: audit 2024-03-11T22:19:26.440146+0000 mon.b (mon.1) 320 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:26.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:26 smithi187 bash[23415]: cluster 2024-03-11T22:19:26.441160+0000 mon.a (mon.0) 2509 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-03-11T22:19:27.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[21434]: audit 2024-03-11T22:19:25.643291+0000 mon.c (mon.2) 577 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:27.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[21434]: audit 2024-03-11T22:19:26.432706+0000 mon.a (mon.0) 2508 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:27.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[21434]: audit 2024-03-11T22:19:26.440146+0000 mon.b (mon.1) 320 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:27.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[21434]: cluster 2024-03-11T22:19:26.441160+0000 mon.a (mon.0) 2509 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-03-11T22:19:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[28804]: audit 2024-03-11T22:19:25.643291+0000 mon.c (mon.2) 577 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[28804]: audit 2024-03-11T22:19:26.432706+0000 mon.a (mon.0) 2508 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[28804]: audit 2024-03-11T22:19:26.440146+0000 mon.b (mon.1) 320 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:27.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:26 smithi049 bash[28804]: cluster 2024-03-11T22:19:26.441160+0000 mon.a (mon.0) 2509 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-03-11T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:27 smithi187 bash[23415]: cluster 2024-03-11T22:19:26.190697+0000 mgr.y (mgr.14601) 435 : cluster 0 pgmap v652: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:27 smithi187 bash[23415]: cluster 2024-03-11T22:19:26.615630+0000 mon.a (mon.0) 2510 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:27 smithi187 bash[23415]: cluster 2024-03-11T22:19:27.441775+0000 mon.a (mon.0) 2511 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-03-11T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:27 smithi187 bash[23415]: audit 2024-03-11T22:19:27.525510+0000 mon.b (mon.1) 321 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:27 smithi187 bash[23415]: audit 2024-03-11T22:19:27.527987+0000 mon.b (mon.1) 322 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-67"}]: dispatch 2024-03-11T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:27 smithi187 bash[23415]: audit 2024-03-11T22:19:27.532654+0000 mon.a (mon.0) 2512 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:27.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:27 smithi187 bash[23415]: audit 2024-03-11T22:19:27.535096+0000 mon.a (mon.0) 2513 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-67"}]: dispatch 2024-03-11T22:19:28.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[21434]: cluster 2024-03-11T22:19:26.190697+0000 mgr.y (mgr.14601) 435 : cluster 0 pgmap v652: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[21434]: cluster 2024-03-11T22:19:26.615630+0000 mon.a (mon.0) 2510 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[21434]: cluster 2024-03-11T22:19:27.441775+0000 mon.a (mon.0) 2511 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[21434]: audit 2024-03-11T22:19:27.525510+0000 mon.b (mon.1) 321 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[21434]: audit 2024-03-11T22:19:27.527987+0000 mon.b (mon.1) 322 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-67"}]: dispatch 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[21434]: audit 2024-03-11T22:19:27.532654+0000 mon.a (mon.0) 2512 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[21434]: audit 2024-03-11T22:19:27.535096+0000 mon.a (mon.0) 2513 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-67"}]: dispatch 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[28804]: cluster 2024-03-11T22:19:26.190697+0000 mgr.y (mgr.14601) 435 : cluster 0 pgmap v652: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[28804]: cluster 2024-03-11T22:19:26.615630+0000 mon.a (mon.0) 2510 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[28804]: cluster 2024-03-11T22:19:27.441775+0000 mon.a (mon.0) 2511 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[28804]: audit 2024-03-11T22:19:27.525510+0000 mon.b (mon.1) 321 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:28.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[28804]: audit 2024-03-11T22:19:27.527987+0000 mon.b (mon.1) 322 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-67"}]: dispatch 2024-03-11T22:19:28.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[28804]: audit 2024-03-11T22:19:27.532654+0000 mon.a (mon.0) 2512 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:28.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:27 smithi049 bash[28804]: audit 2024-03-11T22:19:27.535096+0000 mon.a (mon.0) 2513 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-67"}]: dispatch 2024-03-11T22:19:29.244 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:19:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:19:29.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:29 smithi187 bash[23415]: cluster 2024-03-11T22:19:28.191597+0000 mgr.y (mgr.14601) 436 : cluster 0 pgmap v655: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:29.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:29 smithi187 bash[23415]: cluster 2024-03-11T22:19:28.445101+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-03-11T22:19:29.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:29 smithi187 bash[23415]: audit 2024-03-11T22:19:28.910644+0000 mgr.y (mgr.14601) 437 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:29.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:29 smithi049 bash[21434]: cluster 2024-03-11T22:19:28.191597+0000 mgr.y (mgr.14601) 436 : cluster 0 pgmap v655: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:29.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:29 smithi049 bash[21434]: cluster 2024-03-11T22:19:28.445101+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-03-11T22:19:29.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:29 smithi049 bash[21434]: audit 2024-03-11T22:19:28.910644+0000 mgr.y (mgr.14601) 437 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:29.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:29 smithi049 bash[28804]: cluster 2024-03-11T22:19:28.191597+0000 mgr.y (mgr.14601) 436 : cluster 0 pgmap v655: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:29.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:29 smithi049 bash[28804]: cluster 2024-03-11T22:19:28.445101+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-03-11T22:19:29.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:29 smithi049 bash[28804]: audit 2024-03-11T22:19:28.910644+0000 mgr.y (mgr.14601) 437 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:30.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:30 smithi187 bash[23415]: audit 2024-03-11T22:19:29.455703+0000 mon.b (mon.1) 323 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:30.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:30 smithi187 bash[23415]: cluster 2024-03-11T22:19:29.458897+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-03-11T22:19:30.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:30 smithi187 bash[23415]: audit 2024-03-11T22:19:29.467612+0000 mon.a (mon.0) 2516 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:30.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:30 smithi049 bash[21434]: audit 2024-03-11T22:19:29.455703+0000 mon.b (mon.1) 323 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:30.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:30 smithi049 bash[21434]: cluster 2024-03-11T22:19:29.458897+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-03-11T22:19:30.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:30 smithi049 bash[21434]: audit 2024-03-11T22:19:29.467612+0000 mon.a (mon.0) 2516 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:30.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:30 smithi049 bash[28804]: audit 2024-03-11T22:19:29.455703+0000 mon.b (mon.1) 323 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:30.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:30 smithi049 bash[28804]: cluster 2024-03-11T22:19:29.458897+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-03-11T22:19:30.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:30 smithi049 bash[28804]: audit 2024-03-11T22:19:29.467612+0000 mon.a (mon.0) 2516 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:31.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: cluster 2024-03-11T22:19:30.192509+0000 mgr.y (mgr.14601) 438 : cluster 0 pgmap v658: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:19:31.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: audit 2024-03-11T22:19:30.462665+0000 mon.a (mon.0) 2517 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:31.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: audit 2024-03-11T22:19:30.467720+0000 mon.b (mon.1) 324 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:31.745 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: cluster 2024-03-11T22:19:30.472071+0000 mon.a (mon.0) 2518 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-03-11T22:19:31.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: audit 2024-03-11T22:19:30.556351+0000 mon.b (mon.1) 325 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:31.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: audit 2024-03-11T22:19:30.558022+0000 mon.b (mon.1) 326 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-69"}]: dispatch 2024-03-11T22:19:31.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: audit 2024-03-11T22:19:30.563527+0000 mon.a (mon.0) 2519 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:31.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:31 smithi187 bash[23415]: audit 2024-03-11T22:19:30.564967+0000 mon.a (mon.0) 2520 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-69"}]: dispatch 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: cluster 2024-03-11T22:19:30.192509+0000 mgr.y (mgr.14601) 438 : cluster 0 pgmap v658: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: audit 2024-03-11T22:19:30.462665+0000 mon.a (mon.0) 2517 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: audit 2024-03-11T22:19:30.467720+0000 mon.b (mon.1) 324 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: cluster 2024-03-11T22:19:30.472071+0000 mon.a (mon.0) 2518 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: audit 2024-03-11T22:19:30.556351+0000 mon.b (mon.1) 325 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: audit 2024-03-11T22:19:30.558022+0000 mon.b (mon.1) 326 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-69"}]: dispatch 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: audit 2024-03-11T22:19:30.563527+0000 mon.a (mon.0) 2519 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:31.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[28804]: audit 2024-03-11T22:19:30.564967+0000 mon.a (mon.0) 2520 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-69"}]: dispatch 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: cluster 2024-03-11T22:19:30.192509+0000 mgr.y (mgr.14601) 438 : cluster 0 pgmap v658: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: audit 2024-03-11T22:19:30.462665+0000 mon.a (mon.0) 2517 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: audit 2024-03-11T22:19:30.467720+0000 mon.b (mon.1) 324 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: cluster 2024-03-11T22:19:30.472071+0000 mon.a (mon.0) 2518 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: audit 2024-03-11T22:19:30.556351+0000 mon.b (mon.1) 325 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: audit 2024-03-11T22:19:30.558022+0000 mon.b (mon.1) 326 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-69"}]: dispatch 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: audit 2024-03-11T22:19:30.563527+0000 mon.a (mon.0) 2519 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:31 smithi049 bash[21434]: audit 2024-03-11T22:19:30.564967+0000 mon.a (mon.0) 2520 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-69"}]: dispatch 2024-03-11T22:19:32.744 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:32 smithi187 bash[23415]: cluster 2024-03-11T22:19:31.479783+0000 mon.a (mon.0) 2521 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-03-11T22:19:32.771 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:32 smithi049 bash[28804]: cluster 2024-03-11T22:19:31.479783+0000 mon.a (mon.0) 2521 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-03-11T22:19:32.771 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:32 smithi049 bash[21434]: cluster 2024-03-11T22:19:31.479783+0000 mon.a (mon.0) 2521 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[21434]: cluster 2024-03-11T22:19:32.193433+0000 mgr.y (mgr.14601) 439 : cluster 0 pgmap v661: 260 pgs: 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[21434]: cluster 2024-03-11T22:19:32.473411+0000 mon.a (mon.0) 2522 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[21434]: cluster 2024-03-11T22:19:32.497332+0000 mon.a (mon.0) 2523 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[21434]: audit 2024-03-11T22:19:32.501351+0000 mon.b (mon.1) 327 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[21434]: audit 2024-03-11T22:19:32.509485+0000 mon.a (mon.0) 2524 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[28804]: cluster 2024-03-11T22:19:32.193433+0000 mgr.y (mgr.14601) 439 : cluster 0 pgmap v661: 260 pgs: 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[28804]: cluster 2024-03-11T22:19:32.473411+0000 mon.a (mon.0) 2522 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:19:33.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[28804]: cluster 2024-03-11T22:19:32.497332+0000 mon.a (mon.0) 2523 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-03-11T22:19:33.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[28804]: audit 2024-03-11T22:19:32.501351+0000 mon.b (mon.1) 327 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:33.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:33 smithi049 bash[28804]: audit 2024-03-11T22:19:32.509485+0000 mon.a (mon.0) 2524 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:33.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:33 smithi187 bash[23415]: cluster 2024-03-11T22:19:32.193433+0000 mgr.y (mgr.14601) 439 : cluster 0 pgmap v661: 260 pgs: 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:19:33.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:33 smithi187 bash[23415]: cluster 2024-03-11T22:19:32.473411+0000 mon.a (mon.0) 2522 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:19:33.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:33 smithi187 bash[23415]: cluster 2024-03-11T22:19:32.497332+0000 mon.a (mon.0) 2523 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-03-11T22:19:33.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:33 smithi187 bash[23415]: audit 2024-03-11T22:19:32.501351+0000 mon.b (mon.1) 327 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:33.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:33 smithi187 bash[23415]: audit 2024-03-11T22:19:32.509485+0000 mon.a (mon.0) 2524 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:34.512 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:19:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[21434]: audit 2024-03-11T22:19:33.491461+0000 mon.a (mon.0) 2525 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[21434]: audit 2024-03-11T22:19:33.497144+0000 mon.b (mon.1) 328 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[21434]: cluster 2024-03-11T22:19:33.499474+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[21434]: audit 2024-03-11T22:19:33.532442+0000 mon.b (mon.1) 329 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[21434]: audit 2024-03-11T22:19:33.542818+0000 mon.a (mon.0) 2527 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[28804]: audit 2024-03-11T22:19:33.491461+0000 mon.a (mon.0) 2525 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[28804]: audit 2024-03-11T22:19:33.497144+0000 mon.b (mon.1) 328 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[28804]: cluster 2024-03-11T22:19:33.499474+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[28804]: audit 2024-03-11T22:19:33.532442+0000 mon.b (mon.1) 329 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:34.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:34 smithi049 bash[28804]: audit 2024-03-11T22:19:33.542818+0000 mon.a (mon.0) 2527 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:34.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:34 smithi187 bash[23415]: audit 2024-03-11T22:19:33.491461+0000 mon.a (mon.0) 2525 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:34.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:34 smithi187 bash[23415]: audit 2024-03-11T22:19:33.497144+0000 mon.b (mon.1) 328 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:34.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:34 smithi187 bash[23415]: cluster 2024-03-11T22:19:33.499474+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-03-11T22:19:34.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:34 smithi187 bash[23415]: audit 2024-03-11T22:19:33.532442+0000 mon.b (mon.1) 329 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:34.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:34 smithi187 bash[23415]: audit 2024-03-11T22:19:33.542818+0000 mon.a (mon.0) 2527 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:19:35.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:35 smithi187 bash[23415]: cluster 2024-03-11T22:19:34.196080+0000 mgr.y (mgr.14601) 440 : cluster 0 pgmap v664: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:19:35.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:35 smithi187 bash[23415]: audit 2024-03-11T22:19:34.519106+0000 mon.a (mon.0) 2528 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:19:35.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:35 smithi187 bash[23415]: cluster 2024-03-11T22:19:34.528176+0000 mon.a (mon.0) 2529 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-03-11T22:19:36.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:35 smithi049 bash[21434]: cluster 2024-03-11T22:19:34.196080+0000 mgr.y (mgr.14601) 440 : cluster 0 pgmap v664: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:19:36.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:35 smithi049 bash[21434]: audit 2024-03-11T22:19:34.519106+0000 mon.a (mon.0) 2528 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:19:36.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:35 smithi049 bash[21434]: cluster 2024-03-11T22:19:34.528176+0000 mon.a (mon.0) 2529 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-03-11T22:19:36.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:35 smithi049 bash[28804]: cluster 2024-03-11T22:19:34.196080+0000 mgr.y (mgr.14601) 440 : cluster 0 pgmap v664: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:19:36.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:35 smithi049 bash[28804]: audit 2024-03-11T22:19:34.519106+0000 mon.a (mon.0) 2528 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:19:36.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:35 smithi049 bash[28804]: cluster 2024-03-11T22:19:34.528176+0000 mon.a (mon.0) 2529 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-03-11T22:19:36.994 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:36 smithi187 bash[23415]: cluster 2024-03-11T22:19:35.528132+0000 mon.a (mon.0) 2530 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-03-11T22:19:37.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:36 smithi049 bash[21434]: cluster 2024-03-11T22:19:35.528132+0000 mon.a (mon.0) 2530 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-03-11T22:19:37.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:36 smithi049 bash[28804]: cluster 2024-03-11T22:19:35.528132+0000 mon.a (mon.0) 2530 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-03-11T22:19:37.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:37 smithi187 bash[23415]: cluster 2024-03-11T22:19:36.197027+0000 mgr.y (mgr.14601) 441 : cluster 0 pgmap v667: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:19:38.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:37 smithi049 bash[21434]: cluster 2024-03-11T22:19:36.197027+0000 mgr.y (mgr.14601) 441 : cluster 0 pgmap v667: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:19:38.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:37 smithi049 bash[28804]: cluster 2024-03-11T22:19:36.197027+0000 mgr.y (mgr.14601) 441 : cluster 0 pgmap v667: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:19:39.245 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:19:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:19:39.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:39 smithi187 bash[23415]: cluster 2024-03-11T22:19:38.197917+0000 mgr.y (mgr.14601) 442 : cluster 0 pgmap v668: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 538 B/s wr, 1 op/s 2024-03-11T22:19:39.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:39 smithi187 bash[23415]: audit 2024-03-11T22:19:38.921971+0000 mgr.y (mgr.14601) 443 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:40.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:39 smithi049 bash[21434]: cluster 2024-03-11T22:19:38.197917+0000 mgr.y (mgr.14601) 442 : cluster 0 pgmap v668: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 538 B/s wr, 1 op/s 2024-03-11T22:19:40.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:39 smithi049 bash[21434]: audit 2024-03-11T22:19:38.921971+0000 mgr.y (mgr.14601) 443 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:40.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:39 smithi049 bash[28804]: cluster 2024-03-11T22:19:38.197917+0000 mgr.y (mgr.14601) 442 : cluster 0 pgmap v668: 292 pgs: 6 creating+activating, 4 creating+peering, 282 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 538 B/s wr, 1 op/s 2024-03-11T22:19:40.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:39 smithi049 bash[28804]: audit 2024-03-11T22:19:38.921971+0000 mgr.y (mgr.14601) 443 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:41.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:41 smithi187 bash[23415]: cluster 2024-03-11T22:19:40.200684+0000 mgr.y (mgr.14601) 444 : cluster 0 pgmap v669: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-03-11T22:19:41.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:41 smithi187 bash[23415]: audit 2024-03-11T22:19:40.678070+0000 mon.c (mon.2) 578 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:42.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:41 smithi049 bash[21434]: cluster 2024-03-11T22:19:40.200684+0000 mgr.y (mgr.14601) 444 : cluster 0 pgmap v669: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-03-11T22:19:42.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:41 smithi049 bash[21434]: audit 2024-03-11T22:19:40.678070+0000 mon.c (mon.2) 578 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:42.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:41 smithi049 bash[28804]: cluster 2024-03-11T22:19:40.200684+0000 mgr.y (mgr.14601) 444 : cluster 0 pgmap v669: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-03-11T22:19:42.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:41 smithi049 bash[28804]: audit 2024-03-11T22:19:40.678070+0000 mon.c (mon.2) 578 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:43.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:43 smithi187 bash[23415]: cluster 2024-03-11T22:19:42.201662+0000 mgr.y (mgr.14601) 445 : cluster 0 pgmap v670: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-03-11T22:19:44.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:43 smithi049 bash[21434]: cluster 2024-03-11T22:19:42.201662+0000 mgr.y (mgr.14601) 445 : cluster 0 pgmap v670: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-03-11T22:19:44.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:43 smithi049 bash[28804]: cluster 2024-03-11T22:19:42.201662+0000 mgr.y (mgr.14601) 445 : cluster 0 pgmap v670: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-03-11T22:19:44.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:19:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:19:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:19:45.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:45 smithi187 bash[23415]: cluster 2024-03-11T22:19:44.204378+0000 mgr.y (mgr.14601) 446 : cluster 0 pgmap v671: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-11T22:19:46.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:45 smithi049 bash[21434]: cluster 2024-03-11T22:19:44.204378+0000 mgr.y (mgr.14601) 446 : cluster 0 pgmap v671: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-11T22:19:46.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:45 smithi049 bash[28804]: cluster 2024-03-11T22:19:44.204378+0000 mgr.y (mgr.14601) 446 : cluster 0 pgmap v671: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-11T22:19:47.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:47 smithi187 bash[23415]: cluster 2024-03-11T22:19:46.205303+0000 mgr.y (mgr.14601) 447 : cluster 0 pgmap v672: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:19:48.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:47 smithi049 bash[21434]: cluster 2024-03-11T22:19:46.205303+0000 mgr.y (mgr.14601) 447 : cluster 0 pgmap v672: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:19:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:47 smithi049 bash[28804]: cluster 2024-03-11T22:19:46.205303+0000 mgr.y (mgr.14601) 447 : cluster 0 pgmap v672: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:19:49.245 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:19:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:19:49.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:49 smithi187 bash[23415]: cluster 2024-03-11T22:19:48.206147+0000 mgr.y (mgr.14601) 448 : cluster 0 pgmap v673: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-11T22:19:49.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:49 smithi187 bash[23415]: audit 2024-03-11T22:19:48.932666+0000 mgr.y (mgr.14601) 449 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:50.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:49 smithi049 bash[21434]: cluster 2024-03-11T22:19:48.206147+0000 mgr.y (mgr.14601) 448 : cluster 0 pgmap v673: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-11T22:19:50.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:49 smithi049 bash[21434]: audit 2024-03-11T22:19:48.932666+0000 mgr.y (mgr.14601) 449 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:50.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:49 smithi049 bash[28804]: cluster 2024-03-11T22:19:48.206147+0000 mgr.y (mgr.14601) 448 : cluster 0 pgmap v673: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-11T22:19:50.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:49 smithi049 bash[28804]: audit 2024-03-11T22:19:48.932666+0000 mgr.y (mgr.14601) 449 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:19:51.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:51 smithi187 bash[23415]: cluster 2024-03-11T22:19:50.208860+0000 mgr.y (mgr.14601) 450 : cluster 0 pgmap v674: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-03-11T22:19:52.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:51 smithi049 bash[21434]: cluster 2024-03-11T22:19:50.208860+0000 mgr.y (mgr.14601) 450 : cluster 0 pgmap v674: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-03-11T22:19:52.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:51 smithi049 bash[28804]: cluster 2024-03-11T22:19:50.208860+0000 mgr.y (mgr.14601) 450 : cluster 0 pgmap v674: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-03-11T22:19:53.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:53 smithi187 bash[23415]: cluster 2024-03-11T22:19:52.209797+0000 mgr.y (mgr.14601) 451 : cluster 0 pgmap v675: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:54.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:53 smithi049 bash[21434]: cluster 2024-03-11T22:19:52.209797+0000 mgr.y (mgr.14601) 451 : cluster 0 pgmap v675: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:54.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:53 smithi049 bash[28804]: cluster 2024-03-11T22:19:52.209797+0000 mgr.y (mgr.14601) 451 : cluster 0 pgmap v675: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:54.521 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:19:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:19:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:19:55.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:55 smithi187 bash[23415]: cluster 2024-03-11T22:19:54.212485+0000 mgr.y (mgr.14601) 452 : cluster 0 pgmap v676: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:56.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:55 smithi049 bash[21434]: cluster 2024-03-11T22:19:54.212485+0000 mgr.y (mgr.14601) 452 : cluster 0 pgmap v676: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:56.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:55 smithi049 bash[28804]: cluster 2024-03-11T22:19:54.212485+0000 mgr.y (mgr.14601) 452 : cluster 0 pgmap v676: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:56.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:56 smithi187 bash[23415]: audit 2024-03-11T22:19:55.637964+0000 mon.b (mon.1) 330 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:56.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:56 smithi187 bash[23415]: audit 2024-03-11T22:19:55.639848+0000 mon.b (mon.1) 331 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-71"}]: dispatch 2024-03-11T22:19:56.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:56 smithi187 bash[23415]: audit 2024-03-11T22:19:55.645403+0000 mon.a (mon.0) 2531 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:56.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:56 smithi187 bash[23415]: audit 2024-03-11T22:19:55.647174+0000 mon.a (mon.0) 2532 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-71"}]: dispatch 2024-03-11T22:19:56.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:56 smithi187 bash[23415]: audit 2024-03-11T22:19:55.713072+0000 mon.c (mon.2) 579 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[21434]: audit 2024-03-11T22:19:55.637964+0000 mon.b (mon.1) 330 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[21434]: audit 2024-03-11T22:19:55.639848+0000 mon.b (mon.1) 331 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-71"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[21434]: audit 2024-03-11T22:19:55.645403+0000 mon.a (mon.0) 2531 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[21434]: audit 2024-03-11T22:19:55.647174+0000 mon.a (mon.0) 2532 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-71"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[21434]: audit 2024-03-11T22:19:55.713072+0000 mon.c (mon.2) 579 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[28804]: audit 2024-03-11T22:19:55.637964+0000 mon.b (mon.1) 330 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[28804]: audit 2024-03-11T22:19:55.639848+0000 mon.b (mon.1) 331 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-71"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[28804]: audit 2024-03-11T22:19:55.645403+0000 mon.a (mon.0) 2531 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[28804]: audit 2024-03-11T22:19:55.647174+0000 mon.a (mon.0) 2532 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-71"}]: dispatch 2024-03-11T22:19:57.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:56 smithi049 bash[28804]: audit 2024-03-11T22:19:55.713072+0000 mon.c (mon.2) 579 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:19:57.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:57 smithi187 bash[23415]: cluster 2024-03-11T22:19:56.213367+0000 mgr.y (mgr.14601) 453 : cluster 0 pgmap v677: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:57.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:57 smithi187 bash[23415]: cluster 2024-03-11T22:19:56.597593+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-03-11T22:19:58.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:57 smithi049 bash[21434]: cluster 2024-03-11T22:19:56.213367+0000 mgr.y (mgr.14601) 453 : cluster 0 pgmap v677: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:58.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:57 smithi049 bash[21434]: cluster 2024-03-11T22:19:56.597593+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-03-11T22:19:58.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:57 smithi049 bash[28804]: cluster 2024-03-11T22:19:56.213367+0000 mgr.y (mgr.14601) 453 : cluster 0 pgmap v677: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:19:58.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:57 smithi049 bash[28804]: cluster 2024-03-11T22:19:56.597593+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-03-11T22:19:58.936 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:58 smithi187 bash[23415]: audit 2024-03-11T22:19:57.602460+0000 mon.b (mon.1) 332 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:58.936 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:58 smithi187 bash[23415]: cluster 2024-03-11T22:19:57.605684+0000 mon.a (mon.0) 2534 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-03-11T22:19:58.936 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:58 smithi187 bash[23415]: audit 2024-03-11T22:19:57.614299+0000 mon.a (mon.0) 2535 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:59.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:58 smithi049 bash[21434]: audit 2024-03-11T22:19:57.602460+0000 mon.b (mon.1) 332 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:59.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:58 smithi049 bash[21434]: cluster 2024-03-11T22:19:57.605684+0000 mon.a (mon.0) 2534 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-03-11T22:19:59.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:58 smithi049 bash[21434]: audit 2024-03-11T22:19:57.614299+0000 mon.a (mon.0) 2535 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:59.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:58 smithi049 bash[28804]: audit 2024-03-11T22:19:57.602460+0000 mon.b (mon.1) 332 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:59.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:58 smithi049 bash[28804]: cluster 2024-03-11T22:19:57.605684+0000 mon.a (mon.0) 2534 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-03-11T22:19:59.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:58 smithi049 bash[28804]: audit 2024-03-11T22:19:57.614299+0000 mon.a (mon.0) 2535 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:19:59.245 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:19:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:19:59.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:59 smithi187 bash[23415]: cluster 2024-03-11T22:19:58.214257+0000 mgr.y (mgr.14601) 454 : cluster 0 pgmap v680: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:19:59.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:59 smithi187 bash[23415]: cluster 2024-03-11T22:19:58.599450+0000 mon.a (mon.0) 2536 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:19:59.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:59 smithi187 bash[23415]: audit 2024-03-11T22:19:58.610169+0000 mon.a (mon.0) 2537 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:19:59.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:59 smithi187 bash[23415]: audit 2024-03-11T22:19:58.615104+0000 mon.b (mon.1) 333 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:19:59.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:59 smithi187 bash[23415]: cluster 2024-03-11T22:19:58.619599+0000 mon.a (mon.0) 2538 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-03-11T22:19:59.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:19:59 smithi187 bash[23415]: audit 2024-03-11T22:19:58.944047+0000 mgr.y (mgr.14601) 455 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:00.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[21434]: cluster 2024-03-11T22:19:58.214257+0000 mgr.y (mgr.14601) 454 : cluster 0 pgmap v680: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:00.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[21434]: cluster 2024-03-11T22:19:58.599450+0000 mon.a (mon.0) 2536 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:00.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[21434]: audit 2024-03-11T22:19:58.610169+0000 mon.a (mon.0) 2537 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:00.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[21434]: audit 2024-03-11T22:19:58.615104+0000 mon.b (mon.1) 333 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:00.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[21434]: cluster 2024-03-11T22:19:58.619599+0000 mon.a (mon.0) 2538 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-03-11T22:20:00.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[21434]: audit 2024-03-11T22:19:58.944047+0000 mgr.y (mgr.14601) 455 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:00.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[28804]: cluster 2024-03-11T22:19:58.214257+0000 mgr.y (mgr.14601) 454 : cluster 0 pgmap v680: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:00.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[28804]: cluster 2024-03-11T22:19:58.599450+0000 mon.a (mon.0) 2536 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:00.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[28804]: audit 2024-03-11T22:19:58.610169+0000 mon.a (mon.0) 2537 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:00.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[28804]: audit 2024-03-11T22:19:58.615104+0000 mon.b (mon.1) 333 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:00.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[28804]: cluster 2024-03-11T22:19:58.619599+0000 mon.a (mon.0) 2538 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-03-11T22:20:00.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:19:59 smithi049 bash[28804]: audit 2024-03-11T22:19:58.944047+0000 mgr.y (mgr.14601) 455 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:00.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:19:59.627147+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-03-11T22:20:00.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.000183+0000 mon.a (mon.0) 2540 : cluster 3 Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-03-11T22:20:00.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.000232+0000 mon.a (mon.0) 2541 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-03-11T22:20:00.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.000253+0000 mon.a (mon.0) 2542 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-11T22:20:00.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.000269+0000 mon.a (mon.0) 2543 : cluster 3 application not enabled on pool 'ListObjectssmithi049-64810-1' 2024-03-11T22:20:00.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.000307+0000 mon.a (mon.0) 2544 : cluster 3 application not enabled on pool 'AssertExistssmithi049-65057-1' 2024-03-11T22:20:00.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.000331+0000 mon.a (mon.0) 2545 : cluster 3 application not enabled on pool 'test-rados-api-smithi049-64247-73' 2024-03-11T22:20:00.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.000355+0000 mon.a (mon.0) 2546 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:19:59.627147+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.000183+0000 mon.a (mon.0) 2540 : cluster 3 Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.000232+0000 mon.a (mon.0) 2541 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.000253+0000 mon.a (mon.0) 2542 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.000269+0000 mon.a (mon.0) 2543 : cluster 3 application not enabled on pool 'ListObjectssmithi049-64810-1' 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.000307+0000 mon.a (mon.0) 2544 : cluster 3 application not enabled on pool 'AssertExistssmithi049-65057-1' 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.000331+0000 mon.a (mon.0) 2545 : cluster 3 application not enabled on pool 'test-rados-api-smithi049-64247-73' 2024-03-11T22:20:01.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.000355+0000 mon.a (mon.0) 2546 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:19:59.627147+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.000183+0000 mon.a (mon.0) 2540 : cluster 3 Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.000232+0000 mon.a (mon.0) 2541 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.000253+0000 mon.a (mon.0) 2542 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.000269+0000 mon.a (mon.0) 2543 : cluster 3 application not enabled on pool 'ListObjectssmithi049-64810-1' 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.000307+0000 mon.a (mon.0) 2544 : cluster 3 application not enabled on pool 'AssertExistssmithi049-65057-1' 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.000331+0000 mon.a (mon.0) 2545 : cluster 3 application not enabled on pool 'test-rados-api-smithi049-64247-73' 2024-03-11T22:20:01.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.000355+0000 mon.a (mon.0) 2546 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-11T22:20:01.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:01 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.215081+0000 mgr.y (mgr.14601) 456 : cluster 0 pgmap v683: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:01.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:01 smithi187 bash[23415]: cluster 2024-03-11T22:20:00.629762+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-03-11T22:20:02.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:01 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.215081+0000 mgr.y (mgr.14601) 456 : cluster 0 pgmap v683: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:02.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:01 smithi049 bash[21434]: cluster 2024-03-11T22:20:00.629762+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-03-11T22:20:02.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:01 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.215081+0000 mgr.y (mgr.14601) 456 : cluster 0 pgmap v683: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:02.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:01 smithi049 bash[28804]: cluster 2024-03-11T22:20:00.629762+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-03-11T22:20:03.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:03 smithi187 bash[23415]: cluster 2024-03-11T22:20:02.215982+0000 mgr.y (mgr.14601) 457 : cluster 0 pgmap v685: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:20:04.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:03 smithi049 bash[21434]: cluster 2024-03-11T22:20:02.215982+0000 mgr.y (mgr.14601) 457 : cluster 0 pgmap v685: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:20:04.059 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:03 smithi049 bash[28804]: cluster 2024-03-11T22:20:02.215982+0000 mgr.y (mgr.14601) 457 : cluster 0 pgmap v685: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:20:04.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:20:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:20:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:20:05.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:05 smithi187 bash[23415]: cluster 2024-03-11T22:20:04.218816+0000 mgr.y (mgr.14601) 458 : cluster 0 pgmap v686: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-11T22:20:05.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:05 smithi187 bash[23415]: cluster 2024-03-11T22:20:05.437321+0000 mon.a (mon.0) 2548 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:06.021 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:05 smithi049 bash[28804]: cluster 2024-03-11T22:20:04.218816+0000 mgr.y (mgr.14601) 458 : cluster 0 pgmap v686: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-11T22:20:06.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:05 smithi049 bash[28804]: cluster 2024-03-11T22:20:05.437321+0000 mon.a (mon.0) 2548 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:06.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:05 smithi049 bash[21434]: cluster 2024-03-11T22:20:04.218816+0000 mgr.y (mgr.14601) 458 : cluster 0 pgmap v686: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-11T22:20:06.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:05 smithi049 bash[21434]: cluster 2024-03-11T22:20:05.437321+0000 mon.a (mon.0) 2548 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:07.995 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:07 smithi187 bash[23415]: cluster 2024-03-11T22:20:06.219846+0000 mgr.y (mgr.14601) 459 : cluster 0 pgmap v687: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 942 B/s wr, 3 op/s 2024-03-11T22:20:08.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:07 smithi049 bash[21434]: cluster 2024-03-11T22:20:06.219846+0000 mgr.y (mgr.14601) 459 : cluster 0 pgmap v687: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 942 B/s wr, 3 op/s 2024-03-11T22:20:08.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:07 smithi049 bash[28804]: cluster 2024-03-11T22:20:06.219846+0000 mgr.y (mgr.14601) 459 : cluster 0 pgmap v687: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 942 B/s wr, 3 op/s 2024-03-11T22:20:08.947 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:08 smithi187 bash[23415]: audit 2024-03-11T22:20:08.273712+0000 mon.c (mon.2) 580 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:20:09.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:08 smithi049 bash[21434]: audit 2024-03-11T22:20:08.273712+0000 mon.c (mon.2) 580 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:20:09.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:08 smithi049 bash[28804]: audit 2024-03-11T22:20:08.273712+0000 mon.c (mon.2) 580 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:20:09.245 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:20:08 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: cluster 2024-03-11T22:20:08.220885+0000 mgr.y (mgr.14601) 460 : cluster 0 pgmap v688: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 833 B/s wr, 3 op/s 2024-03-11T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.802465+0000 mon.a (mon.0) 2549 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.812438+0000 mon.a (mon.0) 2550 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.951334+0000 mon.c (mon.2) 581 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.951985+0000 mon.a (mon.0) 2551 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.953910+0000 mon.c (mon.2) 582 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.954380+0000 mon.a (mon.0) 2552 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.955299+0000 mgr.y (mgr.14601) 461 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.956618+0000 mon.c (mon.2) 583 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.957006+0000 mon.a (mon.0) 2553 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.958838+0000 mon.c (mon.2) 584 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.959214+0000 mon.a (mon.0) 2554 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: cephadm 2024-03-11T22:20:08.960973+0000 mgr.y (mgr.14601) 462 : cephadm 1 Adjusting osd_memory_target on smithi187 to 3292M 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:08.968371+0000 mon.a (mon.0) 2555 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.547749+0000 mon.c (mon.2) 585 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.548475+0000 mon.a (mon.0) 2556 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.550468+0000 mon.c (mon.2) 586 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.551200+0000 mon.a (mon.0) 2557 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.553100+0000 mon.c (mon.2) 587 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.553821+0000 mon.a (mon.0) 2558 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.555694+0000 mon.c (mon.2) 588 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.556323+0000 mon.a (mon.0) 2559 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.564881+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.571620+0000 mon.c (mon.2) 589 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.573279+0000 mon.c (mon.2) 590 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:20:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:09 smithi187 bash[23415]: audit 2024-03-11T22:20:09.585936+0000 mon.a (mon.0) 2561 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: cluster 2024-03-11T22:20:08.220885+0000 mgr.y (mgr.14601) 460 : cluster 0 pgmap v688: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 833 B/s wr, 3 op/s 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.802465+0000 mon.a (mon.0) 2549 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.812438+0000 mon.a (mon.0) 2550 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.951334+0000 mon.c (mon.2) 581 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.951985+0000 mon.a (mon.0) 2551 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.953910+0000 mon.c (mon.2) 582 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.954380+0000 mon.a (mon.0) 2552 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.955299+0000 mgr.y (mgr.14601) 461 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:10.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.956618+0000 mon.c (mon.2) 583 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.957006+0000 mon.a (mon.0) 2553 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.958838+0000 mon.c (mon.2) 584 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.959214+0000 mon.a (mon.0) 2554 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: cephadm 2024-03-11T22:20:08.960973+0000 mgr.y (mgr.14601) 462 : cephadm 1 Adjusting osd_memory_target on smithi187 to 3292M 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:08.968371+0000 mon.a (mon.0) 2555 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.547749+0000 mon.c (mon.2) 585 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.548475+0000 mon.a (mon.0) 2556 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.550468+0000 mon.c (mon.2) 586 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.551200+0000 mon.a (mon.0) 2557 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: cluster 2024-03-11T22:20:08.220885+0000 mgr.y (mgr.14601) 460 : cluster 0 pgmap v688: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 833 B/s wr, 3 op/s 2024-03-11T22:20:10.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.802465+0000 mon.a (mon.0) 2549 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.812438+0000 mon.a (mon.0) 2550 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.951334+0000 mon.c (mon.2) 581 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.951985+0000 mon.a (mon.0) 2551 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.953910+0000 mon.c (mon.2) 582 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.954380+0000 mon.a (mon.0) 2552 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.955299+0000 mgr.y (mgr.14601) 461 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.956618+0000 mon.c (mon.2) 583 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.957006+0000 mon.a (mon.0) 2553 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.958838+0000 mon.c (mon.2) 584 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.959214+0000 mon.a (mon.0) 2554 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: cephadm 2024-03-11T22:20:08.960973+0000 mgr.y (mgr.14601) 462 : cephadm 1 Adjusting osd_memory_target on smithi187 to 3292M 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:08.968371+0000 mon.a (mon.0) 2555 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.547749+0000 mon.c (mon.2) 585 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.548475+0000 mon.a (mon.0) 2556 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.550468+0000 mon.c (mon.2) 586 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.551200+0000 mon.a (mon.0) 2557 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.553100+0000 mon.c (mon.2) 587 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.553821+0000 mon.a (mon.0) 2558 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.555694+0000 mon.c (mon.2) 588 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.556323+0000 mon.a (mon.0) 2559 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.564881+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.571620+0000 mon.c (mon.2) 589 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.573279+0000 mon.c (mon.2) 590 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[21434]: audit 2024-03-11T22:20:09.585936+0000 mon.a (mon.0) 2561 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.553100+0000 mon.c (mon.2) 587 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.553821+0000 mon.a (mon.0) 2558 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.555694+0000 mon.c (mon.2) 588 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.556323+0000 mon.a (mon.0) 2559 : audit 1 from='mgr.14601 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-11T22:20:10.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.564881+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:10.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.571620+0000 mon.c (mon.2) 589 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:20:10.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.573279+0000 mon.c (mon.2) 590 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:20:10.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:09 smithi049 bash[28804]: audit 2024-03-11T22:20:09.585936+0000 mon.a (mon.0) 2561 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:20:11.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:10 smithi187 bash[23415]: cephadm 2024-03-11T22:20:09.557855+0000 mgr.y (mgr.14601) 463 : cephadm 1 Adjusting osd_memory_target on smithi049 to 3292M 2024-03-11T22:20:11.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:10 smithi187 bash[23415]: audit 2024-03-11T22:20:10.739665+0000 mon.b (mon.1) 334 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:11.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:10 smithi187 bash[23415]: audit 2024-03-11T22:20:10.742116+0000 mon.b (mon.1) 335 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-73"}]: dispatch 2024-03-11T22:20:11.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:10 smithi187 bash[23415]: audit 2024-03-11T22:20:10.747393+0000 mon.a (mon.0) 2562 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:11.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:10 smithi187 bash[23415]: audit 2024-03-11T22:20:10.747877+0000 mon.c (mon.2) 591 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:11.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:10 smithi187 bash[23415]: audit 2024-03-11T22:20:10.749748+0000 mon.a (mon.0) 2563 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-73"}]: dispatch 2024-03-11T22:20:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[21434]: cephadm 2024-03-11T22:20:09.557855+0000 mgr.y (mgr.14601) 463 : cephadm 1 Adjusting osd_memory_target on smithi049 to 3292M 2024-03-11T22:20:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[21434]: audit 2024-03-11T22:20:10.739665+0000 mon.b (mon.1) 334 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[21434]: audit 2024-03-11T22:20:10.742116+0000 mon.b (mon.1) 335 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-73"}]: dispatch 2024-03-11T22:20:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[21434]: audit 2024-03-11T22:20:10.747393+0000 mon.a (mon.0) 2562 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:11.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[21434]: audit 2024-03-11T22:20:10.747877+0000 mon.c (mon.2) 591 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:11.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[21434]: audit 2024-03-11T22:20:10.749748+0000 mon.a (mon.0) 2563 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-73"}]: dispatch 2024-03-11T22:20:11.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[28804]: cephadm 2024-03-11T22:20:09.557855+0000 mgr.y (mgr.14601) 463 : cephadm 1 Adjusting osd_memory_target on smithi049 to 3292M 2024-03-11T22:20:11.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[28804]: audit 2024-03-11T22:20:10.739665+0000 mon.b (mon.1) 334 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:11.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[28804]: audit 2024-03-11T22:20:10.742116+0000 mon.b (mon.1) 335 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-73"}]: dispatch 2024-03-11T22:20:11.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[28804]: audit 2024-03-11T22:20:10.747393+0000 mon.a (mon.0) 2562 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:11.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[28804]: audit 2024-03-11T22:20:10.747877+0000 mon.c (mon.2) 591 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:11.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:10 smithi049 bash[28804]: audit 2024-03-11T22:20:10.749748+0000 mon.a (mon.0) 2563 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-73"}]: dispatch 2024-03-11T22:20:12.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:11 smithi187 bash[23415]: cluster 2024-03-11T22:20:10.223674+0000 mgr.y (mgr.14601) 464 : cluster 0 pgmap v689: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-03-11T22:20:12.271 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:11 smithi049 bash[21434]: cluster 2024-03-11T22:20:10.223674+0000 mgr.y (mgr.14601) 464 : cluster 0 pgmap v689: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-03-11T22:20:12.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:11 smithi049 bash[28804]: cluster 2024-03-11T22:20:10.223674+0000 mgr.y (mgr.14601) 464 : cluster 0 pgmap v689: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-03-11T22:20:13.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:12 smithi187 bash[23415]: cluster 2024-03-11T22:20:11.828401+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-03-11T22:20:13.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:12 smithi049 bash[21434]: cluster 2024-03-11T22:20:11.828401+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-03-11T22:20:13.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:12 smithi049 bash[28804]: cluster 2024-03-11T22:20:11.828401+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-03-11T22:20:14.227 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[21434]: cluster 2024-03-11T22:20:12.224444+0000 mgr.y (mgr.14601) 465 : cluster 0 pgmap v691: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 306 B/s wr, 1 op/s 2024-03-11T22:20:14.228 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[21434]: cluster 2024-03-11T22:20:12.843664+0000 mon.a (mon.0) 2565 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-03-11T22:20:14.228 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[21434]: audit 2024-03-11T22:20:12.845060+0000 mon.b (mon.1) 336 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:14.228 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[21434]: audit 2024-03-11T22:20:12.853536+0000 mon.a (mon.0) 2566 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:14.228 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[28804]: cluster 2024-03-11T22:20:12.224444+0000 mgr.y (mgr.14601) 465 : cluster 0 pgmap v691: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 306 B/s wr, 1 op/s 2024-03-11T22:20:14.228 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[28804]: cluster 2024-03-11T22:20:12.843664+0000 mon.a (mon.0) 2565 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-03-11T22:20:14.228 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[28804]: audit 2024-03-11T22:20:12.845060+0000 mon.b (mon.1) 336 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:14.228 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:13 smithi049 bash[28804]: audit 2024-03-11T22:20:12.853536+0000 mon.a (mon.0) 2566 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:14.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:13 smithi187 bash[23415]: cluster 2024-03-11T22:20:12.224444+0000 mgr.y (mgr.14601) 465 : cluster 0 pgmap v691: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 306 B/s wr, 1 op/s 2024-03-11T22:20:14.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:13 smithi187 bash[23415]: cluster 2024-03-11T22:20:12.843664+0000 mon.a (mon.0) 2565 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-03-11T22:20:14.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:13 smithi187 bash[23415]: audit 2024-03-11T22:20:12.845060+0000 mon.b (mon.1) 336 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:14.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:13 smithi187 bash[23415]: audit 2024-03-11T22:20:12.853536+0000 mon.a (mon.0) 2566 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:14.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:20:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:20:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:20:15.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:14 smithi187 bash[23415]: audit 2024-03-11T22:20:13.837522+0000 mon.a (mon.0) 2567 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:14 smithi187 bash[23415]: cluster 2024-03-11T22:20:13.844705+0000 mon.a (mon.0) 2568 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-03-11T22:20:15.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:14 smithi187 bash[23415]: audit 2024-03-11T22:20:13.872007+0000 mon.b (mon.1) 337 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:15.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:14 smithi049 bash[21434]: audit 2024-03-11T22:20:13.837522+0000 mon.a (mon.0) 2567 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:15.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:14 smithi049 bash[21434]: cluster 2024-03-11T22:20:13.844705+0000 mon.a (mon.0) 2568 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-03-11T22:20:15.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:14 smithi049 bash[21434]: audit 2024-03-11T22:20:13.872007+0000 mon.b (mon.1) 337 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:15.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:14 smithi049 bash[28804]: audit 2024-03-11T22:20:13.837522+0000 mon.a (mon.0) 2567 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:15.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:14 smithi049 bash[28804]: cluster 2024-03-11T22:20:13.844705+0000 mon.a (mon.0) 2568 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-03-11T22:20:15.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:14 smithi049 bash[28804]: audit 2024-03-11T22:20:13.872007+0000 mon.b (mon.1) 337 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:16.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:15 smithi187 bash[23415]: cluster 2024-03-11T22:20:14.225412+0000 mgr.y (mgr.14601) 466 : cluster 0 pgmap v694: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:16.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:15 smithi187 bash[23415]: cluster 2024-03-11T22:20:14.883246+0000 mon.a (mon.0) 2569 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-03-11T22:20:16.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:15 smithi049 bash[21434]: cluster 2024-03-11T22:20:14.225412+0000 mgr.y (mgr.14601) 466 : cluster 0 pgmap v694: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:16.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:15 smithi049 bash[21434]: cluster 2024-03-11T22:20:14.883246+0000 mon.a (mon.0) 2569 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-03-11T22:20:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:15 smithi049 bash[28804]: cluster 2024-03-11T22:20:14.225412+0000 mgr.y (mgr.14601) 466 : cluster 0 pgmap v694: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:15 smithi049 bash[28804]: cluster 2024-03-11T22:20:14.883246+0000 mon.a (mon.0) 2569 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-03-11T22:20:17.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:16 smithi187 bash[23415]: cluster 2024-03-11T22:20:15.884568+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-03-11T22:20:17.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:16 smithi187 bash[23415]: audit 2024-03-11T22:20:16.002160+0000 mon.b (mon.1) 338 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:17.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:16 smithi187 bash[23415]: audit 2024-03-11T22:20:16.004589+0000 mon.b (mon.1) 339 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-75"}]: dispatch 2024-03-11T22:20:17.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:16 smithi187 bash[23415]: audit 2024-03-11T22:20:16.009933+0000 mon.a (mon.0) 2571 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:17.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:16 smithi187 bash[23415]: audit 2024-03-11T22:20:16.012189+0000 mon.a (mon.0) 2572 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-75"}]: dispatch 2024-03-11T22:20:17.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[21434]: cluster 2024-03-11T22:20:15.884568+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-03-11T22:20:17.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[21434]: audit 2024-03-11T22:20:16.002160+0000 mon.b (mon.1) 338 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:17.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[21434]: audit 2024-03-11T22:20:16.004589+0000 mon.b (mon.1) 339 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-75"}]: dispatch 2024-03-11T22:20:17.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[21434]: audit 2024-03-11T22:20:16.009933+0000 mon.a (mon.0) 2571 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:17.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[21434]: audit 2024-03-11T22:20:16.012189+0000 mon.a (mon.0) 2572 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-75"}]: dispatch 2024-03-11T22:20:17.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[28804]: cluster 2024-03-11T22:20:15.884568+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-03-11T22:20:17.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[28804]: audit 2024-03-11T22:20:16.002160+0000 mon.b (mon.1) 338 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:17.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[28804]: audit 2024-03-11T22:20:16.004589+0000 mon.b (mon.1) 339 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-75"}]: dispatch 2024-03-11T22:20:17.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[28804]: audit 2024-03-11T22:20:16.009933+0000 mon.a (mon.0) 2571 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:17.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:16 smithi049 bash[28804]: audit 2024-03-11T22:20:16.012189+0000 mon.a (mon.0) 2572 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-75"}]: dispatch 2024-03-11T22:20:18.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:17 smithi187 bash[23415]: cluster 2024-03-11T22:20:16.226265+0000 mgr.y (mgr.14601) 467 : cluster 0 pgmap v697: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:20:18.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:17 smithi187 bash[23415]: cluster 2024-03-11T22:20:16.908322+0000 mon.a (mon.0) 2573 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-03-11T22:20:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:17 smithi049 bash[21434]: cluster 2024-03-11T22:20:16.226265+0000 mgr.y (mgr.14601) 467 : cluster 0 pgmap v697: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:20:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:17 smithi049 bash[21434]: cluster 2024-03-11T22:20:16.908322+0000 mon.a (mon.0) 2573 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-03-11T22:20:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:17 smithi049 bash[28804]: cluster 2024-03-11T22:20:16.226265+0000 mgr.y (mgr.14601) 467 : cluster 0 pgmap v697: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:20:18.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:17 smithi049 bash[28804]: cluster 2024-03-11T22:20:16.908322+0000 mon.a (mon.0) 2573 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-03-11T22:20:19.245 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:20:18 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:20:19.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:18 smithi187 bash[23415]: audit 2024-03-11T22:20:17.915628+0000 mon.b (mon.1) 340 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:19.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:18 smithi187 bash[23415]: cluster 2024-03-11T22:20:17.919688+0000 mon.a (mon.0) 2574 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-03-11T22:20:19.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:18 smithi187 bash[23415]: audit 2024-03-11T22:20:17.924750+0000 mon.a (mon.0) 2575 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:19.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:18 smithi049 bash[21434]: audit 2024-03-11T22:20:17.915628+0000 mon.b (mon.1) 340 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:19.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:18 smithi049 bash[21434]: cluster 2024-03-11T22:20:17.919688+0000 mon.a (mon.0) 2574 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-03-11T22:20:19.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:18 smithi049 bash[21434]: audit 2024-03-11T22:20:17.924750+0000 mon.a (mon.0) 2575 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:19.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:18 smithi049 bash[28804]: audit 2024-03-11T22:20:17.915628+0000 mon.b (mon.1) 340 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:19.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:18 smithi049 bash[28804]: cluster 2024-03-11T22:20:17.919688+0000 mon.a (mon.0) 2574 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-03-11T22:20:19.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:18 smithi049 bash[28804]: audit 2024-03-11T22:20:17.924750+0000 mon.a (mon.0) 2575 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:20.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:19 smithi187 bash[23415]: cluster 2024-03-11T22:20:18.227147+0000 mgr.y (mgr.14601) 468 : cluster 0 pgmap v700: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:20.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:19 smithi187 bash[23415]: cluster 2024-03-11T22:20:18.913105+0000 mon.a (mon.0) 2576 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:20.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:19 smithi187 bash[23415]: audit 2024-03-11T22:20:18.922024+0000 mon.a (mon.0) 2577 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:20.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:19 smithi187 bash[23415]: audit 2024-03-11T22:20:18.926479+0000 mon.b (mon.1) 341 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:20.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:19 smithi187 bash[23415]: cluster 2024-03-11T22:20:18.931412+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-03-11T22:20:20.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:19 smithi187 bash[23415]: audit 2024-03-11T22:20:18.965114+0000 mgr.y (mgr.14601) 469 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:20.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[21434]: cluster 2024-03-11T22:20:18.227147+0000 mgr.y (mgr.14601) 468 : cluster 0 pgmap v700: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:20.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[21434]: cluster 2024-03-11T22:20:18.913105+0000 mon.a (mon.0) 2576 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:20.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[21434]: audit 2024-03-11T22:20:18.922024+0000 mon.a (mon.0) 2577 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:20.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[21434]: audit 2024-03-11T22:20:18.926479+0000 mon.b (mon.1) 341 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:20.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[21434]: cluster 2024-03-11T22:20:18.931412+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-03-11T22:20:20.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[21434]: audit 2024-03-11T22:20:18.965114+0000 mgr.y (mgr.14601) 469 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:20.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[28804]: cluster 2024-03-11T22:20:18.227147+0000 mgr.y (mgr.14601) 468 : cluster 0 pgmap v700: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[28804]: cluster 2024-03-11T22:20:18.913105+0000 mon.a (mon.0) 2576 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[28804]: audit 2024-03-11T22:20:18.922024+0000 mon.a (mon.0) 2577 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[28804]: audit 2024-03-11T22:20:18.926479+0000 mon.b (mon.1) 341 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[28804]: cluster 2024-03-11T22:20:18.931412+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-03-11T22:20:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:19 smithi049 bash[28804]: audit 2024-03-11T22:20:18.965114+0000 mgr.y (mgr.14601) 469 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:21.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:20 smithi187 bash[23415]: cluster 2024-03-11T22:20:19.939639+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-03-11T22:20:21.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:20 smithi187 bash[23415]: audit 2024-03-11T22:20:20.049503+0000 mon.b (mon.1) 342 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:21.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:20 smithi187 bash[23415]: audit 2024-03-11T22:20:20.051825+0000 mon.b (mon.1) 343 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-77"}]: dispatch 2024-03-11T22:20:21.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:20 smithi187 bash[23415]: audit 2024-03-11T22:20:20.057306+0000 mon.a (mon.0) 2580 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:21.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:20 smithi187 bash[23415]: audit 2024-03-11T22:20:20.059502+0000 mon.a (mon.0) 2581 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-77"}]: dispatch 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[21434]: cluster 2024-03-11T22:20:19.939639+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[21434]: audit 2024-03-11T22:20:20.049503+0000 mon.b (mon.1) 342 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[21434]: audit 2024-03-11T22:20:20.051825+0000 mon.b (mon.1) 343 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-77"}]: dispatch 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[21434]: audit 2024-03-11T22:20:20.057306+0000 mon.a (mon.0) 2580 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[21434]: audit 2024-03-11T22:20:20.059502+0000 mon.a (mon.0) 2581 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-77"}]: dispatch 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[28804]: cluster 2024-03-11T22:20:19.939639+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[28804]: audit 2024-03-11T22:20:20.049503+0000 mon.b (mon.1) 342 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[28804]: audit 2024-03-11T22:20:20.051825+0000 mon.b (mon.1) 343 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-77"}]: dispatch 2024-03-11T22:20:21.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[28804]: audit 2024-03-11T22:20:20.057306+0000 mon.a (mon.0) 2580 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:21.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:20 smithi049 bash[28804]: audit 2024-03-11T22:20:20.059502+0000 mon.a (mon.0) 2581 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-77"}]: dispatch 2024-03-11T22:20:22.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:21 smithi187 bash[23415]: cluster 2024-03-11T22:20:20.228056+0000 mgr.y (mgr.14601) 470 : cluster 0 pgmap v703: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:20:22.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:21 smithi187 bash[23415]: cluster 2024-03-11T22:20:20.951663+0000 mon.a (mon.0) 2582 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-03-11T22:20:22.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:21 smithi049 bash[21434]: cluster 2024-03-11T22:20:20.228056+0000 mgr.y (mgr.14601) 470 : cluster 0 pgmap v703: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:20:22.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:21 smithi049 bash[21434]: cluster 2024-03-11T22:20:20.951663+0000 mon.a (mon.0) 2582 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-03-11T22:20:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:21 smithi049 bash[28804]: cluster 2024-03-11T22:20:20.228056+0000 mgr.y (mgr.14601) 470 : cluster 0 pgmap v703: 292 pgs: 32 creating+peering, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:20:22.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:21 smithi049 bash[28804]: cluster 2024-03-11T22:20:20.951663+0000 mon.a (mon.0) 2582 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-03-11T22:20:23.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:22 smithi187 bash[23415]: audit 2024-03-11T22:20:21.953120+0000 mon.b (mon.1) 344 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:23.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:22 smithi187 bash[23415]: cluster 2024-03-11T22:20:21.957133+0000 mon.a (mon.0) 2583 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-03-11T22:20:23.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:22 smithi187 bash[23415]: audit 2024-03-11T22:20:21.963960+0000 mon.a (mon.0) 2584 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:23.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:22 smithi187 bash[23415]: audit 2024-03-11T22:20:22.949698+0000 mon.a (mon.0) 2585 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:23.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:22 smithi187 bash[23415]: cluster 2024-03-11T22:20:22.957203+0000 mon.a (mon.0) 2586 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[21434]: audit 2024-03-11T22:20:21.953120+0000 mon.b (mon.1) 344 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[21434]: cluster 2024-03-11T22:20:21.957133+0000 mon.a (mon.0) 2583 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[21434]: audit 2024-03-11T22:20:21.963960+0000 mon.a (mon.0) 2584 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[21434]: audit 2024-03-11T22:20:22.949698+0000 mon.a (mon.0) 2585 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[21434]: cluster 2024-03-11T22:20:22.957203+0000 mon.a (mon.0) 2586 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[28804]: audit 2024-03-11T22:20:21.953120+0000 mon.b (mon.1) 344 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[28804]: cluster 2024-03-11T22:20:21.957133+0000 mon.a (mon.0) 2583 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-03-11T22:20:23.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[28804]: audit 2024-03-11T22:20:21.963960+0000 mon.a (mon.0) 2584 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:23.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[28804]: audit 2024-03-11T22:20:22.949698+0000 mon.a (mon.0) 2585 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:23.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:22 smithi049 bash[28804]: cluster 2024-03-11T22:20:22.957203+0000 mon.a (mon.0) 2586 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-03-11T22:20:24.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:23 smithi187 bash[23415]: cluster 2024-03-11T22:20:22.228935+0000 mgr.y (mgr.14601) 471 : cluster 0 pgmap v706: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:20:24.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:23 smithi187 bash[23415]: audit 2024-03-11T22:20:22.965262+0000 mon.b (mon.1) 345 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:23 smithi049 bash[28804]: cluster 2024-03-11T22:20:22.228935+0000 mgr.y (mgr.14601) 471 : cluster 0 pgmap v706: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:20:24.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:23 smithi049 bash[28804]: audit 2024-03-11T22:20:22.965262+0000 mon.b (mon.1) 345 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:24.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:23 smithi049 bash[21434]: cluster 2024-03-11T22:20:22.228935+0000 mgr.y (mgr.14601) 471 : cluster 0 pgmap v706: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:20:24.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:23 smithi049 bash[21434]: audit 2024-03-11T22:20:22.965262+0000 mon.b (mon.1) 345 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:24.273 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:20:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:20:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:20:25.245 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:24 smithi187 bash[23415]: cluster 2024-03-11T22:20:23.985489+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-03-11T22:20:25.271 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:25 smithi049 bash[28804]: cluster 2024-03-11T22:20:23.985489+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-03-11T22:20:25.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:24 smithi049 bash[21434]: cluster 2024-03-11T22:20:23.985489+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-03-11T22:20:26.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:25 smithi187 bash[23415]: cluster 2024-03-11T22:20:24.229811+0000 mgr.y (mgr.14601) 472 : cluster 0 pgmap v709: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:20:26.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:25 smithi187 bash[23415]: cluster 2024-03-11T22:20:24.988190+0000 mon.a (mon.0) 2588 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:26.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:25 smithi187 bash[23415]: cluster 2024-03-11T22:20:25.005549+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-03-11T22:20:26.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:25 smithi187 bash[23415]: audit 2024-03-11T22:20:25.038209+0000 mon.b (mon.1) 346 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "297.10"}]: dispatch 2024-03-11T22:20:26.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:25 smithi187 bash[23415]: audit 2024-03-11T22:20:25.045724+0000 mgr.y (mgr.14601) 473 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "297.10"}]: dispatch 2024-03-11T22:20:26.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:25 smithi187 bash[23415]: audit 2024-03-11T22:20:25.785861+0000 mon.c (mon.2) 592 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:26.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[28804]: cluster 2024-03-11T22:20:24.229811+0000 mgr.y (mgr.14601) 472 : cluster 0 pgmap v709: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:20:26.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[28804]: cluster 2024-03-11T22:20:24.988190+0000 mon.a (mon.0) 2588 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:26.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[28804]: cluster 2024-03-11T22:20:25.005549+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-03-11T22:20:26.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[28804]: audit 2024-03-11T22:20:25.038209+0000 mon.b (mon.1) 346 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "297.10"}]: dispatch 2024-03-11T22:20:26.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[28804]: audit 2024-03-11T22:20:25.045724+0000 mgr.y (mgr.14601) 473 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "297.10"}]: dispatch 2024-03-11T22:20:26.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[28804]: audit 2024-03-11T22:20:25.785861+0000 mon.c (mon.2) 592 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:26.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[21434]: cluster 2024-03-11T22:20:24.229811+0000 mgr.y (mgr.14601) 472 : cluster 0 pgmap v709: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:20:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[21434]: cluster 2024-03-11T22:20:24.988190+0000 mon.a (mon.0) 2588 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:20:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[21434]: cluster 2024-03-11T22:20:25.005549+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-03-11T22:20:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[21434]: audit 2024-03-11T22:20:25.038209+0000 mon.b (mon.1) 346 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "297.10"}]: dispatch 2024-03-11T22:20:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[21434]: audit 2024-03-11T22:20:25.045724+0000 mgr.y (mgr.14601) 473 : audit 0 from='mon.? v1:172.21.15.187:0/3556211650' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "297.10"}]: dispatch 2024-03-11T22:20:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:26 smithi049 bash[21434]: audit 2024-03-11T22:20:25.785861+0000 mon.c (mon.2) 592 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:27.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:27 smithi049 bash[21434]: cluster 2024-03-11T22:20:25.809984+0000 osd.1 (osd.1) 5 : cluster 0 297.10 deep-scrub starts 2024-03-11T22:20:27.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:27 smithi049 bash[21434]: cluster 2024-03-11T22:20:25.815134+0000 osd.1 (osd.1) 6 : cluster 0 297.10 deep-scrub ok 2024-03-11T22:20:27.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:27 smithi049 bash[28804]: cluster 2024-03-11T22:20:25.809984+0000 osd.1 (osd.1) 5 : cluster 0 297.10 deep-scrub starts 2024-03-11T22:20:27.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:27 smithi049 bash[28804]: cluster 2024-03-11T22:20:25.815134+0000 osd.1 (osd.1) 6 : cluster 0 297.10 deep-scrub ok 2024-03-11T22:20:27.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:27 smithi187 bash[23415]: cluster 2024-03-11T22:20:25.809984+0000 osd.1 (osd.1) 5 : cluster 0 297.10 deep-scrub starts 2024-03-11T22:20:27.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:27 smithi187 bash[23415]: cluster 2024-03-11T22:20:25.815134+0000 osd.1 (osd.1) 6 : cluster 0 297.10 deep-scrub ok 2024-03-11T22:20:28.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:28 smithi049 bash[28804]: cluster 2024-03-11T22:20:26.230681+0000 mgr.y (mgr.14601) 474 : cluster 0 pgmap v711: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:20:28.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:28 smithi049 bash[21434]: cluster 2024-03-11T22:20:26.230681+0000 mgr.y (mgr.14601) 474 : cluster 0 pgmap v711: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:20:28.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:28 smithi187 bash[23415]: cluster 2024-03-11T22:20:26.230681+0000 mgr.y (mgr.14601) 474 : cluster 0 pgmap v711: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-11T22:20:29.245 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:20:28 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:20:30.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:30 smithi049 bash[28804]: cluster 2024-03-11T22:20:28.231570+0000 mgr.y (mgr.14601) 475 : cluster 0 pgmap v712: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 852 B/s wr, 2 op/s 2024-03-11T22:20:30.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:30 smithi049 bash[28804]: audit 2024-03-11T22:20:28.973206+0000 mgr.y (mgr.14601) 476 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:30 smithi049 bash[21434]: cluster 2024-03-11T22:20:28.231570+0000 mgr.y (mgr.14601) 475 : cluster 0 pgmap v712: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 852 B/s wr, 2 op/s 2024-03-11T22:20:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:30 smithi049 bash[21434]: audit 2024-03-11T22:20:28.973206+0000 mgr.y (mgr.14601) 476 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:30.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:30 smithi187 bash[23415]: cluster 2024-03-11T22:20:28.231570+0000 mgr.y (mgr.14601) 475 : cluster 0 pgmap v712: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 852 B/s wr, 2 op/s 2024-03-11T22:20:30.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:30 smithi187 bash[23415]: audit 2024-03-11T22:20:28.973206+0000 mgr.y (mgr.14601) 476 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:32.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:32 smithi049 bash[28804]: cluster 2024-03-11T22:20:30.234297+0000 mgr.y (mgr.14601) 477 : cluster 0 pgmap v713: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 984 B/s wr, 3 op/s 2024-03-11T22:20:32.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:32 smithi049 bash[21434]: cluster 2024-03-11T22:20:30.234297+0000 mgr.y (mgr.14601) 477 : cluster 0 pgmap v713: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 984 B/s wr, 3 op/s 2024-03-11T22:20:32.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:32 smithi187 bash[23415]: cluster 2024-03-11T22:20:30.234297+0000 mgr.y (mgr.14601) 477 : cluster 0 pgmap v713: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 984 B/s wr, 3 op/s 2024-03-11T22:20:33.996 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:20:33 smithi187 bash[50671]: logger=cleanup t=2024-03-11T22:20:33.696115432Z level=info msg="Completed cleanup jobs" duration=80.958916ms 2024-03-11T22:20:34.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:34 smithi049 bash[21434]: cluster 2024-03-11T22:20:32.235216+0000 mgr.y (mgr.14601) 478 : cluster 0 pgmap v714: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 620 B/s rd, 248 B/s wr, 1 op/s 2024-03-11T22:20:34.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:20:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:20:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:20:34.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:34 smithi049 bash[28804]: cluster 2024-03-11T22:20:32.235216+0000 mgr.y (mgr.14601) 478 : cluster 0 pgmap v714: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 620 B/s rd, 248 B/s wr, 1 op/s 2024-03-11T22:20:34.495 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:34 smithi187 bash[23415]: cluster 2024-03-11T22:20:32.235216+0000 mgr.y (mgr.14601) 478 : cluster 0 pgmap v714: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 620 B/s rd, 248 B/s wr, 1 op/s 2024-03-11T22:20:36.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:36 smithi049 bash[21434]: cluster 2024-03-11T22:20:34.238071+0000 mgr.y (mgr.14601) 479 : cluster 0 pgmap v715: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-03-11T22:20:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:36 smithi049 bash[28804]: cluster 2024-03-11T22:20:34.238071+0000 mgr.y (mgr.14601) 479 : cluster 0 pgmap v715: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-03-11T22:20:36.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:36 smithi187 bash[23415]: cluster 2024-03-11T22:20:34.238071+0000 mgr.y (mgr.14601) 479 : cluster 0 pgmap v715: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 204 B/s wr, 1 op/s 2024-03-11T22:20:38.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:38 smithi049 bash[21434]: cluster 2024-03-11T22:20:36.239100+0000 mgr.y (mgr.14601) 480 : cluster 0 pgmap v716: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 182 B/s wr, 1 op/s 2024-03-11T22:20:38.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:38 smithi049 bash[28804]: cluster 2024-03-11T22:20:36.239100+0000 mgr.y (mgr.14601) 480 : cluster 0 pgmap v716: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 182 B/s wr, 1 op/s 2024-03-11T22:20:38.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:38 smithi187 bash[23415]: cluster 2024-03-11T22:20:36.239100+0000 mgr.y (mgr.14601) 480 : cluster 0 pgmap v716: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 911 B/s rd, 182 B/s wr, 1 op/s 2024-03-11T22:20:39.246 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:20:38 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:20:40.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:40 smithi187 bash[23415]: cluster 2024-03-11T22:20:38.240160+0000 mgr.y (mgr.14601) 481 : cluster 0 pgmap v717: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:20:40.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:40 smithi187 bash[23415]: audit 2024-03-11T22:20:38.984643+0000 mgr.y (mgr.14601) 482 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:40.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:40 smithi049 bash[28804]: cluster 2024-03-11T22:20:38.240160+0000 mgr.y (mgr.14601) 481 : cluster 0 pgmap v717: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:20:40.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:40 smithi049 bash[28804]: audit 2024-03-11T22:20:38.984643+0000 mgr.y (mgr.14601) 482 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:40.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:40 smithi049 bash[21434]: cluster 2024-03-11T22:20:38.240160+0000 mgr.y (mgr.14601) 481 : cluster 0 pgmap v717: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:20:40.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:40 smithi049 bash[21434]: audit 2024-03-11T22:20:38.984643+0000 mgr.y (mgr.14601) 482 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:41.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:41 smithi187 bash[23415]: audit 2024-03-11T22:20:40.822303+0000 mon.c (mon.2) 593 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:41.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:41 smithi049 bash[21434]: audit 2024-03-11T22:20:40.822303+0000 mon.c (mon.2) 593 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:41.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:41 smithi049 bash[28804]: audit 2024-03-11T22:20:40.822303+0000 mon.c (mon.2) 593 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:42.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:42 smithi187 bash[23415]: cluster 2024-03-11T22:20:40.242936+0000 mgr.y (mgr.14601) 483 : cluster 0 pgmap v718: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:20:42.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:42 smithi049 bash[21434]: cluster 2024-03-11T22:20:40.242936+0000 mgr.y (mgr.14601) 483 : cluster 0 pgmap v718: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:20:42.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:42 smithi049 bash[28804]: cluster 2024-03-11T22:20:40.242936+0000 mgr.y (mgr.14601) 483 : cluster 0 pgmap v718: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:20:44.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:44 smithi187 bash[23415]: cluster 2024-03-11T22:20:42.243829+0000 mgr.y (mgr.14601) 484 : cluster 0 pgmap v719: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:44.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:44 smithi049 bash[21434]: cluster 2024-03-11T22:20:42.243829+0000 mgr.y (mgr.14601) 484 : cluster 0 pgmap v719: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:44.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:20:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:20:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:20:44.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:44 smithi049 bash[28804]: cluster 2024-03-11T22:20:42.243829+0000 mgr.y (mgr.14601) 484 : cluster 0 pgmap v719: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:45.496 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:20:45 smithi187 bash[32377]: debug 2024-03-11T22:20:45.067+0000 7f0e836c5700 -1 snap_mapper.add_oid found existing snaps mapped on 297:0e3dfd47:test-rados-api-smithi049-64247-80::foo:2, removing 2024-03-11T22:20:45.522 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:20:45 smithi049 bash[37586]: debug 2024-03-11T22:20:45.075+0000 7fee1435c700 -1 snap_mapper.add_oid found existing snaps mapped on 297:0e3dfd47:test-rados-api-smithi049-64247-80::foo:2, removing 2024-03-11T22:20:45.522 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:20:45 smithi049 bash[43363]: debug 2024-03-11T22:20:45.075+0000 7fefd9963700 -1 snap_mapper.add_oid found existing snaps mapped on 297:0e3dfd47:test-rados-api-smithi049-64247-80::foo:2, removing 2024-03-11T22:20:46.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:46 smithi187 bash[23415]: cluster 2024-03-11T22:20:44.246526+0000 mgr.y (mgr.14601) 485 : cluster 0 pgmap v720: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:20:46.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:46 smithi187 bash[23415]: audit 2024-03-11T22:20:45.076206+0000 mon.b (mon.1) 347 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:46.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:46 smithi187 bash[23415]: audit 2024-03-11T22:20:45.078493+0000 mon.b (mon.1) 348 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-79"}]: dispatch 2024-03-11T22:20:46.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:46 smithi187 bash[23415]: audit 2024-03-11T22:20:45.084179+0000 mon.a (mon.0) 2590 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:46.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:46 smithi187 bash[23415]: audit 2024-03-11T22:20:45.086447+0000 mon.a (mon.0) 2591 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-79"}]: dispatch 2024-03-11T22:20:46.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[21434]: cluster 2024-03-11T22:20:44.246526+0000 mgr.y (mgr.14601) 485 : cluster 0 pgmap v720: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:20:46.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[21434]: audit 2024-03-11T22:20:45.076206+0000 mon.b (mon.1) 347 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:46.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[21434]: audit 2024-03-11T22:20:45.078493+0000 mon.b (mon.1) 348 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-79"}]: dispatch 2024-03-11T22:20:46.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[21434]: audit 2024-03-11T22:20:45.084179+0000 mon.a (mon.0) 2590 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:46.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[21434]: audit 2024-03-11T22:20:45.086447+0000 mon.a (mon.0) 2591 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-79"}]: dispatch 2024-03-11T22:20:46.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[28804]: cluster 2024-03-11T22:20:44.246526+0000 mgr.y (mgr.14601) 485 : cluster 0 pgmap v720: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:20:46.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[28804]: audit 2024-03-11T22:20:45.076206+0000 mon.b (mon.1) 347 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:46.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[28804]: audit 2024-03-11T22:20:45.078493+0000 mon.b (mon.1) 348 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-79"}]: dispatch 2024-03-11T22:20:46.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[28804]: audit 2024-03-11T22:20:45.084179+0000 mon.a (mon.0) 2590 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:46.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:46 smithi049 bash[28804]: audit 2024-03-11T22:20:45.086447+0000 mon.a (mon.0) 2591 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-79"}]: dispatch 2024-03-11T22:20:47.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:47 smithi187 bash[23415]: cluster 2024-03-11T22:20:46.070955+0000 mon.a (mon.0) 2592 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-03-11T22:20:47.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:47 smithi049 bash[21434]: cluster 2024-03-11T22:20:46.070955+0000 mon.a (mon.0) 2592 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-03-11T22:20:47.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:47 smithi049 bash[28804]: cluster 2024-03-11T22:20:46.070955+0000 mon.a (mon.0) 2592 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-03-11T22:20:48.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:48 smithi187 bash[23415]: cluster 2024-03-11T22:20:46.247504+0000 mgr.y (mgr.14601) 486 : cluster 0 pgmap v722: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:20:48.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:48 smithi187 bash[23415]: audit 2024-03-11T22:20:47.081969+0000 mon.b (mon.1) 349 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:48.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:48 smithi187 bash[23415]: cluster 2024-03-11T22:20:47.084499+0000 mon.a (mon.0) 2593 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-03-11T22:20:48.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:48 smithi187 bash[23415]: audit 2024-03-11T22:20:47.090727+0000 mon.a (mon.0) 2594 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:48.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[21434]: cluster 2024-03-11T22:20:46.247504+0000 mgr.y (mgr.14601) 486 : cluster 0 pgmap v722: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:20:48.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[21434]: audit 2024-03-11T22:20:47.081969+0000 mon.b (mon.1) 349 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:48.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[21434]: cluster 2024-03-11T22:20:47.084499+0000 mon.a (mon.0) 2593 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-03-11T22:20:48.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[21434]: audit 2024-03-11T22:20:47.090727+0000 mon.a (mon.0) 2594 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:48.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[28804]: cluster 2024-03-11T22:20:46.247504+0000 mgr.y (mgr.14601) 486 : cluster 0 pgmap v722: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:20:48.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[28804]: audit 2024-03-11T22:20:47.081969+0000 mon.b (mon.1) 349 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:48.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[28804]: cluster 2024-03-11T22:20:47.084499+0000 mon.a (mon.0) 2593 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-03-11T22:20:48.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:48 smithi049 bash[28804]: audit 2024-03-11T22:20:47.090727+0000 mon.a (mon.0) 2594 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:49.246 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:20:48 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:20:49.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:49 smithi187 bash[23415]: audit 2024-03-11T22:20:48.079465+0000 mon.a (mon.0) 2595 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:49.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:49 smithi187 bash[23415]: cluster 2024-03-11T22:20:48.087675+0000 mon.a (mon.0) 2596 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-03-11T22:20:49.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:49 smithi187 bash[23415]: audit 2024-03-11T22:20:48.110392+0000 mon.b (mon.1) 350 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:49.246 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:49 smithi187 bash[23415]: audit 2024-03-11T22:20:48.126801+0000 mon.b (mon.1) 351 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:49.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:49 smithi187 bash[23415]: audit 2024-03-11T22:20:48.134934+0000 mon.a (mon.0) 2597 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:49.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[21434]: audit 2024-03-11T22:20:48.079465+0000 mon.a (mon.0) 2595 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:49.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[21434]: cluster 2024-03-11T22:20:48.087675+0000 mon.a (mon.0) 2596 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[21434]: audit 2024-03-11T22:20:48.110392+0000 mon.b (mon.1) 350 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[21434]: audit 2024-03-11T22:20:48.126801+0000 mon.b (mon.1) 351 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[21434]: audit 2024-03-11T22:20:48.134934+0000 mon.a (mon.0) 2597 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[28804]: audit 2024-03-11T22:20:48.079465+0000 mon.a (mon.0) 2595 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[28804]: cluster 2024-03-11T22:20:48.087675+0000 mon.a (mon.0) 2596 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[28804]: audit 2024-03-11T22:20:48.110392+0000 mon.b (mon.1) 350 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[28804]: audit 2024-03-11T22:20:48.126801+0000 mon.b (mon.1) 351 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:49.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:49 smithi049 bash[28804]: audit 2024-03-11T22:20:48.134934+0000 mon.a (mon.0) 2597 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:50.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:50 smithi187 bash[23415]: cluster 2024-03-11T22:20:48.248421+0000 mgr.y (mgr.14601) 487 : cluster 0 pgmap v725: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:50.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:50 smithi187 bash[23415]: audit 2024-03-11T22:20:48.995980+0000 mgr.y (mgr.14601) 488 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:50.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:50 smithi187 bash[23415]: audit 2024-03-11T22:20:49.103178+0000 mon.a (mon.0) 2598 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:20:50.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:50 smithi187 bash[23415]: audit 2024-03-11T22:20:49.104376+0000 mon.b (mon.1) 352 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:50.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:50 smithi187 bash[23415]: cluster 2024-03-11T22:20:49.112447+0000 mon.a (mon.0) 2599 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-03-11T22:20:50.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:50 smithi187 bash[23415]: audit 2024-03-11T22:20:49.114646+0000 mon.a (mon.0) 2600 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[21434]: cluster 2024-03-11T22:20:48.248421+0000 mgr.y (mgr.14601) 487 : cluster 0 pgmap v725: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[21434]: audit 2024-03-11T22:20:48.995980+0000 mgr.y (mgr.14601) 488 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[21434]: audit 2024-03-11T22:20:49.103178+0000 mon.a (mon.0) 2598 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:20:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[21434]: audit 2024-03-11T22:20:49.104376+0000 mon.b (mon.1) 352 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[21434]: cluster 2024-03-11T22:20:49.112447+0000 mon.a (mon.0) 2599 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-03-11T22:20:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[21434]: audit 2024-03-11T22:20:49.114646+0000 mon.a (mon.0) 2600 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[28804]: cluster 2024-03-11T22:20:48.248421+0000 mgr.y (mgr.14601) 487 : cluster 0 pgmap v725: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:20:50.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[28804]: audit 2024-03-11T22:20:48.995980+0000 mgr.y (mgr.14601) 488 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:50.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[28804]: audit 2024-03-11T22:20:49.103178+0000 mon.a (mon.0) 2598 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:20:50.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[28804]: audit 2024-03-11T22:20:49.104376+0000 mon.b (mon.1) 352 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:50.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[28804]: cluster 2024-03-11T22:20:49.112447+0000 mon.a (mon.0) 2599 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-03-11T22:20:50.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:50 smithi049 bash[28804]: audit 2024-03-11T22:20:49.114646+0000 mon.a (mon.0) 2600 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:51.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:51 smithi187 bash[23415]: audit 2024-03-11T22:20:50.105617+0000 mon.a (mon.0) 2601 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:20:51.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:51 smithi187 bash[23415]: audit 2024-03-11T22:20:50.106511+0000 mon.b (mon.1) 353 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:20:51.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:51 smithi187 bash[23415]: cluster 2024-03-11T22:20:50.112699+0000 mon.a (mon.0) 2602 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-03-11T22:20:51.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:51 smithi187 bash[23415]: audit 2024-03-11T22:20:50.115248+0000 mon.a (mon.0) 2603 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:20:51.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:51 smithi187 bash[23415]: cluster 2024-03-11T22:20:50.249339+0000 mgr.y (mgr.14601) 489 : cluster 0 pgmap v728: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:20:51.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:51 smithi187 bash[23415]: audit 2024-03-11T22:20:51.108307+0000 mon.a (mon.0) 2604 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:20:51.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:51 smithi187 bash[23415]: cluster 2024-03-11T22:20:51.115063+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-03-11T22:20:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[21434]: audit 2024-03-11T22:20:50.105617+0000 mon.a (mon.0) 2601 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:20:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[21434]: audit 2024-03-11T22:20:50.106511+0000 mon.b (mon.1) 353 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:20:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[21434]: cluster 2024-03-11T22:20:50.112699+0000 mon.a (mon.0) 2602 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-03-11T22:20:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[21434]: audit 2024-03-11T22:20:50.115248+0000 mon.a (mon.0) 2603 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:20:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[21434]: cluster 2024-03-11T22:20:50.249339+0000 mgr.y (mgr.14601) 489 : cluster 0 pgmap v728: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:20:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[21434]: audit 2024-03-11T22:20:51.108307+0000 mon.a (mon.0) 2604 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:20:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[21434]: cluster 2024-03-11T22:20:51.115063+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-03-11T22:20:51.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[28804]: audit 2024-03-11T22:20:50.105617+0000 mon.a (mon.0) 2601 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:20:51.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[28804]: audit 2024-03-11T22:20:50.106511+0000 mon.b (mon.1) 353 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:20:51.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[28804]: cluster 2024-03-11T22:20:50.112699+0000 mon.a (mon.0) 2602 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-03-11T22:20:51.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[28804]: audit 2024-03-11T22:20:50.115248+0000 mon.a (mon.0) 2603 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:20:51.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[28804]: cluster 2024-03-11T22:20:50.249339+0000 mgr.y (mgr.14601) 489 : cluster 0 pgmap v728: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:20:51.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[28804]: audit 2024-03-11T22:20:51.108307+0000 mon.a (mon.0) 2604 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:20:51.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:51 smithi049 bash[28804]: cluster 2024-03-11T22:20:51.115063+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-03-11T22:20:52.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:52 smithi187 bash[23415]: audit 2024-03-11T22:20:51.110020+0000 mon.b (mon.1) 354 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:52.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:52 smithi187 bash[23415]: audit 2024-03-11T22:20:51.119299+0000 mon.a (mon.0) 2606 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:52.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:52 smithi187 bash[23415]: audit 2024-03-11T22:20:52.111176+0000 mon.a (mon.0) 2607 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:20:52.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:52 smithi187 bash[23415]: cluster 2024-03-11T22:20:52.117767+0000 mon.a (mon.0) 2608 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[21434]: audit 2024-03-11T22:20:51.110020+0000 mon.b (mon.1) 354 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[21434]: audit 2024-03-11T22:20:51.119299+0000 mon.a (mon.0) 2606 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[21434]: audit 2024-03-11T22:20:52.111176+0000 mon.a (mon.0) 2607 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[21434]: cluster 2024-03-11T22:20:52.117767+0000 mon.a (mon.0) 2608 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[28804]: audit 2024-03-11T22:20:51.110020+0000 mon.b (mon.1) 354 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[28804]: audit 2024-03-11T22:20:51.119299+0000 mon.a (mon.0) 2606 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[28804]: audit 2024-03-11T22:20:52.111176+0000 mon.a (mon.0) 2607 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:20:52.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:52 smithi049 bash[28804]: cluster 2024-03-11T22:20:52.117767+0000 mon.a (mon.0) 2608 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-03-11T22:20:53.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:53 smithi187 bash[23415]: audit 2024-03-11T22:20:52.169774+0000 mon.b (mon.1) 355 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-11T22:20:53.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:53 smithi187 bash[23415]: audit 2024-03-11T22:20:52.177979+0000 mon.a (mon.0) 2609 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-11T22:20:53.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:53 smithi187 bash[23415]: cluster 2024-03-11T22:20:52.250217+0000 mgr.y (mgr.14601) 490 : cluster 0 pgmap v731: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:20:53.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:53 smithi049 bash[21434]: audit 2024-03-11T22:20:52.169774+0000 mon.b (mon.1) 355 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-11T22:20:53.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:53 smithi049 bash[21434]: audit 2024-03-11T22:20:52.177979+0000 mon.a (mon.0) 2609 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-11T22:20:53.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:53 smithi049 bash[21434]: cluster 2024-03-11T22:20:52.250217+0000 mgr.y (mgr.14601) 490 : cluster 0 pgmap v731: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:20:53.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:53 smithi049 bash[28804]: audit 2024-03-11T22:20:52.169774+0000 mon.b (mon.1) 355 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-11T22:20:53.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:53 smithi049 bash[28804]: audit 2024-03-11T22:20:52.177979+0000 mon.a (mon.0) 2609 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-11T22:20:53.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:53 smithi049 bash[28804]: cluster 2024-03-11T22:20:52.250217+0000 mgr.y (mgr.14601) 490 : cluster 0 pgmap v731: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:20:54.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:54 smithi187 bash[23415]: audit 2024-03-11T22:20:53.140072+0000 mon.a (mon.0) 2610 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-03-11T22:20:54.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:54 smithi187 bash[23415]: cluster 2024-03-11T22:20:53.148384+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-03-11T22:20:54.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:54 smithi187 bash[23415]: audit 2024-03-11T22:20:53.189186+0000 mon.b (mon.1) 356 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-11T22:20:54.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:54 smithi187 bash[23415]: audit 2024-03-11T22:20:53.198335+0000 mon.a (mon.0) 2612 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-11T22:20:54.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:20:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:20:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[21434]: audit 2024-03-11T22:20:53.140072+0000 mon.a (mon.0) 2610 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-03-11T22:20:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[21434]: cluster 2024-03-11T22:20:53.148384+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-03-11T22:20:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[21434]: audit 2024-03-11T22:20:53.189186+0000 mon.b (mon.1) 356 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-11T22:20:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[21434]: audit 2024-03-11T22:20:53.198335+0000 mon.a (mon.0) 2612 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-11T22:20:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[28804]: audit 2024-03-11T22:20:53.140072+0000 mon.a (mon.0) 2610 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-03-11T22:20:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[28804]: cluster 2024-03-11T22:20:53.148384+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-03-11T22:20:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[28804]: audit 2024-03-11T22:20:53.189186+0000 mon.b (mon.1) 356 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-11T22:20:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:54 smithi049 bash[28804]: audit 2024-03-11T22:20:53.198335+0000 mon.a (mon.0) 2612 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-11T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:55 smithi187 bash[23415]: audit 2024-03-11T22:20:54.142641+0000 mon.a (mon.0) 2613 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-03-11T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:55 smithi187 bash[23415]: cluster 2024-03-11T22:20:54.150415+0000 mon.a (mon.0) 2614 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-03-11T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:55 smithi187 bash[23415]: audit 2024-03-11T22:20:54.173155+0000 mon.b (mon.1) 357 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:55 smithi187 bash[23415]: audit 2024-03-11T22:20:54.181462+0000 mon.a (mon.0) 2615 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:55.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:55 smithi187 bash[23415]: cluster 2024-03-11T22:20:54.251244+0000 mgr.y (mgr.14601) 491 : cluster 0 pgmap v734: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-03-11T22:20:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[21434]: audit 2024-03-11T22:20:54.142641+0000 mon.a (mon.0) 2613 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-03-11T22:20:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[21434]: cluster 2024-03-11T22:20:54.150415+0000 mon.a (mon.0) 2614 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-03-11T22:20:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[21434]: audit 2024-03-11T22:20:54.173155+0000 mon.b (mon.1) 357 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[21434]: audit 2024-03-11T22:20:54.181462+0000 mon.a (mon.0) 2615 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[21434]: cluster 2024-03-11T22:20:54.251244+0000 mgr.y (mgr.14601) 491 : cluster 0 pgmap v734: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-03-11T22:20:55.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[28804]: audit 2024-03-11T22:20:54.142641+0000 mon.a (mon.0) 2613 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-03-11T22:20:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[28804]: cluster 2024-03-11T22:20:54.150415+0000 mon.a (mon.0) 2614 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-03-11T22:20:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[28804]: audit 2024-03-11T22:20:54.173155+0000 mon.b (mon.1) 357 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[28804]: audit 2024-03-11T22:20:54.181462+0000 mon.a (mon.0) 2615 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:20:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:55 smithi049 bash[28804]: cluster 2024-03-11T22:20:54.251244+0000 mgr.y (mgr.14601) 491 : cluster 0 pgmap v734: 292 pgs: 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-03-11T22:20:56.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:56 smithi187 bash[23415]: audit 2024-03-11T22:20:55.164898+0000 mon.a (mon.0) 2616 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:20:56.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:56 smithi187 bash[23415]: cluster 2024-03-11T22:20:55.171581+0000 mon.a (mon.0) 2617 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-03-11T22:20:56.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:56 smithi187 bash[23415]: audit 2024-03-11T22:20:55.241624+0000 mon.b (mon.1) 358 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:56.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:56 smithi187 bash[23415]: audit 2024-03-11T22:20:55.243740+0000 mon.b (mon.1) 359 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-81"}]: dispatch 2024-03-11T22:20:56.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:56 smithi187 bash[23415]: audit 2024-03-11T22:20:55.249727+0000 mon.a (mon.0) 2618 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:56.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:56 smithi187 bash[23415]: audit 2024-03-11T22:20:55.251868+0000 mon.a (mon.0) 2619 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-81"}]: dispatch 2024-03-11T22:20:56.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:56 smithi187 bash[23415]: audit 2024-03-11T22:20:55.856891+0000 mon.c (mon.2) 594 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[21434]: audit 2024-03-11T22:20:55.164898+0000 mon.a (mon.0) 2616 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:20:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[21434]: cluster 2024-03-11T22:20:55.171581+0000 mon.a (mon.0) 2617 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-03-11T22:20:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[21434]: audit 2024-03-11T22:20:55.241624+0000 mon.b (mon.1) 358 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[21434]: audit 2024-03-11T22:20:55.243740+0000 mon.b (mon.1) 359 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-81"}]: dispatch 2024-03-11T22:20:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[21434]: audit 2024-03-11T22:20:55.249727+0000 mon.a (mon.0) 2618 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[21434]: audit 2024-03-11T22:20:55.251868+0000 mon.a (mon.0) 2619 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-81"}]: dispatch 2024-03-11T22:20:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[21434]: audit 2024-03-11T22:20:55.856891+0000 mon.c (mon.2) 594 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[28804]: audit 2024-03-11T22:20:55.164898+0000 mon.a (mon.0) 2616 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:20:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[28804]: cluster 2024-03-11T22:20:55.171581+0000 mon.a (mon.0) 2617 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-03-11T22:20:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[28804]: audit 2024-03-11T22:20:55.241624+0000 mon.b (mon.1) 358 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[28804]: audit 2024-03-11T22:20:55.243740+0000 mon.b (mon.1) 359 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-81"}]: dispatch 2024-03-11T22:20:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[28804]: audit 2024-03-11T22:20:55.249727+0000 mon.a (mon.0) 2618 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:20:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[28804]: audit 2024-03-11T22:20:55.251868+0000 mon.a (mon.0) 2619 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-81"}]: dispatch 2024-03-11T22:20:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:56 smithi049 bash[28804]: audit 2024-03-11T22:20:55.856891+0000 mon.c (mon.2) 594 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:20:57.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:57 smithi187 bash[23415]: cluster 2024-03-11T22:20:56.181783+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-03-11T22:20:57.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:57 smithi187 bash[23415]: cluster 2024-03-11T22:20:56.252123+0000 mgr.y (mgr.14601) 492 : cluster 0 pgmap v737: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-03-11T22:20:57.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:57 smithi049 bash[21434]: cluster 2024-03-11T22:20:56.181783+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-03-11T22:20:57.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:57 smithi049 bash[21434]: cluster 2024-03-11T22:20:56.252123+0000 mgr.y (mgr.14601) 492 : cluster 0 pgmap v737: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-03-11T22:20:57.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:57 smithi049 bash[28804]: cluster 2024-03-11T22:20:56.181783+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-03-11T22:20:57.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:57 smithi049 bash[28804]: cluster 2024-03-11T22:20:56.252123+0000 mgr.y (mgr.14601) 492 : cluster 0 pgmap v737: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-03-11T22:20:58.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:58 smithi187 bash[23415]: cluster 2024-03-11T22:20:57.196121+0000 mon.a (mon.0) 2621 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-03-11T22:20:58.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:58 smithi187 bash[23415]: audit 2024-03-11T22:20:57.196557+0000 mon.b (mon.1) 360 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:58.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:58 smithi187 bash[23415]: audit 2024-03-11T22:20:57.210273+0000 mon.a (mon.0) 2622 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:58 smithi049 bash[21434]: cluster 2024-03-11T22:20:57.196121+0000 mon.a (mon.0) 2621 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-03-11T22:20:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:58 smithi049 bash[21434]: audit 2024-03-11T22:20:57.196557+0000 mon.b (mon.1) 360 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:58.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:58 smithi049 bash[21434]: audit 2024-03-11T22:20:57.210273+0000 mon.a (mon.0) 2622 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:58.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:58 smithi049 bash[28804]: cluster 2024-03-11T22:20:57.196121+0000 mon.a (mon.0) 2621 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-03-11T22:20:58.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:58 smithi049 bash[28804]: audit 2024-03-11T22:20:57.196557+0000 mon.b (mon.1) 360 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:58.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:58 smithi049 bash[28804]: audit 2024-03-11T22:20:57.210273+0000 mon.a (mon.0) 2622 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:20:59.496 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:20:58 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:20:59.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:59 smithi187 bash[23415]: audit 2024-03-11T22:20:58.190808+0000 mon.a (mon.0) 2623 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:59.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:59 smithi187 bash[23415]: audit 2024-03-11T22:20:58.193894+0000 mon.b (mon.1) 361 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:59.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:59 smithi187 bash[23415]: cluster 2024-03-11T22:20:58.198460+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-03-11T22:20:59.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:59 smithi187 bash[23415]: audit 2024-03-11T22:20:58.241272+0000 mon.b (mon.1) 362 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:59.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:59 smithi187 bash[23415]: audit 2024-03-11T22:20:58.250243+0000 mon.a (mon.0) 2625 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:59.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:59 smithi187 bash[23415]: cluster 2024-03-11T22:20:58.253294+0000 mgr.y (mgr.14601) 493 : cluster 0 pgmap v740: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:59.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:20:59 smithi187 bash[23415]: audit 2024-03-11T22:20:59.005397+0000 mgr.y (mgr.14601) 494 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:59.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[21434]: audit 2024-03-11T22:20:58.190808+0000 mon.a (mon.0) 2623 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:59.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[21434]: audit 2024-03-11T22:20:58.193894+0000 mon.b (mon.1) 361 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:59.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[21434]: cluster 2024-03-11T22:20:58.198460+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-03-11T22:20:59.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[21434]: audit 2024-03-11T22:20:58.241272+0000 mon.b (mon.1) 362 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:59.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[21434]: audit 2024-03-11T22:20:58.250243+0000 mon.a (mon.0) 2625 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:59.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[21434]: cluster 2024-03-11T22:20:58.253294+0000 mgr.y (mgr.14601) 493 : cluster 0 pgmap v740: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[21434]: audit 2024-03-11T22:20:59.005397+0000 mgr.y (mgr.14601) 494 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[28804]: audit 2024-03-11T22:20:58.190808+0000 mon.a (mon.0) 2623 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[28804]: audit 2024-03-11T22:20:58.193894+0000 mon.b (mon.1) 361 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[28804]: cluster 2024-03-11T22:20:58.198460+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[28804]: audit 2024-03-11T22:20:58.241272+0000 mon.b (mon.1) 362 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[28804]: audit 2024-03-11T22:20:58.250243+0000 mon.a (mon.0) 2625 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[28804]: cluster 2024-03-11T22:20:58.253294+0000 mgr.y (mgr.14601) 493 : cluster 0 pgmap v740: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:20:59.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:20:59 smithi049 bash[28804]: audit 2024-03-11T22:20:59.005397+0000 mgr.y (mgr.14601) 494 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:00.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:00 smithi187 bash[23415]: audit 2024-03-11T22:20:59.210479+0000 mon.a (mon.0) 2626 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:00.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:00 smithi187 bash[23415]: audit 2024-03-11T22:20:59.211794+0000 mon.b (mon.1) 363 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:00.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:00 smithi187 bash[23415]: cluster 2024-03-11T22:20:59.217359+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-03-11T22:21:00.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:00 smithi187 bash[23415]: audit 2024-03-11T22:20:59.221000+0000 mon.a (mon.0) 2628 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:00.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:00 smithi187 bash[23415]: audit 2024-03-11T22:21:00.213308+0000 mon.a (mon.0) 2629 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:21:00.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:00 smithi187 bash[23415]: cluster 2024-03-11T22:21:00.220442+0000 mon.a (mon.0) 2630 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-03-11T22:21:00.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[21434]: audit 2024-03-11T22:20:59.210479+0000 mon.a (mon.0) 2626 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:00.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[21434]: audit 2024-03-11T22:20:59.211794+0000 mon.b (mon.1) 363 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:00.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[21434]: cluster 2024-03-11T22:20:59.217359+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-03-11T22:21:00.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[21434]: audit 2024-03-11T22:20:59.221000+0000 mon.a (mon.0) 2628 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:00.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[21434]: audit 2024-03-11T22:21:00.213308+0000 mon.a (mon.0) 2629 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:21:00.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[21434]: cluster 2024-03-11T22:21:00.220442+0000 mon.a (mon.0) 2630 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-03-11T22:21:00.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[28804]: audit 2024-03-11T22:20:59.210479+0000 mon.a (mon.0) 2626 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:00.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[28804]: audit 2024-03-11T22:20:59.211794+0000 mon.b (mon.1) 363 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:00.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[28804]: cluster 2024-03-11T22:20:59.217359+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-03-11T22:21:00.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[28804]: audit 2024-03-11T22:20:59.221000+0000 mon.a (mon.0) 2628 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:00.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[28804]: audit 2024-03-11T22:21:00.213308+0000 mon.a (mon.0) 2629 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:21:00.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:00 smithi049 bash[28804]: cluster 2024-03-11T22:21:00.220442+0000 mon.a (mon.0) 2630 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-03-11T22:21:01.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:01 smithi187 bash[23415]: audit 2024-03-11T22:21:00.214165+0000 mon.b (mon.1) 364 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:01.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:01 smithi187 bash[23415]: audit 2024-03-11T22:21:00.223406+0000 mon.a (mon.0) 2631 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:01.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:01 smithi187 bash[23415]: cluster 2024-03-11T22:21:00.254180+0000 mgr.y (mgr.14601) 495 : cluster 0 pgmap v743: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-03-11T22:21:01.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:01 smithi187 bash[23415]: audit 2024-03-11T22:21:01.216179+0000 mon.a (mon.0) 2632 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:01.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:01 smithi187 bash[23415]: cluster 2024-03-11T22:21:01.222443+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-03-11T22:21:01.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[21434]: audit 2024-03-11T22:21:00.214165+0000 mon.b (mon.1) 364 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:01.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[21434]: audit 2024-03-11T22:21:00.223406+0000 mon.a (mon.0) 2631 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:01.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[21434]: cluster 2024-03-11T22:21:00.254180+0000 mgr.y (mgr.14601) 495 : cluster 0 pgmap v743: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-03-11T22:21:01.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[21434]: audit 2024-03-11T22:21:01.216179+0000 mon.a (mon.0) 2632 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:01.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[21434]: cluster 2024-03-11T22:21:01.222443+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-03-11T22:21:01.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[28804]: audit 2024-03-11T22:21:00.214165+0000 mon.b (mon.1) 364 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:01.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[28804]: audit 2024-03-11T22:21:00.223406+0000 mon.a (mon.0) 2631 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:01.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[28804]: cluster 2024-03-11T22:21:00.254180+0000 mgr.y (mgr.14601) 495 : cluster 0 pgmap v743: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-03-11T22:21:01.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[28804]: audit 2024-03-11T22:21:01.216179+0000 mon.a (mon.0) 2632 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:01.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:01 smithi049 bash[28804]: cluster 2024-03-11T22:21:01.222443+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-03-11T22:21:02.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:02 smithi187 bash[23415]: audit 2024-03-11T22:21:01.218095+0000 mon.b (mon.1) 365 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:02.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:02 smithi187 bash[23415]: audit 2024-03-11T22:21:01.227042+0000 mon.a (mon.0) 2634 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:02.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:02 smithi187 bash[23415]: audit 2024-03-11T22:21:02.219003+0000 mon.a (mon.0) 2635 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:02.496 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:02 smithi187 bash[23415]: cluster 2024-03-11T22:21:02.226216+0000 mon.a (mon.0) 2636 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[21434]: audit 2024-03-11T22:21:01.218095+0000 mon.b (mon.1) 365 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[21434]: audit 2024-03-11T22:21:01.227042+0000 mon.a (mon.0) 2634 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[21434]: audit 2024-03-11T22:21:02.219003+0000 mon.a (mon.0) 2635 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[21434]: cluster 2024-03-11T22:21:02.226216+0000 mon.a (mon.0) 2636 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[28804]: audit 2024-03-11T22:21:01.218095+0000 mon.b (mon.1) 365 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[28804]: audit 2024-03-11T22:21:01.227042+0000 mon.a (mon.0) 2634 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[28804]: audit 2024-03-11T22:21:02.219003+0000 mon.a (mon.0) 2635 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:02.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:02 smithi049 bash[28804]: cluster 2024-03-11T22:21:02.226216+0000 mon.a (mon.0) 2636 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-03-11T22:21:03.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:03 smithi049 bash[21434]: cluster 2024-03-11T22:21:02.255021+0000 mgr.y (mgr.14601) 496 : cluster 0 pgmap v746: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-03-11T22:21:03.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:03 smithi049 bash[28804]: cluster 2024-03-11T22:21:02.255021+0000 mgr.y (mgr.14601) 496 : cluster 0 pgmap v746: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-03-11T22:21:03.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:03 smithi187 bash[23415]: cluster 2024-03-11T22:21:02.255021+0000 mgr.y (mgr.14601) 496 : cluster 0 pgmap v746: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-03-11T22:21:04.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:04 smithi049 bash[21434]: cluster 2024-03-11T22:21:03.250498+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-03-11T22:21:04.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:04 smithi049 bash[28804]: cluster 2024-03-11T22:21:03.250498+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-03-11T22:21:04.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:21:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:21:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:21:04.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:04 smithi187 bash[23415]: cluster 2024-03-11T22:21:03.250498+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-03-11T22:21:05.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[21434]: cluster 2024-03-11T22:21:04.257941+0000 mgr.y (mgr.14601) 497 : cluster 0 pgmap v748: 292 pgs: 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-03-11T22:21:05.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[21434]: cluster 2024-03-11T22:21:04.271473+0000 mon.a (mon.0) 2638 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-03-11T22:21:05.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[21434]: audit 2024-03-11T22:21:04.359178+0000 mon.b (mon.1) 366 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[21434]: audit 2024-03-11T22:21:04.361641+0000 mon.b (mon.1) 367 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-83"}]: dispatch 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[21434]: audit 2024-03-11T22:21:04.367624+0000 mon.a (mon.0) 2639 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[21434]: audit 2024-03-11T22:21:04.369834+0000 mon.a (mon.0) 2640 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-83"}]: dispatch 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[28804]: cluster 2024-03-11T22:21:04.257941+0000 mgr.y (mgr.14601) 497 : cluster 0 pgmap v748: 292 pgs: 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[28804]: cluster 2024-03-11T22:21:04.271473+0000 mon.a (mon.0) 2638 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[28804]: audit 2024-03-11T22:21:04.359178+0000 mon.b (mon.1) 366 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[28804]: audit 2024-03-11T22:21:04.361641+0000 mon.b (mon.1) 367 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-83"}]: dispatch 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[28804]: audit 2024-03-11T22:21:04.367624+0000 mon.a (mon.0) 2639 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:05.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:05 smithi049 bash[28804]: audit 2024-03-11T22:21:04.369834+0000 mon.a (mon.0) 2640 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-83"}]: dispatch 2024-03-11T22:21:05.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:05 smithi187 bash[23415]: cluster 2024-03-11T22:21:04.257941+0000 mgr.y (mgr.14601) 497 : cluster 0 pgmap v748: 292 pgs: 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-03-11T22:21:05.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:05 smithi187 bash[23415]: cluster 2024-03-11T22:21:04.271473+0000 mon.a (mon.0) 2638 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-03-11T22:21:05.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:05 smithi187 bash[23415]: audit 2024-03-11T22:21:04.359178+0000 mon.b (mon.1) 366 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:05.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:05 smithi187 bash[23415]: audit 2024-03-11T22:21:04.361641+0000 mon.b (mon.1) 367 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-83"}]: dispatch 2024-03-11T22:21:05.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:05 smithi187 bash[23415]: audit 2024-03-11T22:21:04.367624+0000 mon.a (mon.0) 2639 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:05.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:05 smithi187 bash[23415]: audit 2024-03-11T22:21:04.369834+0000 mon.a (mon.0) 2640 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-83"}]: dispatch 2024-03-11T22:21:06.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:06 smithi187 bash[23415]: cluster 2024-03-11T22:21:05.283049+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-03-11T22:21:06.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:06 smithi049 bash[21434]: cluster 2024-03-11T22:21:05.283049+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-03-11T22:21:06.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:06 smithi049 bash[28804]: cluster 2024-03-11T22:21:05.283049+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-03-11T22:21:07.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:07 smithi187 bash[23415]: cluster 2024-03-11T22:21:06.258986+0000 mgr.y (mgr.14601) 498 : cluster 0 pgmap v751: 260 pgs: 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 253 B/s wr, 2 op/s 2024-03-11T22:21:07.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:07 smithi187 bash[23415]: cluster 2024-03-11T22:21:06.296092+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-03-11T22:21:07.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:07 smithi187 bash[23415]: audit 2024-03-11T22:21:06.300726+0000 mon.b (mon.1) 368 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:07.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:07 smithi187 bash[23415]: audit 2024-03-11T22:21:06.310702+0000 mon.a (mon.0) 2643 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[21434]: cluster 2024-03-11T22:21:06.258986+0000 mgr.y (mgr.14601) 498 : cluster 0 pgmap v751: 260 pgs: 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 253 B/s wr, 2 op/s 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[21434]: cluster 2024-03-11T22:21:06.296092+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[21434]: audit 2024-03-11T22:21:06.300726+0000 mon.b (mon.1) 368 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[21434]: audit 2024-03-11T22:21:06.310702+0000 mon.a (mon.0) 2643 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[28804]: cluster 2024-03-11T22:21:06.258986+0000 mgr.y (mgr.14601) 498 : cluster 0 pgmap v751: 260 pgs: 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 253 B/s wr, 2 op/s 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[28804]: cluster 2024-03-11T22:21:06.296092+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[28804]: audit 2024-03-11T22:21:06.300726+0000 mon.b (mon.1) 368 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:07.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:07 smithi049 bash[28804]: audit 2024-03-11T22:21:06.310702+0000 mon.a (mon.0) 2643 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:08.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:08 smithi187 bash[23415]: audit 2024-03-11T22:21:07.290924+0000 mon.a (mon.0) 2644 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:08.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:08 smithi187 bash[23415]: audit 2024-03-11T22:21:07.296431+0000 mon.b (mon.1) 369 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:08.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:08 smithi187 bash[23415]: cluster 2024-03-11T22:21:07.298195+0000 mon.a (mon.0) 2645 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-03-11T22:21:08.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:08 smithi187 bash[23415]: audit 2024-03-11T22:21:07.338172+0000 mon.b (mon.1) 370 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:08.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:08 smithi187 bash[23415]: audit 2024-03-11T22:21:07.350562+0000 mon.a (mon.0) 2646 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[21434]: audit 2024-03-11T22:21:07.290924+0000 mon.a (mon.0) 2644 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[21434]: audit 2024-03-11T22:21:07.296431+0000 mon.b (mon.1) 369 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[21434]: cluster 2024-03-11T22:21:07.298195+0000 mon.a (mon.0) 2645 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-03-11T22:21:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[21434]: audit 2024-03-11T22:21:07.338172+0000 mon.b (mon.1) 370 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:08.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[21434]: audit 2024-03-11T22:21:07.350562+0000 mon.a (mon.0) 2646 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[28804]: audit 2024-03-11T22:21:07.290924+0000 mon.a (mon.0) 2644 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[28804]: audit 2024-03-11T22:21:07.296431+0000 mon.b (mon.1) 369 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[28804]: cluster 2024-03-11T22:21:07.298195+0000 mon.a (mon.0) 2645 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-03-11T22:21:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[28804]: audit 2024-03-11T22:21:07.338172+0000 mon.b (mon.1) 370 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:08 smithi049 bash[28804]: audit 2024-03-11T22:21:07.350562+0000 mon.a (mon.0) 2646 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:09.320 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:21:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:21:09.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:09 smithi187 bash[23415]: cluster 2024-03-11T22:21:08.259906+0000 mgr.y (mgr.14601) 499 : cluster 0 pgmap v754: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:09.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:09 smithi187 bash[23415]: audit 2024-03-11T22:21:08.313281+0000 mon.a (mon.0) 2647 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:09.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:09 smithi187 bash[23415]: audit 2024-03-11T22:21:08.316068+0000 mon.b (mon.1) 371 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:09.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:09 smithi187 bash[23415]: cluster 2024-03-11T22:21:08.322752+0000 mon.a (mon.0) 2648 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-03-11T22:21:09.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:09 smithi187 bash[23415]: audit 2024-03-11T22:21:08.327278+0000 mon.a (mon.0) 2649 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:09.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:09 smithi187 bash[23415]: audit 2024-03-11T22:21:09.016738+0000 mgr.y (mgr.14601) 500 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[28804]: cluster 2024-03-11T22:21:08.259906+0000 mgr.y (mgr.14601) 499 : cluster 0 pgmap v754: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[28804]: audit 2024-03-11T22:21:08.313281+0000 mon.a (mon.0) 2647 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[28804]: audit 2024-03-11T22:21:08.316068+0000 mon.b (mon.1) 371 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[28804]: cluster 2024-03-11T22:21:08.322752+0000 mon.a (mon.0) 2648 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-03-11T22:21:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[28804]: audit 2024-03-11T22:21:08.327278+0000 mon.a (mon.0) 2649 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:09.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[28804]: audit 2024-03-11T22:21:09.016738+0000 mgr.y (mgr.14601) 500 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[21434]: cluster 2024-03-11T22:21:08.259906+0000 mgr.y (mgr.14601) 499 : cluster 0 pgmap v754: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[21434]: audit 2024-03-11T22:21:08.313281+0000 mon.a (mon.0) 2647 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[21434]: audit 2024-03-11T22:21:08.316068+0000 mon.b (mon.1) 371 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[21434]: cluster 2024-03-11T22:21:08.322752+0000 mon.a (mon.0) 2648 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-03-11T22:21:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[21434]: audit 2024-03-11T22:21:08.327278+0000 mon.a (mon.0) 2649 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:09 smithi049 bash[21434]: audit 2024-03-11T22:21:09.016738+0000 mgr.y (mgr.14601) 500 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:10.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: audit 2024-03-11T22:21:09.316093+0000 mon.a (mon.0) 2650 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:21:10.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: audit 2024-03-11T22:21:09.317258+0000 mon.b (mon.1) 372 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:10.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: cluster 2024-03-11T22:21:09.323618+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-03-11T22:21:10.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: audit 2024-03-11T22:21:09.325783+0000 mon.a (mon.0) 2652 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:10.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: audit 2024-03-11T22:21:09.679735+0000 mon.c (mon.2) 595 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:21:10.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: audit 2024-03-11T22:21:10.261325+0000 mon.a (mon.0) 2653 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:10.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: audit 2024-03-11T22:21:10.278036+0000 mon.a (mon.0) 2654 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:10.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:10 smithi187 bash[23415]: audit 2024-03-11T22:21:10.318555+0000 mon.a (mon.0) 2655 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: audit 2024-03-11T22:21:09.316093+0000 mon.a (mon.0) 2650 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:21:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: audit 2024-03-11T22:21:09.317258+0000 mon.b (mon.1) 372 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: cluster 2024-03-11T22:21:09.323618+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-03-11T22:21:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: audit 2024-03-11T22:21:09.325783+0000 mon.a (mon.0) 2652 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: audit 2024-03-11T22:21:09.679735+0000 mon.c (mon.2) 595 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:21:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: audit 2024-03-11T22:21:10.261325+0000 mon.a (mon.0) 2653 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: audit 2024-03-11T22:21:10.278036+0000 mon.a (mon.0) 2654 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[21434]: audit 2024-03-11T22:21:10.318555+0000 mon.a (mon.0) 2655 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: audit 2024-03-11T22:21:09.316093+0000 mon.a (mon.0) 2650 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_tier","val": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: audit 2024-03-11T22:21:09.317258+0000 mon.b (mon.1) 372 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: cluster 2024-03-11T22:21:09.323618+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: audit 2024-03-11T22:21:09.325783+0000 mon.a (mon.0) 2652 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: audit 2024-03-11T22:21:09.679735+0000 mon.c (mon.2) 595 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: audit 2024-03-11T22:21:10.261325+0000 mon.a (mon.0) 2653 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: audit 2024-03-11T22:21:10.278036+0000 mon.a (mon.0) 2654 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:10 smithi049 bash[28804]: audit 2024-03-11T22:21:10.318555+0000 mon.a (mon.0) 2655 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:11.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:11 smithi187 bash[23415]: cluster 2024-03-11T22:21:10.261024+0000 mgr.y (mgr.14601) 501 : cluster 0 pgmap v757: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-11T22:21:11.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:11 smithi187 bash[23415]: audit 2024-03-11T22:21:10.319545+0000 mon.b (mon.1) 373 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:11.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:11 smithi187 bash[23415]: cluster 2024-03-11T22:21:10.326316+0000 mon.a (mon.0) 2656 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-03-11T22:21:11.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:11 smithi187 bash[23415]: audit 2024-03-11T22:21:10.333326+0000 mon.a (mon.0) 2657 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:11.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:11 smithi187 bash[23415]: audit 2024-03-11T22:21:10.891969+0000 mon.c (mon.2) 596 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:11.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:11 smithi187 bash[23415]: audit 2024-03-11T22:21:11.321304+0000 mon.a (mon.0) 2658 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:11.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:11 smithi187 bash[23415]: cluster 2024-03-11T22:21:11.327352+0000 mon.a (mon.0) 2659 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-03-11T22:21:11.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[21434]: cluster 2024-03-11T22:21:10.261024+0000 mgr.y (mgr.14601) 501 : cluster 0 pgmap v757: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[21434]: audit 2024-03-11T22:21:10.319545+0000 mon.b (mon.1) 373 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[21434]: cluster 2024-03-11T22:21:10.326316+0000 mon.a (mon.0) 2656 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[21434]: audit 2024-03-11T22:21:10.333326+0000 mon.a (mon.0) 2657 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[21434]: audit 2024-03-11T22:21:10.891969+0000 mon.c (mon.2) 596 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[21434]: audit 2024-03-11T22:21:11.321304+0000 mon.a (mon.0) 2658 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[21434]: cluster 2024-03-11T22:21:11.327352+0000 mon.a (mon.0) 2659 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[28804]: cluster 2024-03-11T22:21:10.261024+0000 mgr.y (mgr.14601) 501 : cluster 0 pgmap v757: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[28804]: audit 2024-03-11T22:21:10.319545+0000 mon.b (mon.1) 373 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[28804]: cluster 2024-03-11T22:21:10.326316+0000 mon.a (mon.0) 2656 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[28804]: audit 2024-03-11T22:21:10.333326+0000 mon.a (mon.0) 2657 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:11.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[28804]: audit 2024-03-11T22:21:10.891969+0000 mon.c (mon.2) 596 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:11.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[28804]: audit 2024-03-11T22:21:11.321304+0000 mon.a (mon.0) 2658 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:11.776 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:11 smithi049 bash[28804]: cluster 2024-03-11T22:21:11.327352+0000 mon.a (mon.0) 2659 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-03-11T22:21:13.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:13 smithi187 bash[23415]: cluster 2024-03-11T22:21:12.261948+0000 mgr.y (mgr.14601) 502 : cluster 0 pgmap v760: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-11T22:21:13.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:13 smithi187 bash[23415]: cluster 2024-03-11T22:21:12.352696+0000 mon.a (mon.0) 2660 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-03-11T22:21:13.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:13 smithi049 bash[21434]: cluster 2024-03-11T22:21:12.261948+0000 mgr.y (mgr.14601) 502 : cluster 0 pgmap v760: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-11T22:21:13.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:13 smithi049 bash[21434]: cluster 2024-03-11T22:21:12.352696+0000 mon.a (mon.0) 2660 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-03-11T22:21:13.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:13 smithi049 bash[28804]: cluster 2024-03-11T22:21:12.261948+0000 mgr.y (mgr.14601) 502 : cluster 0 pgmap v760: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-11T22:21:13.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:13 smithi049 bash[28804]: cluster 2024-03-11T22:21:12.352696+0000 mon.a (mon.0) 2660 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-03-11T22:21:14.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:21:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:21:14.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[28804]: cluster 2024-03-11T22:21:13.362165+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[28804]: audit 2024-03-11T22:21:13.452835+0000 mon.b (mon.1) 374 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[28804]: audit 2024-03-11T22:21:13.454864+0000 mon.b (mon.1) 375 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-85"}]: dispatch 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[28804]: audit 2024-03-11T22:21:13.461072+0000 mon.a (mon.0) 2662 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[28804]: audit 2024-03-11T22:21:13.462952+0000 mon.a (mon.0) 2663 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-85"}]: dispatch 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[21434]: cluster 2024-03-11T22:21:13.362165+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[21434]: audit 2024-03-11T22:21:13.452835+0000 mon.b (mon.1) 374 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[21434]: audit 2024-03-11T22:21:13.454864+0000 mon.b (mon.1) 375 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-85"}]: dispatch 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[21434]: audit 2024-03-11T22:21:13.461072+0000 mon.a (mon.0) 2662 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:14.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:14 smithi049 bash[21434]: audit 2024-03-11T22:21:13.462952+0000 mon.a (mon.0) 2663 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-85"}]: dispatch 2024-03-11T22:21:14.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:14 smithi187 bash[23415]: cluster 2024-03-11T22:21:13.362165+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-03-11T22:21:14.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:14 smithi187 bash[23415]: audit 2024-03-11T22:21:13.452835+0000 mon.b (mon.1) 374 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:14.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:14 smithi187 bash[23415]: audit 2024-03-11T22:21:13.454864+0000 mon.b (mon.1) 375 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-85"}]: dispatch 2024-03-11T22:21:14.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:14 smithi187 bash[23415]: audit 2024-03-11T22:21:13.461072+0000 mon.a (mon.0) 2662 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:14.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:14 smithi187 bash[23415]: audit 2024-03-11T22:21:13.462952+0000 mon.a (mon.0) 2663 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-85"}]: dispatch 2024-03-11T22:21:15.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:15 smithi187 bash[23415]: cluster 2024-03-11T22:21:14.264060+0000 mgr.y (mgr.14601) 503 : cluster 0 pgmap v763: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 7.5 KiB/s wr, 12 op/s 2024-03-11T22:21:15.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:15 smithi187 bash[23415]: cluster 2024-03-11T22:21:14.376945+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-03-11T22:21:15.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:15 smithi187 bash[23415]: audit 2024-03-11T22:21:15.337072+0000 mon.a (mon.0) 2665 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:15.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:15 smithi187 bash[23415]: audit 2024-03-11T22:21:15.351466+0000 mon.a (mon.0) 2666 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[21434]: cluster 2024-03-11T22:21:14.264060+0000 mgr.y (mgr.14601) 503 : cluster 0 pgmap v763: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 7.5 KiB/s wr, 12 op/s 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[21434]: cluster 2024-03-11T22:21:14.376945+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[21434]: audit 2024-03-11T22:21:15.337072+0000 mon.a (mon.0) 2665 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[21434]: audit 2024-03-11T22:21:15.351466+0000 mon.a (mon.0) 2666 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[28804]: cluster 2024-03-11T22:21:14.264060+0000 mgr.y (mgr.14601) 503 : cluster 0 pgmap v763: 292 pgs: 292 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 7.5 KiB/s wr, 12 op/s 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[28804]: cluster 2024-03-11T22:21:14.376945+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[28804]: audit 2024-03-11T22:21:15.337072+0000 mon.a (mon.0) 2665 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:15.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:15 smithi049 bash[28804]: audit 2024-03-11T22:21:15.351466+0000 mon.a (mon.0) 2666 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:16.384 INFO:tasks.workunit.client.0.smithi049.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18111 ms) 2024-03-11T22:21:16.384 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-03-11T22:21:16.384 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22180 ms) 2024-03-11T22:21:16.384 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-03-11T22:21:16.384 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3047 ms) 2024-03-11T22:21:16.384 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-03-11T22:21:16.384 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3031 ms) 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3042 ms) 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3036 ms) 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4049 ms) 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (39419 ms) 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.385 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17110 ms) 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (3836 ms) 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3033 ms) 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25119 ms) 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15232 ms) 2024-03-11T22:21:16.386 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5079 ms) 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4042 ms) 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: waiting for scrubs... 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: done waiting 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (25119 ms) 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.387 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10111 ms) 2024-03-11T22:21:16.388 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-03-11T22:21:16.388 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.388 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9101 ms) 2024-03-11T22:21:16.388 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-03-11T22:21:16.388 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:21:16.388 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9096 ms) 2024-03-11T22:21:16.388 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-03-11T22:21:16.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:16 smithi187 bash[23415]: cluster 2024-03-11T22:21:15.372731+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-03-11T22:21:16.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:16 smithi187 bash[23415]: audit 2024-03-11T22:21:15.380705+0000 mon.b (mon.1) 376 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:16.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:16 smithi187 bash[23415]: audit 2024-03-11T22:21:15.393688+0000 mon.a (mon.0) 2668 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:16.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:16 smithi187 bash[23415]: audit 2024-03-11T22:21:16.373109+0000 mon.a (mon.0) 2669 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[21434]: cluster 2024-03-11T22:21:15.372731+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[21434]: audit 2024-03-11T22:21:15.380705+0000 mon.b (mon.1) 376 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[21434]: audit 2024-03-11T22:21:15.393688+0000 mon.a (mon.0) 2668 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[21434]: audit 2024-03-11T22:21:16.373109+0000 mon.a (mon.0) 2669 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[28804]: cluster 2024-03-11T22:21:15.372731+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[28804]: audit 2024-03-11T22:21:15.380705+0000 mon.b (mon.1) 376 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[28804]: audit 2024-03-11T22:21:15.393688+0000 mon.a (mon.0) 2668 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:16.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:16 smithi049 bash[28804]: audit 2024-03-11T22:21:16.373109+0000 mon.a (mon.0) 2669 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:17.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: cluster 2024-03-11T22:21:16.265029+0000 mgr.y (mgr.14601) 504 : cluster 0 pgmap v766: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: audit 2024-03-11T22:21:16.376449+0000 mon.b (mon.1) 377 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: cluster 2024-03-11T22:21:16.386354+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: cluster 2024-03-11T22:21:16.390618+0000 mon.a (mon.0) 2671 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: audit 2024-03-11T22:21:16.881466+0000 mon.a (mon.0) 2672 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: audit 2024-03-11T22:21:16.896365+0000 mon.a (mon.0) 2673 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: audit 2024-03-11T22:21:17.379426+0000 mon.b (mon.1) 378 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: cluster 2024-03-11T22:21:17.383295+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-03-11T22:21:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:17 smithi187 bash[23415]: audit 2024-03-11T22:21:17.388525+0000 mon.a (mon.0) 2675 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:17.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: cluster 2024-03-11T22:21:16.265029+0000 mgr.y (mgr.14601) 504 : cluster 0 pgmap v766: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-11T22:21:17.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: audit 2024-03-11T22:21:16.376449+0000 mon.b (mon.1) 377 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:17.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: cluster 2024-03-11T22:21:16.386354+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-03-11T22:21:17.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: cluster 2024-03-11T22:21:16.390618+0000 mon.a (mon.0) 2671 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:17.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: audit 2024-03-11T22:21:16.881466+0000 mon.a (mon.0) 2672 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: audit 2024-03-11T22:21:16.896365+0000 mon.a (mon.0) 2673 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: audit 2024-03-11T22:21:17.379426+0000 mon.b (mon.1) 378 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: cluster 2024-03-11T22:21:17.383295+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[21434]: audit 2024-03-11T22:21:17.388525+0000 mon.a (mon.0) 2675 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: cluster 2024-03-11T22:21:16.265029+0000 mgr.y (mgr.14601) 504 : cluster 0 pgmap v766: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: audit 2024-03-11T22:21:16.376449+0000 mon.b (mon.1) 377 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: cluster 2024-03-11T22:21:16.386354+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: cluster 2024-03-11T22:21:16.390618+0000 mon.a (mon.0) 2671 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: audit 2024-03-11T22:21:16.881466+0000 mon.a (mon.0) 2672 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: audit 2024-03-11T22:21:16.896365+0000 mon.a (mon.0) 2673 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: audit 2024-03-11T22:21:17.379426+0000 mon.b (mon.1) 378 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: cluster 2024-03-11T22:21:17.383295+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-03-11T22:21:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:17 smithi049 bash[28804]: audit 2024-03-11T22:21:17.388525+0000 mon.a (mon.0) 2675 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:18.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:18 smithi187 bash[23415]: audit 2024-03-11T22:21:17.578150+0000 mon.c (mon.2) 597 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:21:18.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:18 smithi187 bash[23415]: audit 2024-03-11T22:21:17.579924+0000 mon.c (mon.2) 598 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:21:18.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:18 smithi187 bash[23415]: audit 2024-03-11T22:21:17.591336+0000 mon.a (mon.0) 2676 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:18.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:18 smithi187 bash[23415]: audit 2024-03-11T22:21:18.379456+0000 mon.a (mon.0) 2677 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:18.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:18 smithi187 bash[23415]: audit 2024-03-11T22:21:18.381374+0000 mon.b (mon.1) 379 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]: dispatch 2024-03-11T22:21:18.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:18 smithi187 bash[23415]: cluster 2024-03-11T22:21:18.386815+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-03-11T22:21:18.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:18 smithi187 bash[23415]: audit 2024-03-11T22:21:18.395996+0000 mon.a (mon.0) 2679 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]: dispatch 2024-03-11T22:21:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[21434]: audit 2024-03-11T22:21:17.578150+0000 mon.c (mon.2) 597 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:21:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[21434]: audit 2024-03-11T22:21:17.579924+0000 mon.c (mon.2) 598 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:21:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[21434]: audit 2024-03-11T22:21:17.591336+0000 mon.a (mon.0) 2676 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[21434]: audit 2024-03-11T22:21:18.379456+0000 mon.a (mon.0) 2677 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[21434]: audit 2024-03-11T22:21:18.381374+0000 mon.b (mon.1) 379 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]: dispatch 2024-03-11T22:21:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[21434]: cluster 2024-03-11T22:21:18.386815+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[21434]: audit 2024-03-11T22:21:18.395996+0000 mon.a (mon.0) 2679 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]: dispatch 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[28804]: audit 2024-03-11T22:21:17.578150+0000 mon.c (mon.2) 597 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[28804]: audit 2024-03-11T22:21:17.579924+0000 mon.c (mon.2) 598 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[28804]: audit 2024-03-11T22:21:17.591336+0000 mon.a (mon.0) 2676 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[28804]: audit 2024-03-11T22:21:18.379456+0000 mon.a (mon.0) 2677 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[28804]: audit 2024-03-11T22:21:18.381374+0000 mon.b (mon.1) 379 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]: dispatch 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[28804]: cluster 2024-03-11T22:21:18.386815+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-03-11T22:21:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:18 smithi049 bash[28804]: audit 2024-03-11T22:21:18.395996+0000 mon.a (mon.0) 2679 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]: dispatch 2024-03-11T22:21:19.496 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:21:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:21:19.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:19 smithi187 bash[23415]: cluster 2024-03-11T22:21:18.265966+0000 mgr.y (mgr.14601) 505 : cluster 0 pgmap v769: 324 pgs: 64 unknown, 260 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:19.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:19 smithi187 bash[23415]: audit 2024-03-11T22:21:19.028103+0000 mgr.y (mgr.14601) 506 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:19.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:19 smithi187 bash[23415]: audit 2024-03-11T22:21:19.382168+0000 mon.a (mon.0) 2680 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]': finished 2024-03-11T22:21:19.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:19 smithi187 bash[23415]: audit 2024-03-11T22:21:19.382867+0000 mon.b (mon.1) 380 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:19.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:19 smithi187 bash[23415]: cluster 2024-03-11T22:21:19.388666+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-03-11T22:21:19.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:19 smithi187 bash[23415]: audit 2024-03-11T22:21:19.391919+0000 mon.a (mon.0) 2682 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:20.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[21434]: cluster 2024-03-11T22:21:18.265966+0000 mgr.y (mgr.14601) 505 : cluster 0 pgmap v769: 324 pgs: 64 unknown, 260 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:20.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[21434]: audit 2024-03-11T22:21:19.028103+0000 mgr.y (mgr.14601) 506 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:20.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[21434]: audit 2024-03-11T22:21:19.382168+0000 mon.a (mon.0) 2680 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]': finished 2024-03-11T22:21:20.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[21434]: audit 2024-03-11T22:21:19.382867+0000 mon.b (mon.1) 380 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:20.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[21434]: cluster 2024-03-11T22:21:19.388666+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-03-11T22:21:20.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[21434]: audit 2024-03-11T22:21:19.391919+0000 mon.a (mon.0) 2682 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:20.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[28804]: cluster 2024-03-11T22:21:18.265966+0000 mgr.y (mgr.14601) 505 : cluster 0 pgmap v769: 324 pgs: 64 unknown, 260 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:20.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[28804]: audit 2024-03-11T22:21:19.028103+0000 mgr.y (mgr.14601) 506 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:20.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[28804]: audit 2024-03-11T22:21:19.382168+0000 mon.a (mon.0) 2680 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_tier","val": "test-rados-api-smithi049-64247-89-test-flush"}]': finished 2024-03-11T22:21:20.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[28804]: audit 2024-03-11T22:21:19.382867+0000 mon.b (mon.1) 380 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:20.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[28804]: cluster 2024-03-11T22:21:19.388666+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-03-11T22:21:20.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:19 smithi049 bash[28804]: audit 2024-03-11T22:21:19.391919+0000 mon.a (mon.0) 2682 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:21:21.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:21 smithi187 bash[23415]: cluster 2024-03-11T22:21:20.267023+0000 mgr.y (mgr.14601) 507 : cluster 0 pgmap v772: 324 pgs: 324 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:21:21.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:21 smithi187 bash[23415]: audit 2024-03-11T22:21:20.384872+0000 mon.a (mon.0) 2683 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:21.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:21 smithi187 bash[23415]: audit 2024-03-11T22:21:20.386270+0000 mon.b (mon.1) 381 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:21.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:21 smithi187 bash[23415]: cluster 2024-03-11T22:21:20.391337+0000 mon.a (mon.0) 2684 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-03-11T22:21:21.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:21 smithi187 bash[23415]: audit 2024-03-11T22:21:20.395321+0000 mon.a (mon.0) 2685 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:21.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[21434]: cluster 2024-03-11T22:21:20.267023+0000 mgr.y (mgr.14601) 507 : cluster 0 pgmap v772: 324 pgs: 324 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:21:21.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[21434]: audit 2024-03-11T22:21:20.384872+0000 mon.a (mon.0) 2683 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:21.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[21434]: audit 2024-03-11T22:21:20.386270+0000 mon.b (mon.1) 381 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:21.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[21434]: cluster 2024-03-11T22:21:20.391337+0000 mon.a (mon.0) 2684 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-03-11T22:21:21.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[21434]: audit 2024-03-11T22:21:20.395321+0000 mon.a (mon.0) 2685 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[28804]: cluster 2024-03-11T22:21:20.267023+0000 mgr.y (mgr.14601) 507 : cluster 0 pgmap v772: 324 pgs: 324 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:21:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[28804]: audit 2024-03-11T22:21:20.384872+0000 mon.a (mon.0) 2683 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:21:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[28804]: audit 2024-03-11T22:21:20.386270+0000 mon.b (mon.1) 381 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[28804]: cluster 2024-03-11T22:21:20.391337+0000 mon.a (mon.0) 2684 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-03-11T22:21:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:21 smithi049 bash[28804]: audit 2024-03-11T22:21:20.395321+0000 mon.a (mon.0) 2685 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:21:22.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:22 smithi187 bash[23415]: audit 2024-03-11T22:21:21.396349+0000 mon.a (mon.0) 2686 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:22.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:22 smithi187 bash[23415]: cluster 2024-03-11T22:21:21.403194+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-03-11T22:21:22.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:22 smithi049 bash[21434]: audit 2024-03-11T22:21:21.396349+0000 mon.a (mon.0) 2686 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:22.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:22 smithi049 bash[21434]: cluster 2024-03-11T22:21:21.403194+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-03-11T22:21:22.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:22 smithi049 bash[28804]: audit 2024-03-11T22:21:21.396349+0000 mon.a (mon.0) 2686 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:21:22.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:22 smithi049 bash[28804]: cluster 2024-03-11T22:21:21.403194+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-03-11T22:21:23.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:23 smithi187 bash[23415]: cluster 2024-03-11T22:21:22.268164+0000 mgr.y (mgr.14601) 508 : cluster 0 pgmap v775: 324 pgs: 324 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:21:23.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:23 smithi187 bash[23415]: cluster 2024-03-11T22:21:22.414858+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-03-11T22:21:23.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:23 smithi187 bash[23415]: audit 2024-03-11T22:21:22.504215+0000 mon.b (mon.1) 382 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:23.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:23 smithi187 bash[23415]: audit 2024-03-11T22:21:22.506012+0000 mon.b (mon.1) 383 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-87"}]: dispatch 2024-03-11T22:21:23.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:23 smithi187 bash[23415]: audit 2024-03-11T22:21:22.512579+0000 mon.a (mon.0) 2689 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:23.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:23 smithi187 bash[23415]: audit 2024-03-11T22:21:22.514211+0000 mon.a (mon.0) 2690 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-87"}]: dispatch 2024-03-11T22:21:23.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[28804]: cluster 2024-03-11T22:21:22.268164+0000 mgr.y (mgr.14601) 508 : cluster 0 pgmap v775: 324 pgs: 324 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:21:23.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[28804]: cluster 2024-03-11T22:21:22.414858+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-03-11T22:21:23.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[28804]: audit 2024-03-11T22:21:22.504215+0000 mon.b (mon.1) 382 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:23.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[28804]: audit 2024-03-11T22:21:22.506012+0000 mon.b (mon.1) 383 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-87"}]: dispatch 2024-03-11T22:21:23.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[28804]: audit 2024-03-11T22:21:22.512579+0000 mon.a (mon.0) 2689 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:23.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[28804]: audit 2024-03-11T22:21:22.514211+0000 mon.a (mon.0) 2690 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-87"}]: dispatch 2024-03-11T22:21:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[21434]: cluster 2024-03-11T22:21:22.268164+0000 mgr.y (mgr.14601) 508 : cluster 0 pgmap v775: 324 pgs: 324 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:21:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[21434]: cluster 2024-03-11T22:21:22.414858+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-03-11T22:21:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[21434]: audit 2024-03-11T22:21:22.504215+0000 mon.b (mon.1) 382 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[21434]: audit 2024-03-11T22:21:22.506012+0000 mon.b (mon.1) 383 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-87"}]: dispatch 2024-03-11T22:21:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[21434]: audit 2024-03-11T22:21:22.512579+0000 mon.a (mon.0) 2689 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:23.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:23 smithi049 bash[21434]: audit 2024-03-11T22:21:22.514211+0000 mon.a (mon.0) 2690 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-87"}]: dispatch 2024-03-11T22:21:24.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:24 smithi049 bash[21434]: cluster 2024-03-11T22:21:23.415487+0000 mon.a (mon.0) 2691 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-03-11T22:21:24.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:24 smithi049 bash[28804]: cluster 2024-03-11T22:21:23.415487+0000 mon.a (mon.0) 2691 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-03-11T22:21:24.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:21:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:21:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:21:24.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:24 smithi187 bash[23415]: cluster 2024-03-11T22:21:23.415487+0000 mon.a (mon.0) 2691 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-03-11T22:21:25.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:25 smithi187 bash[23415]: cluster 2024-03-11T22:21:24.270758+0000 mgr.y (mgr.14601) 509 : cluster 0 pgmap v778: 260 pgs: 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:21:25.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:25 smithi187 bash[23415]: cluster 2024-03-11T22:21:24.421809+0000 mon.a (mon.0) 2692 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:25.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:25 smithi187 bash[23415]: cluster 2024-03-11T22:21:24.445793+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-03-11T22:21:25.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:25 smithi187 bash[23415]: audit 2024-03-11T22:21:24.452062+0000 mon.b (mon.1) 384 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:25.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:25 smithi187 bash[23415]: audit 2024-03-11T22:21:24.462078+0000 mon.a (mon.0) 2694 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:25.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[21434]: cluster 2024-03-11T22:21:24.270758+0000 mgr.y (mgr.14601) 509 : cluster 0 pgmap v778: 260 pgs: 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:21:25.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[21434]: cluster 2024-03-11T22:21:24.421809+0000 mon.a (mon.0) 2692 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[21434]: cluster 2024-03-11T22:21:24.445793+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[21434]: audit 2024-03-11T22:21:24.452062+0000 mon.b (mon.1) 384 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[21434]: audit 2024-03-11T22:21:24.462078+0000 mon.a (mon.0) 2694 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[28804]: cluster 2024-03-11T22:21:24.270758+0000 mgr.y (mgr.14601) 509 : cluster 0 pgmap v778: 260 pgs: 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[28804]: cluster 2024-03-11T22:21:24.421809+0000 mon.a (mon.0) 2692 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[28804]: cluster 2024-03-11T22:21:24.445793+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[28804]: audit 2024-03-11T22:21:24.452062+0000 mon.b (mon.1) 384 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:25.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:25 smithi049 bash[28804]: audit 2024-03-11T22:21:24.462078+0000 mon.a (mon.0) 2694 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:26.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:26 smithi187 bash[23415]: audit 2024-03-11T22:21:25.446637+0000 mon.a (mon.0) 2695 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:26 smithi187 bash[23415]: audit 2024-03-11T22:21:25.450135+0000 mon.b (mon.1) 385 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:26 smithi187 bash[23415]: cluster 2024-03-11T22:21:25.453596+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-03-11T22:21:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:26 smithi187 bash[23415]: audit 2024-03-11T22:21:25.466563+0000 mon.b (mon.1) 386 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:26 smithi187 bash[23415]: audit 2024-03-11T22:21:25.475525+0000 mon.a (mon.0) 2697 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:26 smithi187 bash[23415]: audit 2024-03-11T22:21:25.926791+0000 mon.c (mon.2) 599 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:26.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[28804]: audit 2024-03-11T22:21:25.446637+0000 mon.a (mon.0) 2695 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:26.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[28804]: audit 2024-03-11T22:21:25.450135+0000 mon.b (mon.1) 385 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:26.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[28804]: cluster 2024-03-11T22:21:25.453596+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-03-11T22:21:26.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[28804]: audit 2024-03-11T22:21:25.466563+0000 mon.b (mon.1) 386 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:26.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[28804]: audit 2024-03-11T22:21:25.475525+0000 mon.a (mon.0) 2697 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:26.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[28804]: audit 2024-03-11T22:21:25.926791+0000 mon.c (mon.2) 599 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[21434]: audit 2024-03-11T22:21:25.446637+0000 mon.a (mon.0) 2695 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[21434]: audit 2024-03-11T22:21:25.450135+0000 mon.b (mon.1) 385 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[21434]: cluster 2024-03-11T22:21:25.453596+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-03-11T22:21:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[21434]: audit 2024-03-11T22:21:25.466563+0000 mon.b (mon.1) 386 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[21434]: audit 2024-03-11T22:21:25.475525+0000 mon.a (mon.0) 2697 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:21:26.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:26 smithi049 bash[21434]: audit 2024-03-11T22:21:25.926791+0000 mon.c (mon.2) 599 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:27.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:27 smithi187 bash[23415]: cluster 2024-03-11T22:21:26.271655+0000 mgr.y (mgr.14601) 510 : cluster 0 pgmap v781: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:21:27.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:27 smithi187 bash[23415]: audit 2024-03-11T22:21:26.455756+0000 mon.a (mon.0) 2698 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:27.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:27 smithi187 bash[23415]: cluster 2024-03-11T22:21:26.464929+0000 mon.a (mon.0) 2699 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-03-11T22:21:27.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:27 smithi049 bash[21434]: cluster 2024-03-11T22:21:26.271655+0000 mgr.y (mgr.14601) 510 : cluster 0 pgmap v781: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:21:27.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:27 smithi049 bash[21434]: audit 2024-03-11T22:21:26.455756+0000 mon.a (mon.0) 2698 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:27.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:27 smithi049 bash[21434]: cluster 2024-03-11T22:21:26.464929+0000 mon.a (mon.0) 2699 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-03-11T22:21:27.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:27 smithi049 bash[28804]: cluster 2024-03-11T22:21:26.271655+0000 mgr.y (mgr.14601) 510 : cluster 0 pgmap v781: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:21:27.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:27 smithi049 bash[28804]: audit 2024-03-11T22:21:26.455756+0000 mon.a (mon.0) 2698 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:21:27.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:27 smithi049 bash[28804]: cluster 2024-03-11T22:21:26.464929+0000 mon.a (mon.0) 2699 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-03-11T22:21:28.746 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:28 smithi187 bash[23415]: cluster 2024-03-11T22:21:27.465383+0000 mon.a (mon.0) 2700 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-03-11T22:21:28.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:28 smithi049 bash[21434]: cluster 2024-03-11T22:21:27.465383+0000 mon.a (mon.0) 2700 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-03-11T22:21:28.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:28 smithi049 bash[28804]: cluster 2024-03-11T22:21:27.465383+0000 mon.a (mon.0) 2700 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-03-11T22:21:29.477 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:21:29.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[23415]: cluster 2024-03-11T22:21:28.272656+0000 mgr.y (mgr.14601) 511 : cluster 0 pgmap v784: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:29.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[23415]: cluster 2024-03-11T22:21:28.489464+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-03-11T22:21:29.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[23415]: audit 2024-03-11T22:21:28.579767+0000 mon.b (mon.1) 387 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:29.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[23415]: audit 2024-03-11T22:21:28.582282+0000 mon.b (mon.1) 388 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-90"}]: dispatch 2024-03-11T22:21:29.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[23415]: audit 2024-03-11T22:21:28.588397+0000 mon.a (mon.0) 2702 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:29.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[23415]: audit 2024-03-11T22:21:28.590610+0000 mon.a (mon.0) 2703 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-90"}]: dispatch 2024-03-11T22:21:29.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:29 smithi187 bash[23415]: audit 2024-03-11T22:21:29.039472+0000 mgr.y (mgr.14601) 512 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:29.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[21434]: cluster 2024-03-11T22:21:28.272656+0000 mgr.y (mgr.14601) 511 : cluster 0 pgmap v784: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:29.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[21434]: cluster 2024-03-11T22:21:28.489464+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-03-11T22:21:29.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[21434]: audit 2024-03-11T22:21:28.579767+0000 mon.b (mon.1) 387 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:29.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[21434]: audit 2024-03-11T22:21:28.582282+0000 mon.b (mon.1) 388 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-90"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[21434]: audit 2024-03-11T22:21:28.588397+0000 mon.a (mon.0) 2702 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[21434]: audit 2024-03-11T22:21:28.590610+0000 mon.a (mon.0) 2703 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-90"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[21434]: audit 2024-03-11T22:21:29.039472+0000 mgr.y (mgr.14601) 512 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[28804]: cluster 2024-03-11T22:21:28.272656+0000 mgr.y (mgr.14601) 511 : cluster 0 pgmap v784: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[28804]: cluster 2024-03-11T22:21:28.489464+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[28804]: audit 2024-03-11T22:21:28.579767+0000 mon.b (mon.1) 387 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[28804]: audit 2024-03-11T22:21:28.582282+0000 mon.b (mon.1) 388 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-90"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[28804]: audit 2024-03-11T22:21:28.588397+0000 mon.a (mon.0) 2702 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[28804]: audit 2024-03-11T22:21:28.590610+0000 mon.a (mon.0) 2703 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-90"}]: dispatch 2024-03-11T22:21:29.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:29 smithi049 bash[28804]: audit 2024-03-11T22:21:29.039472+0000 mgr.y (mgr.14601) 512 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:30.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:30 smithi049 bash[21434]: cluster 2024-03-11T22:21:29.498760+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-03-11T22:21:30.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:30 smithi049 bash[28804]: cluster 2024-03-11T22:21:29.498760+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-03-11T22:21:30.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:30 smithi187 bash[23415]: cluster 2024-03-11T22:21:29.498760+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-03-11T22:21:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[21434]: cluster 2024-03-11T22:21:30.273542+0000 mgr.y (mgr.14601) 513 : cluster 0 pgmap v787: 260 pgs: 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:31.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[21434]: audit 2024-03-11T22:21:30.508232+0000 mon.b (mon.1) 389 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[21434]: cluster 2024-03-11T22:21:30.512284+0000 mon.a (mon.0) 2705 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-03-11T22:21:31.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[21434]: audit 2024-03-11T22:21:30.518777+0000 mon.a (mon.0) 2706 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:31.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[28804]: cluster 2024-03-11T22:21:30.273542+0000 mgr.y (mgr.14601) 513 : cluster 0 pgmap v787: 260 pgs: 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:31.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[28804]: audit 2024-03-11T22:21:30.508232+0000 mon.b (mon.1) 389 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:31.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[28804]: cluster 2024-03-11T22:21:30.512284+0000 mon.a (mon.0) 2705 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-03-11T22:21:31.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:31 smithi049 bash[28804]: audit 2024-03-11T22:21:30.518777+0000 mon.a (mon.0) 2706 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:31.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:31 smithi187 bash[23415]: cluster 2024-03-11T22:21:30.273542+0000 mgr.y (mgr.14601) 513 : cluster 0 pgmap v787: 260 pgs: 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:31.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:31 smithi187 bash[23415]: audit 2024-03-11T22:21:30.508232+0000 mon.b (mon.1) 389 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:31.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:31 smithi187 bash[23415]: cluster 2024-03-11T22:21:30.512284+0000 mon.a (mon.0) 2705 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-03-11T22:21:31.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:31 smithi187 bash[23415]: audit 2024-03-11T22:21:30.518777+0000 mon.a (mon.0) 2706 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:32.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:32 smithi049 bash[21434]: audit 2024-03-11T22:21:31.507253+0000 mon.a (mon.0) 2707 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:32.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:32 smithi049 bash[21434]: audit 2024-03-11T22:21:31.511353+0000 mon.b (mon.1) 390 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:32.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:32 smithi049 bash[21434]: cluster 2024-03-11T22:21:31.515065+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-03-11T22:21:32.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:32 smithi049 bash[28804]: audit 2024-03-11T22:21:31.507253+0000 mon.a (mon.0) 2707 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:32.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:32 smithi049 bash[28804]: audit 2024-03-11T22:21:31.511353+0000 mon.b (mon.1) 390 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:32.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:32 smithi049 bash[28804]: cluster 2024-03-11T22:21:31.515065+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-03-11T22:21:32.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:32 smithi187 bash[23415]: audit 2024-03-11T22:21:31.507253+0000 mon.a (mon.0) 2707 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:32.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:32 smithi187 bash[23415]: audit 2024-03-11T22:21:31.511353+0000 mon.b (mon.1) 390 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:32.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:32 smithi187 bash[23415]: cluster 2024-03-11T22:21:31.515065+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-03-11T22:21:33.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:33 smithi187 bash[23415]: cluster 2024-03-11T22:21:32.274435+0000 mgr.y (mgr.14601) 514 : cluster 0 pgmap v790: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:33.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:33 smithi187 bash[23415]: cluster 2024-03-11T22:21:32.537530+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-03-11T22:21:34.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:33 smithi049 bash[28804]: cluster 2024-03-11T22:21:32.274435+0000 mgr.y (mgr.14601) 514 : cluster 0 pgmap v790: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:34.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:33 smithi049 bash[28804]: cluster 2024-03-11T22:21:32.537530+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-03-11T22:21:34.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:33 smithi049 bash[21434]: cluster 2024-03-11T22:21:32.274435+0000 mgr.y (mgr.14601) 514 : cluster 0 pgmap v790: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:34.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:33 smithi049 bash[21434]: cluster 2024-03-11T22:21:32.537530+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-03-11T22:21:34.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:21:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:21:34.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:34 smithi187 bash[23415]: cluster 2024-03-11T22:21:33.538783+0000 mon.a (mon.0) 2710 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-03-11T22:21:34.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:34 smithi187 bash[23415]: audit 2024-03-11T22:21:33.632507+0000 mon.b (mon.1) 391 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:34.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:34 smithi187 bash[23415]: audit 2024-03-11T22:21:33.635086+0000 mon.b (mon.1) 392 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-92"}]: dispatch 2024-03-11T22:21:34.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:34 smithi187 bash[23415]: audit 2024-03-11T22:21:33.641181+0000 mon.a (mon.0) 2711 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:34.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:34 smithi187 bash[23415]: audit 2024-03-11T22:21:33.643592+0000 mon.a (mon.0) 2712 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-92"}]: dispatch 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[21434]: cluster 2024-03-11T22:21:33.538783+0000 mon.a (mon.0) 2710 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[21434]: audit 2024-03-11T22:21:33.632507+0000 mon.b (mon.1) 391 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[21434]: audit 2024-03-11T22:21:33.635086+0000 mon.b (mon.1) 392 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-92"}]: dispatch 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[21434]: audit 2024-03-11T22:21:33.641181+0000 mon.a (mon.0) 2711 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[21434]: audit 2024-03-11T22:21:33.643592+0000 mon.a (mon.0) 2712 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-92"}]: dispatch 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[28804]: cluster 2024-03-11T22:21:33.538783+0000 mon.a (mon.0) 2710 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[28804]: audit 2024-03-11T22:21:33.632507+0000 mon.b (mon.1) 391 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:35.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[28804]: audit 2024-03-11T22:21:33.635086+0000 mon.b (mon.1) 392 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-92"}]: dispatch 2024-03-11T22:21:35.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[28804]: audit 2024-03-11T22:21:33.641181+0000 mon.a (mon.0) 2711 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:21:35.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:34 smithi049 bash[28804]: audit 2024-03-11T22:21:33.643592+0000 mon.a (mon.0) 2712 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-92"}]: dispatch 2024-03-11T22:21:35.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:35 smithi187 bash[23415]: cluster 2024-03-11T22:21:34.276887+0000 mgr.y (mgr.14601) 515 : cluster 0 pgmap v793: 292 pgs: 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:21:35.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:35 smithi187 bash[23415]: cluster 2024-03-11T22:21:34.559638+0000 mon.a (mon.0) 2713 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-03-11T22:21:36.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:35 smithi049 bash[21434]: cluster 2024-03-11T22:21:34.276887+0000 mgr.y (mgr.14601) 515 : cluster 0 pgmap v793: 292 pgs: 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:21:36.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:35 smithi049 bash[21434]: cluster 2024-03-11T22:21:34.559638+0000 mon.a (mon.0) 2713 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-03-11T22:21:36.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:35 smithi049 bash[28804]: cluster 2024-03-11T22:21:34.276887+0000 mgr.y (mgr.14601) 515 : cluster 0 pgmap v793: 292 pgs: 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:21:36.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:35 smithi049 bash[28804]: cluster 2024-03-11T22:21:34.559638+0000 mon.a (mon.0) 2713 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-03-11T22:21:36.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:36 smithi187 bash[23415]: audit 2024-03-11T22:21:35.571412+0000 mon.b (mon.1) 393 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:36.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:36 smithi187 bash[23415]: cluster 2024-03-11T22:21:35.574102+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-03-11T22:21:36.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:36 smithi187 bash[23415]: audit 2024-03-11T22:21:35.584636+0000 mon.a (mon.0) 2715 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:36 smithi049 bash[21434]: audit 2024-03-11T22:21:35.571412+0000 mon.b (mon.1) 393 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:36 smithi049 bash[21434]: cluster 2024-03-11T22:21:35.574102+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-03-11T22:21:37.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:36 smithi049 bash[21434]: audit 2024-03-11T22:21:35.584636+0000 mon.a (mon.0) 2715 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:36 smithi049 bash[28804]: audit 2024-03-11T22:21:35.571412+0000 mon.b (mon.1) 393 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:36 smithi049 bash[28804]: cluster 2024-03-11T22:21:35.574102+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-03-11T22:21:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:36 smithi049 bash[28804]: audit 2024-03-11T22:21:35.584636+0000 mon.a (mon.0) 2715 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:21:37.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:37 smithi187 bash[23415]: cluster 2024-03-11T22:21:36.277988+0000 mgr.y (mgr.14601) 516 : cluster 0 pgmap v796: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:21:37.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:37 smithi187 bash[23415]: cluster 2024-03-11T22:21:36.566697+0000 mon.a (mon.0) 2716 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:37.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:37 smithi187 bash[23415]: audit 2024-03-11T22:21:36.576514+0000 mon.a (mon.0) 2717 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:37.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:37 smithi187 bash[23415]: audit 2024-03-11T22:21:36.581996+0000 mon.b (mon.1) 394 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:37.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:37 smithi187 bash[23415]: cluster 2024-03-11T22:21:36.585941+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-03-11T22:21:38.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[21434]: cluster 2024-03-11T22:21:36.277988+0000 mgr.y (mgr.14601) 516 : cluster 0 pgmap v796: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:21:38.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[21434]: cluster 2024-03-11T22:21:36.566697+0000 mon.a (mon.0) 2716 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:38.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[21434]: audit 2024-03-11T22:21:36.576514+0000 mon.a (mon.0) 2717 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:38.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[21434]: audit 2024-03-11T22:21:36.581996+0000 mon.b (mon.1) 394 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:38.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[21434]: cluster 2024-03-11T22:21:36.585941+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-03-11T22:21:38.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[28804]: cluster 2024-03-11T22:21:36.277988+0000 mgr.y (mgr.14601) 516 : cluster 0 pgmap v796: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-11T22:21:38.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[28804]: cluster 2024-03-11T22:21:36.566697+0000 mon.a (mon.0) 2716 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:38.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[28804]: audit 2024-03-11T22:21:36.576514+0000 mon.a (mon.0) 2717 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:21:38.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[28804]: audit 2024-03-11T22:21:36.581996+0000 mon.b (mon.1) 394 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:21:38.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:37 smithi049 bash[28804]: cluster 2024-03-11T22:21:36.585941+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-03-11T22:21:38.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:38 smithi187 bash[23415]: cluster 2024-03-11T22:21:37.595789+0000 mon.a (mon.0) 2719 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-03-11T22:21:39.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:38 smithi049 bash[21434]: cluster 2024-03-11T22:21:37.595789+0000 mon.a (mon.0) 2719 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-03-11T22:21:39.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:38 smithi049 bash[28804]: cluster 2024-03-11T22:21:37.595789+0000 mon.a (mon.0) 2719 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-03-11T22:21:39.496 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:21:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:21:39.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:39 smithi187 bash[23415]: cluster 2024-03-11T22:21:38.278873+0000 mgr.y (mgr.14601) 517 : cluster 0 pgmap v799: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:39.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:39 smithi187 bash[23415]: cluster 2024-03-11T22:21:38.607227+0000 mon.a (mon.0) 2720 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-03-11T22:21:39.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:39 smithi187 bash[23415]: audit 2024-03-11T22:21:39.049858+0000 mgr.y (mgr.14601) 518 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:40.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:39 smithi049 bash[21434]: cluster 2024-03-11T22:21:38.278873+0000 mgr.y (mgr.14601) 517 : cluster 0 pgmap v799: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:40.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:39 smithi049 bash[21434]: cluster 2024-03-11T22:21:38.607227+0000 mon.a (mon.0) 2720 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-03-11T22:21:40.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:39 smithi049 bash[21434]: audit 2024-03-11T22:21:39.049858+0000 mgr.y (mgr.14601) 518 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:40.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:39 smithi049 bash[28804]: cluster 2024-03-11T22:21:38.278873+0000 mgr.y (mgr.14601) 517 : cluster 0 pgmap v799: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:21:40.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:39 smithi049 bash[28804]: cluster 2024-03-11T22:21:38.607227+0000 mon.a (mon.0) 2720 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-03-11T22:21:40.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:39 smithi049 bash[28804]: audit 2024-03-11T22:21:39.049858+0000 mgr.y (mgr.14601) 518 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:41.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:41 smithi187 bash[23415]: cluster 2024-03-11T22:21:40.280237+0000 mgr.y (mgr.14601) 519 : cluster 0 pgmap v801: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:41.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:41 smithi187 bash[23415]: audit 2024-03-11T22:21:40.964487+0000 mon.c (mon.2) 600 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:42.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:41 smithi049 bash[21434]: cluster 2024-03-11T22:21:40.280237+0000 mgr.y (mgr.14601) 519 : cluster 0 pgmap v801: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:42.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:41 smithi049 bash[21434]: audit 2024-03-11T22:21:40.964487+0000 mon.c (mon.2) 600 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:42.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:41 smithi049 bash[28804]: cluster 2024-03-11T22:21:40.280237+0000 mgr.y (mgr.14601) 519 : cluster 0 pgmap v801: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-11T22:21:42.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:41 smithi049 bash[28804]: audit 2024-03-11T22:21:40.964487+0000 mon.c (mon.2) 600 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:43.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:43 smithi187 bash[23415]: cluster 2024-03-11T22:21:42.281141+0000 mgr.y (mgr.14601) 520 : cluster 0 pgmap v802: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:21:44.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:43 smithi049 bash[21434]: cluster 2024-03-11T22:21:42.281141+0000 mgr.y (mgr.14601) 520 : cluster 0 pgmap v802: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:21:44.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:43 smithi049 bash[28804]: cluster 2024-03-11T22:21:42.281141+0000 mgr.y (mgr.14601) 520 : cluster 0 pgmap v802: 292 pgs: 292 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:21:44.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:21:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:21:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:21:45.996 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:45 smithi187 bash[23415]: cluster 2024-03-11T22:21:44.283852+0000 mgr.y (mgr.14601) 521 : cluster 0 pgmap v803: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-03-11T22:21:46.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:45 smithi049 bash[21434]: cluster 2024-03-11T22:21:44.283852+0000 mgr.y (mgr.14601) 521 : cluster 0 pgmap v803: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-03-11T22:21:46.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:45 smithi049 bash[28804]: cluster 2024-03-11T22:21:44.283852+0000 mgr.y (mgr.14601) 521 : cluster 0 pgmap v803: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.0 KiB/s wr, 4 op/s 2024-03-11T22:21:46.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:46 smithi187 bash[23415]: cluster 2024-03-11T22:21:45.762214+0000 mon.a (mon.0) 2721 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:46 smithi049 bash[21434]: cluster 2024-03-11T22:21:45.762214+0000 mon.a (mon.0) 2721 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:47.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:46 smithi049 bash[28804]: cluster 2024-03-11T22:21:45.762214+0000 mon.a (mon.0) 2721 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:21:47.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:47 smithi187 bash[23415]: cluster 2024-03-11T22:21:46.284704+0000 mgr.y (mgr.14601) 522 : cluster 0 pgmap v804: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 942 B/s wr, 4 op/s 2024-03-11T22:21:48.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:47 smithi049 bash[21434]: cluster 2024-03-11T22:21:46.284704+0000 mgr.y (mgr.14601) 522 : cluster 0 pgmap v804: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 942 B/s wr, 4 op/s 2024-03-11T22:21:48.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:47 smithi049 bash[28804]: cluster 2024-03-11T22:21:46.284704+0000 mgr.y (mgr.14601) 522 : cluster 0 pgmap v804: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 942 B/s wr, 4 op/s 2024-03-11T22:21:49.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:21:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:21:49.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:49 smithi187 bash[23415]: cluster 2024-03-11T22:21:48.285687+0000 mgr.y (mgr.14601) 523 : cluster 0 pgmap v805: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 818 B/s wr, 3 op/s 2024-03-11T22:21:49.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:49 smithi187 bash[23415]: audit 2024-03-11T22:21:49.059037+0000 mgr.y (mgr.14601) 524 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:50.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:49 smithi049 bash[21434]: cluster 2024-03-11T22:21:48.285687+0000 mgr.y (mgr.14601) 523 : cluster 0 pgmap v805: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 818 B/s wr, 3 op/s 2024-03-11T22:21:50.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:49 smithi049 bash[21434]: audit 2024-03-11T22:21:49.059037+0000 mgr.y (mgr.14601) 524 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:50.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:49 smithi049 bash[28804]: cluster 2024-03-11T22:21:48.285687+0000 mgr.y (mgr.14601) 523 : cluster 0 pgmap v805: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 818 B/s wr, 3 op/s 2024-03-11T22:21:50.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:49 smithi049 bash[28804]: audit 2024-03-11T22:21:49.059037+0000 mgr.y (mgr.14601) 524 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:21:50.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:50 smithi187 bash[23415]: cluster 2024-03-11T22:21:49.643171+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-03-11T22:21:51.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:50 smithi049 bash[21434]: cluster 2024-03-11T22:21:49.643171+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-03-11T22:21:51.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:50 smithi049 bash[28804]: cluster 2024-03-11T22:21:49.643171+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-03-11T22:21:51.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:51 smithi187 bash[23415]: cluster 2024-03-11T22:21:50.286704+0000 mgr.y (mgr.14601) 525 : cluster 0 pgmap v807: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-03-11T22:21:52.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:51 smithi049 bash[21434]: cluster 2024-03-11T22:21:50.286704+0000 mgr.y (mgr.14601) 525 : cluster 0 pgmap v807: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-03-11T22:21:52.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:51 smithi049 bash[28804]: cluster 2024-03-11T22:21:50.286704+0000 mgr.y (mgr.14601) 525 : cluster 0 pgmap v807: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-03-11T22:21:53.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:53 smithi187 bash[23415]: cluster 2024-03-11T22:21:52.287756+0000 mgr.y (mgr.14601) 526 : cluster 0 pgmap v808: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-03-11T22:21:54.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:53 smithi049 bash[21434]: cluster 2024-03-11T22:21:52.287756+0000 mgr.y (mgr.14601) 526 : cluster 0 pgmap v808: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-03-11T22:21:54.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:53 smithi049 bash[28804]: cluster 2024-03-11T22:21:52.287756+0000 mgr.y (mgr.14601) 526 : cluster 0 pgmap v808: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-03-11T22:21:54.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:21:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:21:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:21:55.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:55 smithi187 bash[23415]: cluster 2024-03-11T22:21:54.290633+0000 mgr.y (mgr.14601) 527 : cluster 0 pgmap v809: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:21:56.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:55 smithi049 bash[21434]: cluster 2024-03-11T22:21:54.290633+0000 mgr.y (mgr.14601) 527 : cluster 0 pgmap v809: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:21:56.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:55 smithi049 bash[28804]: cluster 2024-03-11T22:21:54.290633+0000 mgr.y (mgr.14601) 527 : cluster 0 pgmap v809: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:21:57.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:56 smithi049 bash[21434]: cluster 2024-03-11T22:21:55.775425+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-03-11T22:21:57.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:56 smithi049 bash[21434]: audit 2024-03-11T22:21:56.000393+0000 mon.c (mon.2) 601 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:57.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:56 smithi049 bash[28804]: cluster 2024-03-11T22:21:55.775425+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-03-11T22:21:57.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:56 smithi049 bash[28804]: audit 2024-03-11T22:21:56.000393+0000 mon.c (mon.2) 601 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:57.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:56 smithi187 bash[23415]: cluster 2024-03-11T22:21:55.775425+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-03-11T22:21:57.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:56 smithi187 bash[23415]: audit 2024-03-11T22:21:56.000393+0000 mon.c (mon.2) 601 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:21:58.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:57 smithi049 bash[21434]: cluster 2024-03-11T22:21:56.291558+0000 mgr.y (mgr.14601) 528 : cluster 0 pgmap v811: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:21:58.022 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:57 smithi049 bash[28804]: cluster 2024-03-11T22:21:56.291558+0000 mgr.y (mgr.14601) 528 : cluster 0 pgmap v811: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:21:58.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:57 smithi187 bash[23415]: cluster 2024-03-11T22:21:56.291558+0000 mgr.y (mgr.14601) 528 : cluster 0 pgmap v811: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:21:59.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:21:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:22:00.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:59 smithi187 bash[23415]: cluster 2024-03-11T22:21:58.292575+0000 mgr.y (mgr.14601) 529 : cluster 0 pgmap v812: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:00.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:59 smithi187 bash[23415]: audit 2024-03-11T22:21:59.070525+0000 mgr.y (mgr.14601) 530 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:00.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:59 smithi187 bash[23415]: audit 2024-03-11T22:21:59.686891+0000 mon.b (mon.1) 395 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:00.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:59 smithi187 bash[23415]: audit 2024-03-11T22:21:59.689408+0000 mon.b (mon.1) 396 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-94"}]: dispatch 2024-03-11T22:22:00.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:59 smithi187 bash[23415]: audit 2024-03-11T22:21:59.695788+0000 mon.a (mon.0) 2724 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:00.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:21:59 smithi187 bash[23415]: audit 2024-03-11T22:21:59.698189+0000 mon.a (mon.0) 2725 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-94"}]: dispatch 2024-03-11T22:22:00.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[21434]: cluster 2024-03-11T22:21:58.292575+0000 mgr.y (mgr.14601) 529 : cluster 0 pgmap v812: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:00.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[21434]: audit 2024-03-11T22:21:59.070525+0000 mgr.y (mgr.14601) 530 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:00.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[21434]: audit 2024-03-11T22:21:59.686891+0000 mon.b (mon.1) 395 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:00.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[21434]: audit 2024-03-11T22:21:59.689408+0000 mon.b (mon.1) 396 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-94"}]: dispatch 2024-03-11T22:22:00.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[21434]: audit 2024-03-11T22:21:59.695788+0000 mon.a (mon.0) 2724 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:00.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[21434]: audit 2024-03-11T22:21:59.698189+0000 mon.a (mon.0) 2725 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-94"}]: dispatch 2024-03-11T22:22:00.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[28804]: cluster 2024-03-11T22:21:58.292575+0000 mgr.y (mgr.14601) 529 : cluster 0 pgmap v812: 292 pgs: 292 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:00.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[28804]: audit 2024-03-11T22:21:59.070525+0000 mgr.y (mgr.14601) 530 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:00.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[28804]: audit 2024-03-11T22:21:59.686891+0000 mon.b (mon.1) 395 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:00.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[28804]: audit 2024-03-11T22:21:59.689408+0000 mon.b (mon.1) 396 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-94"}]: dispatch 2024-03-11T22:22:00.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[28804]: audit 2024-03-11T22:21:59.695788+0000 mon.a (mon.0) 2724 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:00.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:21:59 smithi049 bash[28804]: audit 2024-03-11T22:21:59.698189+0000 mon.a (mon.0) 2725 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-94"}]: dispatch 2024-03-11T22:22:01.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:00 smithi187 bash[23415]: cluster 2024-03-11T22:21:59.796867+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-03-11T22:22:01.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:00 smithi049 bash[28804]: cluster 2024-03-11T22:21:59.796867+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-03-11T22:22:01.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:00 smithi049 bash[21434]: cluster 2024-03-11T22:21:59.796867+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-03-11T22:22:02.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:01 smithi187 bash[23415]: cluster 2024-03-11T22:22:00.293425+0000 mgr.y (mgr.14601) 531 : cluster 0 pgmap v814: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:22:02.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:01 smithi187 bash[23415]: audit 2024-03-11T22:22:00.817398+0000 mon.b (mon.1) 397 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:02.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:01 smithi187 bash[23415]: cluster 2024-03-11T22:22:00.818471+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-03-11T22:22:02.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:01 smithi187 bash[23415]: audit 2024-03-11T22:22:00.827071+0000 mon.a (mon.0) 2728 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[21434]: cluster 2024-03-11T22:22:00.293425+0000 mgr.y (mgr.14601) 531 : cluster 0 pgmap v814: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:22:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[21434]: audit 2024-03-11T22:22:00.817398+0000 mon.b (mon.1) 397 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[21434]: cluster 2024-03-11T22:22:00.818471+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-03-11T22:22:02.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[21434]: audit 2024-03-11T22:22:00.827071+0000 mon.a (mon.0) 2728 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:02.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[28804]: cluster 2024-03-11T22:22:00.293425+0000 mgr.y (mgr.14601) 531 : cluster 0 pgmap v814: 260 pgs: 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:22:02.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[28804]: audit 2024-03-11T22:22:00.817398+0000 mon.b (mon.1) 397 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:02.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[28804]: cluster 2024-03-11T22:22:00.818471+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-03-11T22:22:02.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:01 smithi049 bash[28804]: audit 2024-03-11T22:22:00.827071+0000 mon.a (mon.0) 2728 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:03.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:02 smithi187 bash[23415]: audit 2024-03-11T22:22:01.807974+0000 mon.a (mon.0) 2729 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:03.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:02 smithi187 bash[23415]: cluster 2024-03-11T22:22:01.814816+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-03-11T22:22:03.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:02 smithi187 bash[23415]: audit 2024-03-11T22:22:01.899422+0000 mon.b (mon.1) 398 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:22:03.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:02 smithi049 bash[21434]: audit 2024-03-11T22:22:01.807974+0000 mon.a (mon.0) 2729 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:03.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:02 smithi049 bash[21434]: cluster 2024-03-11T22:22:01.814816+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-03-11T22:22:03.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:02 smithi049 bash[21434]: audit 2024-03-11T22:22:01.899422+0000 mon.b (mon.1) 398 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:22:03.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:02 smithi049 bash[28804]: audit 2024-03-11T22:22:01.807974+0000 mon.a (mon.0) 2729 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:03.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:02 smithi049 bash[28804]: cluster 2024-03-11T22:22:01.814816+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-03-11T22:22:03.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:02 smithi049 bash[28804]: audit 2024-03-11T22:22:01.899422+0000 mon.b (mon.1) 398 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:22:04.228 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:03 smithi049 bash[28804]: cluster 2024-03-11T22:22:02.294413+0000 mgr.y (mgr.14601) 532 : cluster 0 pgmap v817: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:04.228 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:03 smithi049 bash[28804]: cluster 2024-03-11T22:22:02.838116+0000 mon.a (mon.0) 2731 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-03-11T22:22:04.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:03 smithi049 bash[21434]: cluster 2024-03-11T22:22:02.294413+0000 mgr.y (mgr.14601) 532 : cluster 0 pgmap v817: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:04.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:03 smithi049 bash[21434]: cluster 2024-03-11T22:22:02.838116+0000 mon.a (mon.0) 2731 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-03-11T22:22:04.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:03 smithi187 bash[23415]: cluster 2024-03-11T22:22:02.294413+0000 mgr.y (mgr.14601) 532 : cluster 0 pgmap v817: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:04.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:03 smithi187 bash[23415]: cluster 2024-03-11T22:22:02.838116+0000 mon.a (mon.0) 2731 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-03-11T22:22:04.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:22:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:22:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:22:06.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:05 smithi187 bash[23415]: cluster 2024-03-11T22:22:04.297084+0000 mgr.y (mgr.14601) 533 : cluster 0 pgmap v819: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-11T22:22:06.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:05 smithi049 bash[21434]: cluster 2024-03-11T22:22:04.297084+0000 mgr.y (mgr.14601) 533 : cluster 0 pgmap v819: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-11T22:22:06.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:05 smithi049 bash[28804]: cluster 2024-03-11T22:22:04.297084+0000 mgr.y (mgr.14601) 533 : cluster 0 pgmap v819: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-11T22:22:08.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:07 smithi187 bash[23415]: cluster 2024-03-11T22:22:06.297911+0000 mgr.y (mgr.14601) 534 : cluster 0 pgmap v820: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:22:08.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:07 smithi049 bash[21434]: cluster 2024-03-11T22:22:06.297911+0000 mgr.y (mgr.14601) 534 : cluster 0 pgmap v820: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:22:08.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:07 smithi049 bash[28804]: cluster 2024-03-11T22:22:06.297911+0000 mgr.y (mgr.14601) 534 : cluster 0 pgmap v820: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:22:09.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:22:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:22:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:09 smithi187 bash[23415]: cluster 2024-03-11T22:22:08.298816+0000 mgr.y (mgr.14601) 535 : cluster 0 pgmap v821: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 684 B/s rd, 820 B/s wr, 2 op/s 2024-03-11T22:22:10.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:09 smithi187 bash[23415]: audit 2024-03-11T22:22:09.082045+0000 mgr.y (mgr.14601) 536 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:10.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:09 smithi049 bash[21434]: cluster 2024-03-11T22:22:08.298816+0000 mgr.y (mgr.14601) 535 : cluster 0 pgmap v821: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 684 B/s rd, 820 B/s wr, 2 op/s 2024-03-11T22:22:10.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:09 smithi049 bash[21434]: audit 2024-03-11T22:22:09.082045+0000 mgr.y (mgr.14601) 536 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:10.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:09 smithi049 bash[28804]: cluster 2024-03-11T22:22:08.298816+0000 mgr.y (mgr.14601) 535 : cluster 0 pgmap v821: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 684 B/s rd, 820 B/s wr, 2 op/s 2024-03-11T22:22:10.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:09 smithi049 bash[28804]: audit 2024-03-11T22:22:09.082045+0000 mgr.y (mgr.14601) 536 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:12.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:11 smithi187 bash[23415]: cluster 2024-03-11T22:22:10.301503+0000 mgr.y (mgr.14601) 537 : cluster 0 pgmap v822: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 723 B/s wr, 2 op/s 2024-03-11T22:22:12.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:11 smithi187 bash[23415]: audit 2024-03-11T22:22:11.035290+0000 mon.c (mon.2) 602 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:12.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:11 smithi049 bash[21434]: cluster 2024-03-11T22:22:10.301503+0000 mgr.y (mgr.14601) 537 : cluster 0 pgmap v822: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 723 B/s wr, 2 op/s 2024-03-11T22:22:12.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:11 smithi049 bash[21434]: audit 2024-03-11T22:22:11.035290+0000 mon.c (mon.2) 602 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:12.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:11 smithi049 bash[28804]: cluster 2024-03-11T22:22:10.301503+0000 mgr.y (mgr.14601) 537 : cluster 0 pgmap v822: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 723 B/s wr, 2 op/s 2024-03-11T22:22:12.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:11 smithi049 bash[28804]: audit 2024-03-11T22:22:11.035290+0000 mon.c (mon.2) 602 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:13.247 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:22:12 smithi187 bash[32377]: debug 2024-03-11T22:22:12.893+0000 7f0e85eca700 -1 snap_mapper.add_oid found existing snaps mapped on 95:ff437755:test-rados-api-smithi049-64247-97::foo:21, removing 2024-03-11T22:22:13.272 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:22:12 smithi049 bash[31830]: debug 2024-03-11T22:22:12.901+0000 7f9cb9919700 -1 snap_mapper.add_oid found existing snaps mapped on 95:ff437755:test-rados-api-smithi049-64247-97::foo:21, removing 2024-03-11T22:22:13.272 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:22:12 smithi049 bash[49022]: debug 2024-03-11T22:22:12.901+0000 7f45ea88f700 -1 snap_mapper.add_oid found existing snaps mapped on 95:ff437755:test-rados-api-smithi049-64247-97::foo:21, removing 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[28804]: cluster 2024-03-11T22:22:12.302355+0000 mgr.y (mgr.14601) 538 : cluster 0 pgmap v823: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 613 B/s wr, 2 op/s 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[28804]: audit 2024-03-11T22:22:12.936560+0000 mon.b (mon.1) 399 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[28804]: audit 2024-03-11T22:22:12.938881+0000 mon.b (mon.1) 400 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-96"}]: dispatch 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[28804]: audit 2024-03-11T22:22:12.945472+0000 mon.a (mon.0) 2732 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[28804]: audit 2024-03-11T22:22:12.947713+0000 mon.a (mon.0) 2733 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-96"}]: dispatch 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[21434]: cluster 2024-03-11T22:22:12.302355+0000 mgr.y (mgr.14601) 538 : cluster 0 pgmap v823: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 613 B/s wr, 2 op/s 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[21434]: audit 2024-03-11T22:22:12.936560+0000 mon.b (mon.1) 399 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:14.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[21434]: audit 2024-03-11T22:22:12.938881+0000 mon.b (mon.1) 400 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-96"}]: dispatch 2024-03-11T22:22:14.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[21434]: audit 2024-03-11T22:22:12.945472+0000 mon.a (mon.0) 2732 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:14.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:13 smithi049 bash[21434]: audit 2024-03-11T22:22:12.947713+0000 mon.a (mon.0) 2733 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-96"}]: dispatch 2024-03-11T22:22:14.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:13 smithi187 bash[23415]: cluster 2024-03-11T22:22:12.302355+0000 mgr.y (mgr.14601) 538 : cluster 0 pgmap v823: 292 pgs: 292 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 613 B/s wr, 2 op/s 2024-03-11T22:22:14.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:13 smithi187 bash[23415]: audit 2024-03-11T22:22:12.936560+0000 mon.b (mon.1) 399 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:14.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:13 smithi187 bash[23415]: audit 2024-03-11T22:22:12.938881+0000 mon.b (mon.1) 400 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-96"}]: dispatch 2024-03-11T22:22:14.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:13 smithi187 bash[23415]: audit 2024-03-11T22:22:12.945472+0000 mon.a (mon.0) 2732 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:14.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:13 smithi187 bash[23415]: audit 2024-03-11T22:22:12.947713+0000 mon.a (mon.0) 2733 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-96"}]: dispatch 2024-03-11T22:22:14.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:22:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:22:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:22:15.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:14 smithi187 bash[23415]: cluster 2024-03-11T22:22:13.857701+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-03-11T22:22:15.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:14 smithi049 bash[21434]: cluster 2024-03-11T22:22:13.857701+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-03-11T22:22:15.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:14 smithi049 bash[28804]: cluster 2024-03-11T22:22:13.857701+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-03-11T22:22:16.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:15 smithi187 bash[23415]: cluster 2024-03-11T22:22:14.303137+0000 mgr.y (mgr.14601) 539 : cluster 0 pgmap v825: 260 pgs: 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-03-11T22:22:16.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:15 smithi187 bash[23415]: audit 2024-03-11T22:22:14.880582+0000 mon.b (mon.1) 401 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:16.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:15 smithi187 bash[23415]: cluster 2024-03-11T22:22:14.884307+0000 mon.a (mon.0) 2735 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-03-11T22:22:16.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:15 smithi187 bash[23415]: audit 2024-03-11T22:22:14.889920+0000 mon.a (mon.0) 2736 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:16.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[21434]: cluster 2024-03-11T22:22:14.303137+0000 mgr.y (mgr.14601) 539 : cluster 0 pgmap v825: 260 pgs: 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-03-11T22:22:16.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[21434]: audit 2024-03-11T22:22:14.880582+0000 mon.b (mon.1) 401 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:16.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[21434]: cluster 2024-03-11T22:22:14.884307+0000 mon.a (mon.0) 2735 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-03-11T22:22:16.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[21434]: audit 2024-03-11T22:22:14.889920+0000 mon.a (mon.0) 2736 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[28804]: cluster 2024-03-11T22:22:14.303137+0000 mgr.y (mgr.14601) 539 : cluster 0 pgmap v825: 260 pgs: 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-03-11T22:22:16.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[28804]: audit 2024-03-11T22:22:14.880582+0000 mon.b (mon.1) 401 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:16.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[28804]: cluster 2024-03-11T22:22:14.884307+0000 mon.a (mon.0) 2735 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-03-11T22:22:16.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:15 smithi049 bash[28804]: audit 2024-03-11T22:22:14.889920+0000 mon.a (mon.0) 2736 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:17.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:16 smithi187 bash[23415]: audit 2024-03-11T22:22:15.879278+0000 mon.a (mon.0) 2737 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:17.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:16 smithi187 bash[23415]: cluster 2024-03-11T22:22:15.887358+0000 mon.a (mon.0) 2738 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-03-11T22:22:17.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:16 smithi187 bash[23415]: audit 2024-03-11T22:22:15.927038+0000 mon.b (mon.1) 402 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:17.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:16 smithi187 bash[23415]: audit 2024-03-11T22:22:15.937782+0000 mon.a (mon.0) 2739 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:17.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[28804]: audit 2024-03-11T22:22:15.879278+0000 mon.a (mon.0) 2737 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:17.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[28804]: cluster 2024-03-11T22:22:15.887358+0000 mon.a (mon.0) 2738 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-03-11T22:22:17.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[28804]: audit 2024-03-11T22:22:15.927038+0000 mon.b (mon.1) 402 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:17.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[28804]: audit 2024-03-11T22:22:15.937782+0000 mon.a (mon.0) 2739 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:17.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[21434]: audit 2024-03-11T22:22:15.879278+0000 mon.a (mon.0) 2737 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:17.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[21434]: cluster 2024-03-11T22:22:15.887358+0000 mon.a (mon.0) 2738 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-03-11T22:22:17.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[21434]: audit 2024-03-11T22:22:15.927038+0000 mon.b (mon.1) 402 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:17.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:16 smithi049 bash[21434]: audit 2024-03-11T22:22:15.937782+0000 mon.a (mon.0) 2739 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:18.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:17 smithi187 bash[23415]: cluster 2024-03-11T22:22:16.304054+0000 mgr.y (mgr.14601) 540 : cluster 0 pgmap v828: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:22:18.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:17 smithi187 bash[23415]: audit 2024-03-11T22:22:16.904068+0000 mon.a (mon.0) 2740 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:22:18.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:17 smithi187 bash[23415]: audit 2024-03-11T22:22:16.908038+0000 mon.b (mon.1) 403 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]: dispatch 2024-03-11T22:22:18.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:17 smithi187 bash[23415]: cluster 2024-03-11T22:22:16.913382+0000 mon.a (mon.0) 2741 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-03-11T22:22:18.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:17 smithi187 bash[23415]: audit 2024-03-11T22:22:16.917072+0000 mon.a (mon.0) 2742 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]: dispatch 2024-03-11T22:22:18.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:17 smithi187 bash[23415]: audit 2024-03-11T22:22:17.688929+0000 mon.c (mon.2) 603 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:22:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[21434]: cluster 2024-03-11T22:22:16.304054+0000 mgr.y (mgr.14601) 540 : cluster 0 pgmap v828: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:22:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[21434]: audit 2024-03-11T22:22:16.904068+0000 mon.a (mon.0) 2740 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:22:18.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[21434]: audit 2024-03-11T22:22:16.908038+0000 mon.b (mon.1) 403 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]: dispatch 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[21434]: cluster 2024-03-11T22:22:16.913382+0000 mon.a (mon.0) 2741 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[21434]: audit 2024-03-11T22:22:16.917072+0000 mon.a (mon.0) 2742 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]: dispatch 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[21434]: audit 2024-03-11T22:22:17.688929+0000 mon.c (mon.2) 603 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[28804]: cluster 2024-03-11T22:22:16.304054+0000 mgr.y (mgr.14601) 540 : cluster 0 pgmap v828: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[28804]: audit 2024-03-11T22:22:16.904068+0000 mon.a (mon.0) 2740 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[28804]: audit 2024-03-11T22:22:16.908038+0000 mon.b (mon.1) 403 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]: dispatch 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[28804]: cluster 2024-03-11T22:22:16.913382+0000 mon.a (mon.0) 2741 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[28804]: audit 2024-03-11T22:22:16.917072+0000 mon.a (mon.0) 2742 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]: dispatch 2024-03-11T22:22:18.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:17 smithi049 bash[28804]: audit 2024-03-11T22:22:17.688929+0000 mon.c (mon.2) 603 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:22:19.247 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:22:19.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: cluster 2024-03-11T22:22:17.904481+0000 mon.a (mon.0) 2743 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:19.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:17.905754+0000 mon.b (mon.1) 404 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:19.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:17.906675+0000 mon.a (mon.0) 2744 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]': finished 2024-03-11T22:22:19.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: cluster 2024-03-11T22:22:17.913276+0000 mon.a (mon.0) 2745 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-03-11T22:22:19.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:17.916243+0000 mon.a (mon.0) 2746 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:19.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:18.431635+0000 mon.c (mon.2) 604 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:22:19.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:18.433311+0000 mon.c (mon.2) 605 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:22:19.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:18.442471+0000 mon.a (mon.0) 2747 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:22:19.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:18.908766+0000 mon.b (mon.1) 405 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:22:19.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: audit 2024-03-11T22:22:18.909234+0000 mon.a (mon.0) 2748 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]': finished 2024-03-11T22:22:19.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:18 smithi187 bash[23415]: cluster 2024-03-11T22:22:18.916197+0000 mon.a (mon.0) 2749 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-03-11T22:22:19.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: cluster 2024-03-11T22:22:17.904481+0000 mon.a (mon.0) 2743 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:19.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:17.905754+0000 mon.b (mon.1) 404 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:19.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:17.906675+0000 mon.a (mon.0) 2744 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]': finished 2024-03-11T22:22:19.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: cluster 2024-03-11T22:22:17.913276+0000 mon.a (mon.0) 2745 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-03-11T22:22:19.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:17.916243+0000 mon.a (mon.0) 2746 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:19.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:18.431635+0000 mon.c (mon.2) 604 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:22:19.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:18.433311+0000 mon.c (mon.2) 605 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:22:19.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:18.442471+0000 mon.a (mon.0) 2747 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:22:19.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:18.908766+0000 mon.b (mon.1) 405 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:22:19.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: audit 2024-03-11T22:22:18.909234+0000 mon.a (mon.0) 2748 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]': finished 2024-03-11T22:22:19.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[21434]: cluster 2024-03-11T22:22:18.916197+0000 mon.a (mon.0) 2749 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-03-11T22:22:19.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: cluster 2024-03-11T22:22:17.904481+0000 mon.a (mon.0) 2743 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:19.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:17.905754+0000 mon.b (mon.1) 404 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:19.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:17.906675+0000 mon.a (mon.0) 2744 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-98", "mode": "writeback"}]': finished 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: cluster 2024-03-11T22:22:17.913276+0000 mon.a (mon.0) 2745 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:17.916243+0000 mon.a (mon.0) 2746 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:18.431635+0000 mon.c (mon.2) 604 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:18.433311+0000 mon.c (mon.2) 605 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:18.442471+0000 mon.a (mon.0) 2747 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:18.908766+0000 mon.b (mon.1) 405 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: audit 2024-03-11T22:22:18.909234+0000 mon.a (mon.0) 2748 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-98"}]': finished 2024-03-11T22:22:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:18 smithi049 bash[28804]: cluster 2024-03-11T22:22:18.916197+0000 mon.a (mon.0) 2749 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-03-11T22:22:20.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: cluster 2024-03-11T22:22:18.304612+0000 mgr.y (mgr.14601) 541 : cluster 0 pgmap v831: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:20.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: audit 2024-03-11T22:22:18.919433+0000 mon.a (mon.0) 2750 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:22:20.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: audit 2024-03-11T22:22:19.093576+0000 mgr.y (mgr.14601) 542 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:20.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: cluster 2024-03-11T22:22:19.909646+0000 mon.a (mon.0) 2751 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:20.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: audit 2024-03-11T22:22:19.912019+0000 mon.a (mon.0) 2752 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:22:20.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: audit 2024-03-11T22:22:19.912104+0000 mon.b (mon.1) 406 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-11T22:22:20.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: cluster 2024-03-11T22:22:19.918497+0000 mon.a (mon.0) 2753 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-03-11T22:22:20.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:19 smithi187 bash[23415]: audit 2024-03-11T22:22:19.922472+0000 mon.a (mon.0) 2754 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-11T22:22:20.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: cluster 2024-03-11T22:22:18.304612+0000 mgr.y (mgr.14601) 541 : cluster 0 pgmap v831: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:20.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: audit 2024-03-11T22:22:18.919433+0000 mon.a (mon.0) 2750 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:22:20.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: audit 2024-03-11T22:22:19.093576+0000 mgr.y (mgr.14601) 542 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: cluster 2024-03-11T22:22:19.909646+0000 mon.a (mon.0) 2751 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: audit 2024-03-11T22:22:19.912019+0000 mon.a (mon.0) 2752 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: audit 2024-03-11T22:22:19.912104+0000 mon.b (mon.1) 406 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: cluster 2024-03-11T22:22:19.918497+0000 mon.a (mon.0) 2753 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[28804]: audit 2024-03-11T22:22:19.922472+0000 mon.a (mon.0) 2754 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: cluster 2024-03-11T22:22:18.304612+0000 mgr.y (mgr.14601) 541 : cluster 0 pgmap v831: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: audit 2024-03-11T22:22:18.919433+0000 mon.a (mon.0) 2750 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: audit 2024-03-11T22:22:19.093576+0000 mgr.y (mgr.14601) 542 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: cluster 2024-03-11T22:22:19.909646+0000 mon.a (mon.0) 2751 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: audit 2024-03-11T22:22:19.912019+0000 mon.a (mon.0) 2752 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:22:20.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: audit 2024-03-11T22:22:19.912104+0000 mon.b (mon.1) 406 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-11T22:22:20.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: cluster 2024-03-11T22:22:19.918497+0000 mon.a (mon.0) 2753 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-03-11T22:22:20.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:19 smithi049 bash[21434]: audit 2024-03-11T22:22:19.922472+0000 mon.a (mon.0) 2754 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-11T22:22:22.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:21 smithi187 bash[23415]: cluster 2024-03-11T22:22:20.305437+0000 mgr.y (mgr.14601) 543 : cluster 0 pgmap v834: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:22:22.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:21 smithi187 bash[23415]: audit 2024-03-11T22:22:20.914742+0000 mon.b (mon.1) 407 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:22.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:21 smithi187 bash[23415]: audit 2024-03-11T22:22:20.914829+0000 mon.a (mon.0) 2755 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]': finished 2024-03-11T22:22:22.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:21 smithi187 bash[23415]: cluster 2024-03-11T22:22:20.921354+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-03-11T22:22:22.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:21 smithi187 bash[23415]: audit 2024-03-11T22:22:20.924351+0000 mon.a (mon.0) 2757 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:22.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[21434]: cluster 2024-03-11T22:22:20.305437+0000 mgr.y (mgr.14601) 543 : cluster 0 pgmap v834: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:22:22.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[21434]: audit 2024-03-11T22:22:20.914742+0000 mon.b (mon.1) 407 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:22.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[21434]: audit 2024-03-11T22:22:20.914829+0000 mon.a (mon.0) 2755 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]': finished 2024-03-11T22:22:22.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[21434]: cluster 2024-03-11T22:22:20.921354+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-03-11T22:22:22.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[21434]: audit 2024-03-11T22:22:20.924351+0000 mon.a (mon.0) 2757 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:22.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[28804]: cluster 2024-03-11T22:22:20.305437+0000 mgr.y (mgr.14601) 543 : cluster 0 pgmap v834: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:22:22.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[28804]: audit 2024-03-11T22:22:20.914742+0000 mon.b (mon.1) 407 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:22.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[28804]: audit 2024-03-11T22:22:20.914829+0000 mon.a (mon.0) 2755 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_count","val": "1"}]': finished 2024-03-11T22:22:22.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[28804]: cluster 2024-03-11T22:22:20.921354+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-03-11T22:22:22.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:21 smithi049 bash[28804]: audit 2024-03-11T22:22:20.924351+0000 mon.a (mon.0) 2757 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:23.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:22 smithi187 bash[23415]: audit 2024-03-11T22:22:21.917403+0000 mon.a (mon.0) 2758 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:22:23.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:22 smithi187 bash[23415]: audit 2024-03-11T22:22:21.917814+0000 mon.b (mon.1) 408 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-11T22:22:23.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:22 smithi187 bash[23415]: cluster 2024-03-11T22:22:21.924213+0000 mon.a (mon.0) 2759 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-03-11T22:22:23.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:22 smithi187 bash[23415]: audit 2024-03-11T22:22:21.936485+0000 mon.a (mon.0) 2760 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-11T22:22:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[21434]: audit 2024-03-11T22:22:21.917403+0000 mon.a (mon.0) 2758 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:22:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[21434]: audit 2024-03-11T22:22:21.917814+0000 mon.b (mon.1) 408 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-11T22:22:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[21434]: cluster 2024-03-11T22:22:21.924213+0000 mon.a (mon.0) 2759 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-03-11T22:22:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[21434]: audit 2024-03-11T22:22:21.936485+0000 mon.a (mon.0) 2760 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-11T22:22:23.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[28804]: audit 2024-03-11T22:22:21.917403+0000 mon.a (mon.0) 2758 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:22:23.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[28804]: audit 2024-03-11T22:22:21.917814+0000 mon.b (mon.1) 408 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-11T22:22:23.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[28804]: cluster 2024-03-11T22:22:21.924213+0000 mon.a (mon.0) 2759 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-03-11T22:22:23.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:22 smithi049 bash[28804]: audit 2024-03-11T22:22:21.936485+0000 mon.a (mon.0) 2760 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-11T22:22:24.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[21434]: cluster 2024-03-11T22:22:22.306284+0000 mgr.y (mgr.14601) 544 : cluster 0 pgmap v837: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:22:24.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[21434]: audit 2024-03-11T22:22:22.930638+0000 mon.a (mon.0) 2761 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]': finished 2024-03-11T22:22:24.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[21434]: cluster 2024-03-11T22:22:22.937596+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-03-11T22:22:24.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[21434]: audit 2024-03-11T22:22:23.014130+0000 mon.b (mon.1) 409 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:24.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[21434]: audit 2024-03-11T22:22:23.023134+0000 mon.a (mon.0) 2763 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[28804]: cluster 2024-03-11T22:22:22.306284+0000 mgr.y (mgr.14601) 544 : cluster 0 pgmap v837: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:22:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[28804]: audit 2024-03-11T22:22:22.930638+0000 mon.a (mon.0) 2761 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]': finished 2024-03-11T22:22:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[28804]: cluster 2024-03-11T22:22:22.937596+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-03-11T22:22:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[28804]: audit 2024-03-11T22:22:23.014130+0000 mon.b (mon.1) 409 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:23 smithi049 bash[28804]: audit 2024-03-11T22:22:23.023134+0000 mon.a (mon.0) 2763 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:24.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:23 smithi187 bash[23415]: cluster 2024-03-11T22:22:22.306284+0000 mgr.y (mgr.14601) 544 : cluster 0 pgmap v837: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:22:24.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:23 smithi187 bash[23415]: audit 2024-03-11T22:22:22.930638+0000 mon.a (mon.0) 2761 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-98","var": "target_max_objects","val": "250"}]': finished 2024-03-11T22:22:24.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:23 smithi187 bash[23415]: cluster 2024-03-11T22:22:22.937596+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-03-11T22:22:24.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:23 smithi187 bash[23415]: audit 2024-03-11T22:22:23.014130+0000 mon.b (mon.1) 409 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:24.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:23 smithi187 bash[23415]: audit 2024-03-11T22:22:23.023134+0000 mon.a (mon.0) 2763 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:24.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:22:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:24 smithi187 bash[23415]: audit 2024-03-11T22:22:23.952166+0000 mon.a (mon.0) 2764 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:24 smithi187 bash[23415]: audit 2024-03-11T22:22:23.955892+0000 mon.b (mon.1) 410 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:24 smithi187 bash[23415]: cluster 2024-03-11T22:22:23.958936+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-03-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:24 smithi187 bash[23415]: audit 2024-03-11T22:22:23.965085+0000 mon.a (mon.0) 2766 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:25.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[21434]: audit 2024-03-11T22:22:23.952166+0000 mon.a (mon.0) 2764 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:22:25.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[21434]: audit 2024-03-11T22:22:23.955892+0000 mon.b (mon.1) 410 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:25.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[21434]: cluster 2024-03-11T22:22:23.958936+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-03-11T22:22:25.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[21434]: audit 2024-03-11T22:22:23.965085+0000 mon.a (mon.0) 2766 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:25.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[28804]: audit 2024-03-11T22:22:23.952166+0000 mon.a (mon.0) 2764 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:22:25.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[28804]: audit 2024-03-11T22:22:23.955892+0000 mon.b (mon.1) 410 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:25.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[28804]: cluster 2024-03-11T22:22:23.958936+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-03-11T22:22:25.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:24 smithi049 bash[28804]: audit 2024-03-11T22:22:23.965085+0000 mon.a (mon.0) 2766 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]: dispatch 2024-03-11T22:22:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:26 smithi187 bash[23415]: cluster 2024-03-11T22:22:24.307194+0000 mgr.y (mgr.14601) 545 : cluster 0 pgmap v840: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:26 smithi187 bash[23415]: audit 2024-03-11T22:22:24.963456+0000 mon.a (mon.0) 2767 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]': finished 2024-03-11T22:22:26.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:26 smithi187 bash[23415]: cluster 2024-03-11T22:22:24.972594+0000 mon.a (mon.0) 2768 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-03-11T22:22:26.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:26 smithi049 bash[21434]: cluster 2024-03-11T22:22:24.307194+0000 mgr.y (mgr.14601) 545 : cluster 0 pgmap v840: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:26.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:26 smithi049 bash[21434]: audit 2024-03-11T22:22:24.963456+0000 mon.a (mon.0) 2767 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]': finished 2024-03-11T22:22:26.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:26 smithi049 bash[21434]: cluster 2024-03-11T22:22:24.972594+0000 mon.a (mon.0) 2768 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-03-11T22:22:26.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:26 smithi049 bash[28804]: cluster 2024-03-11T22:22:24.307194+0000 mgr.y (mgr.14601) 545 : cluster 0 pgmap v840: 292 pgs: 292 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:26.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:26 smithi049 bash[28804]: audit 2024-03-11T22:22:24.963456+0000 mon.a (mon.0) 2767 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-98"}]': finished 2024-03-11T22:22:26.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:26 smithi049 bash[28804]: cluster 2024-03-11T22:22:24.972594+0000 mon.a (mon.0) 2768 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-03-11T22:22:27.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:27 smithi187 bash[23415]: cluster 2024-03-11T22:22:25.972345+0000 mon.a (mon.0) 2769 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-03-11T22:22:27.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:27 smithi187 bash[23415]: audit 2024-03-11T22:22:26.070981+0000 mon.c (mon.2) 606 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:27.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:27 smithi187 bash[23415]: cluster 2024-03-11T22:22:26.307984+0000 mgr.y (mgr.14601) 546 : cluster 0 pgmap v843: 260 pgs: 260 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:27.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:27 smithi187 bash[23415]: audit 2024-03-11T22:22:26.972813+0000 mon.b (mon.1) 411 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:27.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:27 smithi187 bash[23415]: cluster 2024-03-11T22:22:26.977731+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-03-11T22:22:27.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:27 smithi187 bash[23415]: audit 2024-03-11T22:22:26.982965+0000 mon.a (mon.0) 2771 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:27.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[28804]: cluster 2024-03-11T22:22:25.972345+0000 mon.a (mon.0) 2769 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-03-11T22:22:27.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[28804]: audit 2024-03-11T22:22:26.070981+0000 mon.c (mon.2) 606 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[28804]: cluster 2024-03-11T22:22:26.307984+0000 mgr.y (mgr.14601) 546 : cluster 0 pgmap v843: 260 pgs: 260 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[28804]: audit 2024-03-11T22:22:26.972813+0000 mon.b (mon.1) 411 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[28804]: cluster 2024-03-11T22:22:26.977731+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[28804]: audit 2024-03-11T22:22:26.982965+0000 mon.a (mon.0) 2771 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[21434]: cluster 2024-03-11T22:22:25.972345+0000 mon.a (mon.0) 2769 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[21434]: audit 2024-03-11T22:22:26.070981+0000 mon.c (mon.2) 606 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[21434]: cluster 2024-03-11T22:22:26.307984+0000 mgr.y (mgr.14601) 546 : cluster 0 pgmap v843: 260 pgs: 260 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[21434]: audit 2024-03-11T22:22:26.972813+0000 mon.b (mon.1) 411 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[21434]: cluster 2024-03-11T22:22:26.977731+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-03-11T22:22:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:27 smithi049 bash[21434]: audit 2024-03-11T22:22:26.982965+0000 mon.a (mon.0) 2771 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:29.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:28 smithi187 bash[23415]: audit 2024-03-11T22:22:27.973819+0000 mon.a (mon.0) 2772 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:29.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:28 smithi187 bash[23415]: cluster 2024-03-11T22:22:27.981093+0000 mon.a (mon.0) 2773 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-03-11T22:22:29.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:28 smithi187 bash[23415]: audit 2024-03-11T22:22:27.986683+0000 mon.b (mon.1) 412 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:29.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:28 smithi187 bash[23415]: audit 2024-03-11T22:22:27.996672+0000 mon.a (mon.0) 2774 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:29.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:22:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:22:29.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[21434]: audit 2024-03-11T22:22:27.973819+0000 mon.a (mon.0) 2772 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:29.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[21434]: cluster 2024-03-11T22:22:27.981093+0000 mon.a (mon.0) 2773 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-03-11T22:22:29.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[21434]: audit 2024-03-11T22:22:27.986683+0000 mon.b (mon.1) 412 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:29.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[21434]: audit 2024-03-11T22:22:27.996672+0000 mon.a (mon.0) 2774 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:29.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[28804]: audit 2024-03-11T22:22:27.973819+0000 mon.a (mon.0) 2772 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:29.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[28804]: cluster 2024-03-11T22:22:27.981093+0000 mon.a (mon.0) 2773 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-03-11T22:22:29.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[28804]: audit 2024-03-11T22:22:27.986683+0000 mon.b (mon.1) 412 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:29.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:28 smithi049 bash[28804]: audit 2024-03-11T22:22:27.996672+0000 mon.a (mon.0) 2774 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:22:30.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:29 smithi187 bash[23415]: cluster 2024-03-11T22:22:28.308838+0000 mgr.y (mgr.14601) 547 : cluster 0 pgmap v846: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:30.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:29 smithi187 bash[23415]: audit 2024-03-11T22:22:28.983222+0000 mon.a (mon.0) 2775 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:22:30.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:29 smithi187 bash[23415]: audit 2024-03-11T22:22:28.983877+0000 mon.b (mon.1) 413 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:30.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:29 smithi187 bash[23415]: cluster 2024-03-11T22:22:28.993000+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-03-11T22:22:30.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:29 smithi187 bash[23415]: audit 2024-03-11T22:22:28.994506+0000 mon.a (mon.0) 2777 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:30.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:29 smithi187 bash[23415]: audit 2024-03-11T22:22:29.105164+0000 mgr.y (mgr.14601) 548 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:29 smithi049 bash[21434]: cluster 2024-03-11T22:22:28.308838+0000 mgr.y (mgr.14601) 547 : cluster 0 pgmap v846: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:29 smithi049 bash[21434]: audit 2024-03-11T22:22:28.983222+0000 mon.a (mon.0) 2775 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:22:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:29 smithi049 bash[21434]: audit 2024-03-11T22:22:28.983877+0000 mon.b (mon.1) 413 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:29 smithi049 bash[21434]: cluster 2024-03-11T22:22:28.993000+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-03-11T22:22:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:29 smithi049 bash[21434]: audit 2024-03-11T22:22:28.994506+0000 mon.a (mon.0) 2777 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:30.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:29 smithi049 bash[21434]: audit 2024-03-11T22:22:29.105164+0000 mgr.y (mgr.14601) 548 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:30.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:30 smithi049 bash[28804]: cluster 2024-03-11T22:22:28.308838+0000 mgr.y (mgr.14601) 547 : cluster 0 pgmap v846: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:30.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:30 smithi049 bash[28804]: audit 2024-03-11T22:22:28.983222+0000 mon.a (mon.0) 2775 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:22:30.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:30 smithi049 bash[28804]: audit 2024-03-11T22:22:28.983877+0000 mon.b (mon.1) 413 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:30.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:30 smithi049 bash[28804]: cluster 2024-03-11T22:22:28.993000+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-03-11T22:22:30.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:30 smithi049 bash[28804]: audit 2024-03-11T22:22:28.994506+0000 mon.a (mon.0) 2777 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:30.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:30 smithi049 bash[28804]: audit 2024-03-11T22:22:29.105164+0000 mgr.y (mgr.14601) 548 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[21434]: audit 2024-03-11T22:22:29.986107+0000 mon.a (mon.0) 2778 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]': finished 2024-03-11T22:22:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[21434]: audit 2024-03-11T22:22:29.986562+0000 mon.b (mon.1) 414 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]: dispatch 2024-03-11T22:22:31.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[21434]: cluster 2024-03-11T22:22:29.993872+0000 mon.a (mon.0) 2779 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[21434]: audit 2024-03-11T22:22:29.996144+0000 mon.a (mon.0) 2780 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]: dispatch 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[21434]: cluster 2024-03-11T22:22:30.986385+0000 mon.a (mon.0) 2781 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[21434]: audit 2024-03-11T22:22:30.988953+0000 mon.a (mon.0) 2782 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]': finished 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[21434]: cluster 2024-03-11T22:22:30.995374+0000 mon.a (mon.0) 2783 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[28804]: audit 2024-03-11T22:22:29.986107+0000 mon.a (mon.0) 2778 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]': finished 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[28804]: audit 2024-03-11T22:22:29.986562+0000 mon.b (mon.1) 414 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]: dispatch 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[28804]: cluster 2024-03-11T22:22:29.993872+0000 mon.a (mon.0) 2779 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[28804]: audit 2024-03-11T22:22:29.996144+0000 mon.a (mon.0) 2780 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]: dispatch 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[28804]: cluster 2024-03-11T22:22:30.986385+0000 mon.a (mon.0) 2781 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[28804]: audit 2024-03-11T22:22:30.988953+0000 mon.a (mon.0) 2782 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]': finished 2024-03-11T22:22:31.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:31 smithi049 bash[28804]: cluster 2024-03-11T22:22:30.995374+0000 mon.a (mon.0) 2783 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-03-11T22:22:31.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:31 smithi187 bash[23415]: audit 2024-03-11T22:22:29.986107+0000 mon.a (mon.0) 2778 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-6", "overlaypool": "test-rados-api-smithi049-64247-100"}]': finished 2024-03-11T22:22:31.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:31 smithi187 bash[23415]: audit 2024-03-11T22:22:29.986562+0000 mon.b (mon.1) 414 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]: dispatch 2024-03-11T22:22:31.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:31 smithi187 bash[23415]: cluster 2024-03-11T22:22:29.993872+0000 mon.a (mon.0) 2779 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-03-11T22:22:31.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:31 smithi187 bash[23415]: audit 2024-03-11T22:22:29.996144+0000 mon.a (mon.0) 2780 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]: dispatch 2024-03-11T22:22:31.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:31 smithi187 bash[23415]: cluster 2024-03-11T22:22:30.986385+0000 mon.a (mon.0) 2781 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:31.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:31 smithi187 bash[23415]: audit 2024-03-11T22:22:30.988953+0000 mon.a (mon.0) 2782 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-100", "mode": "writeback"}]': finished 2024-03-11T22:22:31.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:31 smithi187 bash[23415]: cluster 2024-03-11T22:22:30.995374+0000 mon.a (mon.0) 2783 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-03-11T22:22:32.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[21434]: cluster 2024-03-11T22:22:30.309805+0000 mgr.y (mgr.14601) 549 : cluster 0 pgmap v849: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:32.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[21434]: audit 2024-03-11T22:22:30.989513+0000 mon.b (mon.1) 415 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:22:32.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[21434]: audit 2024-03-11T22:22:30.999301+0000 mon.a (mon.0) 2784 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[21434]: audit 2024-03-11T22:22:31.992085+0000 mon.a (mon.0) 2785 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[21434]: audit 2024-03-11T22:22:31.992300+0000 mon.b (mon.1) 416 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[21434]: cluster 2024-03-11T22:22:31.998884+0000 mon.a (mon.0) 2786 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[21434]: audit 2024-03-11T22:22:32.002273+0000 mon.a (mon.0) 2787 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[28804]: cluster 2024-03-11T22:22:30.309805+0000 mgr.y (mgr.14601) 549 : cluster 0 pgmap v849: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[28804]: audit 2024-03-11T22:22:30.989513+0000 mon.b (mon.1) 415 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[28804]: audit 2024-03-11T22:22:30.999301+0000 mon.a (mon.0) 2784 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[28804]: audit 2024-03-11T22:22:31.992085+0000 mon.a (mon.0) 2785 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[28804]: audit 2024-03-11T22:22:31.992300+0000 mon.b (mon.1) 416 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[28804]: cluster 2024-03-11T22:22:31.998884+0000 mon.a (mon.0) 2786 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-03-11T22:22:32.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:32 smithi049 bash[28804]: audit 2024-03-11T22:22:32.002273+0000 mon.a (mon.0) 2787 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:32.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:32 smithi187 bash[23415]: cluster 2024-03-11T22:22:30.309805+0000 mgr.y (mgr.14601) 549 : cluster 0 pgmap v849: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:32.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:32 smithi187 bash[23415]: audit 2024-03-11T22:22:30.989513+0000 mon.b (mon.1) 415 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:22:32.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:32 smithi187 bash[23415]: audit 2024-03-11T22:22:30.999301+0000 mon.a (mon.0) 2784 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:22:32.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:32 smithi187 bash[23415]: audit 2024-03-11T22:22:31.992085+0000 mon.a (mon.0) 2785 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:22:32.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:32 smithi187 bash[23415]: audit 2024-03-11T22:22:31.992300+0000 mon.b (mon.1) 416 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:32.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:32 smithi187 bash[23415]: cluster 2024-03-11T22:22:31.998884+0000 mon.a (mon.0) 2786 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-03-11T22:22:32.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:32 smithi187 bash[23415]: audit 2024-03-11T22:22:32.002273+0000 mon.a (mon.0) 2787 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:22:34.272 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:22:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:22:34.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[28804]: cluster 2024-03-11T22:22:32.310652+0000 mgr.y (mgr.14601) 550 : cluster 0 pgmap v852: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:34.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[28804]: audit 2024-03-11T22:22:32.994733+0000 mon.a (mon.0) 2788 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[28804]: audit 2024-03-11T22:22:32.994920+0000 mon.b (mon.1) 417 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[28804]: cluster 2024-03-11T22:22:33.001753+0000 mon.a (mon.0) 2789 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[28804]: audit 2024-03-11T22:22:33.007072+0000 mon.a (mon.0) 2790 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[21434]: cluster 2024-03-11T22:22:32.310652+0000 mgr.y (mgr.14601) 550 : cluster 0 pgmap v852: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[21434]: audit 2024-03-11T22:22:32.994733+0000 mon.a (mon.0) 2788 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[21434]: audit 2024-03-11T22:22:32.994920+0000 mon.b (mon.1) 417 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[21434]: cluster 2024-03-11T22:22:33.001753+0000 mon.a (mon.0) 2789 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-03-11T22:22:34.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:34 smithi049 bash[21434]: audit 2024-03-11T22:22:33.007072+0000 mon.a (mon.0) 2790 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:22:34.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:34 smithi187 bash[23415]: cluster 2024-03-11T22:22:32.310652+0000 mgr.y (mgr.14601) 550 : cluster 0 pgmap v852: 292 pgs: 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:34.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:34 smithi187 bash[23415]: audit 2024-03-11T22:22:32.994733+0000 mon.a (mon.0) 2788 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:22:34.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:34 smithi187 bash[23415]: audit 2024-03-11T22:22:32.994920+0000 mon.b (mon.1) 417 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:22:34.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:34 smithi187 bash[23415]: cluster 2024-03-11T22:22:33.001753+0000 mon.a (mon.0) 2789 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-03-11T22:22:34.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:34 smithi187 bash[23415]: audit 2024-03-11T22:22:33.007072+0000 mon.a (mon.0) 2790 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:22:35.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[28804]: cluster 2024-03-11T22:22:33.995117+0000 mon.a (mon.0) 2791 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:35.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[28804]: audit 2024-03-11T22:22:33.997464+0000 mon.a (mon.0) 2792 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:22:35.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[28804]: audit 2024-03-11T22:22:33.998538+0000 mon.b (mon.1) 418 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[28804]: cluster 2024-03-11T22:22:34.005012+0000 mon.a (mon.0) 2793 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[28804]: audit 2024-03-11T22:22:34.008496+0000 mon.a (mon.0) 2794 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[28804]: audit 2024-03-11T22:22:35.000209+0000 mon.a (mon.0) 2795 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[28804]: cluster 2024-03-11T22:22:35.006971+0000 mon.a (mon.0) 2796 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[21434]: cluster 2024-03-11T22:22:33.995117+0000 mon.a (mon.0) 2791 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[21434]: audit 2024-03-11T22:22:33.997464+0000 mon.a (mon.0) 2792 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[21434]: audit 2024-03-11T22:22:33.998538+0000 mon.b (mon.1) 418 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[21434]: cluster 2024-03-11T22:22:34.005012+0000 mon.a (mon.0) 2793 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[21434]: audit 2024-03-11T22:22:34.008496+0000 mon.a (mon.0) 2794 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[21434]: audit 2024-03-11T22:22:35.000209+0000 mon.a (mon.0) 2795 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-03-11T22:22:35.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:35 smithi049 bash[21434]: cluster 2024-03-11T22:22:35.006971+0000 mon.a (mon.0) 2796 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-03-11T22:22:35.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:35 smithi187 bash[23415]: cluster 2024-03-11T22:22:33.995117+0000 mon.a (mon.0) 2791 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:35.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:35 smithi187 bash[23415]: audit 2024-03-11T22:22:33.997464+0000 mon.a (mon.0) 2792 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:22:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:35 smithi187 bash[23415]: audit 2024-03-11T22:22:33.998538+0000 mon.b (mon.1) 418 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-11T22:22:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:35 smithi187 bash[23415]: cluster 2024-03-11T22:22:34.005012+0000 mon.a (mon.0) 2793 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-03-11T22:22:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:35 smithi187 bash[23415]: audit 2024-03-11T22:22:34.008496+0000 mon.a (mon.0) 2794 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-11T22:22:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:35 smithi187 bash[23415]: audit 2024-03-11T22:22:35.000209+0000 mon.a (mon.0) 2795 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-03-11T22:22:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:35 smithi187 bash[23415]: cluster 2024-03-11T22:22:35.006971+0000 mon.a (mon.0) 2796 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-03-11T22:22:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:36 smithi049 bash[28804]: cluster 2024-03-11T22:22:34.311585+0000 mgr.y (mgr.14601) 551 : cluster 0 pgmap v855: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:36 smithi049 bash[28804]: audit 2024-03-11T22:22:35.077353+0000 mon.b (mon.1) 419 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:36.272 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:36 smithi049 bash[28804]: audit 2024-03-11T22:22:35.086522+0000 mon.a (mon.0) 2797 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:36.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:36 smithi049 bash[21434]: cluster 2024-03-11T22:22:34.311585+0000 mgr.y (mgr.14601) 551 : cluster 0 pgmap v855: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:36.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:36 smithi049 bash[21434]: audit 2024-03-11T22:22:35.077353+0000 mon.b (mon.1) 419 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:36.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:36 smithi049 bash[21434]: audit 2024-03-11T22:22:35.086522+0000 mon.a (mon.0) 2797 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:36.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:36 smithi187 bash[23415]: cluster 2024-03-11T22:22:34.311585+0000 mgr.y (mgr.14601) 551 : cluster 0 pgmap v855: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:36.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:36 smithi187 bash[23415]: audit 2024-03-11T22:22:35.077353+0000 mon.b (mon.1) 419 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:36.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:36 smithi187 bash[23415]: audit 2024-03-11T22:22:35.086522+0000 mon.a (mon.0) 2797 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:37.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:37 smithi187 bash[23415]: audit 2024-03-11T22:22:36.032391+0000 mon.a (mon.0) 2798 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:22:37.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:37 smithi187 bash[23415]: audit 2024-03-11T22:22:36.032885+0000 mon.b (mon.1) 420 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:37.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:37 smithi187 bash[23415]: cluster 2024-03-11T22:22:36.039485+0000 mon.a (mon.0) 2799 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-03-11T22:22:37.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:37 smithi187 bash[23415]: audit 2024-03-11T22:22:36.043246+0000 mon.a (mon.0) 2800 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:37.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[21434]: audit 2024-03-11T22:22:36.032391+0000 mon.a (mon.0) 2798 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:22:37.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[21434]: audit 2024-03-11T22:22:36.032885+0000 mon.b (mon.1) 420 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:37.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[21434]: cluster 2024-03-11T22:22:36.039485+0000 mon.a (mon.0) 2799 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-03-11T22:22:37.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[21434]: audit 2024-03-11T22:22:36.043246+0000 mon.a (mon.0) 2800 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:37.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[28804]: audit 2024-03-11T22:22:36.032391+0000 mon.a (mon.0) 2798 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]': finished 2024-03-11T22:22:37.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[28804]: audit 2024-03-11T22:22:36.032885+0000 mon.b (mon.1) 420 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:37.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[28804]: cluster 2024-03-11T22:22:36.039485+0000 mon.a (mon.0) 2799 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-03-11T22:22:37.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:37 smithi049 bash[28804]: audit 2024-03-11T22:22:36.043246+0000 mon.a (mon.0) 2800 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]: dispatch 2024-03-11T22:22:38.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:38 smithi187 bash[23415]: cluster 2024-03-11T22:22:36.312505+0000 mgr.y (mgr.14601) 552 : cluster 0 pgmap v858: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:38.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:38 smithi187 bash[23415]: audit 2024-03-11T22:22:37.041664+0000 mon.a (mon.0) 2801 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]': finished 2024-03-11T22:22:38.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:38 smithi187 bash[23415]: cluster 2024-03-11T22:22:37.051154+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-03-11T22:22:38.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:38 smithi049 bash[21434]: cluster 2024-03-11T22:22:36.312505+0000 mgr.y (mgr.14601) 552 : cluster 0 pgmap v858: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:38.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:38 smithi049 bash[21434]: audit 2024-03-11T22:22:37.041664+0000 mon.a (mon.0) 2801 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]': finished 2024-03-11T22:22:38.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:38 smithi049 bash[21434]: cluster 2024-03-11T22:22:37.051154+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-03-11T22:22:38.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:38 smithi049 bash[28804]: cluster 2024-03-11T22:22:36.312505+0000 mgr.y (mgr.14601) 552 : cluster 0 pgmap v858: 292 pgs: 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:38.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:38 smithi049 bash[28804]: audit 2024-03-11T22:22:37.041664+0000 mon.a (mon.0) 2801 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-100"}]': finished 2024-03-11T22:22:38.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:38 smithi049 bash[28804]: cluster 2024-03-11T22:22:37.051154+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-03-11T22:22:39.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:39 smithi187 bash[23415]: cluster 2024-03-11T22:22:38.058608+0000 mon.a (mon.0) 2803 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-03-11T22:22:39.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:22:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:22:39.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:39 smithi049 bash[21434]: cluster 2024-03-11T22:22:38.058608+0000 mon.a (mon.0) 2803 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-03-11T22:22:39.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:39 smithi049 bash[28804]: cluster 2024-03-11T22:22:38.058608+0000 mon.a (mon.0) 2803 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-03-11T22:22:40.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:40 smithi187 bash[23415]: cluster 2024-03-11T22:22:38.313326+0000 mgr.y (mgr.14601) 553 : cluster 0 pgmap v861: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:40.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:40 smithi187 bash[23415]: audit 2024-03-11T22:22:39.067338+0000 mon.b (mon.1) 421 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:40.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:40 smithi187 bash[23415]: cluster 2024-03-11T22:22:39.072709+0000 mon.a (mon.0) 2804 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-03-11T22:22:40.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:40 smithi187 bash[23415]: audit 2024-03-11T22:22:39.080493+0000 mon.a (mon.0) 2805 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:40.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:40 smithi187 bash[23415]: audit 2024-03-11T22:22:39.114428+0000 mgr.y (mgr.14601) 554 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:40.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[21434]: cluster 2024-03-11T22:22:38.313326+0000 mgr.y (mgr.14601) 553 : cluster 0 pgmap v861: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:40.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[21434]: audit 2024-03-11T22:22:39.067338+0000 mon.b (mon.1) 421 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:40.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[21434]: cluster 2024-03-11T22:22:39.072709+0000 mon.a (mon.0) 2804 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-03-11T22:22:40.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[21434]: audit 2024-03-11T22:22:39.080493+0000 mon.a (mon.0) 2805 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:40.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[21434]: audit 2024-03-11T22:22:39.114428+0000 mgr.y (mgr.14601) 554 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:40.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[28804]: cluster 2024-03-11T22:22:38.313326+0000 mgr.y (mgr.14601) 553 : cluster 0 pgmap v861: 260 pgs: 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:40.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[28804]: audit 2024-03-11T22:22:39.067338+0000 mon.b (mon.1) 421 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:40.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[28804]: cluster 2024-03-11T22:22:39.072709+0000 mon.a (mon.0) 2804 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-03-11T22:22:40.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[28804]: audit 2024-03-11T22:22:39.080493+0000 mon.a (mon.0) 2805 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:40.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:40 smithi049 bash[28804]: audit 2024-03-11T22:22:39.114428+0000 mgr.y (mgr.14601) 554 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: audit 2024-03-11T22:22:40.067935+0000 mon.a (mon.0) 2806 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: audit 2024-03-11T22:22:40.070597+0000 mon.b (mon.1) 422 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: cluster 2024-03-11T22:22:40.076410+0000 mon.a (mon.0) 2807 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: audit 2024-03-11T22:22:40.099366+0000 mon.b (mon.1) 423 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: audit 2024-03-11T22:22:40.123470+0000 mon.a (mon.0) 2808 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: audit 2024-03-11T22:22:41.070656+0000 mon.a (mon.0) 2809 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: audit 2024-03-11T22:22:41.072137+0000 mon.b (mon.1) 424 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: cluster 2024-03-11T22:22:41.077588+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-03-11T22:22:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:41 smithi187 bash[23415]: audit 2024-03-11T22:22:41.081994+0000 mon.a (mon.0) 2811 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:22:41.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: audit 2024-03-11T22:22:40.067935+0000 mon.a (mon.0) 2806 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: audit 2024-03-11T22:22:40.070597+0000 mon.b (mon.1) 422 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: cluster 2024-03-11T22:22:40.076410+0000 mon.a (mon.0) 2807 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: audit 2024-03-11T22:22:40.099366+0000 mon.b (mon.1) 423 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: audit 2024-03-11T22:22:40.123470+0000 mon.a (mon.0) 2808 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: audit 2024-03-11T22:22:41.070656+0000 mon.a (mon.0) 2809 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: audit 2024-03-11T22:22:41.072137+0000 mon.b (mon.1) 424 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: cluster 2024-03-11T22:22:41.077588+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[21434]: audit 2024-03-11T22:22:41.081994+0000 mon.a (mon.0) 2811 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: audit 2024-03-11T22:22:40.067935+0000 mon.a (mon.0) 2806 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: audit 2024-03-11T22:22:40.070597+0000 mon.b (mon.1) 422 : audit 0 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: cluster 2024-03-11T22:22:40.076410+0000 mon.a (mon.0) 2807 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-03-11T22:22:41.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: audit 2024-03-11T22:22:40.099366+0000 mon.b (mon.1) 423 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:22:41.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: audit 2024-03-11T22:22:40.123470+0000 mon.a (mon.0) 2808 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-11T22:22:41.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: audit 2024-03-11T22:22:41.070656+0000 mon.a (mon.0) 2809 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-11T22:22:41.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: audit 2024-03-11T22:22:41.072137+0000 mon.b (mon.1) 424 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:22:41.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: cluster 2024-03-11T22:22:41.077588+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-03-11T22:22:41.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:41 smithi049 bash[28804]: audit 2024-03-11T22:22:41.081994+0000 mon.a (mon.0) 2811 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-11T22:22:42.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:42 smithi187 bash[23415]: cluster 2024-03-11T22:22:40.314524+0000 mgr.y (mgr.14601) 555 : cluster 0 pgmap v864: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:42.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:42 smithi187 bash[23415]: audit 2024-03-11T22:22:41.471653+0000 mon.c (mon.2) 607 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:42.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:42 smithi187 bash[23415]: audit 2024-03-11T22:22:42.072938+0000 mon.b (mon.1) 425 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:22:42.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:42 smithi187 bash[23415]: audit 2024-03-11T22:22:42.073578+0000 mon.a (mon.0) 2812 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:22:42.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:42 smithi187 bash[23415]: cluster 2024-03-11T22:22:42.080041+0000 mon.a (mon.0) 2813 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-03-11T22:22:42.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:42 smithi187 bash[23415]: audit 2024-03-11T22:22:42.082361+0000 mon.a (mon.0) 2814 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:22:42.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[21434]: cluster 2024-03-11T22:22:40.314524+0000 mgr.y (mgr.14601) 555 : cluster 0 pgmap v864: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:42.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[21434]: audit 2024-03-11T22:22:41.471653+0000 mon.c (mon.2) 607 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:42.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[21434]: audit 2024-03-11T22:22:42.072938+0000 mon.b (mon.1) 425 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:22:42.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[21434]: audit 2024-03-11T22:22:42.073578+0000 mon.a (mon.0) 2812 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:22:42.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[21434]: cluster 2024-03-11T22:22:42.080041+0000 mon.a (mon.0) 2813 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-03-11T22:22:42.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[21434]: audit 2024-03-11T22:22:42.082361+0000 mon.a (mon.0) 2814 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:22:42.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[28804]: cluster 2024-03-11T22:22:40.314524+0000 mgr.y (mgr.14601) 555 : cluster 0 pgmap v864: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:42.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[28804]: audit 2024-03-11T22:22:41.471653+0000 mon.c (mon.2) 607 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:42.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[28804]: audit 2024-03-11T22:22:42.072938+0000 mon.b (mon.1) 425 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:22:42.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[28804]: audit 2024-03-11T22:22:42.073578+0000 mon.a (mon.0) 2812 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-11T22:22:42.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[28804]: cluster 2024-03-11T22:22:42.080041+0000 mon.a (mon.0) 2813 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-03-11T22:22:42.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:42 smithi049 bash[28804]: audit 2024-03-11T22:22:42.082361+0000 mon.a (mon.0) 2814 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-11T22:22:44.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:44 smithi187 bash[23415]: cluster 2024-03-11T22:22:42.315476+0000 mgr.y (mgr.14601) 556 : cluster 0 pgmap v867: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:44.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:44 smithi187 bash[23415]: audit 2024-03-11T22:22:43.076355+0000 mon.a (mon.0) 2815 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:22:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:44 smithi187 bash[23415]: cluster 2024-03-11T22:22:43.083389+0000 mon.a (mon.0) 2816 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-03-11T22:22:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:44 smithi187 bash[23415]: audit 2024-03-11T22:22:43.153886+0000 mon.b (mon.1) 426 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:44 smithi187 bash[23415]: audit 2024-03-11T22:22:43.156058+0000 mon.b (mon.1) 427 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-102"}]: dispatch 2024-03-11T22:22:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:44 smithi187 bash[23415]: audit 2024-03-11T22:22:43.163247+0000 mon.a (mon.0) 2817 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:44 smithi187 bash[23415]: audit 2024-03-11T22:22:43.165357+0000 mon.a (mon.0) 2818 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-102"}]: dispatch 2024-03-11T22:22:44.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:22:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:22:44.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21434]: cluster 2024-03-11T22:22:42.315476+0000 mgr.y (mgr.14601) 556 : cluster 0 pgmap v867: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:44.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21434]: audit 2024-03-11T22:22:43.076355+0000 mon.a (mon.0) 2815 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:22:44.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21434]: cluster 2024-03-11T22:22:43.083389+0000 mon.a (mon.0) 2816 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-03-11T22:22:44.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21434]: audit 2024-03-11T22:22:43.153886+0000 mon.b (mon.1) 426 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21434]: audit 2024-03-11T22:22:43.156058+0000 mon.b (mon.1) 427 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-102"}]: dispatch 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21434]: audit 2024-03-11T22:22:43.163247+0000 mon.a (mon.0) 2817 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[21434]: audit 2024-03-11T22:22:43.165357+0000 mon.a (mon.0) 2818 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-102"}]: dispatch 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[28804]: cluster 2024-03-11T22:22:42.315476+0000 mgr.y (mgr.14601) 556 : cluster 0 pgmap v867: 292 pgs: 32 unknown, 260 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[28804]: audit 2024-03-11T22:22:43.076355+0000 mon.a (mon.0) 2815 : audit 1 from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[28804]: cluster 2024-03-11T22:22:43.083389+0000 mon.a (mon.0) 2816 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[28804]: audit 2024-03-11T22:22:43.153886+0000 mon.b (mon.1) 426 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[28804]: audit 2024-03-11T22:22:43.156058+0000 mon.b (mon.1) 427 : audit 1 from='client.? v1:172.21.15.49:0/345785574' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-102"}]: dispatch 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[28804]: audit 2024-03-11T22:22:43.163247+0000 mon.a (mon.0) 2817 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-6"}]: dispatch 2024-03-11T22:22:44.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:44 smithi049 bash[28804]: audit 2024-03-11T22:22:43.165357+0000 mon.a (mon.0) 2818 : audit 1 from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-6", "tierpool": "test-rados-api-smithi049-64247-102"}]: dispatch 2024-03-11T22:22:45.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:45 smithi187 bash[23415]: cluster 2024-03-11T22:22:44.132268+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-03-11T22:22:45.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:45 smithi049 bash[21434]: cluster 2024-03-11T22:22:44.132268+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-03-11T22:22:45.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:45 smithi049 bash[28804]: cluster 2024-03-11T22:22:44.132268+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: cluster 2024-03-11T22:22:44.316400+0000 mgr.y (mgr.14601) 557 : cluster 0 pgmap v870: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: cluster 2024-03-11T22:22:45.144886+0000 mon.a (mon.0) 2820 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: audit 2024-03-11T22:22:45.175478+0000 mon.c (mon.2) 608 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: audit 2024-03-11T22:22:45.175923+0000 mon.a (mon.0) 2821 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: audit 2024-03-11T22:22:45.177541+0000 mon.c (mon.2) 609 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: audit 2024-03-11T22:22:45.177856+0000 mon.a (mon.0) 2822 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: audit 2024-03-11T22:22:45.178367+0000 mon.c (mon.2) 610 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:22:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:46 smithi187 bash[23415]: audit 2024-03-11T22:22:45.178686+0000 mon.a (mon.0) 2823 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: cluster 2024-03-11T22:22:44.316400+0000 mgr.y (mgr.14601) 557 : cluster 0 pgmap v870: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: cluster 2024-03-11T22:22:45.144886+0000 mon.a (mon.0) 2820 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: audit 2024-03-11T22:22:45.175478+0000 mon.c (mon.2) 608 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: audit 2024-03-11T22:22:45.175923+0000 mon.a (mon.0) 2821 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: audit 2024-03-11T22:22:45.177541+0000 mon.c (mon.2) 609 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: audit 2024-03-11T22:22:45.177856+0000 mon.a (mon.0) 2822 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: audit 2024-03-11T22:22:45.178367+0000 mon.c (mon.2) 610 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:22:46.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[21434]: audit 2024-03-11T22:22:45.178686+0000 mon.a (mon.0) 2823 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: cluster 2024-03-11T22:22:44.316400+0000 mgr.y (mgr.14601) 557 : cluster 0 pgmap v870: 260 pgs: 260 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: cluster 2024-03-11T22:22:45.144886+0000 mon.a (mon.0) 2820 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: audit 2024-03-11T22:22:45.175478+0000 mon.c (mon.2) 608 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: audit 2024-03-11T22:22:45.175923+0000 mon.a (mon.0) 2821 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: audit 2024-03-11T22:22:45.177541+0000 mon.c (mon.2) 609 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: audit 2024-03-11T22:22:45.177856+0000 mon.a (mon.0) 2822 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: audit 2024-03-11T22:22:45.178367+0000 mon.c (mon.2) 610 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:22:46.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:46 smithi049 bash[28804]: audit 2024-03-11T22:22:45.178686+0000 mon.a (mon.0) 2823 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:22:47.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:47 smithi187 bash[23415]: audit 2024-03-11T22:22:46.139150+0000 mon.a (mon.0) 2824 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:22:47.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:47 smithi187 bash[23415]: cluster 2024-03-11T22:22:46.145616+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-03-11T22:22:47.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:47 smithi187 bash[23415]: audit 2024-03-11T22:22:46.149119+0000 mon.c (mon.2) 611 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:47.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:47 smithi187 bash[23415]: audit 2024-03-11T22:22:46.162474+0000 mon.a (mon.0) 2826 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:47.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:47 smithi187 bash[23415]: cluster 2024-03-11T22:22:46.317243+0000 mgr.y (mgr.14601) 558 : cluster 0 pgmap v873: 228 pgs: 228 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:47.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[21434]: audit 2024-03-11T22:22:46.139150+0000 mon.a (mon.0) 2824 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:22:47.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[21434]: cluster 2024-03-11T22:22:46.145616+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-03-11T22:22:47.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[21434]: audit 2024-03-11T22:22:46.149119+0000 mon.c (mon.2) 611 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:47.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[21434]: audit 2024-03-11T22:22:46.162474+0000 mon.a (mon.0) 2826 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:47.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[21434]: cluster 2024-03-11T22:22:46.317243+0000 mgr.y (mgr.14601) 558 : cluster 0 pgmap v873: 228 pgs: 228 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[28804]: audit 2024-03-11T22:22:46.139150+0000 mon.a (mon.0) 2824 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:22:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[28804]: cluster 2024-03-11T22:22:46.145616+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-03-11T22:22:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[28804]: audit 2024-03-11T22:22:46.149119+0000 mon.c (mon.2) 611 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[28804]: audit 2024-03-11T22:22:46.162474+0000 mon.a (mon.0) 2826 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:22:47.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:47 smithi049 bash[28804]: cluster 2024-03-11T22:22:46.317243+0000 mgr.y (mgr.14601) 558 : cluster 0 pgmap v873: 228 pgs: 228 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:48.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:48 smithi187 bash[23415]: cluster 2024-03-11T22:22:47.628259+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-03-11T22:22:48.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:48 smithi049 bash[28804]: cluster 2024-03-11T22:22:47.628259+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-03-11T22:22:48.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:48 smithi049 bash[21434]: cluster 2024-03-11T22:22:47.628259+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-03-11T22:22:49.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:22:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:22:49.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:49 smithi187 bash[23415]: audit 2024-03-11T22:22:48.172956+0000 mon.a (mon.0) 2828 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:22:49.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:49 smithi187 bash[23415]: cluster 2024-03-11T22:22:48.180164+0000 mon.a (mon.0) 2829 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-03-11T22:22:49.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:49 smithi187 bash[23415]: cluster 2024-03-11T22:22:48.318207+0000 mgr.y (mgr.14601) 559 : cluster 0 pgmap v876: 236 pgs: 8 unknown, 228 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:49.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:49 smithi187 bash[23415]: audit 2024-03-11T22:22:49.123844+0000 mgr.y (mgr.14601) 560 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[21434]: audit 2024-03-11T22:22:48.172956+0000 mon.a (mon.0) 2828 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[21434]: cluster 2024-03-11T22:22:48.180164+0000 mon.a (mon.0) 2829 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[21434]: cluster 2024-03-11T22:22:48.318207+0000 mgr.y (mgr.14601) 559 : cluster 0 pgmap v876: 236 pgs: 8 unknown, 228 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[21434]: audit 2024-03-11T22:22:49.123844+0000 mgr.y (mgr.14601) 560 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[28804]: audit 2024-03-11T22:22:48.172956+0000 mon.a (mon.0) 2828 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi049-64247-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[28804]: cluster 2024-03-11T22:22:48.180164+0000 mon.a (mon.0) 2829 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[28804]: cluster 2024-03-11T22:22:48.318207+0000 mgr.y (mgr.14601) 559 : cluster 0 pgmap v876: 236 pgs: 8 unknown, 228 active+clean; 582 KiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:49.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:49 smithi049 bash[28804]: audit 2024-03-11T22:22:49.123844+0000 mgr.y (mgr.14601) 560 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:50.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:50 smithi187 bash[23415]: cluster 2024-03-11T22:22:49.173016+0000 mon.a (mon.0) 2830 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:22:50.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:50 smithi187 bash[23415]: cluster 2024-03-11T22:22:49.192195+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-03-11T22:22:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:50 smithi049 bash[21434]: cluster 2024-03-11T22:22:49.173016+0000 mon.a (mon.0) 2830 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:22:50.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:50 smithi049 bash[21434]: cluster 2024-03-11T22:22:49.192195+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-03-11T22:22:50.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:50 smithi049 bash[28804]: cluster 2024-03-11T22:22:49.173016+0000 mon.a (mon.0) 2830 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:22:50.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:50 smithi049 bash[28804]: cluster 2024-03-11T22:22:49.192195+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-03-11T22:22:51.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:51 smithi187 bash[23415]: cluster 2024-03-11T22:22:50.203874+0000 mon.a (mon.0) 2832 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-03-11T22:22:51.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:51 smithi187 bash[23415]: audit 2024-03-11T22:22:50.210247+0000 mon.c (mon.2) 612 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:51.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:51 smithi187 bash[23415]: audit 2024-03-11T22:22:50.212900+0000 mon.a (mon.0) 2833 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:51.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:51 smithi187 bash[23415]: cluster 2024-03-11T22:22:50.319175+0000 mgr.y (mgr.14601) 561 : cluster 0 pgmap v879: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:51.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[28804]: cluster 2024-03-11T22:22:50.203874+0000 mon.a (mon.0) 2832 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-03-11T22:22:51.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[28804]: audit 2024-03-11T22:22:50.210247+0000 mon.c (mon.2) 612 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:51.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[28804]: audit 2024-03-11T22:22:50.212900+0000 mon.a (mon.0) 2833 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:51.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[28804]: cluster 2024-03-11T22:22:50.319175+0000 mgr.y (mgr.14601) 561 : cluster 0 pgmap v879: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:51.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[21434]: cluster 2024-03-11T22:22:50.203874+0000 mon.a (mon.0) 2832 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-03-11T22:22:51.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[21434]: audit 2024-03-11T22:22:50.210247+0000 mon.c (mon.2) 612 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:51.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[21434]: audit 2024-03-11T22:22:50.212900+0000 mon.a (mon.0) 2833 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:51.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:51 smithi049 bash[21434]: cluster 2024-03-11T22:22:50.319175+0000 mgr.y (mgr.14601) 561 : cluster 0 pgmap v879: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:52.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:52 smithi187 bash[23415]: audit 2024-03-11T22:22:51.206288+0000 mon.a (mon.0) 2834 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:52.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:52 smithi187 bash[23415]: cluster 2024-03-11T22:22:51.215980+0000 mon.a (mon.0) 2835 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-03-11T22:22:52.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:52 smithi049 bash[21434]: audit 2024-03-11T22:22:51.206288+0000 mon.a (mon.0) 2834 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:52.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:52 smithi049 bash[21434]: cluster 2024-03-11T22:22:51.215980+0000 mon.a (mon.0) 2835 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-03-11T22:22:52.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:52 smithi049 bash[28804]: audit 2024-03-11T22:22:51.206288+0000 mon.a (mon.0) 2834 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:52.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:52 smithi049 bash[28804]: cluster 2024-03-11T22:22:51.215980+0000 mon.a (mon.0) 2835 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-03-11T22:22:53.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:53 smithi187 bash[23415]: cluster 2024-03-11T22:22:52.226025+0000 mon.a (mon.0) 2836 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-03-11T22:22:53.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:53 smithi187 bash[23415]: audit 2024-03-11T22:22:52.231675+0000 mon.c (mon.2) 613 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:53.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:53 smithi187 bash[23415]: audit 2024-03-11T22:22:52.232725+0000 mon.a (mon.0) 2837 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:53.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:53 smithi187 bash[23415]: cluster 2024-03-11T22:22:52.320068+0000 mgr.y (mgr.14601) 562 : cluster 0 pgmap v882: 300 pgs: 64 unknown, 8 creating+peering, 228 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:53.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[28804]: cluster 2024-03-11T22:22:52.226025+0000 mon.a (mon.0) 2836 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-03-11T22:22:53.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[28804]: audit 2024-03-11T22:22:52.231675+0000 mon.c (mon.2) 613 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:53.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[28804]: audit 2024-03-11T22:22:52.232725+0000 mon.a (mon.0) 2837 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:53.522 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[28804]: cluster 2024-03-11T22:22:52.320068+0000 mgr.y (mgr.14601) 562 : cluster 0 pgmap v882: 300 pgs: 64 unknown, 8 creating+peering, 228 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:53.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[21434]: cluster 2024-03-11T22:22:52.226025+0000 mon.a (mon.0) 2836 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-03-11T22:22:53.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[21434]: audit 2024-03-11T22:22:52.231675+0000 mon.c (mon.2) 613 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:53.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[21434]: audit 2024-03-11T22:22:52.232725+0000 mon.a (mon.0) 2837 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:22:53.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:53 smithi049 bash[21434]: cluster 2024-03-11T22:22:52.320068+0000 mgr.y (mgr.14601) 562 : cluster 0 pgmap v882: 300 pgs: 64 unknown, 8 creating+peering, 228 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:22:54.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:54 smithi187 bash[23415]: audit 2024-03-11T22:22:53.228633+0000 mon.a (mon.0) 2838 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:54.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:54 smithi187 bash[23415]: cluster 2024-03-11T22:22:53.236738+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-03-11T22:22:54.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:54 smithi187 bash[23415]: audit 2024-03-11T22:22:53.241998+0000 mon.c (mon.2) 614 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:54.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:54 smithi187 bash[23415]: audit 2024-03-11T22:22:53.243047+0000 mon.a (mon.0) 2840 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:54.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:22:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:22:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[21434]: audit 2024-03-11T22:22:53.228633+0000 mon.a (mon.0) 2838 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:54.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[21434]: cluster 2024-03-11T22:22:53.236738+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-03-11T22:22:54.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[21434]: audit 2024-03-11T22:22:53.241998+0000 mon.c (mon.2) 614 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:54.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[21434]: audit 2024-03-11T22:22:53.243047+0000 mon.a (mon.0) 2840 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[28804]: audit 2024-03-11T22:22:53.228633+0000 mon.a (mon.0) 2838 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:22:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[28804]: cluster 2024-03-11T22:22:53.236738+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-03-11T22:22:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[28804]: audit 2024-03-11T22:22:53.241998+0000 mon.c (mon.2) 614 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:54.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:54 smithi049 bash[28804]: audit 2024-03-11T22:22:53.243047+0000 mon.a (mon.0) 2840 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:55.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:55 smithi187 bash[23415]: audit 2024-03-11T22:22:54.231448+0000 mon.a (mon.0) 2841 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:55.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:55 smithi187 bash[23415]: cluster 2024-03-11T22:22:54.239909+0000 mon.a (mon.0) 2842 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-03-11T22:22:55.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:55 smithi187 bash[23415]: audit 2024-03-11T22:22:54.242840+0000 mon.c (mon.2) 615 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:55.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:55 smithi187 bash[23415]: audit 2024-03-11T22:22:54.252150+0000 mon.a (mon.0) 2843 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:55.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:55 smithi187 bash[23415]: cluster 2024-03-11T22:22:54.320993+0000 mgr.y (mgr.14601) 563 : cluster 0 pgmap v885: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[21434]: audit 2024-03-11T22:22:54.231448+0000 mon.a (mon.0) 2841 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[21434]: cluster 2024-03-11T22:22:54.239909+0000 mon.a (mon.0) 2842 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-03-11T22:22:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[21434]: audit 2024-03-11T22:22:54.242840+0000 mon.c (mon.2) 615 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[21434]: audit 2024-03-11T22:22:54.252150+0000 mon.a (mon.0) 2843 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:55.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[21434]: cluster 2024-03-11T22:22:54.320993+0000 mgr.y (mgr.14601) 563 : cluster 0 pgmap v885: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[28804]: audit 2024-03-11T22:22:54.231448+0000 mon.a (mon.0) 2841 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[28804]: cluster 2024-03-11T22:22:54.239909+0000 mon.a (mon.0) 2842 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-03-11T22:22:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[28804]: audit 2024-03-11T22:22:54.242840+0000 mon.c (mon.2) 615 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[28804]: audit 2024-03-11T22:22:54.252150+0000 mon.a (mon.0) 2843 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:55.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:55 smithi049 bash[28804]: cluster 2024-03-11T22:22:54.320993+0000 mgr.y (mgr.14601) 563 : cluster 0 pgmap v885: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:56.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:56 smithi187 bash[23415]: cluster 2024-03-11T22:22:55.244088+0000 mon.a (mon.0) 2844 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:22:56.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:56 smithi187 bash[23415]: audit 2024-03-11T22:22:55.254651+0000 mon.a (mon.0) 2845 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:56.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:56 smithi187 bash[23415]: cluster 2024-03-11T22:22:55.260856+0000 mon.a (mon.0) 2846 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-03-11T22:22:56.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:56 smithi187 bash[23415]: audit 2024-03-11T22:22:55.262724+0000 mon.c (mon.2) 616 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:22:56.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:56 smithi187 bash[23415]: audit 2024-03-11T22:22:55.265669+0000 mon.a (mon.0) 2847 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:22:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[21434]: cluster 2024-03-11T22:22:55.244088+0000 mon.a (mon.0) 2844 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:22:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[21434]: audit 2024-03-11T22:22:55.254651+0000 mon.a (mon.0) 2845 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[21434]: cluster 2024-03-11T22:22:55.260856+0000 mon.a (mon.0) 2846 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-03-11T22:22:56.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[21434]: audit 2024-03-11T22:22:55.262724+0000 mon.c (mon.2) 616 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:22:56.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[21434]: audit 2024-03-11T22:22:55.265669+0000 mon.a (mon.0) 2847 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:22:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[28804]: cluster 2024-03-11T22:22:55.244088+0000 mon.a (mon.0) 2844 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:22:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[28804]: audit 2024-03-11T22:22:55.254651+0000 mon.a (mon.0) 2845 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-107", "overlaypool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[28804]: cluster 2024-03-11T22:22:55.260856+0000 mon.a (mon.0) 2846 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-03-11T22:22:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[28804]: audit 2024-03-11T22:22:55.262724+0000 mon.c (mon.2) 616 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:22:56.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:56 smithi049 bash[28804]: audit 2024-03-11T22:22:55.265669+0000 mon.a (mon.0) 2847 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: cluster 2024-03-11T22:22:56.257418+0000 mon.a (mon.0) 2848 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: audit 2024-03-11T22:22:56.275235+0000 mon.a (mon.0) 2849 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]': finished 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: cluster 2024-03-11T22:22:56.285477+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: audit 2024-03-11T22:22:56.319913+0000 mon.c (mon.2) 617 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]: dispatch 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: audit 2024-03-11T22:22:56.320324+0000 mon.a (mon.0) 2851 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]: dispatch 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: cluster 2024-03-11T22:22:56.321549+0000 mgr.y (mgr.14601) 564 : cluster 0 pgmap v888: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: audit 2024-03-11T22:22:56.515429+0000 mon.a (mon.0) 2852 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:22:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:57 smithi187 bash[23415]: audit 2024-03-11T22:22:56.518755+0000 mon.c (mon.2) 618 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:57.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: cluster 2024-03-11T22:22:56.257418+0000 mon.a (mon.0) 2848 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:57.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: audit 2024-03-11T22:22:56.275235+0000 mon.a (mon.0) 2849 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]': finished 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: cluster 2024-03-11T22:22:56.285477+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: audit 2024-03-11T22:22:56.319913+0000 mon.c (mon.2) 617 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]: dispatch 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: audit 2024-03-11T22:22:56.320324+0000 mon.a (mon.0) 2851 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]: dispatch 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: cluster 2024-03-11T22:22:56.321549+0000 mgr.y (mgr.14601) 564 : cluster 0 pgmap v888: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: audit 2024-03-11T22:22:56.515429+0000 mon.a (mon.0) 2852 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[21434]: audit 2024-03-11T22:22:56.518755+0000 mon.c (mon.2) 618 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: cluster 2024-03-11T22:22:56.257418+0000 mon.a (mon.0) 2848 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: audit 2024-03-11T22:22:56.275235+0000 mon.a (mon.0) 2849 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-107-cache", "mode": "writeback"}]': finished 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: cluster 2024-03-11T22:22:56.285477+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: audit 2024-03-11T22:22:56.319913+0000 mon.c (mon.2) 617 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]: dispatch 2024-03-11T22:22:57.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: audit 2024-03-11T22:22:56.320324+0000 mon.a (mon.0) 2851 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]: dispatch 2024-03-11T22:22:57.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: cluster 2024-03-11T22:22:56.321549+0000 mgr.y (mgr.14601) 564 : cluster 0 pgmap v888: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:22:57.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: audit 2024-03-11T22:22:56.515429+0000 mon.a (mon.0) 2852 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:22:57.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:57 smithi049 bash[28804]: audit 2024-03-11T22:22:56.518755+0000 mon.c (mon.2) 618 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:22:58.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:58 smithi187 bash[23415]: audit 2024-03-11T22:22:57.283708+0000 mon.a (mon.0) 2853 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]': finished 2024-03-11T22:22:58.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:58 smithi187 bash[23415]: cluster 2024-03-11T22:22:57.290080+0000 mon.a (mon.0) 2854 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-03-11T22:22:58.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:58 smithi187 bash[23415]: audit 2024-03-11T22:22:57.291378+0000 mon.c (mon.2) 619 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:58.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:58 smithi187 bash[23415]: audit 2024-03-11T22:22:57.292917+0000 mon.a (mon.0) 2855 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[21434]: audit 2024-03-11T22:22:57.283708+0000 mon.a (mon.0) 2853 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]': finished 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[21434]: cluster 2024-03-11T22:22:57.290080+0000 mon.a (mon.0) 2854 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[21434]: audit 2024-03-11T22:22:57.291378+0000 mon.c (mon.2) 619 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[21434]: audit 2024-03-11T22:22:57.292917+0000 mon.a (mon.0) 2855 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[28804]: audit 2024-03-11T22:22:57.283708+0000 mon.a (mon.0) 2853 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-107"}]': finished 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[28804]: cluster 2024-03-11T22:22:57.290080+0000 mon.a (mon.0) 2854 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[28804]: audit 2024-03-11T22:22:57.291378+0000 mon.c (mon.2) 619 : audit 1 from='client.? v1:172.21.15.49:0/2114213664' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:58.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:58 smithi049 bash[28804]: audit 2024-03-11T22:22:57.292917+0000 mon.a (mon.0) 2855 : audit 1 from='client.47090 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]: dispatch 2024-03-11T22:22:59.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:22:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:22:59.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:59 smithi187 bash[23415]: cluster 2024-03-11T22:22:58.284776+0000 mon.a (mon.0) 2856 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:59.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:59 smithi187 bash[23415]: audit 2024-03-11T22:22:58.296107+0000 mon.a (mon.0) 2857 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:59.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:59 smithi187 bash[23415]: cluster 2024-03-11T22:22:58.303800+0000 mon.a (mon.0) 2858 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-03-11T22:22:59.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:59 smithi187 bash[23415]: cluster 2024-03-11T22:22:58.322485+0000 mgr.y (mgr.14601) 565 : cluster 0 pgmap v891: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:59.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:22:59 smithi187 bash[23415]: audit 2024-03-11T22:22:59.125704+0000 mgr.y (mgr.14601) 566 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[21434]: cluster 2024-03-11T22:22:58.284776+0000 mon.a (mon.0) 2856 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[21434]: audit 2024-03-11T22:22:58.296107+0000 mon.a (mon.0) 2857 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[21434]: cluster 2024-03-11T22:22:58.303800+0000 mon.a (mon.0) 2858 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-03-11T22:22:59.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[21434]: cluster 2024-03-11T22:22:58.322485+0000 mgr.y (mgr.14601) 565 : cluster 0 pgmap v891: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:59.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[21434]: audit 2024-03-11T22:22:59.125704+0000 mgr.y (mgr.14601) 566 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:22:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[28804]: cluster 2024-03-11T22:22:58.284776+0000 mon.a (mon.0) 2856 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:22:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[28804]: audit 2024-03-11T22:22:58.296107+0000 mon.a (mon.0) 2857 : audit 1 from='client.47090 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-107", "tierpool": "test-rados-api-smithi049-64247-107-cache"}]': finished 2024-03-11T22:22:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[28804]: cluster 2024-03-11T22:22:58.303800+0000 mon.a (mon.0) 2858 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-03-11T22:22:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[28804]: cluster 2024-03-11T22:22:58.322485+0000 mgr.y (mgr.14601) 565 : cluster 0 pgmap v891: 300 pgs: 300 active+clean; 582 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:22:59.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:22:59 smithi049 bash[28804]: audit 2024-03-11T22:22:59.125704+0000 mgr.y (mgr.14601) 566 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:00.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:00 smithi187 bash[23415]: cluster 2024-03-11T22:22:59.310423+0000 mon.a (mon.0) 2859 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-03-11T22:23:00.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:00 smithi049 bash[21434]: cluster 2024-03-11T22:22:59.310423+0000 mon.a (mon.0) 2859 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-03-11T22:23:00.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:00 smithi049 bash[28804]: cluster 2024-03-11T22:22:59.310423+0000 mon.a (mon.0) 2859 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: cluster 2024-03-11T22:23:00.312573+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: cluster 2024-03-11T22:23:00.323293+0000 mgr.y (mgr.14601) 567 : cluster 0 pgmap v894: 236 pgs: 236 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: audit 2024-03-11T22:23:00.348313+0000 mon.c (mon.2) 620 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: audit 2024-03-11T22:23:00.349005+0000 mon.a (mon.0) 2861 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: audit 2024-03-11T22:23:00.350404+0000 mon.c (mon.2) 621 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: audit 2024-03-11T22:23:00.350689+0000 mon.a (mon.0) 2862 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: audit 2024-03-11T22:23:00.351145+0000 mon.c (mon.2) 622 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:01.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:01 smithi187 bash[23415]: audit 2024-03-11T22:23:00.351409+0000 mon.a (mon.0) 2863 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:01.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: cluster 2024-03-11T22:23:00.312573+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-03-11T22:23:01.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: cluster 2024-03-11T22:23:00.323293+0000 mgr.y (mgr.14601) 567 : cluster 0 pgmap v894: 236 pgs: 236 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:01.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: audit 2024-03-11T22:23:00.348313+0000 mon.c (mon.2) 620 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: audit 2024-03-11T22:23:00.349005+0000 mon.a (mon.0) 2861 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: audit 2024-03-11T22:23:00.350404+0000 mon.c (mon.2) 621 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: audit 2024-03-11T22:23:00.350689+0000 mon.a (mon.0) 2862 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: audit 2024-03-11T22:23:00.351145+0000 mon.c (mon.2) 622 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[21434]: audit 2024-03-11T22:23:00.351409+0000 mon.a (mon.0) 2863 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: cluster 2024-03-11T22:23:00.312573+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: cluster 2024-03-11T22:23:00.323293+0000 mgr.y (mgr.14601) 567 : cluster 0 pgmap v894: 236 pgs: 236 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: audit 2024-03-11T22:23:00.348313+0000 mon.c (mon.2) 620 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: audit 2024-03-11T22:23:00.349005+0000 mon.a (mon.0) 2861 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: audit 2024-03-11T22:23:00.350404+0000 mon.c (mon.2) 621 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: audit 2024-03-11T22:23:00.350689+0000 mon.a (mon.0) 2862 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: audit 2024-03-11T22:23:00.351145+0000 mon.c (mon.2) 622 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:01.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:01 smithi049 bash[28804]: audit 2024-03-11T22:23:00.351409+0000 mon.a (mon.0) 2863 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:02.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:02 smithi187 bash[23415]: audit 2024-03-11T22:23:01.327178+0000 mon.a (mon.0) 2864 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:23:02.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:02 smithi187 bash[23415]: cluster 2024-03-11T22:23:01.336136+0000 mon.a (mon.0) 2865 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-03-11T22:23:02.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:02 smithi187 bash[23415]: audit 2024-03-11T22:23:01.338882+0000 mon.c (mon.2) 623 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:02.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:02 smithi187 bash[23415]: audit 2024-03-11T22:23:01.339621+0000 mon.a (mon.0) 2866 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:02.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[21434]: audit 2024-03-11T22:23:01.327178+0000 mon.a (mon.0) 2864 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:23:02.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[21434]: cluster 2024-03-11T22:23:01.336136+0000 mon.a (mon.0) 2865 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-03-11T22:23:02.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[21434]: audit 2024-03-11T22:23:01.338882+0000 mon.c (mon.2) 623 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:02.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[21434]: audit 2024-03-11T22:23:01.339621+0000 mon.a (mon.0) 2866 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:02.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[28804]: audit 2024-03-11T22:23:01.327178+0000 mon.a (mon.0) 2864 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:23:02.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[28804]: cluster 2024-03-11T22:23:01.336136+0000 mon.a (mon.0) 2865 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-03-11T22:23:02.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[28804]: audit 2024-03-11T22:23:01.338882+0000 mon.c (mon.2) 623 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:02.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:02 smithi049 bash[28804]: audit 2024-03-11T22:23:01.339621+0000 mon.a (mon.0) 2866 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:03.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:03 smithi187 bash[23415]: cluster 2024-03-11T22:23:02.324218+0000 mgr.y (mgr.14601) 568 : cluster 0 pgmap v896: 236 pgs: 236 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:03.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:03 smithi187 bash[23415]: cluster 2024-03-11T22:23:02.801004+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-03-11T22:23:03.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:03 smithi049 bash[21434]: cluster 2024-03-11T22:23:02.324218+0000 mgr.y (mgr.14601) 568 : cluster 0 pgmap v896: 236 pgs: 236 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:03.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:03 smithi049 bash[21434]: cluster 2024-03-11T22:23:02.801004+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-03-11T22:23:03.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:03 smithi049 bash[28804]: cluster 2024-03-11T22:23:02.324218+0000 mgr.y (mgr.14601) 568 : cluster 0 pgmap v896: 236 pgs: 236 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:03.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:03 smithi049 bash[28804]: cluster 2024-03-11T22:23:02.801004+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-03-11T22:23:04.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:23:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:23:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:23:04.522 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:04 smithi049 bash[21434]: audit 2024-03-11T22:23:03.348532+0000 mon.a (mon.0) 2868 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:04.523 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:04 smithi049 bash[21434]: cluster 2024-03-11T22:23:03.354525+0000 mon.a (mon.0) 2869 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-03-11T22:23:04.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:04 smithi049 bash[28804]: audit 2024-03-11T22:23:03.348532+0000 mon.a (mon.0) 2868 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:04.523 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:04 smithi049 bash[28804]: cluster 2024-03-11T22:23:03.354525+0000 mon.a (mon.0) 2869 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-03-11T22:23:04.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:04 smithi187 bash[23415]: audit 2024-03-11T22:23:03.348532+0000 mon.a (mon.0) 2868 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:04.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:04 smithi187 bash[23415]: cluster 2024-03-11T22:23:03.354525+0000 mon.a (mon.0) 2869 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-03-11T22:23:05.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:05 smithi187 bash[23415]: cluster 2024-03-11T22:23:04.327283+0000 mgr.y (mgr.14601) 569 : cluster 0 pgmap v899: 244 pgs: 5 creating+peering, 3 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:05.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:05 smithi187 bash[23415]: cluster 2024-03-11T22:23:04.350866+0000 mon.a (mon.0) 2870 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:05.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:05 smithi187 bash[23415]: cluster 2024-03-11T22:23:04.370311+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-03-11T22:23:05.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:05 smithi187 bash[23415]: audit 2024-03-11T22:23:04.375794+0000 mon.c (mon.2) 624 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:05.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:05 smithi187 bash[23415]: audit 2024-03-11T22:23:04.377726+0000 mon.a (mon.0) 2872 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[28804]: cluster 2024-03-11T22:23:04.327283+0000 mgr.y (mgr.14601) 569 : cluster 0 pgmap v899: 244 pgs: 5 creating+peering, 3 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[28804]: cluster 2024-03-11T22:23:04.350866+0000 mon.a (mon.0) 2870 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[28804]: cluster 2024-03-11T22:23:04.370311+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-03-11T22:23:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[28804]: audit 2024-03-11T22:23:04.375794+0000 mon.c (mon.2) 624 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:05.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[28804]: audit 2024-03-11T22:23:04.377726+0000 mon.a (mon.0) 2872 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[21434]: cluster 2024-03-11T22:23:04.327283+0000 mgr.y (mgr.14601) 569 : cluster 0 pgmap v899: 244 pgs: 5 creating+peering, 3 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[21434]: cluster 2024-03-11T22:23:04.350866+0000 mon.a (mon.0) 2870 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[21434]: cluster 2024-03-11T22:23:04.370311+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-03-11T22:23:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[21434]: audit 2024-03-11T22:23:04.375794+0000 mon.c (mon.2) 624 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:05.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:05 smithi049 bash[21434]: audit 2024-03-11T22:23:04.377726+0000 mon.a (mon.0) 2872 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:06.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:06 smithi187 bash[23415]: audit 2024-03-11T22:23:05.365984+0000 mon.a (mon.0) 2873 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:06.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:06 smithi187 bash[23415]: cluster 2024-03-11T22:23:05.372938+0000 mon.a (mon.0) 2874 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-03-11T22:23:06.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:06 smithi187 bash[23415]: audit 2024-03-11T22:23:05.381732+0000 mon.c (mon.2) 625 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:06.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:06 smithi187 bash[23415]: audit 2024-03-11T22:23:05.382969+0000 mon.a (mon.0) 2875 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:06.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[21434]: audit 2024-03-11T22:23:05.365984+0000 mon.a (mon.0) 2873 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:06.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[21434]: cluster 2024-03-11T22:23:05.372938+0000 mon.a (mon.0) 2874 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-03-11T22:23:06.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[21434]: audit 2024-03-11T22:23:05.381732+0000 mon.c (mon.2) 625 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:06.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[21434]: audit 2024-03-11T22:23:05.382969+0000 mon.a (mon.0) 2875 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:06.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[28804]: audit 2024-03-11T22:23:05.365984+0000 mon.a (mon.0) 2873 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:06.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[28804]: cluster 2024-03-11T22:23:05.372938+0000 mon.a (mon.0) 2874 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-03-11T22:23:06.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[28804]: audit 2024-03-11T22:23:05.381732+0000 mon.c (mon.2) 625 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:06.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:06 smithi049 bash[28804]: audit 2024-03-11T22:23:05.382969+0000 mon.a (mon.0) 2875 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:07.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:07 smithi187 bash[23415]: cluster 2024-03-11T22:23:06.328274+0000 mgr.y (mgr.14601) 570 : cluster 0 pgmap v902: 276 pgs: 5 creating+peering, 35 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:07.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:07 smithi187 bash[23415]: audit 2024-03-11T22:23:06.374833+0000 mon.a (mon.0) 2876 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:07.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:07 smithi187 bash[23415]: cluster 2024-03-11T22:23:06.383901+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-03-11T22:23:07.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:07 smithi187 bash[23415]: audit 2024-03-11T22:23:06.385417+0000 mon.c (mon.2) 626 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:07.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:07 smithi187 bash[23415]: audit 2024-03-11T22:23:06.386259+0000 mon.a (mon.0) 2878 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[21434]: cluster 2024-03-11T22:23:06.328274+0000 mgr.y (mgr.14601) 570 : cluster 0 pgmap v902: 276 pgs: 5 creating+peering, 35 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[21434]: audit 2024-03-11T22:23:06.374833+0000 mon.a (mon.0) 2876 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[21434]: cluster 2024-03-11T22:23:06.383901+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-03-11T22:23:07.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[21434]: audit 2024-03-11T22:23:06.385417+0000 mon.c (mon.2) 626 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:07.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[21434]: audit 2024-03-11T22:23:06.386259+0000 mon.a (mon.0) 2878 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:07.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[28804]: cluster 2024-03-11T22:23:06.328274+0000 mgr.y (mgr.14601) 570 : cluster 0 pgmap v902: 276 pgs: 5 creating+peering, 35 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:07.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[28804]: audit 2024-03-11T22:23:06.374833+0000 mon.a (mon.0) 2876 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:07.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[28804]: cluster 2024-03-11T22:23:06.383901+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-03-11T22:23:07.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[28804]: audit 2024-03-11T22:23:06.385417+0000 mon.c (mon.2) 626 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:07.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:07 smithi049 bash[28804]: audit 2024-03-11T22:23:06.386259+0000 mon.a (mon.0) 2878 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:08.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:08 smithi187 bash[23415]: audit 2024-03-11T22:23:07.385492+0000 mon.a (mon.0) 2879 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:08.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:08 smithi187 bash[23415]: cluster 2024-03-11T22:23:07.391775+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-03-11T22:23:08.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:08 smithi187 bash[23415]: audit 2024-03-11T22:23:07.394042+0000 mon.c (mon.2) 627 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:23:08.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:08 smithi187 bash[23415]: audit 2024-03-11T22:23:07.395039+0000 mon.a (mon.0) 2881 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:23:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[21434]: audit 2024-03-11T22:23:07.385492+0000 mon.a (mon.0) 2879 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:08.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[21434]: cluster 2024-03-11T22:23:07.391775+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-03-11T22:23:08.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[21434]: audit 2024-03-11T22:23:07.394042+0000 mon.c (mon.2) 627 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:23:08.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[21434]: audit 2024-03-11T22:23:07.395039+0000 mon.a (mon.0) 2881 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:23:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[28804]: audit 2024-03-11T22:23:07.385492+0000 mon.a (mon.0) 2879 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-109", "overlaypool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[28804]: cluster 2024-03-11T22:23:07.391775+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-03-11T22:23:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[28804]: audit 2024-03-11T22:23:07.394042+0000 mon.c (mon.2) 627 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:23:08.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:08 smithi049 bash[28804]: audit 2024-03-11T22:23:07.395039+0000 mon.a (mon.0) 2881 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]: dispatch 2024-03-11T22:23:09.405 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:23:09.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[23415]: cluster 2024-03-11T22:23:08.329200+0000 mgr.y (mgr.14601) 571 : cluster 0 pgmap v905: 276 pgs: 5 creating+peering, 35 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:09.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[23415]: cluster 2024-03-11T22:23:08.386584+0000 mon.a (mon.0) 2882 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:09.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[23415]: audit 2024-03-11T22:23:08.394870+0000 mon.a (mon.0) 2883 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]': finished 2024-03-11T22:23:09.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[23415]: cluster 2024-03-11T22:23:08.403088+0000 mon.a (mon.0) 2884 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-03-11T22:23:09.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[23415]: audit 2024-03-11T22:23:08.407462+0000 mon.c (mon.2) 628 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:23:09.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[23415]: audit 2024-03-11T22:23:08.408097+0000 mon.a (mon.0) 2885 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:23:09.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:09 smithi187 bash[23415]: audit 2024-03-11T22:23:09.137030+0000 mgr.y (mgr.14601) 572 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[21434]: cluster 2024-03-11T22:23:08.329200+0000 mgr.y (mgr.14601) 571 : cluster 0 pgmap v905: 276 pgs: 5 creating+peering, 35 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:09.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[21434]: cluster 2024-03-11T22:23:08.386584+0000 mon.a (mon.0) 2882 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[21434]: audit 2024-03-11T22:23:08.394870+0000 mon.a (mon.0) 2883 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]': finished 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[21434]: cluster 2024-03-11T22:23:08.403088+0000 mon.a (mon.0) 2884 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[21434]: audit 2024-03-11T22:23:08.407462+0000 mon.c (mon.2) 628 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[21434]: audit 2024-03-11T22:23:08.408097+0000 mon.a (mon.0) 2885 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[21434]: audit 2024-03-11T22:23:09.137030+0000 mgr.y (mgr.14601) 572 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[28804]: cluster 2024-03-11T22:23:08.329200+0000 mgr.y (mgr.14601) 571 : cluster 0 pgmap v905: 276 pgs: 5 creating+peering, 35 unknown, 236 active+clean; 582 KiB data, 608 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[28804]: cluster 2024-03-11T22:23:08.386584+0000 mon.a (mon.0) 2882 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[28804]: audit 2024-03-11T22:23:08.394870+0000 mon.a (mon.0) 2883 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-109-cache", "mode": "writeback"}]': finished 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[28804]: cluster 2024-03-11T22:23:08.403088+0000 mon.a (mon.0) 2884 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[28804]: audit 2024-03-11T22:23:08.407462+0000 mon.c (mon.2) 628 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[28804]: audit 2024-03-11T22:23:08.408097+0000 mon.a (mon.0) 2885 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:23:09.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:09 smithi049 bash[28804]: audit 2024-03-11T22:23:09.137030+0000 mgr.y (mgr.14601) 572 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:10.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:10 smithi187 bash[23415]: audit 2024-03-11T22:23:09.397965+0000 mon.a (mon.0) 2886 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:23:10.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:10 smithi187 bash[23415]: cluster 2024-03-11T22:23:09.404798+0000 mon.a (mon.0) 2887 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-03-11T22:23:10.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:10 smithi187 bash[23415]: audit 2024-03-11T22:23:09.406530+0000 mon.c (mon.2) 629 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:23:10.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:10 smithi187 bash[23415]: audit 2024-03-11T22:23:09.410579+0000 mon.a (mon.0) 2888 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:23:10.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:10 smithi187 bash[23415]: audit 2024-03-11T22:23:10.400394+0000 mon.a (mon.0) 2889 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:23:10.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:10 smithi187 bash[23415]: cluster 2024-03-11T22:23:10.407355+0000 mon.a (mon.0) 2890 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-03-11T22:23:10.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:10 smithi187 bash[23415]: audit 2024-03-11T22:23:10.410227+0000 mon.c (mon.2) 630 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:23:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[21434]: audit 2024-03-11T22:23:09.397965+0000 mon.a (mon.0) 2886 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:23:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[21434]: cluster 2024-03-11T22:23:09.404798+0000 mon.a (mon.0) 2887 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-03-11T22:23:10.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[21434]: audit 2024-03-11T22:23:09.406530+0000 mon.c (mon.2) 629 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[21434]: audit 2024-03-11T22:23:09.410579+0000 mon.a (mon.0) 2888 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[21434]: audit 2024-03-11T22:23:10.400394+0000 mon.a (mon.0) 2889 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[21434]: cluster 2024-03-11T22:23:10.407355+0000 mon.a (mon.0) 2890 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[21434]: audit 2024-03-11T22:23:10.410227+0000 mon.c (mon.2) 630 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[28804]: audit 2024-03-11T22:23:09.397965+0000 mon.a (mon.0) 2886 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[28804]: cluster 2024-03-11T22:23:09.404798+0000 mon.a (mon.0) 2887 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[28804]: audit 2024-03-11T22:23:09.406530+0000 mon.c (mon.2) 629 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[28804]: audit 2024-03-11T22:23:09.410579+0000 mon.a (mon.0) 2888 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[28804]: audit 2024-03-11T22:23:10.400394+0000 mon.a (mon.0) 2889 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[28804]: cluster 2024-03-11T22:23:10.407355+0000 mon.a (mon.0) 2890 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-03-11T22:23:10.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:10 smithi049 bash[28804]: audit 2024-03-11T22:23:10.410227+0000 mon.c (mon.2) 630 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:23:11.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:11 smithi187 bash[23415]: cluster 2024-03-11T22:23:10.330074+0000 mgr.y (mgr.14601) 573 : cluster 0 pgmap v908: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:11.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:11 smithi187 bash[23415]: audit 2024-03-11T22:23:10.411382+0000 mon.a (mon.0) 2891 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:23:11.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:11 smithi187 bash[23415]: cluster 2024-03-11T22:23:11.400777+0000 mon.a (mon.0) 2892 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:23:11.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:11 smithi187 bash[23415]: audit 2024-03-11T22:23:11.403096+0000 mon.a (mon.0) 2893 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:23:11.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:11 smithi187 bash[23415]: cluster 2024-03-11T22:23:11.411185+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-03-11T22:23:11.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:11 smithi187 bash[23415]: audit 2024-03-11T22:23:11.413673+0000 mon.c (mon.2) 631 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-11T22:23:11.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:11 smithi187 bash[23415]: audit 2024-03-11T22:23:11.414562+0000 mon.a (mon.0) 2895 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-11T22:23:11.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[21434]: cluster 2024-03-11T22:23:10.330074+0000 mgr.y (mgr.14601) 573 : cluster 0 pgmap v908: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:11.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[21434]: audit 2024-03-11T22:23:10.411382+0000 mon.a (mon.0) 2891 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[21434]: cluster 2024-03-11T22:23:11.400777+0000 mon.a (mon.0) 2892 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[21434]: audit 2024-03-11T22:23:11.403096+0000 mon.a (mon.0) 2893 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[21434]: cluster 2024-03-11T22:23:11.411185+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[21434]: audit 2024-03-11T22:23:11.413673+0000 mon.c (mon.2) 631 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[21434]: audit 2024-03-11T22:23:11.414562+0000 mon.a (mon.0) 2895 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[28804]: cluster 2024-03-11T22:23:10.330074+0000 mgr.y (mgr.14601) 573 : cluster 0 pgmap v908: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[28804]: audit 2024-03-11T22:23:10.411382+0000 mon.a (mon.0) 2891 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[28804]: cluster 2024-03-11T22:23:11.400777+0000 mon.a (mon.0) 2892 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[28804]: audit 2024-03-11T22:23:11.403096+0000 mon.a (mon.0) 2893 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[28804]: cluster 2024-03-11T22:23:11.411185+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[28804]: audit 2024-03-11T22:23:11.413673+0000 mon.c (mon.2) 631 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-11T22:23:11.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:11 smithi049 bash[28804]: audit 2024-03-11T22:23:11.414562+0000 mon.a (mon.0) 2895 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-11T22:23:12.997 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:12 smithi187 bash[23415]: audit 2024-03-11T22:23:11.562121+0000 mon.a (mon.0) 2896 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:12.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:12 smithi187 bash[23415]: audit 2024-03-11T22:23:11.565364+0000 mon.c (mon.2) 632 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:12.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:12 smithi187 bash[23415]: audit 2024-03-11T22:23:12.405915+0000 mon.a (mon.0) 2897 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-03-11T22:23:12.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:12 smithi187 bash[23415]: cluster 2024-03-11T22:23:12.413454+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-03-11T22:23:12.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:12 smithi187 bash[23415]: audit 2024-03-11T22:23:12.489290+0000 mon.c (mon.2) 633 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:12.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:12 smithi187 bash[23415]: audit 2024-03-11T22:23:12.490066+0000 mon.a (mon.0) 2899 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:13.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[21434]: audit 2024-03-11T22:23:11.562121+0000 mon.a (mon.0) 2896 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[21434]: audit 2024-03-11T22:23:11.565364+0000 mon.c (mon.2) 632 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[21434]: audit 2024-03-11T22:23:12.405915+0000 mon.a (mon.0) 2897 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[21434]: cluster 2024-03-11T22:23:12.413454+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[21434]: audit 2024-03-11T22:23:12.489290+0000 mon.c (mon.2) 633 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[21434]: audit 2024-03-11T22:23:12.490066+0000 mon.a (mon.0) 2899 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[28804]: audit 2024-03-11T22:23:11.562121+0000 mon.a (mon.0) 2896 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[28804]: audit 2024-03-11T22:23:11.565364+0000 mon.c (mon.2) 632 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[28804]: audit 2024-03-11T22:23:12.405915+0000 mon.a (mon.0) 2897 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[28804]: cluster 2024-03-11T22:23:12.413454+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-03-11T22:23:13.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[28804]: audit 2024-03-11T22:23:12.489290+0000 mon.c (mon.2) 633 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:13.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:12 smithi049 bash[28804]: audit 2024-03-11T22:23:12.490066+0000 mon.a (mon.0) 2899 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:13.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:13 smithi187 bash[23415]: cluster 2024-03-11T22:23:12.331261+0000 mgr.y (mgr.14601) 574 : cluster 0 pgmap v911: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:13.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:13 smithi187 bash[23415]: audit 2024-03-11T22:23:13.408989+0000 mon.a (mon.0) 2900 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:13.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:13 smithi187 bash[23415]: cluster 2024-03-11T22:23:13.416566+0000 mon.a (mon.0) 2901 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-03-11T22:23:13.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:13 smithi187 bash[23415]: audit 2024-03-11T22:23:13.418776+0000 mon.c (mon.2) 634 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:13.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:13 smithi187 bash[23415]: audit 2024-03-11T22:23:13.419778+0000 mon.a (mon.0) 2902 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[28804]: cluster 2024-03-11T22:23:12.331261+0000 mgr.y (mgr.14601) 574 : cluster 0 pgmap v911: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[28804]: audit 2024-03-11T22:23:13.408989+0000 mon.a (mon.0) 2900 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[28804]: cluster 2024-03-11T22:23:13.416566+0000 mon.a (mon.0) 2901 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[28804]: audit 2024-03-11T22:23:13.418776+0000 mon.c (mon.2) 634 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[28804]: audit 2024-03-11T22:23:13.419778+0000 mon.a (mon.0) 2902 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[21434]: cluster 2024-03-11T22:23:12.331261+0000 mgr.y (mgr.14601) 574 : cluster 0 pgmap v911: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[21434]: audit 2024-03-11T22:23:13.408989+0000 mon.a (mon.0) 2900 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[21434]: cluster 2024-03-11T22:23:13.416566+0000 mon.a (mon.0) 2901 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[21434]: audit 2024-03-11T22:23:13.418776+0000 mon.c (mon.2) 634 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:14.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:13 smithi049 bash[21434]: audit 2024-03-11T22:23:13.419778+0000 mon.a (mon.0) 2902 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]: dispatch 2024-03-11T22:23:14.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:23:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:23:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:23:15.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:15 smithi187 bash[23415]: cluster 2024-03-11T22:23:14.333923+0000 mgr.y (mgr.14601) 575 : cluster 0 pgmap v914: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:23:15.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:15 smithi187 bash[23415]: audit 2024-03-11T22:23:14.411647+0000 mon.a (mon.0) 2903 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:15.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:15 smithi187 bash[23415]: cluster 2024-03-11T22:23:14.418581+0000 mon.a (mon.0) 2904 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-03-11T22:23:15.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:15 smithi049 bash[21434]: cluster 2024-03-11T22:23:14.333923+0000 mgr.y (mgr.14601) 575 : cluster 0 pgmap v914: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:23:15.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:15 smithi049 bash[21434]: audit 2024-03-11T22:23:14.411647+0000 mon.a (mon.0) 2903 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:15.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:15 smithi049 bash[21434]: cluster 2024-03-11T22:23:14.418581+0000 mon.a (mon.0) 2904 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-03-11T22:23:15.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:15 smithi049 bash[28804]: cluster 2024-03-11T22:23:14.333923+0000 mgr.y (mgr.14601) 575 : cluster 0 pgmap v914: 276 pgs: 276 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-11T22:23:15.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:15 smithi049 bash[28804]: audit 2024-03-11T22:23:14.411647+0000 mon.a (mon.0) 2903 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-109", "tierpool": "test-rados-api-smithi049-64247-109-cache"}]': finished 2024-03-11T22:23:15.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:15 smithi049 bash[28804]: cluster 2024-03-11T22:23:14.418581+0000 mon.a (mon.0) 2904 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-03-11T22:23:16.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:16 smithi187 bash[23415]: cluster 2024-03-11T22:23:15.427389+0000 mon.a (mon.0) 2905 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-03-11T22:23:16.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:16 smithi049 bash[21434]: cluster 2024-03-11T22:23:15.427389+0000 mon.a (mon.0) 2905 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-03-11T22:23:16.772 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:16 smithi049 bash[28804]: cluster 2024-03-11T22:23:15.427389+0000 mon.a (mon.0) 2905 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-03-11T22:23:17.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:17 smithi187 bash[23415]: cluster 2024-03-11T22:23:16.334955+0000 mgr.y (mgr.14601) 576 : cluster 0 pgmap v917: 244 pgs: 244 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:17.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:17 smithi187 bash[23415]: cluster 2024-03-11T22:23:16.438711+0000 mon.a (mon.0) 2906 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-03-11T22:23:17.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:17 smithi187 bash[23415]: audit 2024-03-11T22:23:16.440945+0000 mon.c (mon.2) 635 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:17.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:17 smithi187 bash[23415]: audit 2024-03-11T22:23:16.441819+0000 mon.a (mon.0) 2907 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:17.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[21434]: cluster 2024-03-11T22:23:16.334955+0000 mgr.y (mgr.14601) 576 : cluster 0 pgmap v917: 244 pgs: 244 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[21434]: cluster 2024-03-11T22:23:16.438711+0000 mon.a (mon.0) 2906 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-03-11T22:23:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[21434]: audit 2024-03-11T22:23:16.440945+0000 mon.c (mon.2) 635 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:17.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[21434]: audit 2024-03-11T22:23:16.441819+0000 mon.a (mon.0) 2907 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[28804]: cluster 2024-03-11T22:23:16.334955+0000 mgr.y (mgr.14601) 576 : cluster 0 pgmap v917: 244 pgs: 244 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[28804]: cluster 2024-03-11T22:23:16.438711+0000 mon.a (mon.0) 2906 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-03-11T22:23:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[28804]: audit 2024-03-11T22:23:16.440945+0000 mon.c (mon.2) 635 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:17.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:17 smithi049 bash[28804]: audit 2024-03-11T22:23:16.441819+0000 mon.a (mon.0) 2907 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:18.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:18 smithi187 bash[23415]: audit 2024-03-11T22:23:17.433140+0000 mon.a (mon.0) 2908 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:18.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:18 smithi187 bash[23415]: cluster 2024-03-11T22:23:17.440407+0000 mon.a (mon.0) 2909 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-03-11T22:23:18.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:18 smithi187 bash[23415]: audit 2024-03-11T22:23:17.441518+0000 mon.c (mon.2) 636 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:18.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:18 smithi187 bash[23415]: audit 2024-03-11T22:23:17.443216+0000 mon.a (mon.0) 2910 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:18.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:18 smithi187 bash[23415]: audit 2024-03-11T22:23:18.436410+0000 mon.a (mon.0) 2911 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:18.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:18 smithi187 bash[23415]: cluster 2024-03-11T22:23:18.444400+0000 mon.a (mon.0) 2912 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-03-11T22:23:18.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[21434]: audit 2024-03-11T22:23:17.433140+0000 mon.a (mon.0) 2908 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[21434]: cluster 2024-03-11T22:23:17.440407+0000 mon.a (mon.0) 2909 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[21434]: audit 2024-03-11T22:23:17.441518+0000 mon.c (mon.2) 636 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[21434]: audit 2024-03-11T22:23:17.443216+0000 mon.a (mon.0) 2910 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[21434]: audit 2024-03-11T22:23:18.436410+0000 mon.a (mon.0) 2911 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[21434]: cluster 2024-03-11T22:23:18.444400+0000 mon.a (mon.0) 2912 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[28804]: audit 2024-03-11T22:23:17.433140+0000 mon.a (mon.0) 2908 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[28804]: cluster 2024-03-11T22:23:17.440407+0000 mon.a (mon.0) 2909 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[28804]: audit 2024-03-11T22:23:17.441518+0000 mon.c (mon.2) 636 : audit 1 from='client.? v1:172.21.15.49:0/2010674004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[28804]: audit 2024-03-11T22:23:17.443216+0000 mon.a (mon.0) 2910 : audit 1 from='client.47096 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]: dispatch 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[28804]: audit 2024-03-11T22:23:18.436410+0000 mon.a (mon.0) 2911 : audit 1 from='client.47096 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-109"}]': finished 2024-03-11T22:23:18.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:18 smithi049 bash[28804]: cluster 2024-03-11T22:23:18.444400+0000 mon.a (mon.0) 2912 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-03-11T22:23:19.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:23:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:23:19.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:19 smithi187 bash[23415]: cluster 2024-03-11T22:23:18.335881+0000 mgr.y (mgr.14601) 577 : cluster 0 pgmap v920: 236 pgs: 236 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:19.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:19 smithi187 bash[23415]: cluster 2024-03-11T22:23:18.446491+0000 mon.a (mon.0) 2913 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:19.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:19 smithi187 bash[23415]: audit 2024-03-11T22:23:18.539352+0000 mon.c (mon.2) 637 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:23:19.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:19 smithi187 bash[23415]: audit 2024-03-11T22:23:19.285892+0000 mon.c (mon.2) 638 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:23:19.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:19 smithi187 bash[23415]: audit 2024-03-11T22:23:19.287534+0000 mon.c (mon.2) 639 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:23:19.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:19 smithi187 bash[23415]: audit 2024-03-11T22:23:19.296984+0000 mon.a (mon.0) 2914 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:19.772 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[21434]: cluster 2024-03-11T22:23:18.335881+0000 mgr.y (mgr.14601) 577 : cluster 0 pgmap v920: 236 pgs: 236 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[21434]: cluster 2024-03-11T22:23:18.446491+0000 mon.a (mon.0) 2913 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[21434]: audit 2024-03-11T22:23:18.539352+0000 mon.c (mon.2) 637 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[21434]: audit 2024-03-11T22:23:19.285892+0000 mon.c (mon.2) 638 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[21434]: audit 2024-03-11T22:23:19.287534+0000 mon.c (mon.2) 639 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[21434]: audit 2024-03-11T22:23:19.296984+0000 mon.a (mon.0) 2914 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[28804]: cluster 2024-03-11T22:23:18.335881+0000 mgr.y (mgr.14601) 577 : cluster 0 pgmap v920: 236 pgs: 236 active+clean; 582 KiB data, 613 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[28804]: cluster 2024-03-11T22:23:18.446491+0000 mon.a (mon.0) 2913 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[28804]: audit 2024-03-11T22:23:18.539352+0000 mon.c (mon.2) 637 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[28804]: audit 2024-03-11T22:23:19.285892+0000 mon.c (mon.2) 638 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:23:19.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[28804]: audit 2024-03-11T22:23:19.287534+0000 mon.c (mon.2) 639 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:23:19.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:19 smithi049 bash[28804]: audit 2024-03-11T22:23:19.296984+0000 mon.a (mon.0) 2914 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:20.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:20 smithi187 bash[23415]: audit 2024-03-11T22:23:19.146168+0000 mgr.y (mgr.14601) 578 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:20.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:20 smithi187 bash[23415]: cluster 2024-03-11T22:23:19.469931+0000 mon.a (mon.0) 2915 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-03-11T22:23:20.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:20 smithi187 bash[23415]: audit 2024-03-11T22:23:19.482893+0000 mon.c (mon.2) 640 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:20.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:20 smithi187 bash[23415]: audit 2024-03-11T22:23:19.483530+0000 mon.a (mon.0) 2916 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[21434]: audit 2024-03-11T22:23:19.146168+0000 mgr.y (mgr.14601) 578 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[21434]: cluster 2024-03-11T22:23:19.469931+0000 mon.a (mon.0) 2915 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[21434]: audit 2024-03-11T22:23:19.482893+0000 mon.c (mon.2) 640 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[21434]: audit 2024-03-11T22:23:19.483530+0000 mon.a (mon.0) 2916 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[28804]: audit 2024-03-11T22:23:19.146168+0000 mgr.y (mgr.14601) 578 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[28804]: cluster 2024-03-11T22:23:19.469931+0000 mon.a (mon.0) 2915 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[28804]: audit 2024-03-11T22:23:19.482893+0000 mon.c (mon.2) 640 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:20.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:20 smithi049 bash[28804]: audit 2024-03-11T22:23:19.483530+0000 mon.a (mon.0) 2916 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:21.747 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:21 smithi187 bash[23415]: cluster 2024-03-11T22:23:20.336708+0000 mgr.y (mgr.14601) 579 : cluster 0 pgmap v923: 228 pgs: 228 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-11T22:23:21.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:21 smithi187 bash[23415]: audit 2024-03-11T22:23:20.483006+0000 mon.a (mon.0) 2917 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:23:21.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:21 smithi187 bash[23415]: cluster 2024-03-11T22:23:20.490702+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-03-11T22:23:21.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:21 smithi187 bash[23415]: audit 2024-03-11T22:23:20.493745+0000 mon.c (mon.2) 641 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:21.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:21 smithi187 bash[23415]: audit 2024-03-11T22:23:20.494418+0000 mon.a (mon.0) 2919 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[21434]: cluster 2024-03-11T22:23:20.336708+0000 mgr.y (mgr.14601) 579 : cluster 0 pgmap v923: 228 pgs: 228 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[21434]: audit 2024-03-11T22:23:20.483006+0000 mon.a (mon.0) 2917 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[21434]: cluster 2024-03-11T22:23:20.490702+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[21434]: audit 2024-03-11T22:23:20.493745+0000 mon.c (mon.2) 641 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[21434]: audit 2024-03-11T22:23:20.494418+0000 mon.a (mon.0) 2919 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[28804]: cluster 2024-03-11T22:23:20.336708+0000 mgr.y (mgr.14601) 579 : cluster 0 pgmap v923: 228 pgs: 228 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[28804]: audit 2024-03-11T22:23:20.483006+0000 mon.a (mon.0) 2917 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:23:21.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[28804]: cluster 2024-03-11T22:23:20.490702+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-03-11T22:23:21.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[28804]: audit 2024-03-11T22:23:20.493745+0000 mon.c (mon.2) 641 : audit 1 from='client.? v1:172.21.15.49:0/1850278495' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:21.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:21 smithi049 bash[28804]: audit 2024-03-11T22:23:20.494418+0000 mon.a (mon.0) 2919 : audit 1 from='client.47084 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]: dispatch 2024-03-11T22:23:22.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[21434]: audit 2024-03-11T22:23:21.486174+0000 mon.a (mon.0) 2920 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:23:22.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[21434]: cluster 2024-03-11T22:23:21.492372+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-03-11T22:23:22.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[21434]: audit 2024-03-11T22:23:21.546066+0000 mon.a (mon.0) 2922 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:22.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[21434]: audit 2024-03-11T22:23:21.547920+0000 mon.a (mon.0) 2923 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:22.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[21434]: audit 2024-03-11T22:23:21.548329+0000 mon.a (mon.0) 2924 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:22.773 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[28804]: audit 2024-03-11T22:23:21.486174+0000 mon.a (mon.0) 2920 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:23:22.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[28804]: cluster 2024-03-11T22:23:21.492372+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-03-11T22:23:22.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[28804]: audit 2024-03-11T22:23:21.546066+0000 mon.a (mon.0) 2922 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:22.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[28804]: audit 2024-03-11T22:23:21.547920+0000 mon.a (mon.0) 2923 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:22.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:22 smithi049 bash[28804]: audit 2024-03-11T22:23:21.548329+0000 mon.a (mon.0) 2924 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:22.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:22 smithi187 bash[23415]: audit 2024-03-11T22:23:21.486174+0000 mon.a (mon.0) 2920 : audit 1 from='client.47084 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi049-64247-104"}]': finished 2024-03-11T22:23:22.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:22 smithi187 bash[23415]: cluster 2024-03-11T22:23:21.492372+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-03-11T22:23:22.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:22 smithi187 bash[23415]: audit 2024-03-11T22:23:21.546066+0000 mon.a (mon.0) 2922 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:22.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:22 smithi187 bash[23415]: audit 2024-03-11T22:23:21.547920+0000 mon.a (mon.0) 2923 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:22.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:22 smithi187 bash[23415]: audit 2024-03-11T22:23:21.548329+0000 mon.a (mon.0) 2924 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-11T22:23:24.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[21434]: cluster 2024-03-11T22:23:22.337513+0000 mgr.y (mgr.14601) 580 : cluster 0 pgmap v926: 228 pgs: 228 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-11T22:23:24.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[21434]: audit 2024-03-11T22:23:22.499895+0000 mon.a (mon.0) 2925 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:23:24.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[21434]: cluster 2024-03-11T22:23:22.507179+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-03-11T22:23:24.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[21434]: audit 2024-03-11T22:23:22.508892+0000 mon.a (mon.0) 2927 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[28804]: cluster 2024-03-11T22:23:22.337513+0000 mgr.y (mgr.14601) 580 : cluster 0 pgmap v926: 228 pgs: 228 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-11T22:23:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[28804]: audit 2024-03-11T22:23:22.499895+0000 mon.a (mon.0) 2925 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:23:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[28804]: cluster 2024-03-11T22:23:22.507179+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-03-11T22:23:24.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:23 smithi049 bash[28804]: audit 2024-03-11T22:23:22.508892+0000 mon.a (mon.0) 2927 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:24.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:23 smithi187 bash[23415]: cluster 2024-03-11T22:23:22.337513+0000 mgr.y (mgr.14601) 580 : cluster 0 pgmap v926: 228 pgs: 228 active+clean; 582 KiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-11T22:23:24.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:23 smithi187 bash[23415]: audit 2024-03-11T22:23:22.499895+0000 mon.a (mon.0) 2925 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi049-64247-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-11T22:23:24.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:23 smithi187 bash[23415]: cluster 2024-03-11T22:23:22.507179+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-03-11T22:23:24.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:23 smithi187 bash[23415]: audit 2024-03-11T22:23:22.508892+0000 mon.a (mon.0) 2927 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:24.522 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:23:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:23:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:23:25.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:24 smithi187 bash[23415]: cluster 2024-03-11T22:23:23.969696+0000 mon.a (mon.0) 2928 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-03-11T22:23:25.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:24 smithi187 bash[23415]: audit 2024-03-11T22:23:24.506171+0000 mon.a (mon.0) 2929 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:25.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:24 smithi187 bash[23415]: cluster 2024-03-11T22:23:24.512278+0000 mon.a (mon.0) 2930 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-03-11T22:23:25.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:24 smithi049 bash[21434]: cluster 2024-03-11T22:23:23.969696+0000 mon.a (mon.0) 2928 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-03-11T22:23:25.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:24 smithi049 bash[21434]: audit 2024-03-11T22:23:24.506171+0000 mon.a (mon.0) 2929 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:25.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:24 smithi049 bash[21434]: cluster 2024-03-11T22:23:24.512278+0000 mon.a (mon.0) 2930 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-03-11T22:23:25.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:24 smithi049 bash[28804]: cluster 2024-03-11T22:23:23.969696+0000 mon.a (mon.0) 2928 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-03-11T22:23:25.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:24 smithi049 bash[28804]: audit 2024-03-11T22:23:24.506171+0000 mon.a (mon.0) 2929 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi049-64247-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:25.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:24 smithi049 bash[28804]: cluster 2024-03-11T22:23:24.512278+0000 mon.a (mon.0) 2930 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-03-11T22:23:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:25 smithi187 bash[23415]: cluster 2024-03-11T22:23:24.339755+0000 mgr.y (mgr.14601) 581 : cluster 0 pgmap v929: 228 pgs: 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:25 smithi187 bash[23415]: cluster 2024-03-11T22:23:25.518584+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-03-11T22:23:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:25 smithi187 bash[23415]: audit 2024-03-11T22:23:25.527498+0000 mon.a (mon.0) 2932 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:25 smithi187 bash[23415]: cluster 2024-03-11T22:23:25.795284+0000 mon.a (mon.0) 2933 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[28804]: cluster 2024-03-11T22:23:24.339755+0000 mgr.y (mgr.14601) 581 : cluster 0 pgmap v929: 228 pgs: 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[28804]: cluster 2024-03-11T22:23:25.518584+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[28804]: audit 2024-03-11T22:23:25.527498+0000 mon.a (mon.0) 2932 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[28804]: cluster 2024-03-11T22:23:25.795284+0000 mon.a (mon.0) 2933 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[21434]: cluster 2024-03-11T22:23:24.339755+0000 mgr.y (mgr.14601) 581 : cluster 0 pgmap v929: 228 pgs: 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[21434]: cluster 2024-03-11T22:23:25.518584+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[21434]: audit 2024-03-11T22:23:25.527498+0000 mon.a (mon.0) 2932 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:26.273 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:25 smithi049 bash[21434]: cluster 2024-03-11T22:23:25.795284+0000 mon.a (mon.0) 2933 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[21434]: cluster 2024-03-11T22:23:26.340660+0000 mgr.y (mgr.14601) 582 : cluster 0 pgmap v932: 268 pgs: 40 unknown, 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[21434]: audit 2024-03-11T22:23:26.513206+0000 mon.a (mon.0) 2934 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[21434]: cluster 2024-03-11T22:23:26.521941+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-03-11T22:23:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[21434]: audit 2024-03-11T22:23:26.575367+0000 mon.a (mon.0) 2936 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:27.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[21434]: audit 2024-03-11T22:23:26.602171+0000 mon.c (mon.2) 642 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:27.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[28804]: cluster 2024-03-11T22:23:26.340660+0000 mgr.y (mgr.14601) 582 : cluster 0 pgmap v932: 268 pgs: 40 unknown, 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:27.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[28804]: audit 2024-03-11T22:23:26.513206+0000 mon.a (mon.0) 2934 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:27.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[28804]: cluster 2024-03-11T22:23:26.521941+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-03-11T22:23:27.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[28804]: audit 2024-03-11T22:23:26.575367+0000 mon.a (mon.0) 2936 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:27.774 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:27 smithi049 bash[28804]: audit 2024-03-11T22:23:26.602171+0000 mon.c (mon.2) 642 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:27.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:27 smithi187 bash[23415]: cluster 2024-03-11T22:23:26.340660+0000 mgr.y (mgr.14601) 582 : cluster 0 pgmap v932: 268 pgs: 40 unknown, 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:27.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:27 smithi187 bash[23415]: audit 2024-03-11T22:23:26.513206+0000 mon.a (mon.0) 2934 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:27.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:27 smithi187 bash[23415]: cluster 2024-03-11T22:23:26.521941+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-03-11T22:23:27.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:27 smithi187 bash[23415]: audit 2024-03-11T22:23:26.575367+0000 mon.a (mon.0) 2936 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:27.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:27 smithi187 bash[23415]: audit 2024-03-11T22:23:26.602171+0000 mon.c (mon.2) 642 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:28.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:28 smithi187 bash[23415]: audit 2024-03-11T22:23:27.523969+0000 mon.a (mon.0) 2937 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:28.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:28 smithi187 bash[23415]: cluster 2024-03-11T22:23:27.529974+0000 mon.a (mon.0) 2938 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-03-11T22:23:28.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:28 smithi187 bash[23415]: audit 2024-03-11T22:23:27.530800+0000 mon.a (mon.0) 2939 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-112"}]: dispatch 2024-03-11T22:23:29.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:28 smithi049 bash[21434]: audit 2024-03-11T22:23:27.523969+0000 mon.a (mon.0) 2937 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:29.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:28 smithi049 bash[21434]: cluster 2024-03-11T22:23:27.529974+0000 mon.a (mon.0) 2938 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-03-11T22:23:29.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:28 smithi049 bash[21434]: audit 2024-03-11T22:23:27.530800+0000 mon.a (mon.0) 2939 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-112"}]: dispatch 2024-03-11T22:23:29.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:28 smithi049 bash[28804]: audit 2024-03-11T22:23:27.523969+0000 mon.a (mon.0) 2937 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:29.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:28 smithi049 bash[28804]: cluster 2024-03-11T22:23:27.529974+0000 mon.a (mon.0) 2938 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-03-11T22:23:29.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:28 smithi049 bash[28804]: audit 2024-03-11T22:23:27.530800+0000 mon.a (mon.0) 2939 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-112"}]: dispatch 2024-03-11T22:23:29.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:23:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:23:29.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:29 smithi187 bash[23415]: cluster 2024-03-11T22:23:28.341699+0000 mgr.y (mgr.14601) 583 : cluster 0 pgmap v935: 268 pgs: 40 unknown, 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:29.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:29 smithi187 bash[23415]: audit 2024-03-11T22:23:28.532968+0000 mon.a (mon.0) 2940 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-112"}]': finished 2024-03-11T22:23:29.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:29 smithi187 bash[23415]: cluster 2024-03-11T22:23:28.540384+0000 mon.a (mon.0) 2941 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-03-11T22:23:29.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:29 smithi187 bash[23415]: audit 2024-03-11T22:23:28.615961+0000 mon.a (mon.0) 2942 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:30.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[21434]: cluster 2024-03-11T22:23:28.341699+0000 mgr.y (mgr.14601) 583 : cluster 0 pgmap v935: 268 pgs: 40 unknown, 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:30.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[21434]: audit 2024-03-11T22:23:28.532968+0000 mon.a (mon.0) 2940 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-112"}]': finished 2024-03-11T22:23:30.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[21434]: cluster 2024-03-11T22:23:28.540384+0000 mon.a (mon.0) 2941 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-03-11T22:23:30.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[21434]: audit 2024-03-11T22:23:28.615961+0000 mon.a (mon.0) 2942 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:30.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[28804]: cluster 2024-03-11T22:23:28.341699+0000 mgr.y (mgr.14601) 583 : cluster 0 pgmap v935: 268 pgs: 40 unknown, 228 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:30.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[28804]: audit 2024-03-11T22:23:28.532968+0000 mon.a (mon.0) 2940 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-112"}]': finished 2024-03-11T22:23:30.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[28804]: cluster 2024-03-11T22:23:28.540384+0000 mon.a (mon.0) 2941 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-03-11T22:23:30.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:29 smithi049 bash[28804]: audit 2024-03-11T22:23:28.615961+0000 mon.a (mon.0) 2942 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:30.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:30 smithi187 bash[23415]: audit 2024-03-11T22:23:29.157112+0000 mgr.y (mgr.14601) 584 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:30.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:30 smithi187 bash[23415]: audit 2024-03-11T22:23:29.535751+0000 mon.a (mon.0) 2943 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:30.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:30 smithi187 bash[23415]: cluster 2024-03-11T22:23:29.542755+0000 mon.a (mon.0) 2944 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-03-11T22:23:30.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:30 smithi187 bash[23415]: audit 2024-03-11T22:23:29.544627+0000 mon.a (mon.0) 2945 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112"}]: dispatch 2024-03-11T22:23:30.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:30 smithi187 bash[23415]: audit 2024-03-11T22:23:30.538328+0000 mon.a (mon.0) 2946 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112"}]': finished 2024-03-11T22:23:30.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:30 smithi187 bash[23415]: cluster 2024-03-11T22:23:30.545228+0000 mon.a (mon.0) 2947 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-03-11T22:23:31.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[21434]: audit 2024-03-11T22:23:29.157112+0000 mgr.y (mgr.14601) 584 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:31.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[21434]: audit 2024-03-11T22:23:29.535751+0000 mon.a (mon.0) 2943 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:31.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[21434]: cluster 2024-03-11T22:23:29.542755+0000 mon.a (mon.0) 2944 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-03-11T22:23:31.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[21434]: audit 2024-03-11T22:23:29.544627+0000 mon.a (mon.0) 2945 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112"}]: dispatch 2024-03-11T22:23:31.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[21434]: audit 2024-03-11T22:23:30.538328+0000 mon.a (mon.0) 2946 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112"}]': finished 2024-03-11T22:23:31.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[21434]: cluster 2024-03-11T22:23:30.545228+0000 mon.a (mon.0) 2947 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-03-11T22:23:31.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[28804]: audit 2024-03-11T22:23:29.157112+0000 mgr.y (mgr.14601) 584 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:31.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[28804]: audit 2024-03-11T22:23:29.535751+0000 mon.a (mon.0) 2943 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:31.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[28804]: cluster 2024-03-11T22:23:29.542755+0000 mon.a (mon.0) 2944 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-03-11T22:23:31.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[28804]: audit 2024-03-11T22:23:29.544627+0000 mon.a (mon.0) 2945 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112"}]: dispatch 2024-03-11T22:23:31.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[28804]: audit 2024-03-11T22:23:30.538328+0000 mon.a (mon.0) 2946 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-112"}]': finished 2024-03-11T22:23:31.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:30 smithi049 bash[28804]: cluster 2024-03-11T22:23:30.545228+0000 mon.a (mon.0) 2947 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-03-11T22:23:31.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:31 smithi187 bash[23415]: cluster 2024-03-11T22:23:30.342589+0000 mgr.y (mgr.14601) 585 : cluster 0 pgmap v938: 268 pgs: 268 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:23:31.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:31 smithi187 bash[23415]: cluster 2024-03-11T22:23:30.796863+0000 mon.a (mon.0) 2948 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:32.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:31 smithi049 bash[21434]: cluster 2024-03-11T22:23:30.342589+0000 mgr.y (mgr.14601) 585 : cluster 0 pgmap v938: 268 pgs: 268 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:23:32.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:31 smithi049 bash[21434]: cluster 2024-03-11T22:23:30.796863+0000 mon.a (mon.0) 2948 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:32.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:31 smithi049 bash[28804]: cluster 2024-03-11T22:23:30.342589+0000 mgr.y (mgr.14601) 585 : cluster 0 pgmap v938: 268 pgs: 268 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:23:32.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:31 smithi049 bash[28804]: cluster 2024-03-11T22:23:30.796863+0000 mon.a (mon.0) 2948 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:23:32.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:32 smithi187 bash[23415]: cluster 2024-03-11T22:23:31.581401+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-03-11T22:23:33.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:32 smithi049 bash[21434]: cluster 2024-03-11T22:23:31.581401+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-03-11T22:23:33.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:32 smithi049 bash[28804]: cluster 2024-03-11T22:23:31.581401+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-03-11T22:23:33.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:33 smithi187 bash[23415]: cluster 2024-03-11T22:23:32.343725+0000 mgr.y (mgr.14601) 586 : cluster 0 pgmap v941: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:34.028 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:33 smithi187 bash[23415]: cluster 2024-03-11T22:23:32.594733+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-03-11T22:23:34.028 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:33 smithi187 bash[23415]: audit 2024-03-11T22:23:32.598138+0000 mon.a (mon.0) 2951 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:34.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:33 smithi049 bash[21434]: cluster 2024-03-11T22:23:32.343725+0000 mgr.y (mgr.14601) 586 : cluster 0 pgmap v941: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:34.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:33 smithi049 bash[21434]: cluster 2024-03-11T22:23:32.594733+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-03-11T22:23:34.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:33 smithi049 bash[21434]: audit 2024-03-11T22:23:32.598138+0000 mon.a (mon.0) 2951 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:34.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:33 smithi049 bash[28804]: cluster 2024-03-11T22:23:32.343725+0000 mgr.y (mgr.14601) 586 : cluster 0 pgmap v941: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:34.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:33 smithi049 bash[28804]: cluster 2024-03-11T22:23:32.594733+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-03-11T22:23:34.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:33 smithi049 bash[28804]: audit 2024-03-11T22:23:32.598138+0000 mon.a (mon.0) 2951 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:34.523 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:23:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:23:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:23:34.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:34 smithi187 bash[23415]: audit 2024-03-11T22:23:33.591418+0000 mon.a (mon.0) 2952 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:34.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:34 smithi187 bash[23415]: cluster 2024-03-11T22:23:33.598555+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-03-11T22:23:34.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:34 smithi187 bash[23415]: audit 2024-03-11T22:23:33.655128+0000 mon.a (mon.0) 2954 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:35.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:34 smithi049 bash[21434]: audit 2024-03-11T22:23:33.591418+0000 mon.a (mon.0) 2952 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:35.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:34 smithi049 bash[21434]: cluster 2024-03-11T22:23:33.598555+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-03-11T22:23:35.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:34 smithi049 bash[21434]: audit 2024-03-11T22:23:33.655128+0000 mon.a (mon.0) 2954 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:35.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:34 smithi049 bash[28804]: audit 2024-03-11T22:23:33.591418+0000 mon.a (mon.0) 2952 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:35.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:34 smithi049 bash[28804]: cluster 2024-03-11T22:23:33.598555+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-03-11T22:23:35.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:34 smithi049 bash[28804]: audit 2024-03-11T22:23:33.655128+0000 mon.a (mon.0) 2954 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:35.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:35 smithi187 bash[23415]: cluster 2024-03-11T22:23:34.346007+0000 mgr.y (mgr.14601) 587 : cluster 0 pgmap v944: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:23:35.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:35 smithi187 bash[23415]: audit 2024-03-11T22:23:34.617622+0000 mon.a (mon.0) 2955 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:35.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:35 smithi187 bash[23415]: cluster 2024-03-11T22:23:34.626123+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-03-11T22:23:35.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:35 smithi187 bash[23415]: audit 2024-03-11T22:23:34.627264+0000 mon.a (mon.0) 2957 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-114"}]: dispatch 2024-03-11T22:23:36.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[21434]: cluster 2024-03-11T22:23:34.346007+0000 mgr.y (mgr.14601) 587 : cluster 0 pgmap v944: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:23:36.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[21434]: audit 2024-03-11T22:23:34.617622+0000 mon.a (mon.0) 2955 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:36.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[21434]: cluster 2024-03-11T22:23:34.626123+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-03-11T22:23:36.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[21434]: audit 2024-03-11T22:23:34.627264+0000 mon.a (mon.0) 2957 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-114"}]: dispatch 2024-03-11T22:23:36.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[28804]: cluster 2024-03-11T22:23:34.346007+0000 mgr.y (mgr.14601) 587 : cluster 0 pgmap v944: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:23:36.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[28804]: audit 2024-03-11T22:23:34.617622+0000 mon.a (mon.0) 2955 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:36.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[28804]: cluster 2024-03-11T22:23:34.626123+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-03-11T22:23:36.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:35 smithi049 bash[28804]: audit 2024-03-11T22:23:34.627264+0000 mon.a (mon.0) 2957 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-114"}]: dispatch 2024-03-11T22:23:36.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:36 smithi187 bash[23415]: audit 2024-03-11T22:23:35.628043+0000 mon.a (mon.0) 2958 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-114"}]': finished 2024-03-11T22:23:36.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:36 smithi187 bash[23415]: cluster 2024-03-11T22:23:35.634264+0000 mon.a (mon.0) 2959 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-03-11T22:23:36.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:36 smithi187 bash[23415]: audit 2024-03-11T22:23:35.635712+0000 mon.a (mon.0) 2960 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-114", "mode": "writeback"}]: dispatch 2024-03-11T22:23:37.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:36 smithi049 bash[21434]: audit 2024-03-11T22:23:35.628043+0000 mon.a (mon.0) 2958 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-114"}]': finished 2024-03-11T22:23:37.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:36 smithi049 bash[21434]: cluster 2024-03-11T22:23:35.634264+0000 mon.a (mon.0) 2959 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-03-11T22:23:37.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:36 smithi049 bash[21434]: audit 2024-03-11T22:23:35.635712+0000 mon.a (mon.0) 2960 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-114", "mode": "writeback"}]: dispatch 2024-03-11T22:23:37.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:36 smithi049 bash[28804]: audit 2024-03-11T22:23:35.628043+0000 mon.a (mon.0) 2958 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-114"}]': finished 2024-03-11T22:23:37.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:36 smithi049 bash[28804]: cluster 2024-03-11T22:23:35.634264+0000 mon.a (mon.0) 2959 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-03-11T22:23:37.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:36 smithi049 bash[28804]: audit 2024-03-11T22:23:35.635712+0000 mon.a (mon.0) 2960 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-114", "mode": "writeback"}]: dispatch 2024-03-11T22:23:37.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:37 smithi187 bash[23415]: cluster 2024-03-11T22:23:36.347116+0000 mgr.y (mgr.14601) 588 : cluster 0 pgmap v947: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:37.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:37 smithi187 bash[23415]: cluster 2024-03-11T22:23:36.629401+0000 mon.a (mon.0) 2961 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:37.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:37 smithi187 bash[23415]: audit 2024-03-11T22:23:36.637510+0000 mon.a (mon.0) 2962 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-114", "mode": "writeback"}]': finished 2024-03-11T22:23:37.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:37 smithi187 bash[23415]: cluster 2024-03-11T22:23:36.645912+0000 mon.a (mon.0) 2963 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-03-11T22:23:37.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:37 smithi187 bash[23415]: audit 2024-03-11T22:23:36.754758+0000 mon.a (mon.0) 2964 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:38.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[21434]: cluster 2024-03-11T22:23:36.347116+0000 mgr.y (mgr.14601) 588 : cluster 0 pgmap v947: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:38.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[21434]: cluster 2024-03-11T22:23:36.629401+0000 mon.a (mon.0) 2961 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:38.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[21434]: audit 2024-03-11T22:23:36.637510+0000 mon.a (mon.0) 2962 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-114", "mode": "writeback"}]': finished 2024-03-11T22:23:38.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[21434]: cluster 2024-03-11T22:23:36.645912+0000 mon.a (mon.0) 2963 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-03-11T22:23:38.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[21434]: audit 2024-03-11T22:23:36.754758+0000 mon.a (mon.0) 2964 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:38.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[28804]: cluster 2024-03-11T22:23:36.347116+0000 mgr.y (mgr.14601) 588 : cluster 0 pgmap v947: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:38.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[28804]: cluster 2024-03-11T22:23:36.629401+0000 mon.a (mon.0) 2961 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:38.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[28804]: audit 2024-03-11T22:23:36.637510+0000 mon.a (mon.0) 2962 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-114", "mode": "writeback"}]': finished 2024-03-11T22:23:38.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[28804]: cluster 2024-03-11T22:23:36.645912+0000 mon.a (mon.0) 2963 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-03-11T22:23:38.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:37 smithi049 bash[28804]: audit 2024-03-11T22:23:36.754758+0000 mon.a (mon.0) 2964 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:23:38.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:38 smithi187 bash[23415]: audit 2024-03-11T22:23:37.639987+0000 mon.a (mon.0) 2965 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:38.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:38 smithi187 bash[23415]: cluster 2024-03-11T22:23:37.647996+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-03-11T22:23:38.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:38 smithi187 bash[23415]: audit 2024-03-11T22:23:37.650028+0000 mon.a (mon.0) 2967 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114"}]: dispatch 2024-03-11T22:23:38.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:38 smithi187 bash[23415]: cluster 2024-03-11T22:23:38.640447+0000 mon.a (mon.0) 2968 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:23:38.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:38 smithi187 bash[23415]: audit 2024-03-11T22:23:38.642846+0000 mon.a (mon.0) 2969 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114"}]': finished 2024-03-11T22:23:38.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:38 smithi187 bash[23415]: cluster 2024-03-11T22:23:38.649522+0000 mon.a (mon.0) 2970 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-03-11T22:23:39.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[21434]: audit 2024-03-11T22:23:37.639987+0000 mon.a (mon.0) 2965 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:39.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[21434]: cluster 2024-03-11T22:23:37.647996+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-03-11T22:23:39.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[21434]: audit 2024-03-11T22:23:37.650028+0000 mon.a (mon.0) 2967 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114"}]: dispatch 2024-03-11T22:23:39.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[21434]: cluster 2024-03-11T22:23:38.640447+0000 mon.a (mon.0) 2968 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:23:39.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[21434]: audit 2024-03-11T22:23:38.642846+0000 mon.a (mon.0) 2969 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114"}]': finished 2024-03-11T22:23:39.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[21434]: cluster 2024-03-11T22:23:38.649522+0000 mon.a (mon.0) 2970 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-03-11T22:23:39.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[28804]: audit 2024-03-11T22:23:37.639987+0000 mon.a (mon.0) 2965 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:23:39.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[28804]: cluster 2024-03-11T22:23:37.647996+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-03-11T22:23:39.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[28804]: audit 2024-03-11T22:23:37.650028+0000 mon.a (mon.0) 2967 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114"}]: dispatch 2024-03-11T22:23:39.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[28804]: cluster 2024-03-11T22:23:38.640447+0000 mon.a (mon.0) 2968 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:23:39.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[28804]: audit 2024-03-11T22:23:38.642846+0000 mon.a (mon.0) 2969 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-114"}]': finished 2024-03-11T22:23:39.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:38 smithi049 bash[28804]: cluster 2024-03-11T22:23:38.649522+0000 mon.a (mon.0) 2970 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-03-11T22:23:39.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:23:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:23:39.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:39 smithi187 bash[23415]: cluster 2024-03-11T22:23:38.347960+0000 mgr.y (mgr.14601) 589 : cluster 0 pgmap v950: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:40.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:39 smithi049 bash[21434]: cluster 2024-03-11T22:23:38.347960+0000 mgr.y (mgr.14601) 589 : cluster 0 pgmap v950: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:40.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:39 smithi049 bash[28804]: cluster 2024-03-11T22:23:38.347960+0000 mgr.y (mgr.14601) 589 : cluster 0 pgmap v950: 268 pgs: 1 active, 12 creating+activating, 16 creating+peering, 239 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:23:40.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:40 smithi187 bash[23415]: audit 2024-03-11T22:23:39.165849+0000 mgr.y (mgr.14601) 590 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:40.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:40 smithi187 bash[23415]: cluster 2024-03-11T22:23:39.670366+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-03-11T22:23:41.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:40 smithi049 bash[21434]: audit 2024-03-11T22:23:39.165849+0000 mgr.y (mgr.14601) 590 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:41.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:40 smithi049 bash[21434]: cluster 2024-03-11T22:23:39.670366+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-03-11T22:23:41.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:40 smithi049 bash[28804]: audit 2024-03-11T22:23:39.165849+0000 mgr.y (mgr.14601) 590 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:41.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:40 smithi049 bash[28804]: cluster 2024-03-11T22:23:39.670366+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-03-11T22:23:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:41 smithi187 bash[23415]: cluster 2024-03-11T22:23:40.348834+0000 mgr.y (mgr.14601) 591 : cluster 0 pgmap v953: 236 pgs: 236 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:41 smithi187 bash[23415]: cluster 2024-03-11T22:23:40.696458+0000 mon.a (mon.0) 2972 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-03-11T22:23:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:41 smithi187 bash[23415]: audit 2024-03-11T22:23:40.699783+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:41 smithi187 bash[23415]: audit 2024-03-11T22:23:41.636169+0000 mon.c (mon.2) 643 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:42.023 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[28804]: cluster 2024-03-11T22:23:40.348834+0000 mgr.y (mgr.14601) 591 : cluster 0 pgmap v953: 236 pgs: 236 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:42.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[28804]: cluster 2024-03-11T22:23:40.696458+0000 mon.a (mon.0) 2972 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-03-11T22:23:42.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[28804]: audit 2024-03-11T22:23:40.699783+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:42.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[28804]: audit 2024-03-11T22:23:41.636169+0000 mon.c (mon.2) 643 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:42.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[21434]: cluster 2024-03-11T22:23:40.348834+0000 mgr.y (mgr.14601) 591 : cluster 0 pgmap v953: 236 pgs: 236 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:42.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[21434]: cluster 2024-03-11T22:23:40.696458+0000 mon.a (mon.0) 2972 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-03-11T22:23:42.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[21434]: audit 2024-03-11T22:23:40.699783+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:23:42.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:41 smithi049 bash[21434]: audit 2024-03-11T22:23:41.636169+0000 mon.c (mon.2) 643 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:42.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:42 smithi187 bash[23415]: audit 2024-03-11T22:23:41.700453+0000 mon.a (mon.0) 2974 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:42.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:42 smithi187 bash[23415]: cluster 2024-03-11T22:23:41.707720+0000 mon.a (mon.0) 2975 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-03-11T22:23:43.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:42 smithi049 bash[21434]: audit 2024-03-11T22:23:41.700453+0000 mon.a (mon.0) 2974 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:43.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:42 smithi049 bash[21434]: cluster 2024-03-11T22:23:41.707720+0000 mon.a (mon.0) 2975 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-03-11T22:23:43.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:42 smithi049 bash[28804]: audit 2024-03-11T22:23:41.700453+0000 mon.a (mon.0) 2974 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:23:43.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:42 smithi049 bash[28804]: cluster 2024-03-11T22:23:41.707720+0000 mon.a (mon.0) 2975 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-03-11T22:23:43.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:43 smithi187 bash[23415]: cluster 2024-03-11T22:23:42.349790+0000 mgr.y (mgr.14601) 592 : cluster 0 pgmap v956: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:43.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:43 smithi187 bash[23415]: cluster 2024-03-11T22:23:42.718020+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-03-11T22:23:43.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:43 smithi187 bash[23415]: audit 2024-03-11T22:23:42.759235+0000 mon.a (mon.0) 2977 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:44.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:43 smithi049 bash[21434]: cluster 2024-03-11T22:23:42.349790+0000 mgr.y (mgr.14601) 592 : cluster 0 pgmap v956: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:44.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:43 smithi049 bash[21434]: cluster 2024-03-11T22:23:42.718020+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-03-11T22:23:44.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:43 smithi049 bash[21434]: audit 2024-03-11T22:23:42.759235+0000 mon.a (mon.0) 2977 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:44.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:43 smithi049 bash[28804]: cluster 2024-03-11T22:23:42.349790+0000 mgr.y (mgr.14601) 592 : cluster 0 pgmap v956: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:23:44.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:43 smithi049 bash[28804]: cluster 2024-03-11T22:23:42.718020+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-03-11T22:23:44.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:43 smithi049 bash[28804]: audit 2024-03-11T22:23:42.759235+0000 mon.a (mon.0) 2977 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:23:44.523 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:23:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:23:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:23:44.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:44 smithi187 bash[23415]: audit 2024-03-11T22:23:43.726842+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:44.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:44 smithi187 bash[23415]: cluster 2024-03-11T22:23:43.734794+0000 mon.a (mon.0) 2979 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-03-11T22:23:44.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:44 smithi187 bash[23415]: audit 2024-03-11T22:23:43.735751+0000 mon.a (mon.0) 2980 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-116"}]: dispatch 2024-03-11T22:23:45.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:44 smithi049 bash[21434]: audit 2024-03-11T22:23:43.726842+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:45.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:44 smithi049 bash[21434]: cluster 2024-03-11T22:23:43.734794+0000 mon.a (mon.0) 2979 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-03-11T22:23:45.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:44 smithi049 bash[21434]: audit 2024-03-11T22:23:43.735751+0000 mon.a (mon.0) 2980 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-116"}]: dispatch 2024-03-11T22:23:45.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:44 smithi049 bash[28804]: audit 2024-03-11T22:23:43.726842+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:23:45.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:44 smithi049 bash[28804]: cluster 2024-03-11T22:23:43.734794+0000 mon.a (mon.0) 2979 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-03-11T22:23:45.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:44 smithi049 bash[28804]: audit 2024-03-11T22:23:43.735751+0000 mon.a (mon.0) 2980 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-116"}]: dispatch 2024-03-11T22:23:45.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:45 smithi187 bash[23415]: cluster 2024-03-11T22:23:44.350675+0000 mgr.y (mgr.14601) 593 : cluster 0 pgmap v959: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:23:45.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:45 smithi187 bash[23415]: audit 2024-03-11T22:23:44.729759+0000 mon.a (mon.0) 2981 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-116"}]': finished 2024-03-11T22:23:45.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:45 smithi187 bash[23415]: cluster 2024-03-11T22:23:44.737507+0000 mon.a (mon.0) 2982 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-03-11T22:23:45.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:45 smithi187 bash[23415]: audit 2024-03-11T22:23:44.739224+0000 mon.a (mon.0) 2983 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-116", "mode": "writeback"}]: dispatch 2024-03-11T22:23:45.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:45 smithi187 bash[23415]: cluster 2024-03-11T22:23:45.729985+0000 mon.a (mon.0) 2984 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:45.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:45 smithi187 bash[23415]: audit 2024-03-11T22:23:45.732318+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-116", "mode": "writeback"}]': finished 2024-03-11T22:23:46.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[21434]: cluster 2024-03-11T22:23:44.350675+0000 mgr.y (mgr.14601) 593 : cluster 0 pgmap v959: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[21434]: audit 2024-03-11T22:23:44.729759+0000 mon.a (mon.0) 2981 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-116"}]': finished 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[21434]: cluster 2024-03-11T22:23:44.737507+0000 mon.a (mon.0) 2982 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[21434]: audit 2024-03-11T22:23:44.739224+0000 mon.a (mon.0) 2983 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-116", "mode": "writeback"}]: dispatch 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[21434]: cluster 2024-03-11T22:23:45.729985+0000 mon.a (mon.0) 2984 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[21434]: audit 2024-03-11T22:23:45.732318+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-116", "mode": "writeback"}]': finished 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[28804]: cluster 2024-03-11T22:23:44.350675+0000 mgr.y (mgr.14601) 593 : cluster 0 pgmap v959: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[28804]: audit 2024-03-11T22:23:44.729759+0000 mon.a (mon.0) 2981 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-116"}]': finished 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[28804]: cluster 2024-03-11T22:23:44.737507+0000 mon.a (mon.0) 2982 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[28804]: audit 2024-03-11T22:23:44.739224+0000 mon.a (mon.0) 2983 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-116", "mode": "writeback"}]: dispatch 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[28804]: cluster 2024-03-11T22:23:45.729985+0000 mon.a (mon.0) 2984 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:23:46.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:45 smithi049 bash[28804]: audit 2024-03-11T22:23:45.732318+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-116", "mode": "writeback"}]': finished 2024-03-11T22:23:46.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:46 smithi187 bash[23415]: cluster 2024-03-11T22:23:45.739077+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-03-11T22:23:46.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:46 smithi187 bash[23415]: audit 2024-03-11T22:23:45.780995+0000 mon.a (mon.0) 2987 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "318.1"}]: dispatch 2024-03-11T22:23:46.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:46 smithi187 bash[23415]: audit 2024-03-11T22:23:45.781603+0000 mgr.y (mgr.14601) 594 : audit 0 from='mon.0 v1:172.21.15.49:0/1747664784' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "318.1"}]: dispatch 2024-03-11T22:23:46.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:46 smithi187 bash[23415]: cluster 2024-03-11T22:23:45.850284+0000 osd.2 (osd.2) 11 : cluster 0 318.1 deep-scrub starts 2024-03-11T22:23:46.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:46 smithi187 bash[23415]: cluster 2024-03-11T22:23:45.855788+0000 osd.2 (osd.2) 12 : cluster 0 318.1 deep-scrub ok 2024-03-11T22:23:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[21434]: cluster 2024-03-11T22:23:45.739077+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[21434]: audit 2024-03-11T22:23:45.780995+0000 mon.a (mon.0) 2987 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "318.1"}]: dispatch 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[21434]: audit 2024-03-11T22:23:45.781603+0000 mgr.y (mgr.14601) 594 : audit 0 from='mon.0 v1:172.21.15.49:0/1747664784' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "318.1"}]: dispatch 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[21434]: cluster 2024-03-11T22:23:45.850284+0000 osd.2 (osd.2) 11 : cluster 0 318.1 deep-scrub starts 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[21434]: cluster 2024-03-11T22:23:45.855788+0000 osd.2 (osd.2) 12 : cluster 0 318.1 deep-scrub ok 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[28804]: cluster 2024-03-11T22:23:45.739077+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[28804]: audit 2024-03-11T22:23:45.780995+0000 mon.a (mon.0) 2987 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "318.1"}]: dispatch 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[28804]: audit 2024-03-11T22:23:45.781603+0000 mgr.y (mgr.14601) 594 : audit 0 from='mon.0 v1:172.21.15.49:0/1747664784' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "318.1"}]: dispatch 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[28804]: cluster 2024-03-11T22:23:45.850284+0000 osd.2 (osd.2) 11 : cluster 0 318.1 deep-scrub starts 2024-03-11T22:23:47.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:46 smithi049 bash[28804]: cluster 2024-03-11T22:23:45.855788+0000 osd.2 (osd.2) 12 : cluster 0 318.1 deep-scrub ok 2024-03-11T22:23:48.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:47 smithi049 bash[21434]: cluster 2024-03-11T22:23:46.351583+0000 mgr.y (mgr.14601) 595 : cluster 0 pgmap v962: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:23:48.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:47 smithi049 bash[28804]: cluster 2024-03-11T22:23:46.351583+0000 mgr.y (mgr.14601) 595 : cluster 0 pgmap v962: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:23:48.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:47 smithi187 bash[23415]: cluster 2024-03-11T22:23:46.351583+0000 mgr.y (mgr.14601) 595 : cluster 0 pgmap v962: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:23:49.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:23:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:23:50.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:49 smithi049 bash[21434]: cluster 2024-03-11T22:23:48.352465+0000 mgr.y (mgr.14601) 596 : cluster 0 pgmap v963: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:23:50.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:49 smithi049 bash[28804]: cluster 2024-03-11T22:23:48.352465+0000 mgr.y (mgr.14601) 596 : cluster 0 pgmap v963: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:23:50.247 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:49 smithi187 bash[23415]: cluster 2024-03-11T22:23:48.352465+0000 mgr.y (mgr.14601) 596 : cluster 0 pgmap v963: 268 pgs: 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:23:51.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:50 smithi049 bash[21434]: audit 2024-03-11T22:23:49.173467+0000 mgr.y (mgr.14601) 597 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:51.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:50 smithi049 bash[28804]: audit 2024-03-11T22:23:49.173467+0000 mgr.y (mgr.14601) 597 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:51.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:50 smithi187 bash[23415]: audit 2024-03-11T22:23:49.173467+0000 mgr.y (mgr.14601) 597 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:23:52.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:51 smithi049 bash[21434]: cluster 2024-03-11T22:23:50.355146+0000 mgr.y (mgr.14601) 598 : cluster 0 pgmap v964: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:23:52.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:51 smithi049 bash[28804]: cluster 2024-03-11T22:23:50.355146+0000 mgr.y (mgr.14601) 598 : cluster 0 pgmap v964: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:23:52.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:51 smithi187 bash[23415]: cluster 2024-03-11T22:23:50.355146+0000 mgr.y (mgr.14601) 598 : cluster 0 pgmap v964: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:23:54.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:53 smithi049 bash[21434]: cluster 2024-03-11T22:23:52.356042+0000 mgr.y (mgr.14601) 599 : cluster 0 pgmap v965: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-03-11T22:23:54.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:53 smithi049 bash[28804]: cluster 2024-03-11T22:23:52.356042+0000 mgr.y (mgr.14601) 599 : cluster 0 pgmap v965: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-03-11T22:23:54.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:53 smithi187 bash[23415]: cluster 2024-03-11T22:23:52.356042+0000 mgr.y (mgr.14601) 599 : cluster 0 pgmap v965: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-03-11T22:23:54.524 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:23:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:23:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:23:56.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:55 smithi049 bash[21434]: cluster 2024-03-11T22:23:54.358609+0000 mgr.y (mgr.14601) 600 : cluster 0 pgmap v966: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:56.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:55 smithi049 bash[28804]: cluster 2024-03-11T22:23:54.358609+0000 mgr.y (mgr.14601) 600 : cluster 0 pgmap v966: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:56.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:55 smithi187 bash[23415]: cluster 2024-03-11T22:23:54.358609+0000 mgr.y (mgr.14601) 600 : cluster 0 pgmap v966: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:23:57.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:57 smithi187 bash[23415]: cluster 2024-03-11T22:23:56.359511+0000 mgr.y (mgr.14601) 601 : cluster 0 pgmap v967: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:23:57.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:57 smithi187 bash[23415]: audit 2024-03-11T22:23:56.680903+0000 mon.a (mon.0) 2988 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:57.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:57 smithi187 bash[23415]: audit 2024-03-11T22:23:56.684105+0000 mon.c (mon.2) 644 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:58.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:57 smithi049 bash[21434]: cluster 2024-03-11T22:23:56.359511+0000 mgr.y (mgr.14601) 601 : cluster 0 pgmap v967: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:23:58.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:57 smithi049 bash[21434]: audit 2024-03-11T22:23:56.680903+0000 mon.a (mon.0) 2988 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:58.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:57 smithi049 bash[21434]: audit 2024-03-11T22:23:56.684105+0000 mon.c (mon.2) 644 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:58.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:57 smithi049 bash[28804]: cluster 2024-03-11T22:23:56.359511+0000 mgr.y (mgr.14601) 601 : cluster 0 pgmap v967: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:23:58.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:57 smithi049 bash[28804]: audit 2024-03-11T22:23:56.680903+0000 mon.a (mon.0) 2988 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:23:58.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:57 smithi049 bash[28804]: audit 2024-03-11T22:23:56.684105+0000 mon.c (mon.2) 644 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:23:59.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:23:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:23:59.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:23:59 smithi187 bash[23415]: cluster 2024-03-11T22:23:58.360379+0000 mgr.y (mgr.14601) 602 : cluster 0 pgmap v968: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-03-11T22:24:00.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:23:59 smithi049 bash[21434]: cluster 2024-03-11T22:23:58.360379+0000 mgr.y (mgr.14601) 602 : cluster 0 pgmap v968: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-03-11T22:24:00.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:23:59 smithi049 bash[28804]: cluster 2024-03-11T22:23:58.360379+0000 mgr.y (mgr.14601) 602 : cluster 0 pgmap v968: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-03-11T22:24:00.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:00 smithi187 bash[23415]: audit 2024-03-11T22:23:59.184230+0000 mgr.y (mgr.14601) 603 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:01.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:00 smithi049 bash[21434]: audit 2024-03-11T22:23:59.184230+0000 mgr.y (mgr.14601) 603 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:01.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:00 smithi049 bash[28804]: audit 2024-03-11T22:23:59.184230+0000 mgr.y (mgr.14601) 603 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:01.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:01 smithi187 bash[23415]: cluster 2024-03-11T22:24:00.362975+0000 mgr.y (mgr.14601) 604 : cluster 0 pgmap v969: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:24:02.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:01 smithi049 bash[21434]: cluster 2024-03-11T22:24:00.362975+0000 mgr.y (mgr.14601) 604 : cluster 0 pgmap v969: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:24:02.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:01 smithi049 bash[28804]: cluster 2024-03-11T22:24:00.362975+0000 mgr.y (mgr.14601) 604 : cluster 0 pgmap v969: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:24:02.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:02 smithi187 bash[23415]: cluster 2024-03-11T22:24:01.705769+0000 mon.a (mon.0) 2989 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-03-11T22:24:02.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:02 smithi187 bash[23415]: audit 2024-03-11T22:24:01.776506+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:03.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:02 smithi049 bash[21434]: cluster 2024-03-11T22:24:01.705769+0000 mon.a (mon.0) 2989 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-03-11T22:24:03.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:02 smithi049 bash[21434]: audit 2024-03-11T22:24:01.776506+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:03.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:02 smithi049 bash[28804]: cluster 2024-03-11T22:24:01.705769+0000 mon.a (mon.0) 2989 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-03-11T22:24:03.024 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:02 smithi049 bash[28804]: audit 2024-03-11T22:24:01.776506+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:03.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:03 smithi187 bash[23415]: cluster 2024-03-11T22:24:02.363970+0000 mgr.y (mgr.14601) 605 : cluster 0 pgmap v971: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:24:03.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:03 smithi187 bash[23415]: audit 2024-03-11T22:24:02.702238+0000 mon.a (mon.0) 2991 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:03.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:03 smithi187 bash[23415]: cluster 2024-03-11T22:24:02.709235+0000 mon.a (mon.0) 2992 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-03-11T22:24:03.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:03 smithi187 bash[23415]: audit 2024-03-11T22:24:02.710593+0000 mon.a (mon.0) 2993 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116"}]: dispatch 2024-03-11T22:24:03.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:03 smithi187 bash[23415]: cluster 2024-03-11T22:24:03.702541+0000 mon.a (mon.0) 2994 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:03.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:03 smithi187 bash[23415]: audit 2024-03-11T22:24:03.704948+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116"}]': finished 2024-03-11T22:24:03.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:03 smithi187 bash[23415]: cluster 2024-03-11T22:24:03.712305+0000 mon.a (mon.0) 2996 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-03-11T22:24:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[21434]: cluster 2024-03-11T22:24:02.363970+0000 mgr.y (mgr.14601) 605 : cluster 0 pgmap v971: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:24:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[21434]: audit 2024-03-11T22:24:02.702238+0000 mon.a (mon.0) 2991 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[21434]: cluster 2024-03-11T22:24:02.709235+0000 mon.a (mon.0) 2992 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-03-11T22:24:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[21434]: audit 2024-03-11T22:24:02.710593+0000 mon.a (mon.0) 2993 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116"}]: dispatch 2024-03-11T22:24:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[21434]: cluster 2024-03-11T22:24:03.702541+0000 mon.a (mon.0) 2994 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:04.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[21434]: audit 2024-03-11T22:24:03.704948+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116"}]': finished 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[21434]: cluster 2024-03-11T22:24:03.712305+0000 mon.a (mon.0) 2996 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[28804]: cluster 2024-03-11T22:24:02.363970+0000 mgr.y (mgr.14601) 605 : cluster 0 pgmap v971: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[28804]: audit 2024-03-11T22:24:02.702238+0000 mon.a (mon.0) 2991 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[28804]: cluster 2024-03-11T22:24:02.709235+0000 mon.a (mon.0) 2992 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[28804]: audit 2024-03-11T22:24:02.710593+0000 mon.a (mon.0) 2993 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116"}]: dispatch 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[28804]: cluster 2024-03-11T22:24:03.702541+0000 mon.a (mon.0) 2994 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[28804]: audit 2024-03-11T22:24:03.704948+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-116"}]': finished 2024-03-11T22:24:04.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:03 smithi049 bash[28804]: cluster 2024-03-11T22:24:03.712305+0000 mon.a (mon.0) 2996 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-03-11T22:24:04.524 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:24:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:24:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:24:05.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:05 smithi187 bash[23415]: cluster 2024-03-11T22:24:04.717904+0000 mon.a (mon.0) 2997 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:24:05.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:05 smithi187 bash[23415]: cluster 2024-03-11T22:24:04.733251+0000 mon.a (mon.0) 2998 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-03-11T22:24:05.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:05 smithi049 bash[21434]: cluster 2024-03-11T22:24:04.717904+0000 mon.a (mon.0) 2997 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:24:05.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:05 smithi049 bash[21434]: cluster 2024-03-11T22:24:04.733251+0000 mon.a (mon.0) 2998 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-03-11T22:24:05.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:05 smithi049 bash[28804]: cluster 2024-03-11T22:24:04.717904+0000 mon.a (mon.0) 2997 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:24:05.524 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:05 smithi049 bash[28804]: cluster 2024-03-11T22:24:04.733251+0000 mon.a (mon.0) 2998 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-03-11T22:24:06.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:06 smithi187 bash[23415]: cluster 2024-03-11T22:24:04.364871+0000 mgr.y (mgr.14601) 606 : cluster 0 pgmap v974: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:24:06.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:06 smithi187 bash[23415]: cluster 2024-03-11T22:24:05.737496+0000 mon.a (mon.0) 2999 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-03-11T22:24:06.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:06 smithi187 bash[23415]: audit 2024-03-11T22:24:05.740997+0000 mon.a (mon.0) 3000 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:06.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:06 smithi187 bash[23415]: audit 2024-03-11T22:24:05.808906+0000 mon.a (mon.0) 3001 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:06.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:06 smithi187 bash[23415]: cluster 2024-03-11T22:24:05.816297+0000 mon.a (mon.0) 3002 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-03-11T22:24:06.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[21434]: cluster 2024-03-11T22:24:04.364871+0000 mgr.y (mgr.14601) 606 : cluster 0 pgmap v974: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:24:06.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[21434]: cluster 2024-03-11T22:24:05.737496+0000 mon.a (mon.0) 2999 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-03-11T22:24:06.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[21434]: audit 2024-03-11T22:24:05.740997+0000 mon.a (mon.0) 3000 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:06.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[21434]: audit 2024-03-11T22:24:05.808906+0000 mon.a (mon.0) 3001 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:06.524 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[21434]: cluster 2024-03-11T22:24:05.816297+0000 mon.a (mon.0) 3002 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-03-11T22:24:06.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[28804]: cluster 2024-03-11T22:24:04.364871+0000 mgr.y (mgr.14601) 606 : cluster 0 pgmap v974: 268 pgs: 268 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:24:06.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[28804]: cluster 2024-03-11T22:24:05.737496+0000 mon.a (mon.0) 2999 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-03-11T22:24:06.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[28804]: audit 2024-03-11T22:24:05.740997+0000 mon.a (mon.0) 3000 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:06.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[28804]: audit 2024-03-11T22:24:05.808906+0000 mon.a (mon.0) 3001 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:06.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:06 smithi049 bash[28804]: cluster 2024-03-11T22:24:05.816297+0000 mon.a (mon.0) 3002 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-03-11T22:24:08.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:07 smithi187 bash[23415]: cluster 2024-03-11T22:24:06.365766+0000 mgr.y (mgr.14601) 607 : cluster 0 pgmap v978: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 1 op/s 2024-03-11T22:24:08.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:07 smithi187 bash[23415]: cluster 2024-03-11T22:24:06.818229+0000 mon.a (mon.0) 3003 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-03-11T22:24:08.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:07 smithi187 bash[23415]: audit 2024-03-11T22:24:06.832323+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:08.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:07 smithi049 bash[21434]: cluster 2024-03-11T22:24:06.365766+0000 mgr.y (mgr.14601) 607 : cluster 0 pgmap v978: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 1 op/s 2024-03-11T22:24:08.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:07 smithi049 bash[21434]: cluster 2024-03-11T22:24:06.818229+0000 mon.a (mon.0) 3003 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-03-11T22:24:08.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:07 smithi049 bash[21434]: audit 2024-03-11T22:24:06.832323+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:08.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:07 smithi049 bash[28804]: cluster 2024-03-11T22:24:06.365766+0000 mgr.y (mgr.14601) 607 : cluster 0 pgmap v978: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 1 op/s 2024-03-11T22:24:08.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:07 smithi049 bash[28804]: cluster 2024-03-11T22:24:06.818229+0000 mon.a (mon.0) 3003 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-03-11T22:24:08.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:07 smithi049 bash[28804]: audit 2024-03-11T22:24:06.832323+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:09.190 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:08 smithi187 bash[23415]: audit 2024-03-11T22:24:07.822411+0000 mon.a (mon.0) 3005 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:09.190 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:08 smithi187 bash[23415]: cluster 2024-03-11T22:24:07.829577+0000 mon.a (mon.0) 3006 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-03-11T22:24:09.190 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:08 smithi187 bash[23415]: audit 2024-03-11T22:24:07.831444+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-118"}]: dispatch 2024-03-11T22:24:09.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:08 smithi049 bash[21434]: audit 2024-03-11T22:24:07.822411+0000 mon.a (mon.0) 3005 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:09.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:08 smithi049 bash[21434]: cluster 2024-03-11T22:24:07.829577+0000 mon.a (mon.0) 3006 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-03-11T22:24:09.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:08 smithi049 bash[21434]: audit 2024-03-11T22:24:07.831444+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-118"}]: dispatch 2024-03-11T22:24:09.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:08 smithi049 bash[28804]: audit 2024-03-11T22:24:07.822411+0000 mon.a (mon.0) 3005 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:09.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:08 smithi049 bash[28804]: cluster 2024-03-11T22:24:07.829577+0000 mon.a (mon.0) 3006 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-03-11T22:24:09.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:08 smithi049 bash[28804]: audit 2024-03-11T22:24:07.831444+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-118"}]: dispatch 2024-03-11T22:24:09.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:24:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:24:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:09 smithi187 bash[23415]: cluster 2024-03-11T22:24:08.366667+0000 mgr.y (mgr.14601) 608 : cluster 0 pgmap v981: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:24:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:09 smithi187 bash[23415]: audit 2024-03-11T22:24:08.831316+0000 mon.a (mon.0) 3008 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-118"}]': finished 2024-03-11T22:24:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:09 smithi187 bash[23415]: cluster 2024-03-11T22:24:08.840907+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-03-11T22:24:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:09 smithi187 bash[23415]: audit 2024-03-11T22:24:08.842329+0000 mon.a (mon.0) 3010 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-118", "mode": "writeback"}]: dispatch 2024-03-11T22:24:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[21434]: cluster 2024-03-11T22:24:08.366667+0000 mgr.y (mgr.14601) 608 : cluster 0 pgmap v981: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:24:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[21434]: audit 2024-03-11T22:24:08.831316+0000 mon.a (mon.0) 3008 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-118"}]': finished 2024-03-11T22:24:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[21434]: cluster 2024-03-11T22:24:08.840907+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-03-11T22:24:10.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[21434]: audit 2024-03-11T22:24:08.842329+0000 mon.a (mon.0) 3010 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-118", "mode": "writeback"}]: dispatch 2024-03-11T22:24:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[28804]: cluster 2024-03-11T22:24:08.366667+0000 mgr.y (mgr.14601) 608 : cluster 0 pgmap v981: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:24:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[28804]: audit 2024-03-11T22:24:08.831316+0000 mon.a (mon.0) 3008 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-118"}]': finished 2024-03-11T22:24:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[28804]: cluster 2024-03-11T22:24:08.840907+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-03-11T22:24:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:09 smithi049 bash[28804]: audit 2024-03-11T22:24:08.842329+0000 mon.a (mon.0) 3010 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-118", "mode": "writeback"}]: dispatch 2024-03-11T22:24:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:10 smithi187 bash[23415]: audit 2024-03-11T22:24:09.195387+0000 mgr.y (mgr.14601) 609 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:10 smithi187 bash[23415]: cluster 2024-03-11T22:24:09.831762+0000 mon.a (mon.0) 3011 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:10 smithi187 bash[23415]: audit 2024-03-11T22:24:09.834126+0000 mon.a (mon.0) 3012 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-118", "mode": "writeback"}]': finished 2024-03-11T22:24:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:10 smithi187 bash[23415]: cluster 2024-03-11T22:24:09.840582+0000 mon.a (mon.0) 3013 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-03-11T22:24:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:10 smithi187 bash[23415]: cluster 2024-03-11T22:24:10.807977+0000 mon.a (mon.0) 3014 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:24:11.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[21434]: audit 2024-03-11T22:24:09.195387+0000 mgr.y (mgr.14601) 609 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:11.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[21434]: cluster 2024-03-11T22:24:09.831762+0000 mon.a (mon.0) 3011 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:11.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[21434]: audit 2024-03-11T22:24:09.834126+0000 mon.a (mon.0) 3012 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-118", "mode": "writeback"}]': finished 2024-03-11T22:24:11.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[21434]: cluster 2024-03-11T22:24:09.840582+0000 mon.a (mon.0) 3013 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-03-11T22:24:11.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[21434]: cluster 2024-03-11T22:24:10.807977+0000 mon.a (mon.0) 3014 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:24:11.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[28804]: audit 2024-03-11T22:24:09.195387+0000 mgr.y (mgr.14601) 609 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:11.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[28804]: cluster 2024-03-11T22:24:09.831762+0000 mon.a (mon.0) 3011 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:11.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[28804]: audit 2024-03-11T22:24:09.834126+0000 mon.a (mon.0) 3012 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-118", "mode": "writeback"}]': finished 2024-03-11T22:24:11.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[28804]: cluster 2024-03-11T22:24:09.840582+0000 mon.a (mon.0) 3013 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-03-11T22:24:11.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:10 smithi049 bash[28804]: cluster 2024-03-11T22:24:10.807977+0000 mon.a (mon.0) 3014 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:24:12.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:11 smithi187 bash[23415]: cluster 2024-03-11T22:24:10.367692+0000 mgr.y (mgr.14601) 610 : cluster 0 pgmap v984: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:24:12.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:11 smithi187 bash[23415]: cluster 2024-03-11T22:24:10.862012+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-03-11T22:24:12.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:11 smithi187 bash[23415]: audit 2024-03-11T22:24:10.936925+0000 mon.a (mon.0) 3016 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:12.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:11 smithi187 bash[23415]: audit 2024-03-11T22:24:11.718659+0000 mon.c (mon.2) 645 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:12.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[21434]: cluster 2024-03-11T22:24:10.367692+0000 mgr.y (mgr.14601) 610 : cluster 0 pgmap v984: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:24:12.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[21434]: cluster 2024-03-11T22:24:10.862012+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-03-11T22:24:12.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[21434]: audit 2024-03-11T22:24:10.936925+0000 mon.a (mon.0) 3016 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:12.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[21434]: audit 2024-03-11T22:24:11.718659+0000 mon.c (mon.2) 645 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:12.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[28804]: cluster 2024-03-11T22:24:10.367692+0000 mgr.y (mgr.14601) 610 : cluster 0 pgmap v984: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:24:12.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[28804]: cluster 2024-03-11T22:24:10.862012+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-03-11T22:24:12.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[28804]: audit 2024-03-11T22:24:10.936925+0000 mon.a (mon.0) 3016 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:12.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:11 smithi049 bash[28804]: audit 2024-03-11T22:24:11.718659+0000 mon.c (mon.2) 645 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:13.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:12 smithi187 bash[23415]: audit 2024-03-11T22:24:11.855705+0000 mon.a (mon.0) 3017 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:13.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:12 smithi187 bash[23415]: cluster 2024-03-11T22:24:11.862577+0000 mon.a (mon.0) 3018 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-03-11T22:24:13.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:12 smithi187 bash[23415]: audit 2024-03-11T22:24:11.864925+0000 mon.a (mon.0) 3019 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118"}]: dispatch 2024-03-11T22:24:13.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:12 smithi187 bash[23415]: cluster 2024-03-11T22:24:12.856094+0000 mon.a (mon.0) 3020 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:13.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:12 smithi187 bash[23415]: audit 2024-03-11T22:24:12.858209+0000 mon.a (mon.0) 3021 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118"}]': finished 2024-03-11T22:24:13.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[21434]: audit 2024-03-11T22:24:11.855705+0000 mon.a (mon.0) 3017 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:13.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[21434]: cluster 2024-03-11T22:24:11.862577+0000 mon.a (mon.0) 3018 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[21434]: audit 2024-03-11T22:24:11.864925+0000 mon.a (mon.0) 3019 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118"}]: dispatch 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[21434]: cluster 2024-03-11T22:24:12.856094+0000 mon.a (mon.0) 3020 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[21434]: audit 2024-03-11T22:24:12.858209+0000 mon.a (mon.0) 3021 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118"}]': finished 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[28804]: audit 2024-03-11T22:24:11.855705+0000 mon.a (mon.0) 3017 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[28804]: cluster 2024-03-11T22:24:11.862577+0000 mon.a (mon.0) 3018 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[28804]: audit 2024-03-11T22:24:11.864925+0000 mon.a (mon.0) 3019 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118"}]: dispatch 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[28804]: cluster 2024-03-11T22:24:12.856094+0000 mon.a (mon.0) 3020 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:13.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:12 smithi049 bash[28804]: audit 2024-03-11T22:24:12.858209+0000 mon.a (mon.0) 3021 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-118"}]': finished 2024-03-11T22:24:14.229 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:13 smithi049 bash[28804]: cluster 2024-03-11T22:24:12.368588+0000 mgr.y (mgr.14601) 611 : cluster 0 pgmap v987: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:24:14.229 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:13 smithi049 bash[28804]: cluster 2024-03-11T22:24:12.866223+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-03-11T22:24:14.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:13 smithi049 bash[21434]: cluster 2024-03-11T22:24:12.368588+0000 mgr.y (mgr.14601) 611 : cluster 0 pgmap v987: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:24:14.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:13 smithi049 bash[21434]: cluster 2024-03-11T22:24:12.866223+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-03-11T22:24:14.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:13 smithi187 bash[23415]: cluster 2024-03-11T22:24:12.368588+0000 mgr.y (mgr.14601) 611 : cluster 0 pgmap v987: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:24:14.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:13 smithi187 bash[23415]: cluster 2024-03-11T22:24:12.866223+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-03-11T22:24:14.524 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:24:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:24:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:24:15.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:14 smithi187 bash[23415]: cluster 2024-03-11T22:24:13.890441+0000 mon.a (mon.0) 3023 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-03-11T22:24:15.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:14 smithi049 bash[21434]: cluster 2024-03-11T22:24:13.890441+0000 mon.a (mon.0) 3023 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-03-11T22:24:15.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:14 smithi049 bash[28804]: cluster 2024-03-11T22:24:13.890441+0000 mon.a (mon.0) 3023 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-03-11T22:24:16.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:15 smithi187 bash[23415]: cluster 2024-03-11T22:24:14.369365+0000 mgr.y (mgr.14601) 612 : cluster 0 pgmap v990: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:16.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:15 smithi187 bash[23415]: cluster 2024-03-11T22:24:14.908449+0000 mon.a (mon.0) 3024 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-03-11T22:24:16.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:15 smithi187 bash[23415]: audit 2024-03-11T22:24:14.922114+0000 mon.a (mon.0) 3025 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:16.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:15 smithi187 bash[23415]: audit 2024-03-11T22:24:15.812921+0000 mon.a (mon.0) 3026 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:16.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:15 smithi187 bash[23415]: cluster 2024-03-11T22:24:15.821483+0000 mon.a (mon.0) 3027 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-03-11T22:24:16.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:15 smithi187 bash[23415]: audit 2024-03-11T22:24:15.886218+0000 mon.a (mon.0) 3028 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:16.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[21434]: cluster 2024-03-11T22:24:14.369365+0000 mgr.y (mgr.14601) 612 : cluster 0 pgmap v990: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:16.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[21434]: cluster 2024-03-11T22:24:14.908449+0000 mon.a (mon.0) 3024 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-03-11T22:24:16.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[21434]: audit 2024-03-11T22:24:14.922114+0000 mon.a (mon.0) 3025 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[21434]: audit 2024-03-11T22:24:15.812921+0000 mon.a (mon.0) 3026 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[21434]: cluster 2024-03-11T22:24:15.821483+0000 mon.a (mon.0) 3027 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[21434]: audit 2024-03-11T22:24:15.886218+0000 mon.a (mon.0) 3028 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[28804]: cluster 2024-03-11T22:24:14.369365+0000 mgr.y (mgr.14601) 612 : cluster 0 pgmap v990: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[28804]: cluster 2024-03-11T22:24:14.908449+0000 mon.a (mon.0) 3024 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[28804]: audit 2024-03-11T22:24:14.922114+0000 mon.a (mon.0) 3025 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[28804]: audit 2024-03-11T22:24:15.812921+0000 mon.a (mon.0) 3026 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[28804]: cluster 2024-03-11T22:24:15.821483+0000 mon.a (mon.0) 3027 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-03-11T22:24:16.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:15 smithi049 bash[28804]: audit 2024-03-11T22:24:15.886218+0000 mon.a (mon.0) 3028 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:18.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:17 smithi187 bash[23415]: cluster 2024-03-11T22:24:16.370184+0000 mgr.y (mgr.14601) 613 : cluster 0 pgmap v993: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:18.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:17 smithi187 bash[23415]: audit 2024-03-11T22:24:16.816153+0000 mon.a (mon.0) 3029 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:18.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:17 smithi187 bash[23415]: cluster 2024-03-11T22:24:16.823224+0000 mon.a (mon.0) 3030 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-03-11T22:24:18.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:17 smithi187 bash[23415]: audit 2024-03-11T22:24:16.824652+0000 mon.a (mon.0) 3031 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-120"}]: dispatch 2024-03-11T22:24:18.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[28804]: cluster 2024-03-11T22:24:16.370184+0000 mgr.y (mgr.14601) 613 : cluster 0 pgmap v993: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:18.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[28804]: audit 2024-03-11T22:24:16.816153+0000 mon.a (mon.0) 3029 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:18.274 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[28804]: cluster 2024-03-11T22:24:16.823224+0000 mon.a (mon.0) 3030 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-03-11T22:24:18.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[28804]: audit 2024-03-11T22:24:16.824652+0000 mon.a (mon.0) 3031 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-120"}]: dispatch 2024-03-11T22:24:18.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[21434]: cluster 2024-03-11T22:24:16.370184+0000 mgr.y (mgr.14601) 613 : cluster 0 pgmap v993: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:18.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[21434]: audit 2024-03-11T22:24:16.816153+0000 mon.a (mon.0) 3029 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:18.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[21434]: cluster 2024-03-11T22:24:16.823224+0000 mon.a (mon.0) 3030 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-03-11T22:24:18.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:17 smithi049 bash[21434]: audit 2024-03-11T22:24:16.824652+0000 mon.a (mon.0) 3031 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-120"}]: dispatch 2024-03-11T22:24:19.200 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:18 smithi187 bash[23415]: audit 2024-03-11T22:24:17.818882+0000 mon.a (mon.0) 3032 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-120"}]': finished 2024-03-11T22:24:19.200 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:18 smithi187 bash[23415]: cluster 2024-03-11T22:24:17.826103+0000 mon.a (mon.0) 3033 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-03-11T22:24:19.200 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:18 smithi187 bash[23415]: audit 2024-03-11T22:24:17.828965+0000 mon.a (mon.0) 3034 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-120", "mode": "writeback"}]: dispatch 2024-03-11T22:24:19.200 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:18 smithi187 bash[23415]: cluster 2024-03-11T22:24:18.819482+0000 mon.a (mon.0) 3035 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:19.200 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:18 smithi187 bash[23415]: audit 2024-03-11T22:24:18.821939+0000 mon.a (mon.0) 3036 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-120", "mode": "writeback"}]': finished 2024-03-11T22:24:19.200 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:18 smithi187 bash[23415]: cluster 2024-03-11T22:24:18.829053+0000 mon.a (mon.0) 3037 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[21434]: audit 2024-03-11T22:24:17.818882+0000 mon.a (mon.0) 3032 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-120"}]': finished 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[21434]: cluster 2024-03-11T22:24:17.826103+0000 mon.a (mon.0) 3033 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[21434]: audit 2024-03-11T22:24:17.828965+0000 mon.a (mon.0) 3034 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-120", "mode": "writeback"}]: dispatch 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[21434]: cluster 2024-03-11T22:24:18.819482+0000 mon.a (mon.0) 3035 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[21434]: audit 2024-03-11T22:24:18.821939+0000 mon.a (mon.0) 3036 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-120", "mode": "writeback"}]': finished 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[21434]: cluster 2024-03-11T22:24:18.829053+0000 mon.a (mon.0) 3037 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[28804]: audit 2024-03-11T22:24:17.818882+0000 mon.a (mon.0) 3032 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-120"}]': finished 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[28804]: cluster 2024-03-11T22:24:17.826103+0000 mon.a (mon.0) 3033 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-03-11T22:24:19.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[28804]: audit 2024-03-11T22:24:17.828965+0000 mon.a (mon.0) 3034 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-120", "mode": "writeback"}]: dispatch 2024-03-11T22:24:19.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[28804]: cluster 2024-03-11T22:24:18.819482+0000 mon.a (mon.0) 3035 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:19.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[28804]: audit 2024-03-11T22:24:18.821939+0000 mon.a (mon.0) 3036 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-120", "mode": "writeback"}]': finished 2024-03-11T22:24:19.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:18 smithi049 bash[28804]: cluster 2024-03-11T22:24:18.829053+0000 mon.a (mon.0) 3037 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-03-11T22:24:19.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:24:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:24:20.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:19 smithi187 bash[23415]: cluster 2024-03-11T22:24:18.371279+0000 mgr.y (mgr.14601) 614 : cluster 0 pgmap v996: 268 pgs: 30 unknown, 238 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:20.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:19 smithi187 bash[23415]: audit 2024-03-11T22:24:18.989301+0000 mon.a (mon.0) 3038 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:20.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:19 smithi187 bash[23415]: audit 2024-03-11T22:24:19.400935+0000 mon.c (mon.2) 646 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:24:20.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:19 smithi049 bash[21434]: cluster 2024-03-11T22:24:18.371279+0000 mgr.y (mgr.14601) 614 : cluster 0 pgmap v996: 268 pgs: 30 unknown, 238 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:20.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:19 smithi049 bash[21434]: audit 2024-03-11T22:24:18.989301+0000 mon.a (mon.0) 3038 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:20.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:19 smithi049 bash[21434]: audit 2024-03-11T22:24:19.400935+0000 mon.c (mon.2) 646 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:24:20.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:19 smithi049 bash[28804]: cluster 2024-03-11T22:24:18.371279+0000 mgr.y (mgr.14601) 614 : cluster 0 pgmap v996: 268 pgs: 30 unknown, 238 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:20.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:19 smithi049 bash[28804]: audit 2024-03-11T22:24:18.989301+0000 mon.a (mon.0) 3038 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:20.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:19 smithi049 bash[28804]: audit 2024-03-11T22:24:19.400935+0000 mon.c (mon.2) 646 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:24:21.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:20 smithi187 bash[23415]: audit 2024-03-11T22:24:19.204739+0000 mgr.y (mgr.14601) 615 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:21.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:20 smithi187 bash[23415]: audit 2024-03-11T22:24:19.855928+0000 mon.a (mon.0) 3039 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:21.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:20 smithi187 bash[23415]: cluster 2024-03-11T22:24:19.858898+0000 mon.a (mon.0) 3040 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-03-11T22:24:21.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:20 smithi187 bash[23415]: audit 2024-03-11T22:24:19.862517+0000 mon.a (mon.0) 3041 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120"}]: dispatch 2024-03-11T22:24:21.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:20 smithi187 bash[23415]: audit 2024-03-11T22:24:20.134576+0000 mon.c (mon.2) 647 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:24:21.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:20 smithi187 bash[23415]: audit 2024-03-11T22:24:20.136458+0000 mon.c (mon.2) 648 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:24:21.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:20 smithi187 bash[23415]: audit 2024-03-11T22:24:20.147544+0000 mon.a (mon.0) 3042 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[21434]: audit 2024-03-11T22:24:19.204739+0000 mgr.y (mgr.14601) 615 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[21434]: audit 2024-03-11T22:24:19.855928+0000 mon.a (mon.0) 3039 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[21434]: cluster 2024-03-11T22:24:19.858898+0000 mon.a (mon.0) 3040 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[21434]: audit 2024-03-11T22:24:19.862517+0000 mon.a (mon.0) 3041 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120"}]: dispatch 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[21434]: audit 2024-03-11T22:24:20.134576+0000 mon.c (mon.2) 647 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[21434]: audit 2024-03-11T22:24:20.136458+0000 mon.c (mon.2) 648 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[21434]: audit 2024-03-11T22:24:20.147544+0000 mon.a (mon.0) 3042 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:21.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[28804]: audit 2024-03-11T22:24:19.204739+0000 mgr.y (mgr.14601) 615 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:21.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[28804]: audit 2024-03-11T22:24:19.855928+0000 mon.a (mon.0) 3039 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:21.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[28804]: cluster 2024-03-11T22:24:19.858898+0000 mon.a (mon.0) 3040 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-03-11T22:24:21.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[28804]: audit 2024-03-11T22:24:19.862517+0000 mon.a (mon.0) 3041 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120"}]: dispatch 2024-03-11T22:24:21.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[28804]: audit 2024-03-11T22:24:20.134576+0000 mon.c (mon.2) 647 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:24:21.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[28804]: audit 2024-03-11T22:24:20.136458+0000 mon.c (mon.2) 648 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:24:21.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:20 smithi049 bash[28804]: audit 2024-03-11T22:24:20.147544+0000 mon.a (mon.0) 3042 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:22.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:21 smithi187 bash[23415]: cluster 2024-03-11T22:24:20.372299+0000 mgr.y (mgr.14601) 616 : cluster 0 pgmap v999: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:22.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:21 smithi187 bash[23415]: cluster 2024-03-11T22:24:20.856492+0000 mon.a (mon.0) 3043 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:22.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:21 smithi187 bash[23415]: audit 2024-03-11T22:24:20.858699+0000 mon.a (mon.0) 3044 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120"}]': finished 2024-03-11T22:24:22.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:21 smithi187 bash[23415]: cluster 2024-03-11T22:24:20.865740+0000 mon.a (mon.0) 3045 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[21434]: cluster 2024-03-11T22:24:20.372299+0000 mgr.y (mgr.14601) 616 : cluster 0 pgmap v999: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[21434]: cluster 2024-03-11T22:24:20.856492+0000 mon.a (mon.0) 3043 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[21434]: audit 2024-03-11T22:24:20.858699+0000 mon.a (mon.0) 3044 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120"}]': finished 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[21434]: cluster 2024-03-11T22:24:20.865740+0000 mon.a (mon.0) 3045 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[28804]: cluster 2024-03-11T22:24:20.372299+0000 mgr.y (mgr.14601) 616 : cluster 0 pgmap v999: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[28804]: cluster 2024-03-11T22:24:20.856492+0000 mon.a (mon.0) 3043 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[28804]: audit 2024-03-11T22:24:20.858699+0000 mon.a (mon.0) 3044 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-120"}]': finished 2024-03-11T22:24:22.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:21 smithi049 bash[28804]: cluster 2024-03-11T22:24:20.865740+0000 mon.a (mon.0) 3045 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-03-11T22:24:23.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:22 smithi187 bash[23415]: cluster 2024-03-11T22:24:21.885433+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-03-11T22:24:23.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:22 smithi049 bash[21434]: cluster 2024-03-11T22:24:21.885433+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-03-11T22:24:23.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:22 smithi049 bash[28804]: cluster 2024-03-11T22:24:21.885433+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-03-11T22:24:24.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:23 smithi049 bash[21434]: cluster 2024-03-11T22:24:22.372814+0000 mgr.y (mgr.14601) 617 : cluster 0 pgmap v1002: 236 pgs: 236 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-11T22:24:24.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:23 smithi049 bash[21434]: cluster 2024-03-11T22:24:22.900302+0000 mon.a (mon.0) 3047 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-03-11T22:24:24.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:23 smithi049 bash[21434]: audit 2024-03-11T22:24:22.904468+0000 mon.a (mon.0) 3048 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:24.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:23 smithi049 bash[28804]: cluster 2024-03-11T22:24:22.372814+0000 mgr.y (mgr.14601) 617 : cluster 0 pgmap v1002: 236 pgs: 236 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-11T22:24:24.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:23 smithi049 bash[28804]: cluster 2024-03-11T22:24:22.900302+0000 mon.a (mon.0) 3047 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-03-11T22:24:24.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:23 smithi049 bash[28804]: audit 2024-03-11T22:24:22.904468+0000 mon.a (mon.0) 3048 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:24.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:23 smithi187 bash[23415]: cluster 2024-03-11T22:24:22.372814+0000 mgr.y (mgr.14601) 617 : cluster 0 pgmap v1002: 236 pgs: 236 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-11T22:24:24.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:23 smithi187 bash[23415]: cluster 2024-03-11T22:24:22.900302+0000 mon.a (mon.0) 3047 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-03-11T22:24:24.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:23 smithi187 bash[23415]: audit 2024-03-11T22:24:22.904468+0000 mon.a (mon.0) 3048 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:24.524 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:24:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:24:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:24:25.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:24 smithi187 bash[23415]: audit 2024-03-11T22:24:23.895268+0000 mon.a (mon.0) 3049 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:25.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:24 smithi187 bash[23415]: cluster 2024-03-11T22:24:23.902178+0000 mon.a (mon.0) 3050 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-03-11T22:24:25.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:24 smithi187 bash[23415]: audit 2024-03-11T22:24:23.963173+0000 mon.a (mon.0) 3051 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:25.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:24 smithi049 bash[21434]: audit 2024-03-11T22:24:23.895268+0000 mon.a (mon.0) 3049 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:25.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:24 smithi049 bash[21434]: cluster 2024-03-11T22:24:23.902178+0000 mon.a (mon.0) 3050 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-03-11T22:24:25.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:24 smithi049 bash[21434]: audit 2024-03-11T22:24:23.963173+0000 mon.a (mon.0) 3051 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:25.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:24 smithi049 bash[28804]: audit 2024-03-11T22:24:23.895268+0000 mon.a (mon.0) 3049 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:25.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:24 smithi049 bash[28804]: cluster 2024-03-11T22:24:23.902178+0000 mon.a (mon.0) 3050 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-03-11T22:24:25.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:24 smithi049 bash[28804]: audit 2024-03-11T22:24:23.963173+0000 mon.a (mon.0) 3051 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:25 smithi187 bash[23415]: cluster 2024-03-11T22:24:24.373693+0000 mgr.y (mgr.14601) 618 : cluster 0 pgmap v1005: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:25 smithi187 bash[23415]: audit 2024-03-11T22:24:24.915797+0000 mon.a (mon.0) 3052 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:25 smithi187 bash[23415]: cluster 2024-03-11T22:24:24.924748+0000 mon.a (mon.0) 3053 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-03-11T22:24:26.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:25 smithi187 bash[23415]: audit 2024-03-11T22:24:24.926610+0000 mon.a (mon.0) 3054 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-122"}]: dispatch 2024-03-11T22:24:26.274 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[21434]: cluster 2024-03-11T22:24:24.373693+0000 mgr.y (mgr.14601) 618 : cluster 0 pgmap v1005: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:26.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[21434]: audit 2024-03-11T22:24:24.915797+0000 mon.a (mon.0) 3052 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:26.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[21434]: cluster 2024-03-11T22:24:24.924748+0000 mon.a (mon.0) 3053 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-03-11T22:24:26.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[21434]: audit 2024-03-11T22:24:24.926610+0000 mon.a (mon.0) 3054 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-122"}]: dispatch 2024-03-11T22:24:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[28804]: cluster 2024-03-11T22:24:24.373693+0000 mgr.y (mgr.14601) 618 : cluster 0 pgmap v1005: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[28804]: audit 2024-03-11T22:24:24.915797+0000 mon.a (mon.0) 3052 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[28804]: cluster 2024-03-11T22:24:24.924748+0000 mon.a (mon.0) 3053 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-03-11T22:24:26.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:25 smithi049 bash[28804]: audit 2024-03-11T22:24:24.926610+0000 mon.a (mon.0) 3054 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-122"}]: dispatch 2024-03-11T22:24:27.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:26 smithi187 bash[23415]: audit 2024-03-11T22:24:25.926367+0000 mon.a (mon.0) 3055 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-122"}]': finished 2024-03-11T22:24:27.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:26 smithi187 bash[23415]: cluster 2024-03-11T22:24:25.933353+0000 mon.a (mon.0) 3056 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-03-11T22:24:27.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:26 smithi187 bash[23415]: audit 2024-03-11T22:24:25.935930+0000 mon.a (mon.0) 3057 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-122", "mode": "writeback"}]: dispatch 2024-03-11T22:24:27.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:26 smithi187 bash[23415]: audit 2024-03-11T22:24:26.760132+0000 mon.a (mon.0) 3058 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:27.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:26 smithi187 bash[23415]: audit 2024-03-11T22:24:26.763034+0000 mon.c (mon.2) 649 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[21434]: audit 2024-03-11T22:24:25.926367+0000 mon.a (mon.0) 3055 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-122"}]': finished 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[21434]: cluster 2024-03-11T22:24:25.933353+0000 mon.a (mon.0) 3056 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[21434]: audit 2024-03-11T22:24:25.935930+0000 mon.a (mon.0) 3057 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-122", "mode": "writeback"}]: dispatch 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[21434]: audit 2024-03-11T22:24:26.760132+0000 mon.a (mon.0) 3058 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[21434]: audit 2024-03-11T22:24:26.763034+0000 mon.c (mon.2) 649 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[28804]: audit 2024-03-11T22:24:25.926367+0000 mon.a (mon.0) 3055 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-122"}]': finished 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[28804]: cluster 2024-03-11T22:24:25.933353+0000 mon.a (mon.0) 3056 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[28804]: audit 2024-03-11T22:24:25.935930+0000 mon.a (mon.0) 3057 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-122", "mode": "writeback"}]: dispatch 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[28804]: audit 2024-03-11T22:24:26.760132+0000 mon.a (mon.0) 3058 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:27.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:26 smithi049 bash[28804]: audit 2024-03-11T22:24:26.763034+0000 mon.c (mon.2) 649 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:28.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:27 smithi187 bash[23415]: cluster 2024-03-11T22:24:26.374590+0000 mgr.y (mgr.14601) 619 : cluster 0 pgmap v1008: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:28.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:27 smithi187 bash[23415]: cluster 2024-03-11T22:24:26.927478+0000 mon.a (mon.0) 3059 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:28.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:27 smithi187 bash[23415]: audit 2024-03-11T22:24:26.935079+0000 mon.a (mon.0) 3060 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-122", "mode": "writeback"}]': finished 2024-03-11T22:24:28.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:27 smithi187 bash[23415]: cluster 2024-03-11T22:24:26.942785+0000 mon.a (mon.0) 3061 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-03-11T22:24:28.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:27 smithi187 bash[23415]: audit 2024-03-11T22:24:27.079552+0000 mon.a (mon.0) 3062 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[21434]: cluster 2024-03-11T22:24:26.374590+0000 mgr.y (mgr.14601) 619 : cluster 0 pgmap v1008: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[21434]: cluster 2024-03-11T22:24:26.927478+0000 mon.a (mon.0) 3059 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[21434]: audit 2024-03-11T22:24:26.935079+0000 mon.a (mon.0) 3060 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-122", "mode": "writeback"}]': finished 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[21434]: cluster 2024-03-11T22:24:26.942785+0000 mon.a (mon.0) 3061 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[21434]: audit 2024-03-11T22:24:27.079552+0000 mon.a (mon.0) 3062 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[28804]: cluster 2024-03-11T22:24:26.374590+0000 mgr.y (mgr.14601) 619 : cluster 0 pgmap v1008: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[28804]: cluster 2024-03-11T22:24:26.927478+0000 mon.a (mon.0) 3059 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[28804]: audit 2024-03-11T22:24:26.935079+0000 mon.a (mon.0) 3060 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-122", "mode": "writeback"}]': finished 2024-03-11T22:24:28.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[28804]: cluster 2024-03-11T22:24:26.942785+0000 mon.a (mon.0) 3061 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-03-11T22:24:28.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:27 smithi049 bash[28804]: audit 2024-03-11T22:24:27.079552+0000 mon.a (mon.0) 3062 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:29.208 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:28 smithi187 bash[23415]: audit 2024-03-11T22:24:27.945927+0000 mon.a (mon.0) 3063 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:29.208 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:28 smithi187 bash[23415]: cluster 2024-03-11T22:24:27.952582+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-03-11T22:24:29.208 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:28 smithi187 bash[23415]: audit 2024-03-11T22:24:27.954254+0000 mon.a (mon.0) 3065 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122"}]: dispatch 2024-03-11T22:24:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:28 smithi049 bash[21434]: audit 2024-03-11T22:24:27.945927+0000 mon.a (mon.0) 3063 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:28 smithi049 bash[21434]: cluster 2024-03-11T22:24:27.952582+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-03-11T22:24:29.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:28 smithi049 bash[21434]: audit 2024-03-11T22:24:27.954254+0000 mon.a (mon.0) 3065 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122"}]: dispatch 2024-03-11T22:24:29.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:28 smithi049 bash[28804]: audit 2024-03-11T22:24:27.945927+0000 mon.a (mon.0) 3063 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:29.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:28 smithi049 bash[28804]: cluster 2024-03-11T22:24:27.952582+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-03-11T22:24:29.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:28 smithi049 bash[28804]: audit 2024-03-11T22:24:27.954254+0000 mon.a (mon.0) 3065 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122"}]: dispatch 2024-03-11T22:24:29.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:24:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:24:30.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:29 smithi187 bash[23415]: cluster 2024-03-11T22:24:28.375858+0000 mgr.y (mgr.14601) 620 : cluster 0 pgmap v1011: 268 pgs: 31 creating+peering, 237 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:30.323 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:29 smithi187 bash[23415]: cluster 2024-03-11T22:24:28.946847+0000 mon.a (mon.0) 3066 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:30.323 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:29 smithi187 bash[23415]: audit 2024-03-11T22:24:28.958252+0000 mon.a (mon.0) 3067 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122"}]': finished 2024-03-11T22:24:30.323 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:29 smithi187 bash[23415]: cluster 2024-03-11T22:24:28.965877+0000 mon.a (mon.0) 3068 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-03-11T22:24:30.324 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[21434]: cluster 2024-03-11T22:24:28.375858+0000 mgr.y (mgr.14601) 620 : cluster 0 pgmap v1011: 268 pgs: 31 creating+peering, 237 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:30.324 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[21434]: cluster 2024-03-11T22:24:28.946847+0000 mon.a (mon.0) 3066 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:30.324 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[21434]: audit 2024-03-11T22:24:28.958252+0000 mon.a (mon.0) 3067 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122"}]': finished 2024-03-11T22:24:30.324 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[21434]: cluster 2024-03-11T22:24:28.965877+0000 mon.a (mon.0) 3068 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-03-11T22:24:30.325 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[28804]: cluster 2024-03-11T22:24:28.375858+0000 mgr.y (mgr.14601) 620 : cluster 0 pgmap v1011: 268 pgs: 31 creating+peering, 237 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:30.325 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[28804]: cluster 2024-03-11T22:24:28.946847+0000 mon.a (mon.0) 3066 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:30.325 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[28804]: audit 2024-03-11T22:24:28.958252+0000 mon.a (mon.0) 3067 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-122"}]': finished 2024-03-11T22:24:30.325 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:29 smithi049 bash[28804]: cluster 2024-03-11T22:24:28.965877+0000 mon.a (mon.0) 3068 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-03-11T22:24:31.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:30 smithi187 bash[23415]: audit 2024-03-11T22:24:29.212759+0000 mgr.y (mgr.14601) 621 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:31.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:30 smithi187 bash[23415]: cluster 2024-03-11T22:24:29.967453+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-03-11T22:24:31.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:30 smithi049 bash[21434]: audit 2024-03-11T22:24:29.212759+0000 mgr.y (mgr.14601) 621 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:31.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:30 smithi049 bash[21434]: cluster 2024-03-11T22:24:29.967453+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-03-11T22:24:31.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:30 smithi049 bash[28804]: audit 2024-03-11T22:24:29.212759+0000 mgr.y (mgr.14601) 621 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:31.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:30 smithi049 bash[28804]: cluster 2024-03-11T22:24:29.967453+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-03-11T22:24:32.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:31 smithi187 bash[23415]: cluster 2024-03-11T22:24:30.376868+0000 mgr.y (mgr.14601) 622 : cluster 0 pgmap v1014: 236 pgs: 236 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:24:32.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:31 smithi187 bash[23415]: cluster 2024-03-11T22:24:30.981784+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-03-11T22:24:32.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:31 smithi187 bash[23415]: audit 2024-03-11T22:24:30.989931+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:31 smithi049 bash[21434]: cluster 2024-03-11T22:24:30.376868+0000 mgr.y (mgr.14601) 622 : cluster 0 pgmap v1014: 236 pgs: 236 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:24:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:31 smithi049 bash[21434]: cluster 2024-03-11T22:24:30.981784+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-03-11T22:24:32.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:31 smithi049 bash[21434]: audit 2024-03-11T22:24:30.989931+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:31 smithi049 bash[28804]: cluster 2024-03-11T22:24:30.376868+0000 mgr.y (mgr.14601) 622 : cluster 0 pgmap v1014: 236 pgs: 236 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-11T22:24:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:31 smithi049 bash[28804]: cluster 2024-03-11T22:24:30.981784+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-03-11T22:24:32.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:31 smithi049 bash[28804]: audit 2024-03-11T22:24:30.989931+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:33.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:33 smithi049 bash[21434]: audit 2024-03-11T22:24:31.975144+0000 mon.a (mon.0) 3072 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:33.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:33 smithi049 bash[21434]: cluster 2024-03-11T22:24:31.983143+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-03-11T22:24:33.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:33 smithi049 bash[28804]: audit 2024-03-11T22:24:31.975144+0000 mon.a (mon.0) 3072 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:33.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:33 smithi049 bash[28804]: cluster 2024-03-11T22:24:31.983143+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-03-11T22:24:33.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:32 smithi187 bash[23415]: audit 2024-03-11T22:24:31.975144+0000 mon.a (mon.0) 3072 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:33.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:32 smithi187 bash[23415]: cluster 2024-03-11T22:24:31.983143+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-03-11T22:24:34.275 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:24:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:24:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:24:34.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:34 smithi049 bash[28804]: cluster 2024-03-11T22:24:32.377819+0000 mgr.y (mgr.14601) 623 : cluster 0 pgmap v1017: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 511 B/s wr, 0 op/s 2024-03-11T22:24:34.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:34 smithi049 bash[28804]: cluster 2024-03-11T22:24:33.012596+0000 mon.a (mon.0) 3074 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-03-11T22:24:34.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:34 smithi049 bash[28804]: audit 2024-03-11T22:24:33.052432+0000 mon.a (mon.0) 3075 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:34.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:34 smithi049 bash[21434]: cluster 2024-03-11T22:24:32.377819+0000 mgr.y (mgr.14601) 623 : cluster 0 pgmap v1017: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 511 B/s wr, 0 op/s 2024-03-11T22:24:34.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:34 smithi049 bash[21434]: cluster 2024-03-11T22:24:33.012596+0000 mon.a (mon.0) 3074 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-03-11T22:24:34.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:34 smithi049 bash[21434]: audit 2024-03-11T22:24:33.052432+0000 mon.a (mon.0) 3075 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:34.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:34 smithi187 bash[23415]: cluster 2024-03-11T22:24:32.377819+0000 mgr.y (mgr.14601) 623 : cluster 0 pgmap v1017: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 511 B/s wr, 0 op/s 2024-03-11T22:24:34.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:34 smithi187 bash[23415]: cluster 2024-03-11T22:24:33.012596+0000 mon.a (mon.0) 3074 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-03-11T22:24:34.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:34 smithi187 bash[23415]: audit 2024-03-11T22:24:33.052432+0000 mon.a (mon.0) 3075 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:35.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:35 smithi049 bash[21434]: audit 2024-03-11T22:24:34.007207+0000 mon.a (mon.0) 3076 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:35.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:35 smithi049 bash[21434]: cluster 2024-03-11T22:24:34.015222+0000 mon.a (mon.0) 3077 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-03-11T22:24:35.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:35 smithi049 bash[21434]: audit 2024-03-11T22:24:34.016959+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-124"}]: dispatch 2024-03-11T22:24:35.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:35 smithi049 bash[28804]: audit 2024-03-11T22:24:34.007207+0000 mon.a (mon.0) 3076 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:35.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:35 smithi049 bash[28804]: cluster 2024-03-11T22:24:34.015222+0000 mon.a (mon.0) 3077 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-03-11T22:24:35.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:35 smithi049 bash[28804]: audit 2024-03-11T22:24:34.016959+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-124"}]: dispatch 2024-03-11T22:24:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:35 smithi187 bash[23415]: audit 2024-03-11T22:24:34.007207+0000 mon.a (mon.0) 3076 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:35 smithi187 bash[23415]: cluster 2024-03-11T22:24:34.015222+0000 mon.a (mon.0) 3077 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-03-11T22:24:35.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:35 smithi187 bash[23415]: audit 2024-03-11T22:24:34.016959+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-124"}]: dispatch 2024-03-11T22:24:36.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:36 smithi187 bash[23415]: cluster 2024-03-11T22:24:34.378704+0000 mgr.y (mgr.14601) 624 : cluster 0 pgmap v1020: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:24:36.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:36 smithi187 bash[23415]: audit 2024-03-11T22:24:35.009901+0000 mon.a (mon.0) 3079 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-124"}]': finished 2024-03-11T22:24:36.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:36 smithi187 bash[23415]: cluster 2024-03-11T22:24:35.017290+0000 mon.a (mon.0) 3080 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-03-11T22:24:36.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:36 smithi187 bash[23415]: audit 2024-03-11T22:24:35.019669+0000 mon.a (mon.0) 3081 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-124", "mode": "writeback"}]: dispatch 2024-03-11T22:24:36.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:36 smithi187 bash[23415]: cluster 2024-03-11T22:24:36.010226+0000 mon.a (mon.0) 3082 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:36.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:36 smithi187 bash[23415]: audit 2024-03-11T22:24:36.012510+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-124", "mode": "writeback"}]': finished 2024-03-11T22:24:36.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:36 smithi187 bash[23415]: cluster 2024-03-11T22:24:36.019753+0000 mon.a (mon.0) 3084 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-03-11T22:24:36.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[21434]: cluster 2024-03-11T22:24:34.378704+0000 mgr.y (mgr.14601) 624 : cluster 0 pgmap v1020: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:24:36.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[21434]: audit 2024-03-11T22:24:35.009901+0000 mon.a (mon.0) 3079 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-124"}]': finished 2024-03-11T22:24:36.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[21434]: cluster 2024-03-11T22:24:35.017290+0000 mon.a (mon.0) 3080 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-03-11T22:24:36.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[21434]: audit 2024-03-11T22:24:35.019669+0000 mon.a (mon.0) 3081 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-124", "mode": "writeback"}]: dispatch 2024-03-11T22:24:36.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[21434]: cluster 2024-03-11T22:24:36.010226+0000 mon.a (mon.0) 3082 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[21434]: audit 2024-03-11T22:24:36.012510+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-124", "mode": "writeback"}]': finished 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[21434]: cluster 2024-03-11T22:24:36.019753+0000 mon.a (mon.0) 3084 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[28804]: cluster 2024-03-11T22:24:34.378704+0000 mgr.y (mgr.14601) 624 : cluster 0 pgmap v1020: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[28804]: audit 2024-03-11T22:24:35.009901+0000 mon.a (mon.0) 3079 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-124"}]': finished 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[28804]: cluster 2024-03-11T22:24:35.017290+0000 mon.a (mon.0) 3080 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[28804]: audit 2024-03-11T22:24:35.019669+0000 mon.a (mon.0) 3081 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-124", "mode": "writeback"}]: dispatch 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[28804]: cluster 2024-03-11T22:24:36.010226+0000 mon.a (mon.0) 3082 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[28804]: audit 2024-03-11T22:24:36.012510+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-124", "mode": "writeback"}]': finished 2024-03-11T22:24:36.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:36 smithi049 bash[28804]: cluster 2024-03-11T22:24:36.019753+0000 mon.a (mon.0) 3084 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-03-11T22:24:38.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:38 smithi187 bash[23415]: cluster 2024-03-11T22:24:36.379895+0000 mgr.y (mgr.14601) 625 : cluster 0 pgmap v1023: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:24:38.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:38 smithi187 bash[23415]: cluster 2024-03-11T22:24:37.049034+0000 mon.a (mon.0) 3085 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-03-11T22:24:38.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:38 smithi187 bash[23415]: audit 2024-03-11T22:24:37.125894+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:38.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:38 smithi049 bash[21434]: cluster 2024-03-11T22:24:36.379895+0000 mgr.y (mgr.14601) 625 : cluster 0 pgmap v1023: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:24:38.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:38 smithi049 bash[21434]: cluster 2024-03-11T22:24:37.049034+0000 mon.a (mon.0) 3085 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-03-11T22:24:38.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:38 smithi049 bash[21434]: audit 2024-03-11T22:24:37.125894+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:38.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:38 smithi049 bash[28804]: cluster 2024-03-11T22:24:36.379895+0000 mgr.y (mgr.14601) 625 : cluster 0 pgmap v1023: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-11T22:24:38.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:38 smithi049 bash[28804]: cluster 2024-03-11T22:24:37.049034+0000 mon.a (mon.0) 3085 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-03-11T22:24:38.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:38 smithi049 bash[28804]: audit 2024-03-11T22:24:37.125894+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:39.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:24:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:24:39.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:39 smithi187 bash[23415]: audit 2024-03-11T22:24:38.044637+0000 mon.a (mon.0) 3087 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:39.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:39 smithi187 bash[23415]: cluster 2024-03-11T22:24:38.052201+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-03-11T22:24:39.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:39 smithi187 bash[23415]: audit 2024-03-11T22:24:38.053418+0000 mon.a (mon.0) 3089 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124"}]: dispatch 2024-03-11T22:24:39.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:39 smithi187 bash[23415]: cluster 2024-03-11T22:24:39.045090+0000 mon.a (mon.0) 3090 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:39.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:39 smithi187 bash[23415]: audit 2024-03-11T22:24:39.047479+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124"}]': finished 2024-03-11T22:24:39.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:39 smithi187 bash[23415]: cluster 2024-03-11T22:24:39.055050+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-03-11T22:24:39.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[28804]: audit 2024-03-11T22:24:38.044637+0000 mon.a (mon.0) 3087 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:39.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[28804]: cluster 2024-03-11T22:24:38.052201+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-03-11T22:24:39.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[28804]: audit 2024-03-11T22:24:38.053418+0000 mon.a (mon.0) 3089 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124"}]: dispatch 2024-03-11T22:24:39.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[28804]: cluster 2024-03-11T22:24:39.045090+0000 mon.a (mon.0) 3090 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:39.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[28804]: audit 2024-03-11T22:24:39.047479+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124"}]': finished 2024-03-11T22:24:39.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[28804]: cluster 2024-03-11T22:24:39.055050+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-03-11T22:24:39.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[21434]: audit 2024-03-11T22:24:38.044637+0000 mon.a (mon.0) 3087 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:39.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[21434]: cluster 2024-03-11T22:24:38.052201+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-03-11T22:24:39.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[21434]: audit 2024-03-11T22:24:38.053418+0000 mon.a (mon.0) 3089 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124"}]: dispatch 2024-03-11T22:24:39.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[21434]: cluster 2024-03-11T22:24:39.045090+0000 mon.a (mon.0) 3090 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:39.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[21434]: audit 2024-03-11T22:24:39.047479+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-124"}]': finished 2024-03-11T22:24:39.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:39 smithi049 bash[21434]: cluster 2024-03-11T22:24:39.055050+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-03-11T22:24:40.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:40 smithi187 bash[23415]: cluster 2024-03-11T22:24:38.381121+0000 mgr.y (mgr.14601) 626 : cluster 0 pgmap v1026: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:24:41.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:40 smithi049 bash[21434]: cluster 2024-03-11T22:24:38.381121+0000 mgr.y (mgr.14601) 626 : cluster 0 pgmap v1026: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:24:41.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:40 smithi049 bash[28804]: cluster 2024-03-11T22:24:38.381121+0000 mgr.y (mgr.14601) 626 : cluster 0 pgmap v1026: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:24:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:41 smithi187 bash[23415]: audit 2024-03-11T22:24:39.223956+0000 mgr.y (mgr.14601) 627 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:41 smithi187 bash[23415]: cluster 2024-03-11T22:24:40.078274+0000 mon.a (mon.0) 3093 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-03-11T22:24:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:41 smithi187 bash[23415]: cluster 2024-03-11T22:24:40.381913+0000 mgr.y (mgr.14601) 628 : cluster 0 pgmap v1029: 236 pgs: 236 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:41 smithi187 bash[23415]: cluster 2024-03-11T22:24:41.082184+0000 mon.a (mon.0) 3094 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-03-11T22:24:41.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:41 smithi187 bash[23415]: audit 2024-03-11T22:24:41.087372+0000 mon.a (mon.0) 3095 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:42.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[21434]: audit 2024-03-11T22:24:39.223956+0000 mgr.y (mgr.14601) 627 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:42.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[21434]: cluster 2024-03-11T22:24:40.078274+0000 mon.a (mon.0) 3093 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-03-11T22:24:42.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[21434]: cluster 2024-03-11T22:24:40.381913+0000 mgr.y (mgr.14601) 628 : cluster 0 pgmap v1029: 236 pgs: 236 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:42.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[21434]: cluster 2024-03-11T22:24:41.082184+0000 mon.a (mon.0) 3094 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-03-11T22:24:42.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[21434]: audit 2024-03-11T22:24:41.087372+0000 mon.a (mon.0) 3095 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:42.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[28804]: audit 2024-03-11T22:24:39.223956+0000 mgr.y (mgr.14601) 627 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:42.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[28804]: cluster 2024-03-11T22:24:40.078274+0000 mon.a (mon.0) 3093 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-03-11T22:24:42.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[28804]: cluster 2024-03-11T22:24:40.381913+0000 mgr.y (mgr.14601) 628 : cluster 0 pgmap v1029: 236 pgs: 236 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:42.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[28804]: cluster 2024-03-11T22:24:41.082184+0000 mon.a (mon.0) 3094 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-03-11T22:24:42.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:41 smithi049 bash[28804]: audit 2024-03-11T22:24:41.087372+0000 mon.a (mon.0) 3095 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:42.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:42 smithi187 bash[23415]: audit 2024-03-11T22:24:41.797770+0000 mon.c (mon.2) 650 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:42.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:42 smithi187 bash[23415]: audit 2024-03-11T22:24:42.078254+0000 mon.a (mon.0) 3096 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:42.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:42 smithi187 bash[23415]: cluster 2024-03-11T22:24:42.085396+0000 mon.a (mon.0) 3097 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-03-11T22:24:42.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:42 smithi187 bash[23415]: audit 2024-03-11T22:24:42.090216+0000 mon.a (mon.0) 3098 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[21434]: audit 2024-03-11T22:24:41.797770+0000 mon.c (mon.2) 650 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[21434]: audit 2024-03-11T22:24:42.078254+0000 mon.a (mon.0) 3096 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[21434]: cluster 2024-03-11T22:24:42.085396+0000 mon.a (mon.0) 3097 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-03-11T22:24:43.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[21434]: audit 2024-03-11T22:24:42.090216+0000 mon.a (mon.0) 3098 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:43.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[28804]: audit 2024-03-11T22:24:41.797770+0000 mon.c (mon.2) 650 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:43.025 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[28804]: audit 2024-03-11T22:24:42.078254+0000 mon.a (mon.0) 3096 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[28804]: cluster 2024-03-11T22:24:42.085396+0000 mon.a (mon.0) 3097 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-03-11T22:24:43.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:42 smithi049 bash[28804]: audit 2024-03-11T22:24:42.090216+0000 mon.a (mon.0) 3098 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:44 smithi187 bash[23415]: cluster 2024-03-11T22:24:42.382759+0000 mgr.y (mgr.14601) 629 : cluster 0 pgmap v1032: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:24:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:44 smithi187 bash[23415]: audit 2024-03-11T22:24:43.087136+0000 mon.a (mon.0) 3099 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:44 smithi187 bash[23415]: cluster 2024-03-11T22:24:43.093581+0000 mon.a (mon.0) 3100 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-03-11T22:24:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:44 smithi187 bash[23415]: audit 2024-03-11T22:24:43.096139+0000 mon.a (mon.0) 3101 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-126"}]: dispatch 2024-03-11T22:24:44.525 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:24:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:24:44.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[21434]: cluster 2024-03-11T22:24:42.382759+0000 mgr.y (mgr.14601) 629 : cluster 0 pgmap v1032: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:24:44.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[21434]: audit 2024-03-11T22:24:43.087136+0000 mon.a (mon.0) 3099 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:44.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[21434]: cluster 2024-03-11T22:24:43.093581+0000 mon.a (mon.0) 3100 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-03-11T22:24:44.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[21434]: audit 2024-03-11T22:24:43.096139+0000 mon.a (mon.0) 3101 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-126"}]: dispatch 2024-03-11T22:24:44.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[28804]: cluster 2024-03-11T22:24:42.382759+0000 mgr.y (mgr.14601) 629 : cluster 0 pgmap v1032: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:24:44.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[28804]: audit 2024-03-11T22:24:43.087136+0000 mon.a (mon.0) 3099 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:44.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[28804]: cluster 2024-03-11T22:24:43.093581+0000 mon.a (mon.0) 3100 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-03-11T22:24:44.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:44 smithi049 bash[28804]: audit 2024-03-11T22:24:43.096139+0000 mon.a (mon.0) 3101 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-126"}]: dispatch 2024-03-11T22:24:45.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:45 smithi187 bash[23415]: audit 2024-03-11T22:24:44.089898+0000 mon.a (mon.0) 3102 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-126"}]': finished 2024-03-11T22:24:45.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:45 smithi187 bash[23415]: cluster 2024-03-11T22:24:44.097134+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-03-11T22:24:45.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:45 smithi187 bash[23415]: audit 2024-03-11T22:24:44.100110+0000 mon.a (mon.0) 3104 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-126", "mode": "writeback"}]: dispatch 2024-03-11T22:24:45.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:45 smithi187 bash[23415]: cluster 2024-03-11T22:24:45.090319+0000 mon.a (mon.0) 3105 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:45.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:45 smithi187 bash[23415]: audit 2024-03-11T22:24:45.092798+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-126", "mode": "writeback"}]': finished 2024-03-11T22:24:45.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:45 smithi187 bash[23415]: cluster 2024-03-11T22:24:45.099607+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-03-11T22:24:45.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[21434]: audit 2024-03-11T22:24:44.089898+0000 mon.a (mon.0) 3102 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-126"}]': finished 2024-03-11T22:24:45.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[21434]: cluster 2024-03-11T22:24:44.097134+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-03-11T22:24:45.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[21434]: audit 2024-03-11T22:24:44.100110+0000 mon.a (mon.0) 3104 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-126", "mode": "writeback"}]: dispatch 2024-03-11T22:24:45.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[21434]: cluster 2024-03-11T22:24:45.090319+0000 mon.a (mon.0) 3105 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:45.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[21434]: audit 2024-03-11T22:24:45.092798+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-126", "mode": "writeback"}]': finished 2024-03-11T22:24:45.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[21434]: cluster 2024-03-11T22:24:45.099607+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-03-11T22:24:45.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[28804]: audit 2024-03-11T22:24:44.089898+0000 mon.a (mon.0) 3102 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-126"}]': finished 2024-03-11T22:24:45.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[28804]: cluster 2024-03-11T22:24:44.097134+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-03-11T22:24:45.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[28804]: audit 2024-03-11T22:24:44.100110+0000 mon.a (mon.0) 3104 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-126", "mode": "writeback"}]: dispatch 2024-03-11T22:24:45.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[28804]: cluster 2024-03-11T22:24:45.090319+0000 mon.a (mon.0) 3105 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:45.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[28804]: audit 2024-03-11T22:24:45.092798+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-126", "mode": "writeback"}]': finished 2024-03-11T22:24:45.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:45 smithi049 bash[28804]: cluster 2024-03-11T22:24:45.099607+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-03-11T22:24:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:46 smithi187 bash[23415]: cluster 2024-03-11T22:24:44.383656+0000 mgr.y (mgr.14601) 630 : cluster 0 pgmap v1035: 268 pgs: 268 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:46 smithi187 bash[23415]: audit 2024-03-11T22:24:45.260437+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:46 smithi187 bash[23415]: audit 2024-03-11T22:24:45.823989+0000 mon.a (mon.0) 3109 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:46.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:46 smithi187 bash[23415]: cluster 2024-03-11T22:24:45.830331+0000 mon.a (mon.0) 3110 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-03-11T22:24:46.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:46 smithi187 bash[23415]: audit 2024-03-11T22:24:45.831179+0000 mon.a (mon.0) 3111 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126"}]: dispatch 2024-03-11T22:24:46.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[28804]: cluster 2024-03-11T22:24:44.383656+0000 mgr.y (mgr.14601) 630 : cluster 0 pgmap v1035: 268 pgs: 268 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:46.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[28804]: audit 2024-03-11T22:24:45.260437+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:46.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[28804]: audit 2024-03-11T22:24:45.823989+0000 mon.a (mon.0) 3109 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:46.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[28804]: cluster 2024-03-11T22:24:45.830331+0000 mon.a (mon.0) 3110 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-03-11T22:24:46.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[28804]: audit 2024-03-11T22:24:45.831179+0000 mon.a (mon.0) 3111 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126"}]: dispatch 2024-03-11T22:24:46.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[21434]: cluster 2024-03-11T22:24:44.383656+0000 mgr.y (mgr.14601) 630 : cluster 0 pgmap v1035: 268 pgs: 268 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:46.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[21434]: audit 2024-03-11T22:24:45.260437+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:46.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[21434]: audit 2024-03-11T22:24:45.823989+0000 mon.a (mon.0) 3109 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:24:46.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[21434]: cluster 2024-03-11T22:24:45.830331+0000 mon.a (mon.0) 3110 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-03-11T22:24:46.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:46 smithi049 bash[21434]: audit 2024-03-11T22:24:45.831179+0000 mon.a (mon.0) 3111 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126"}]: dispatch 2024-03-11T22:24:47.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:47 smithi187 bash[23415]: cluster 2024-03-11T22:24:46.824265+0000 mon.a (mon.0) 3112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:47.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:47 smithi187 bash[23415]: audit 2024-03-11T22:24:46.826611+0000 mon.a (mon.0) 3113 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126"}]': finished 2024-03-11T22:24:47.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:47 smithi187 bash[23415]: cluster 2024-03-11T22:24:46.833689+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-03-11T22:24:47.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:47 smithi049 bash[21434]: cluster 2024-03-11T22:24:46.824265+0000 mon.a (mon.0) 3112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:47.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:47 smithi049 bash[21434]: audit 2024-03-11T22:24:46.826611+0000 mon.a (mon.0) 3113 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126"}]': finished 2024-03-11T22:24:47.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:47 smithi049 bash[21434]: cluster 2024-03-11T22:24:46.833689+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-03-11T22:24:47.525 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:47 smithi049 bash[28804]: cluster 2024-03-11T22:24:46.824265+0000 mon.a (mon.0) 3112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:24:47.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:47 smithi049 bash[28804]: audit 2024-03-11T22:24:46.826611+0000 mon.a (mon.0) 3113 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-126"}]': finished 2024-03-11T22:24:47.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:47 smithi049 bash[28804]: cluster 2024-03-11T22:24:46.833689+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-03-11T22:24:47.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:24:47.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9036 ms) 2024-03-11T22:24:47.836 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6083 ms) 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5060 ms) 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25240 ms) 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14060 ms) 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12112 ms) 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-03-11T22:24:47.837 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: 00000010 69 73 |is| 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: 00000012 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12089 ms) 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: require_osd_release = squid 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6070 ms) 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (566353 ms total) 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1308 ms) 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10831 ms) 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-03-11T22:24:47.838 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18142 ms) 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (3 ms) 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30284 ms total) 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7067 ms) 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8090 ms) 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: waiting for scrub... 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: done waiting 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (25063 ms) 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-03-11T22:24:47.839 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9156 ms) 2024-03-11T22:24:47.840 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-03-11T22:24:47.840 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (7998 ms) 2024-03-11T22:24:47.840 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-03-11T22:24:47.840 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8081 ms) 2024-03-11T22:24:47.840 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-03-11T22:24:47.840 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10109 ms) 2024-03-11T22:24:47.840 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-03-11T22:24:48.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:48 smithi187 bash[23415]: cluster 2024-03-11T22:24:46.384569+0000 mgr.y (mgr.14601) 631 : cluster 0 pgmap v1038: 268 pgs: 268 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:48.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:48 smithi187 bash[23415]: cluster 2024-03-11T22:24:47.839469+0000 mon.a (mon.0) 3115 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-03-11T22:24:48.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:48 smithi049 bash[21434]: cluster 2024-03-11T22:24:46.384569+0000 mgr.y (mgr.14601) 631 : cluster 0 pgmap v1038: 268 pgs: 268 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:48.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:48 smithi049 bash[21434]: cluster 2024-03-11T22:24:47.839469+0000 mon.a (mon.0) 3115 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-03-11T22:24:48.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:48 smithi049 bash[28804]: cluster 2024-03-11T22:24:46.384569+0000 mgr.y (mgr.14601) 631 : cluster 0 pgmap v1038: 268 pgs: 268 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:48.775 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:48 smithi049 bash[28804]: cluster 2024-03-11T22:24:47.839469+0000 mon.a (mon.0) 3115 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-03-11T22:24:49.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:24:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:24:50.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:49 smithi187 bash[23415]: cluster 2024-03-11T22:24:48.386875+0000 mgr.y (mgr.14601) 632 : cluster 0 pgmap v1041: 236 pgs: 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:50.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:49 smithi187 bash[23415]: cluster 2024-03-11T22:24:48.839361+0000 mon.a (mon.0) 3116 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-03-11T22:24:50.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:49 smithi187 bash[23415]: audit 2024-03-11T22:24:48.847514+0000 mon.a (mon.0) 3117 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:49 smithi049 bash[28804]: cluster 2024-03-11T22:24:48.386875+0000 mgr.y (mgr.14601) 632 : cluster 0 pgmap v1041: 236 pgs: 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:49 smithi049 bash[28804]: cluster 2024-03-11T22:24:48.839361+0000 mon.a (mon.0) 3116 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-03-11T22:24:50.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:49 smithi049 bash[28804]: audit 2024-03-11T22:24:48.847514+0000 mon.a (mon.0) 3117 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:50.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:49 smithi049 bash[21434]: cluster 2024-03-11T22:24:48.386875+0000 mgr.y (mgr.14601) 632 : cluster 0 pgmap v1041: 236 pgs: 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:24:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:49 smithi049 bash[21434]: cluster 2024-03-11T22:24:48.839361+0000 mon.a (mon.0) 3116 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-03-11T22:24:50.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:49 smithi049 bash[21434]: audit 2024-03-11T22:24:48.847514+0000 mon.a (mon.0) 3117 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:24:51.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:50 smithi187 bash[23415]: audit 2024-03-11T22:24:49.235005+0000 mgr.y (mgr.14601) 633 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:51.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:50 smithi187 bash[23415]: audit 2024-03-11T22:24:49.836185+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:51.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:50 smithi187 bash[23415]: cluster 2024-03-11T22:24:49.843892+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-03-11T22:24:51.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:50 smithi187 bash[23415]: audit 2024-03-11T22:24:49.851643+0000 mon.a (mon.0) 3120 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:51.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:50 smithi187 bash[23415]: audit 2024-03-11T22:24:50.839134+0000 mon.a (mon.0) 3121 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:51.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:50 smithi187 bash[23415]: cluster 2024-03-11T22:24:50.847895+0000 mon.a (mon.0) 3122 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-03-11T22:24:51.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:50 smithi187 bash[23415]: audit 2024-03-11T22:24:50.850851+0000 mon.a (mon.0) 3123 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-128"}]: dispatch 2024-03-11T22:24:51.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[21434]: audit 2024-03-11T22:24:49.235005+0000 mgr.y (mgr.14601) 633 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:51.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[21434]: audit 2024-03-11T22:24:49.836185+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:51.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[21434]: cluster 2024-03-11T22:24:49.843892+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-03-11T22:24:51.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[21434]: audit 2024-03-11T22:24:49.851643+0000 mon.a (mon.0) 3120 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:51.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[21434]: audit 2024-03-11T22:24:50.839134+0000 mon.a (mon.0) 3121 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:51.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[21434]: cluster 2024-03-11T22:24:50.847895+0000 mon.a (mon.0) 3122 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-03-11T22:24:51.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[21434]: audit 2024-03-11T22:24:50.850851+0000 mon.a (mon.0) 3123 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-128"}]: dispatch 2024-03-11T22:24:51.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[28804]: audit 2024-03-11T22:24:49.235005+0000 mgr.y (mgr.14601) 633 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:24:51.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[28804]: audit 2024-03-11T22:24:49.836185+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:24:51.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[28804]: cluster 2024-03-11T22:24:49.843892+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-03-11T22:24:51.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[28804]: audit 2024-03-11T22:24:49.851643+0000 mon.a (mon.0) 3120 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:24:51.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[28804]: audit 2024-03-11T22:24:50.839134+0000 mon.a (mon.0) 3121 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:24:51.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[28804]: cluster 2024-03-11T22:24:50.847895+0000 mon.a (mon.0) 3122 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-03-11T22:24:51.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:50 smithi049 bash[28804]: audit 2024-03-11T22:24:50.850851+0000 mon.a (mon.0) 3123 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-128"}]: dispatch 2024-03-11T22:24:52.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:51 smithi187 bash[23415]: cluster 2024-03-11T22:24:50.387842+0000 mgr.y (mgr.14601) 634 : cluster 0 pgmap v1044: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:52.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:51 smithi187 bash[23415]: audit 2024-03-11T22:24:51.842037+0000 mon.a (mon.0) 3124 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-128"}]': finished 2024-03-11T22:24:52.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:51 smithi187 bash[23415]: cluster 2024-03-11T22:24:51.849603+0000 mon.a (mon.0) 3125 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-03-11T22:24:52.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:51 smithi187 bash[23415]: audit 2024-03-11T22:24:51.851670+0000 mon.a (mon.0) 3126 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-128", "mode": "writeback"}]: dispatch 2024-03-11T22:24:52.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[28804]: cluster 2024-03-11T22:24:50.387842+0000 mgr.y (mgr.14601) 634 : cluster 0 pgmap v1044: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:52.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[28804]: audit 2024-03-11T22:24:51.842037+0000 mon.a (mon.0) 3124 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-128"}]': finished 2024-03-11T22:24:52.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[28804]: cluster 2024-03-11T22:24:51.849603+0000 mon.a (mon.0) 3125 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-03-11T22:24:52.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[28804]: audit 2024-03-11T22:24:51.851670+0000 mon.a (mon.0) 3126 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-128", "mode": "writeback"}]: dispatch 2024-03-11T22:24:52.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[21434]: cluster 2024-03-11T22:24:50.387842+0000 mgr.y (mgr.14601) 634 : cluster 0 pgmap v1044: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:24:52.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[21434]: audit 2024-03-11T22:24:51.842037+0000 mon.a (mon.0) 3124 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-128"}]': finished 2024-03-11T22:24:52.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[21434]: cluster 2024-03-11T22:24:51.849603+0000 mon.a (mon.0) 3125 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-03-11T22:24:52.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:51 smithi049 bash[21434]: audit 2024-03-11T22:24:51.851670+0000 mon.a (mon.0) 3126 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-128", "mode": "writeback"}]: dispatch 2024-03-11T22:24:53.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:52 smithi187 bash[23415]: cluster 2024-03-11T22:24:52.842599+0000 mon.a (mon.0) 3127 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:53.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:52 smithi187 bash[23415]: audit 2024-03-11T22:24:52.845165+0000 mon.a (mon.0) 3128 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-128", "mode": "writeback"}]': finished 2024-03-11T22:24:53.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:52 smithi187 bash[23415]: cluster 2024-03-11T22:24:52.851965+0000 mon.a (mon.0) 3129 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-03-11T22:24:53.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:52 smithi049 bash[21434]: cluster 2024-03-11T22:24:52.842599+0000 mon.a (mon.0) 3127 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:53.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:52 smithi049 bash[21434]: audit 2024-03-11T22:24:52.845165+0000 mon.a (mon.0) 3128 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-128", "mode": "writeback"}]': finished 2024-03-11T22:24:53.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:52 smithi049 bash[21434]: cluster 2024-03-11T22:24:52.851965+0000 mon.a (mon.0) 3129 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-03-11T22:24:53.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:52 smithi049 bash[28804]: cluster 2024-03-11T22:24:52.842599+0000 mon.a (mon.0) 3127 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:24:53.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:52 smithi049 bash[28804]: audit 2024-03-11T22:24:52.845165+0000 mon.a (mon.0) 3128 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-128", "mode": "writeback"}]': finished 2024-03-11T22:24:53.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:52 smithi049 bash[28804]: cluster 2024-03-11T22:24:52.851965+0000 mon.a (mon.0) 3129 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-03-11T22:24:54.230 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:53 smithi049 bash[28804]: cluster 2024-03-11T22:24:52.388759+0000 mgr.y (mgr.14601) 635 : cluster 0 pgmap v1047: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-11T22:24:54.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:53 smithi049 bash[21434]: cluster 2024-03-11T22:24:52.388759+0000 mgr.y (mgr.14601) 635 : cluster 0 pgmap v1047: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-11T22:24:54.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:53 smithi187 bash[23415]: cluster 2024-03-11T22:24:52.388759+0000 mgr.y (mgr.14601) 635 : cluster 0 pgmap v1047: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-11T22:24:54.525 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:24:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:24:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:24:56.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:55 smithi187 bash[23415]: cluster 2024-03-11T22:24:54.391322+0000 mgr.y (mgr.14601) 636 : cluster 0 pgmap v1049: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 450 B/s wr, 1 op/s 2024-03-11T22:24:56.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:55 smithi049 bash[21434]: cluster 2024-03-11T22:24:54.391322+0000 mgr.y (mgr.14601) 636 : cluster 0 pgmap v1049: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 450 B/s wr, 1 op/s 2024-03-11T22:24:56.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:55 smithi049 bash[28804]: cluster 2024-03-11T22:24:54.391322+0000 mgr.y (mgr.14601) 636 : cluster 0 pgmap v1049: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 450 B/s wr, 1 op/s 2024-03-11T22:24:58.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:57 smithi187 bash[23415]: cluster 2024-03-11T22:24:56.392230+0000 mgr.y (mgr.14601) 637 : cluster 0 pgmap v1050: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-03-11T22:24:58.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:57 smithi187 bash[23415]: audit 2024-03-11T22:24:56.841553+0000 mon.a (mon.0) 3130 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:58.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:57 smithi187 bash[23415]: audit 2024-03-11T22:24:56.844554+0000 mon.c (mon.2) 651 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:58.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:57 smithi049 bash[28804]: cluster 2024-03-11T22:24:56.392230+0000 mgr.y (mgr.14601) 637 : cluster 0 pgmap v1050: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-03-11T22:24:58.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:57 smithi049 bash[28804]: audit 2024-03-11T22:24:56.841553+0000 mon.a (mon.0) 3130 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:58.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:57 smithi049 bash[28804]: audit 2024-03-11T22:24:56.844554+0000 mon.c (mon.2) 651 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:58.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:57 smithi049 bash[21434]: cluster 2024-03-11T22:24:56.392230+0000 mgr.y (mgr.14601) 637 : cluster 0 pgmap v1050: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-03-11T22:24:58.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:57 smithi049 bash[21434]: audit 2024-03-11T22:24:56.841553+0000 mon.a (mon.0) 3130 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:24:58.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:57 smithi049 bash[21434]: audit 2024-03-11T22:24:56.844554+0000 mon.c (mon.2) 651 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:24:59.242 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:58 smithi187 bash[23415]: audit 2024-03-11T22:24:58.016767+0000 mon.a (mon.0) 3131 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:59.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:58 smithi049 bash[21434]: audit 2024-03-11T22:24:58.016767+0000 mon.a (mon.0) 3131 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:59.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:58 smithi049 bash[28804]: audit 2024-03-11T22:24:58.016767+0000 mon.a (mon.0) 3131 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:24:59.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:24:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:25:00.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:59 smithi187 bash[23415]: cluster 2024-03-11T22:24:58.393446+0000 mgr.y (mgr.14601) 638 : cluster 0 pgmap v1051: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 271 B/s wr, 1 op/s 2024-03-11T22:25:00.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:59 smithi187 bash[23415]: audit 2024-03-11T22:24:58.848500+0000 mon.a (mon.0) 3132 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:00.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:59 smithi187 bash[23415]: cluster 2024-03-11T22:24:58.856362+0000 mon.a (mon.0) 3133 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-03-11T22:25:00.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:24:59 smithi187 bash[23415]: audit 2024-03-11T22:24:58.857809+0000 mon.a (mon.0) 3134 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128"}]: dispatch 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[21434]: cluster 2024-03-11T22:24:58.393446+0000 mgr.y (mgr.14601) 638 : cluster 0 pgmap v1051: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 271 B/s wr, 1 op/s 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[21434]: audit 2024-03-11T22:24:58.848500+0000 mon.a (mon.0) 3132 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[21434]: cluster 2024-03-11T22:24:58.856362+0000 mon.a (mon.0) 3133 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[21434]: audit 2024-03-11T22:24:58.857809+0000 mon.a (mon.0) 3134 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128"}]: dispatch 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[28804]: cluster 2024-03-11T22:24:58.393446+0000 mgr.y (mgr.14601) 638 : cluster 0 pgmap v1051: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 271 B/s wr, 1 op/s 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[28804]: audit 2024-03-11T22:24:58.848500+0000 mon.a (mon.0) 3132 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[28804]: cluster 2024-03-11T22:24:58.856362+0000 mon.a (mon.0) 3133 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-03-11T22:25:00.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:24:59 smithi049 bash[28804]: audit 2024-03-11T22:24:58.857809+0000 mon.a (mon.0) 3134 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128"}]: dispatch 2024-03-11T22:25:01.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:00 smithi187 bash[23415]: audit 2024-03-11T22:24:59.246117+0000 mgr.y (mgr.14601) 639 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:01.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:00 smithi187 bash[23415]: cluster 2024-03-11T22:24:59.848942+0000 mon.a (mon.0) 3135 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:01.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:00 smithi187 bash[23415]: audit 2024-03-11T22:24:59.851117+0000 mon.a (mon.0) 3136 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128"}]': finished 2024-03-11T22:25:01.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:00 smithi187 bash[23415]: cluster 2024-03-11T22:24:59.857729+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-03-11T22:25:01.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[21434]: audit 2024-03-11T22:24:59.246117+0000 mgr.y (mgr.14601) 639 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:01.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[21434]: cluster 2024-03-11T22:24:59.848942+0000 mon.a (mon.0) 3135 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:01.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[21434]: audit 2024-03-11T22:24:59.851117+0000 mon.a (mon.0) 3136 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128"}]': finished 2024-03-11T22:25:01.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[21434]: cluster 2024-03-11T22:24:59.857729+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-03-11T22:25:01.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[28804]: audit 2024-03-11T22:24:59.246117+0000 mgr.y (mgr.14601) 639 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:01.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[28804]: cluster 2024-03-11T22:24:59.848942+0000 mon.a (mon.0) 3135 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:01.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[28804]: audit 2024-03-11T22:24:59.851117+0000 mon.a (mon.0) 3136 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-128"}]': finished 2024-03-11T22:25:01.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:00 smithi049 bash[28804]: cluster 2024-03-11T22:24:59.857729+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-03-11T22:25:01.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:01 smithi187 bash[23415]: cluster 2024-03-11T22:25:00.394313+0000 mgr.y (mgr.14601) 640 : cluster 0 pgmap v1054: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 271 B/s wr, 1 op/s 2024-03-11T22:25:01.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:01 smithi187 bash[23415]: cluster 2024-03-11T22:25:00.862521+0000 mon.a (mon.0) 3138 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:01.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:01 smithi187 bash[23415]: cluster 2024-03-11T22:25:00.881235+0000 mon.a (mon.0) 3139 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-03-11T22:25:02.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:01 smithi049 bash[28804]: cluster 2024-03-11T22:25:00.394313+0000 mgr.y (mgr.14601) 640 : cluster 0 pgmap v1054: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 271 B/s wr, 1 op/s 2024-03-11T22:25:02.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:01 smithi049 bash[28804]: cluster 2024-03-11T22:25:00.862521+0000 mon.a (mon.0) 3138 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:02.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:01 smithi049 bash[28804]: cluster 2024-03-11T22:25:00.881235+0000 mon.a (mon.0) 3139 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-03-11T22:25:02.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:01 smithi049 bash[21434]: cluster 2024-03-11T22:25:00.394313+0000 mgr.y (mgr.14601) 640 : cluster 0 pgmap v1054: 268 pgs: 268 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 271 B/s wr, 1 op/s 2024-03-11T22:25:02.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:01 smithi049 bash[21434]: cluster 2024-03-11T22:25:00.862521+0000 mon.a (mon.0) 3138 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:02.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:01 smithi049 bash[21434]: cluster 2024-03-11T22:25:00.881235+0000 mon.a (mon.0) 3139 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-03-11T22:25:03.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:02 smithi187 bash[23415]: cluster 2024-03-11T22:25:01.881909+0000 mon.a (mon.0) 3140 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-03-11T22:25:03.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:02 smithi187 bash[23415]: audit 2024-03-11T22:25:01.885356+0000 mon.a (mon.0) 3141 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:03.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:02 smithi049 bash[21434]: cluster 2024-03-11T22:25:01.881909+0000 mon.a (mon.0) 3140 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-03-11T22:25:03.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:02 smithi049 bash[21434]: audit 2024-03-11T22:25:01.885356+0000 mon.a (mon.0) 3141 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:03.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:02 smithi049 bash[28804]: cluster 2024-03-11T22:25:01.881909+0000 mon.a (mon.0) 3140 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-03-11T22:25:03.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:02 smithi049 bash[28804]: audit 2024-03-11T22:25:01.885356+0000 mon.a (mon.0) 3141 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[21434]: cluster 2024-03-11T22:25:02.395339+0000 mgr.y (mgr.14601) 641 : cluster 0 pgmap v1057: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[21434]: audit 2024-03-11T22:25:02.887492+0000 mon.a (mon.0) 3142 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[21434]: cluster 2024-03-11T22:25:02.900237+0000 mon.a (mon.0) 3143 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[21434]: audit 2024-03-11T22:25:02.907198+0000 mon.a (mon.0) 3144 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[28804]: cluster 2024-03-11T22:25:02.395339+0000 mgr.y (mgr.14601) 641 : cluster 0 pgmap v1057: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[28804]: audit 2024-03-11T22:25:02.887492+0000 mon.a (mon.0) 3142 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[28804]: cluster 2024-03-11T22:25:02.900237+0000 mon.a (mon.0) 3143 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-03-11T22:25:04.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:03 smithi049 bash[28804]: audit 2024-03-11T22:25:02.907198+0000 mon.a (mon.0) 3144 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:04.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:03 smithi187 bash[23415]: cluster 2024-03-11T22:25:02.395339+0000 mgr.y (mgr.14601) 641 : cluster 0 pgmap v1057: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:04.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:03 smithi187 bash[23415]: audit 2024-03-11T22:25:02.887492+0000 mon.a (mon.0) 3142 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:04.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:03 smithi187 bash[23415]: cluster 2024-03-11T22:25:02.900237+0000 mon.a (mon.0) 3143 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-03-11T22:25:04.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:03 smithi187 bash[23415]: audit 2024-03-11T22:25:02.907198+0000 mon.a (mon.0) 3144 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:04.525 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:25:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:25:05.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:04 smithi187 bash[23415]: audit 2024-03-11T22:25:03.890259+0000 mon.a (mon.0) 3145 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:05.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:04 smithi187 bash[23415]: cluster 2024-03-11T22:25:03.896754+0000 mon.a (mon.0) 3146 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-03-11T22:25:05.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:04 smithi187 bash[23415]: audit 2024-03-11T22:25:03.898054+0000 mon.a (mon.0) 3147 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-130"}]: dispatch 2024-03-11T22:25:05.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:04 smithi187 bash[23415]: audit 2024-03-11T22:25:04.892923+0000 mon.a (mon.0) 3148 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-130"}]': finished 2024-03-11T22:25:05.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[21434]: audit 2024-03-11T22:25:03.890259+0000 mon.a (mon.0) 3145 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:05.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[21434]: cluster 2024-03-11T22:25:03.896754+0000 mon.a (mon.0) 3146 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-03-11T22:25:05.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[21434]: audit 2024-03-11T22:25:03.898054+0000 mon.a (mon.0) 3147 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-130"}]: dispatch 2024-03-11T22:25:05.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[21434]: audit 2024-03-11T22:25:04.892923+0000 mon.a (mon.0) 3148 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-130"}]': finished 2024-03-11T22:25:05.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[28804]: audit 2024-03-11T22:25:03.890259+0000 mon.a (mon.0) 3145 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:05.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[28804]: cluster 2024-03-11T22:25:03.896754+0000 mon.a (mon.0) 3146 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-03-11T22:25:05.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[28804]: audit 2024-03-11T22:25:03.898054+0000 mon.a (mon.0) 3147 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-130"}]: dispatch 2024-03-11T22:25:05.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:04 smithi049 bash[28804]: audit 2024-03-11T22:25:04.892923+0000 mon.a (mon.0) 3148 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-130"}]': finished 2024-03-11T22:25:06.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:05 smithi187 bash[23415]: cluster 2024-03-11T22:25:04.396267+0000 mgr.y (mgr.14601) 642 : cluster 0 pgmap v1060: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:25:06.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:05 smithi187 bash[23415]: cluster 2024-03-11T22:25:04.901052+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-03-11T22:25:06.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:05 smithi187 bash[23415]: audit 2024-03-11T22:25:04.903512+0000 mon.a (mon.0) 3150 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-130", "mode": "writeback"}]: dispatch 2024-03-11T22:25:06.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:05 smithi187 bash[23415]: cluster 2024-03-11T22:25:05.893205+0000 mon.a (mon.0) 3151 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:06.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:05 smithi187 bash[23415]: audit 2024-03-11T22:25:05.895673+0000 mon.a (mon.0) 3152 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-130", "mode": "writeback"}]': finished 2024-03-11T22:25:06.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:05 smithi187 bash[23415]: cluster 2024-03-11T22:25:05.902508+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-03-11T22:25:06.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[28804]: cluster 2024-03-11T22:25:04.396267+0000 mgr.y (mgr.14601) 642 : cluster 0 pgmap v1060: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[28804]: cluster 2024-03-11T22:25:04.901052+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[28804]: audit 2024-03-11T22:25:04.903512+0000 mon.a (mon.0) 3150 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-130", "mode": "writeback"}]: dispatch 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[28804]: cluster 2024-03-11T22:25:05.893205+0000 mon.a (mon.0) 3151 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[28804]: audit 2024-03-11T22:25:05.895673+0000 mon.a (mon.0) 3152 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-130", "mode": "writeback"}]': finished 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[28804]: cluster 2024-03-11T22:25:05.902508+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[21434]: cluster 2024-03-11T22:25:04.396267+0000 mgr.y (mgr.14601) 642 : cluster 0 pgmap v1060: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[21434]: cluster 2024-03-11T22:25:04.901052+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[21434]: audit 2024-03-11T22:25:04.903512+0000 mon.a (mon.0) 3150 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-130", "mode": "writeback"}]: dispatch 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[21434]: cluster 2024-03-11T22:25:05.893205+0000 mon.a (mon.0) 3151 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[21434]: audit 2024-03-11T22:25:05.895673+0000 mon.a (mon.0) 3152 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-130", "mode": "writeback"}]': finished 2024-03-11T22:25:06.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:05 smithi049 bash[21434]: cluster 2024-03-11T22:25:05.902508+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-03-11T22:25:07.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:06 smithi187 bash[23415]: audit 2024-03-11T22:25:06.116575+0000 mon.a (mon.0) 3154 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:07.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:06 smithi049 bash[21434]: audit 2024-03-11T22:25:06.116575+0000 mon.a (mon.0) 3154 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:07.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:06 smithi049 bash[28804]: audit 2024-03-11T22:25:06.116575+0000 mon.a (mon.0) 3154 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:08.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:07 smithi187 bash[23415]: cluster 2024-03-11T22:25:06.397194+0000 mgr.y (mgr.14601) 643 : cluster 0 pgmap v1063: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:08.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:07 smithi187 bash[23415]: audit 2024-03-11T22:25:06.925823+0000 mon.a (mon.0) 3155 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:08.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:07 smithi187 bash[23415]: cluster 2024-03-11T22:25:06.932730+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-03-11T22:25:08.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:07 smithi187 bash[23415]: audit 2024-03-11T22:25:06.934610+0000 mon.a (mon.0) 3157 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130"}]: dispatch 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[21434]: cluster 2024-03-11T22:25:06.397194+0000 mgr.y (mgr.14601) 643 : cluster 0 pgmap v1063: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[21434]: audit 2024-03-11T22:25:06.925823+0000 mon.a (mon.0) 3155 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[21434]: cluster 2024-03-11T22:25:06.932730+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[21434]: audit 2024-03-11T22:25:06.934610+0000 mon.a (mon.0) 3157 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130"}]: dispatch 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[28804]: cluster 2024-03-11T22:25:06.397194+0000 mgr.y (mgr.14601) 643 : cluster 0 pgmap v1063: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[28804]: audit 2024-03-11T22:25:06.925823+0000 mon.a (mon.0) 3155 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[28804]: cluster 2024-03-11T22:25:06.932730+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-03-11T22:25:08.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:07 smithi049 bash[28804]: audit 2024-03-11T22:25:06.934610+0000 mon.a (mon.0) 3157 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130"}]: dispatch 2024-03-11T22:25:09.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:08 smithi187 bash[23415]: cluster 2024-03-11T22:25:07.926400+0000 mon.a (mon.0) 3158 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:09.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:08 smithi187 bash[23415]: audit 2024-03-11T22:25:07.928814+0000 mon.a (mon.0) 3159 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130"}]': finished 2024-03-11T22:25:09.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:08 smithi187 bash[23415]: cluster 2024-03-11T22:25:07.935525+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-03-11T22:25:09.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:08 smithi049 bash[28804]: cluster 2024-03-11T22:25:07.926400+0000 mon.a (mon.0) 3158 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:09.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:08 smithi049 bash[28804]: audit 2024-03-11T22:25:07.928814+0000 mon.a (mon.0) 3159 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130"}]': finished 2024-03-11T22:25:09.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:08 smithi049 bash[28804]: cluster 2024-03-11T22:25:07.935525+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-03-11T22:25:09.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:08 smithi049 bash[21434]: cluster 2024-03-11T22:25:07.926400+0000 mon.a (mon.0) 3158 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:09.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:08 smithi049 bash[21434]: audit 2024-03-11T22:25:07.928814+0000 mon.a (mon.0) 3159 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-130"}]': finished 2024-03-11T22:25:09.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:08 smithi049 bash[21434]: cluster 2024-03-11T22:25:07.935525+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-03-11T22:25:09.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:25:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:25:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:09 smithi187 bash[23415]: cluster 2024-03-11T22:25:08.398362+0000 mgr.y (mgr.14601) 644 : cluster 0 pgmap v1066: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:09 smithi187 bash[23415]: cluster 2024-03-11T22:25:08.940833+0000 mon.a (mon.0) 3161 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:10.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:09 smithi187 bash[23415]: cluster 2024-03-11T22:25:08.958692+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-03-11T22:25:10.275 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:09 smithi049 bash[28804]: cluster 2024-03-11T22:25:08.398362+0000 mgr.y (mgr.14601) 644 : cluster 0 pgmap v1066: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:10.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:09 smithi049 bash[28804]: cluster 2024-03-11T22:25:08.940833+0000 mon.a (mon.0) 3161 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:10.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:09 smithi049 bash[28804]: cluster 2024-03-11T22:25:08.958692+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-03-11T22:25:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:09 smithi049 bash[21434]: cluster 2024-03-11T22:25:08.398362+0000 mgr.y (mgr.14601) 644 : cluster 0 pgmap v1066: 268 pgs: 268 active+clean; 582 KiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:09 smithi049 bash[21434]: cluster 2024-03-11T22:25:08.940833+0000 mon.a (mon.0) 3161 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:10.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:09 smithi049 bash[21434]: cluster 2024-03-11T22:25:08.958692+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-03-11T22:25:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:10 smithi187 bash[23415]: audit 2024-03-11T22:25:09.256020+0000 mgr.y (mgr.14601) 645 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:10 smithi187 bash[23415]: cluster 2024-03-11T22:25:09.962545+0000 mon.a (mon.0) 3163 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-03-11T22:25:11.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:10 smithi187 bash[23415]: audit 2024-03-11T22:25:09.973556+0000 mon.a (mon.0) 3164 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:11.275 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:10 smithi049 bash[21434]: audit 2024-03-11T22:25:09.256020+0000 mgr.y (mgr.14601) 645 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:11.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:10 smithi049 bash[21434]: cluster 2024-03-11T22:25:09.962545+0000 mon.a (mon.0) 3163 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-03-11T22:25:11.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:10 smithi049 bash[21434]: audit 2024-03-11T22:25:09.973556+0000 mon.a (mon.0) 3164 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:11.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:10 smithi049 bash[28804]: audit 2024-03-11T22:25:09.256020+0000 mgr.y (mgr.14601) 645 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:11.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:10 smithi049 bash[28804]: cluster 2024-03-11T22:25:09.962545+0000 mon.a (mon.0) 3163 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-03-11T22:25:11.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:10 smithi049 bash[28804]: audit 2024-03-11T22:25:09.973556+0000 mon.a (mon.0) 3164 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:12.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:11 smithi187 bash[23415]: cluster 2024-03-11T22:25:10.399287+0000 mgr.y (mgr.14601) 646 : cluster 0 pgmap v1069: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:25:12.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:11 smithi187 bash[23415]: audit 2024-03-11T22:25:10.967778+0000 mon.a (mon.0) 3165 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:12.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:11 smithi187 bash[23415]: cluster 2024-03-11T22:25:10.977022+0000 mon.a (mon.0) 3166 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-03-11T22:25:12.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:11 smithi187 bash[23415]: audit 2024-03-11T22:25:10.981409+0000 mon.a (mon.0) 3167 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:12.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:11 smithi187 bash[23415]: audit 2024-03-11T22:25:11.887132+0000 mon.a (mon.0) 3168 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:12.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:11 smithi187 bash[23415]: audit 2024-03-11T22:25:11.890717+0000 mon.c (mon.2) 652 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[21434]: cluster 2024-03-11T22:25:10.399287+0000 mgr.y (mgr.14601) 646 : cluster 0 pgmap v1069: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[21434]: audit 2024-03-11T22:25:10.967778+0000 mon.a (mon.0) 3165 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[21434]: cluster 2024-03-11T22:25:10.977022+0000 mon.a (mon.0) 3166 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[21434]: audit 2024-03-11T22:25:10.981409+0000 mon.a (mon.0) 3167 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[21434]: audit 2024-03-11T22:25:11.887132+0000 mon.a (mon.0) 3168 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[21434]: audit 2024-03-11T22:25:11.890717+0000 mon.c (mon.2) 652 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[28804]: cluster 2024-03-11T22:25:10.399287+0000 mgr.y (mgr.14601) 646 : cluster 0 pgmap v1069: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[28804]: audit 2024-03-11T22:25:10.967778+0000 mon.a (mon.0) 3165 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:12.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[28804]: cluster 2024-03-11T22:25:10.977022+0000 mon.a (mon.0) 3166 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-03-11T22:25:12.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[28804]: audit 2024-03-11T22:25:10.981409+0000 mon.a (mon.0) 3167 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:12.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[28804]: audit 2024-03-11T22:25:11.887132+0000 mon.a (mon.0) 3168 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:12.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:11 smithi049 bash[28804]: audit 2024-03-11T22:25:11.890717+0000 mon.c (mon.2) 652 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:13.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:12 smithi187 bash[23415]: audit 2024-03-11T22:25:11.970361+0000 mon.a (mon.0) 3169 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:13.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:12 smithi187 bash[23415]: cluster 2024-03-11T22:25:11.978349+0000 mon.a (mon.0) 3170 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-03-11T22:25:13.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:12 smithi187 bash[23415]: audit 2024-03-11T22:25:11.980869+0000 mon.a (mon.0) 3171 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:13.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:12 smithi187 bash[23415]: audit 2024-03-11T22:25:12.973002+0000 mon.a (mon.0) 3172 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:13.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:12 smithi187 bash[23415]: cluster 2024-03-11T22:25:12.979529+0000 mon.a (mon.0) 3173 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-03-11T22:25:13.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:12 smithi187 bash[23415]: audit 2024-03-11T22:25:12.981012+0000 mon.a (mon.0) 3174 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-132", "mode": "writeback"}]: dispatch 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[21434]: audit 2024-03-11T22:25:11.970361+0000 mon.a (mon.0) 3169 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[21434]: cluster 2024-03-11T22:25:11.978349+0000 mon.a (mon.0) 3170 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[21434]: audit 2024-03-11T22:25:11.980869+0000 mon.a (mon.0) 3171 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[21434]: audit 2024-03-11T22:25:12.973002+0000 mon.a (mon.0) 3172 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[21434]: cluster 2024-03-11T22:25:12.979529+0000 mon.a (mon.0) 3173 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[21434]: audit 2024-03-11T22:25:12.981012+0000 mon.a (mon.0) 3174 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-132", "mode": "writeback"}]: dispatch 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[28804]: audit 2024-03-11T22:25:11.970361+0000 mon.a (mon.0) 3169 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[28804]: cluster 2024-03-11T22:25:11.978349+0000 mon.a (mon.0) 3170 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[28804]: audit 2024-03-11T22:25:11.980869+0000 mon.a (mon.0) 3171 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:13.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[28804]: audit 2024-03-11T22:25:12.973002+0000 mon.a (mon.0) 3172 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:13.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[28804]: cluster 2024-03-11T22:25:12.979529+0000 mon.a (mon.0) 3173 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-03-11T22:25:13.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:12 smithi049 bash[28804]: audit 2024-03-11T22:25:12.981012+0000 mon.a (mon.0) 3174 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-132", "mode": "writeback"}]: dispatch 2024-03-11T22:25:14.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:13 smithi187 bash[23415]: cluster 2024-03-11T22:25:12.400218+0000 mgr.y (mgr.14601) 647 : cluster 0 pgmap v1072: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-03-11T22:25:14.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:13 smithi187 bash[23415]: cluster 2024-03-11T22:25:13.973420+0000 mon.a (mon.0) 3175 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:14.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:13 smithi187 bash[23415]: audit 2024-03-11T22:25:13.975927+0000 mon.a (mon.0) 3176 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-132", "mode": "writeback"}]': finished 2024-03-11T22:25:14.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:13 smithi187 bash[23415]: cluster 2024-03-11T22:25:13.983359+0000 mon.a (mon.0) 3177 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-03-11T22:25:14.275 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:25:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:25:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[21434]: cluster 2024-03-11T22:25:12.400218+0000 mgr.y (mgr.14601) 647 : cluster 0 pgmap v1072: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[21434]: cluster 2024-03-11T22:25:13.973420+0000 mon.a (mon.0) 3175 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[21434]: audit 2024-03-11T22:25:13.975927+0000 mon.a (mon.0) 3176 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-132", "mode": "writeback"}]': finished 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[21434]: cluster 2024-03-11T22:25:13.983359+0000 mon.a (mon.0) 3177 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[28804]: cluster 2024-03-11T22:25:12.400218+0000 mgr.y (mgr.14601) 647 : cluster 0 pgmap v1072: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 618 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[28804]: cluster 2024-03-11T22:25:13.973420+0000 mon.a (mon.0) 3175 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[28804]: audit 2024-03-11T22:25:13.975927+0000 mon.a (mon.0) 3176 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-132", "mode": "writeback"}]': finished 2024-03-11T22:25:14.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:13 smithi049 bash[28804]: cluster 2024-03-11T22:25:13.983359+0000 mon.a (mon.0) 3177 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-03-11T22:25:16.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:16 smithi049 bash[21434]: cluster 2024-03-11T22:25:14.401145+0000 mgr.y (mgr.14601) 648 : cluster 0 pgmap v1075: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:16.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:16 smithi049 bash[21434]: cluster 2024-03-11T22:25:15.010081+0000 mon.a (mon.0) 3178 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-03-11T22:25:16.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:16 smithi049 bash[21434]: cluster 2024-03-11T22:25:15.834688+0000 mon.a (mon.0) 3179 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:16.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:16 smithi049 bash[28804]: cluster 2024-03-11T22:25:14.401145+0000 mgr.y (mgr.14601) 648 : cluster 0 pgmap v1075: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:16.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:16 smithi049 bash[28804]: cluster 2024-03-11T22:25:15.010081+0000 mon.a (mon.0) 3178 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-03-11T22:25:16.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:16 smithi049 bash[28804]: cluster 2024-03-11T22:25:15.834688+0000 mon.a (mon.0) 3179 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:16.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:16 smithi187 bash[23415]: cluster 2024-03-11T22:25:14.401145+0000 mgr.y (mgr.14601) 648 : cluster 0 pgmap v1075: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:16.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:16 smithi187 bash[23415]: cluster 2024-03-11T22:25:15.010081+0000 mon.a (mon.0) 3178 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-03-11T22:25:16.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:16 smithi187 bash[23415]: cluster 2024-03-11T22:25:15.834688+0000 mon.a (mon.0) 3179 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:17.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:17 smithi049 bash[21434]: cluster 2024-03-11T22:25:16.013101+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-03-11T22:25:17.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:17 smithi049 bash[21434]: audit 2024-03-11T22:25:16.112773+0000 mon.a (mon.0) 3181 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:17.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:17 smithi049 bash[28804]: cluster 2024-03-11T22:25:16.013101+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-03-11T22:25:17.276 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:17 smithi049 bash[28804]: audit 2024-03-11T22:25:16.112773+0000 mon.a (mon.0) 3181 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:17.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:17 smithi187 bash[23415]: cluster 2024-03-11T22:25:16.013101+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-03-11T22:25:17.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:17 smithi187 bash[23415]: audit 2024-03-11T22:25:16.112773+0000 mon.a (mon.0) 3181 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:18.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:18 smithi187 bash[23415]: cluster 2024-03-11T22:25:16.402011+0000 mgr.y (mgr.14601) 649 : cluster 0 pgmap v1078: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:18.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:18 smithi187 bash[23415]: audit 2024-03-11T22:25:17.031008+0000 mon.a (mon.0) 3182 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:18 smithi187 bash[23415]: cluster 2024-03-11T22:25:17.038043+0000 mon.a (mon.0) 3183 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-03-11T22:25:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:18 smithi187 bash[23415]: audit 2024-03-11T22:25:17.061541+0000 mon.a (mon.0) 3184 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[21434]: cluster 2024-03-11T22:25:16.402011+0000 mgr.y (mgr.14601) 649 : cluster 0 pgmap v1078: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[21434]: audit 2024-03-11T22:25:17.031008+0000 mon.a (mon.0) 3182 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[21434]: cluster 2024-03-11T22:25:17.038043+0000 mon.a (mon.0) 3183 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[21434]: audit 2024-03-11T22:25:17.061541+0000 mon.a (mon.0) 3184 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[28804]: cluster 2024-03-11T22:25:16.402011+0000 mgr.y (mgr.14601) 649 : cluster 0 pgmap v1078: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[28804]: audit 2024-03-11T22:25:17.031008+0000 mon.a (mon.0) 3182 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[28804]: cluster 2024-03-11T22:25:17.038043+0000 mon.a (mon.0) 3183 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-03-11T22:25:18.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:18 smithi049 bash[28804]: audit 2024-03-11T22:25:17.061541+0000 mon.a (mon.0) 3184 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:19.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:25:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:25:19.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:19 smithi187 bash[23415]: audit 2024-03-11T22:25:18.033730+0000 mon.a (mon.0) 3185 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:19.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:19 smithi187 bash[23415]: cluster 2024-03-11T22:25:18.040188+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-03-11T22:25:19.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:19 smithi187 bash[23415]: cluster 2024-03-11T22:25:19.043256+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-03-11T22:25:19.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:19 smithi049 bash[21434]: audit 2024-03-11T22:25:18.033730+0000 mon.a (mon.0) 3185 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:19.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:19 smithi049 bash[21434]: cluster 2024-03-11T22:25:18.040188+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-03-11T22:25:19.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:19 smithi049 bash[21434]: cluster 2024-03-11T22:25:19.043256+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-03-11T22:25:19.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:19 smithi049 bash[28804]: audit 2024-03-11T22:25:18.033730+0000 mon.a (mon.0) 3185 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:19.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:19 smithi049 bash[28804]: cluster 2024-03-11T22:25:18.040188+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-03-11T22:25:19.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:19 smithi049 bash[28804]: cluster 2024-03-11T22:25:19.043256+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-03-11T22:25:20.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:20 smithi187 bash[23415]: cluster 2024-03-11T22:25:18.403421+0000 mgr.y (mgr.14601) 650 : cluster 0 pgmap v1081: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:25:20.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:20 smithi187 bash[23415]: audit 2024-03-11T22:25:19.121450+0000 mon.a (mon.0) 3188 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:20 smithi049 bash[21434]: cluster 2024-03-11T22:25:18.403421+0000 mgr.y (mgr.14601) 650 : cluster 0 pgmap v1081: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:25:20.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:20 smithi049 bash[21434]: audit 2024-03-11T22:25:19.121450+0000 mon.a (mon.0) 3188 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:20.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:20 smithi049 bash[28804]: cluster 2024-03-11T22:25:18.403421+0000 mgr.y (mgr.14601) 650 : cluster 0 pgmap v1081: 268 pgs: 268 active+clean; 582 KiB data, 622 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-11T22:25:20.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:20 smithi049 bash[28804]: audit 2024-03-11T22:25:19.121450+0000 mon.a (mon.0) 3188 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:21.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: audit 2024-03-11T22:25:19.269114+0000 mgr.y (mgr.14601) 651 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:21.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: audit 2024-03-11T22:25:20.071553+0000 mon.a (mon.0) 3189 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:21.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: cluster 2024-03-11T22:25:20.078767+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-03-11T22:25:21.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: audit 2024-03-11T22:25:20.080758+0000 mon.a (mon.0) 3191 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:21.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: audit 2024-03-11T22:25:20.243348+0000 mon.c (mon.2) 653 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:25:21.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: audit 2024-03-11T22:25:20.982839+0000 mon.c (mon.2) 654 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:25:21.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: audit 2024-03-11T22:25:20.984615+0000 mon.c (mon.2) 655 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:25:21.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:21 smithi187 bash[23415]: audit 2024-03-11T22:25:20.995202+0000 mon.a (mon.0) 3192 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:21.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: audit 2024-03-11T22:25:19.269114+0000 mgr.y (mgr.14601) 651 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:21.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: audit 2024-03-11T22:25:20.071553+0000 mon.a (mon.0) 3189 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:21.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: cluster 2024-03-11T22:25:20.078767+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-03-11T22:25:21.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: audit 2024-03-11T22:25:20.080758+0000 mon.a (mon.0) 3191 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:21.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: audit 2024-03-11T22:25:20.243348+0000 mon.c (mon.2) 653 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:25:21.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: audit 2024-03-11T22:25:20.982839+0000 mon.c (mon.2) 654 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:25:21.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: audit 2024-03-11T22:25:20.984615+0000 mon.c (mon.2) 655 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[21434]: audit 2024-03-11T22:25:20.995202+0000 mon.a (mon.0) 3192 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: audit 2024-03-11T22:25:19.269114+0000 mgr.y (mgr.14601) 651 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: audit 2024-03-11T22:25:20.071553+0000 mon.a (mon.0) 3189 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: cluster 2024-03-11T22:25:20.078767+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: audit 2024-03-11T22:25:20.080758+0000 mon.a (mon.0) 3191 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132"}]: dispatch 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: audit 2024-03-11T22:25:20.243348+0000 mon.c (mon.2) 653 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: audit 2024-03-11T22:25:20.982839+0000 mon.c (mon.2) 654 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: audit 2024-03-11T22:25:20.984615+0000 mon.c (mon.2) 655 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:25:21.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:21 smithi049 bash[28804]: audit 2024-03-11T22:25:20.995202+0000 mon.a (mon.0) 3192 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:22.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:22 smithi187 bash[23415]: cluster 2024-03-11T22:25:20.404434+0000 mgr.y (mgr.14601) 652 : cluster 0 pgmap v1084: 268 pgs: 268 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:25:22.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:22 smithi187 bash[23415]: cluster 2024-03-11T22:25:21.072216+0000 mon.a (mon.0) 3193 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:22.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:22 smithi187 bash[23415]: audit 2024-03-11T22:25:21.083512+0000 mon.a (mon.0) 3194 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:22.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:22 smithi187 bash[23415]: cluster 2024-03-11T22:25:21.091889+0000 mon.a (mon.0) 3195 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-03-11T22:25:23.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[21434]: cluster 2024-03-11T22:25:20.404434+0000 mgr.y (mgr.14601) 652 : cluster 0 pgmap v1084: 268 pgs: 268 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:25:23.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[21434]: cluster 2024-03-11T22:25:21.072216+0000 mon.a (mon.0) 3193 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:23.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[21434]: audit 2024-03-11T22:25:21.083512+0000 mon.a (mon.0) 3194 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:23.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[21434]: cluster 2024-03-11T22:25:21.091889+0000 mon.a (mon.0) 3195 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-03-11T22:25:23.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[28804]: cluster 2024-03-11T22:25:20.404434+0000 mgr.y (mgr.14601) 652 : cluster 0 pgmap v1084: 268 pgs: 268 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-11T22:25:23.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[28804]: cluster 2024-03-11T22:25:21.072216+0000 mon.a (mon.0) 3193 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:23.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[28804]: audit 2024-03-11T22:25:21.083512+0000 mon.a (mon.0) 3194 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-132"}]': finished 2024-03-11T22:25:23.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:22 smithi049 bash[28804]: cluster 2024-03-11T22:25:21.091889+0000 mon.a (mon.0) 3195 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-03-11T22:25:23.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:23 smithi187 bash[23415]: cluster 2024-03-11T22:25:22.092983+0000 mon.a (mon.0) 3196 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-03-11T22:25:23.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:23 smithi187 bash[23415]: cluster 2024-03-11T22:25:22.405324+0000 mgr.y (mgr.14601) 653 : cluster 0 pgmap v1087: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:23.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:23 smithi187 bash[23415]: cluster 2024-03-11T22:25:23.096497+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-03-11T22:25:23.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:23 smithi187 bash[23415]: audit 2024-03-11T22:25:23.101430+0000 mon.a (mon.0) 3198 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:24.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[21434]: cluster 2024-03-11T22:25:22.092983+0000 mon.a (mon.0) 3196 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-03-11T22:25:24.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[21434]: cluster 2024-03-11T22:25:22.405324+0000 mgr.y (mgr.14601) 653 : cluster 0 pgmap v1087: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:24.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[21434]: cluster 2024-03-11T22:25:23.096497+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-03-11T22:25:24.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[21434]: audit 2024-03-11T22:25:23.101430+0000 mon.a (mon.0) 3198 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:24.026 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[28804]: cluster 2024-03-11T22:25:22.092983+0000 mon.a (mon.0) 3196 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-03-11T22:25:24.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[28804]: cluster 2024-03-11T22:25:22.405324+0000 mgr.y (mgr.14601) 653 : cluster 0 pgmap v1087: 236 pgs: 236 active+clean; 582 KiB data, 623 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:24.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[28804]: cluster 2024-03-11T22:25:23.096497+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-03-11T22:25:24.027 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:23 smithi049 bash[28804]: audit 2024-03-11T22:25:23.101430+0000 mon.a (mon.0) 3198 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:24.526 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:25:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:25:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:25:25.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:25 smithi187 bash[23415]: audit 2024-03-11T22:25:24.092772+0000 mon.a (mon.0) 3199 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:25.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:25 smithi187 bash[23415]: cluster 2024-03-11T22:25:24.101138+0000 mon.a (mon.0) 3200 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-03-11T22:25:25.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:25 smithi187 bash[23415]: audit 2024-03-11T22:25:24.104131+0000 mon.a (mon.0) 3201 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:25.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:25 smithi049 bash[21434]: audit 2024-03-11T22:25:24.092772+0000 mon.a (mon.0) 3199 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:25.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:25 smithi049 bash[21434]: cluster 2024-03-11T22:25:24.101138+0000 mon.a (mon.0) 3200 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-03-11T22:25:25.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:25 smithi049 bash[21434]: audit 2024-03-11T22:25:24.104131+0000 mon.a (mon.0) 3201 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:25.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:25 smithi049 bash[28804]: audit 2024-03-11T22:25:24.092772+0000 mon.a (mon.0) 3199 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:25.526 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:25 smithi049 bash[28804]: cluster 2024-03-11T22:25:24.101138+0000 mon.a (mon.0) 3200 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-03-11T22:25:25.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:25 smithi049 bash[28804]: audit 2024-03-11T22:25:24.104131+0000 mon.a (mon.0) 3201 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:26 smithi187 bash[23415]: cluster 2024-03-11T22:25:24.406193+0000 mgr.y (mgr.14601) 654 : cluster 0 pgmap v1090: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-11T22:25:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:26 smithi187 bash[23415]: audit 2024-03-11T22:25:25.096071+0000 mon.a (mon.0) 3202 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:26 smithi187 bash[23415]: cluster 2024-03-11T22:25:25.103272+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-03-11T22:25:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:26 smithi187 bash[23415]: audit 2024-03-11T22:25:25.107528+0000 mon.a (mon.0) 3204 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-134"}]: dispatch 2024-03-11T22:25:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:26 smithi187 bash[23415]: audit 2024-03-11T22:25:25.839922+0000 mon.a (mon.0) 3205 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-134"}]': finished 2024-03-11T22:25:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:26 smithi187 bash[23415]: cluster 2024-03-11T22:25:25.846614+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-03-11T22:25:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:26 smithi187 bash[23415]: audit 2024-03-11T22:25:25.849570+0000 mon.a (mon.0) 3207 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-134", "mode": "writeback"}]: dispatch 2024-03-11T22:25:26.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[21434]: cluster 2024-03-11T22:25:24.406193+0000 mgr.y (mgr.14601) 654 : cluster 0 pgmap v1090: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-11T22:25:26.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[21434]: audit 2024-03-11T22:25:25.096071+0000 mon.a (mon.0) 3202 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:26.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[21434]: cluster 2024-03-11T22:25:25.103272+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-03-11T22:25:26.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[21434]: audit 2024-03-11T22:25:25.107528+0000 mon.a (mon.0) 3204 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-134"}]: dispatch 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[21434]: audit 2024-03-11T22:25:25.839922+0000 mon.a (mon.0) 3205 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-134"}]': finished 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[21434]: cluster 2024-03-11T22:25:25.846614+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[21434]: audit 2024-03-11T22:25:25.849570+0000 mon.a (mon.0) 3207 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-134", "mode": "writeback"}]: dispatch 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[28804]: cluster 2024-03-11T22:25:24.406193+0000 mgr.y (mgr.14601) 654 : cluster 0 pgmap v1090: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[28804]: audit 2024-03-11T22:25:25.096071+0000 mon.a (mon.0) 3202 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[28804]: cluster 2024-03-11T22:25:25.103272+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[28804]: audit 2024-03-11T22:25:25.107528+0000 mon.a (mon.0) 3204 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-134"}]: dispatch 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[28804]: audit 2024-03-11T22:25:25.839922+0000 mon.a (mon.0) 3205 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-134"}]': finished 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[28804]: cluster 2024-03-11T22:25:25.846614+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-03-11T22:25:26.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:26 smithi049 bash[28804]: audit 2024-03-11T22:25:25.849570+0000 mon.a (mon.0) 3207 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-134", "mode": "writeback"}]: dispatch 2024-03-11T22:25:27.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:27 smithi187 bash[23415]: cluster 2024-03-11T22:25:26.840340+0000 mon.a (mon.0) 3208 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:27.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:27 smithi187 bash[23415]: audit 2024-03-11T22:25:26.842689+0000 mon.a (mon.0) 3209 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-134", "mode": "writeback"}]': finished 2024-03-11T22:25:27.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:27 smithi187 bash[23415]: cluster 2024-03-11T22:25:26.850837+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-03-11T22:25:27.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:27 smithi187 bash[23415]: audit 2024-03-11T22:25:26.933363+0000 mon.a (mon.0) 3211 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:27.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:27 smithi187 bash[23415]: audit 2024-03-11T22:25:26.936648+0000 mon.c (mon.2) 656 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:27.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:27 smithi187 bash[23415]: audit 2024-03-11T22:25:26.963421+0000 mon.a (mon.0) 3212 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:27.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[21434]: cluster 2024-03-11T22:25:26.840340+0000 mon.a (mon.0) 3208 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:27.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[21434]: audit 2024-03-11T22:25:26.842689+0000 mon.a (mon.0) 3209 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-134", "mode": "writeback"}]': finished 2024-03-11T22:25:27.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[21434]: cluster 2024-03-11T22:25:26.850837+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-03-11T22:25:27.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[21434]: audit 2024-03-11T22:25:26.933363+0000 mon.a (mon.0) 3211 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:27.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[21434]: audit 2024-03-11T22:25:26.936648+0000 mon.c (mon.2) 656 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:27.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[21434]: audit 2024-03-11T22:25:26.963421+0000 mon.a (mon.0) 3212 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:27.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[28804]: cluster 2024-03-11T22:25:26.840340+0000 mon.a (mon.0) 3208 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:27.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[28804]: audit 2024-03-11T22:25:26.842689+0000 mon.a (mon.0) 3209 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-134", "mode": "writeback"}]': finished 2024-03-11T22:25:27.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[28804]: cluster 2024-03-11T22:25:26.850837+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-03-11T22:25:27.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[28804]: audit 2024-03-11T22:25:26.933363+0000 mon.a (mon.0) 3211 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:27.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[28804]: audit 2024-03-11T22:25:26.936648+0000 mon.c (mon.2) 656 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:27.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:27 smithi049 bash[28804]: audit 2024-03-11T22:25:26.963421+0000 mon.a (mon.0) 3212 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:28.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:28 smithi187 bash[23415]: cluster 2024-03-11T22:25:26.407132+0000 mgr.y (mgr.14601) 655 : cluster 0 pgmap v1093: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:28.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:28 smithi187 bash[23415]: audit 2024-03-11T22:25:27.931325+0000 mon.a (mon.0) 3213 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:28.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:28 smithi187 bash[23415]: cluster 2024-03-11T22:25:27.937520+0000 mon.a (mon.0) 3214 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-03-11T22:25:28.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:28 smithi187 bash[23415]: audit 2024-03-11T22:25:27.940331+0000 mon.a (mon.0) 3215 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134"}]: dispatch 2024-03-11T22:25:28.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[21434]: cluster 2024-03-11T22:25:26.407132+0000 mgr.y (mgr.14601) 655 : cluster 0 pgmap v1093: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:28.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[21434]: audit 2024-03-11T22:25:27.931325+0000 mon.a (mon.0) 3213 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:28.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[21434]: cluster 2024-03-11T22:25:27.937520+0000 mon.a (mon.0) 3214 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-03-11T22:25:28.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[21434]: audit 2024-03-11T22:25:27.940331+0000 mon.a (mon.0) 3215 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134"}]: dispatch 2024-03-11T22:25:28.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[28804]: cluster 2024-03-11T22:25:26.407132+0000 mgr.y (mgr.14601) 655 : cluster 0 pgmap v1093: 268 pgs: 32 creating+peering, 236 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:28.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[28804]: audit 2024-03-11T22:25:27.931325+0000 mon.a (mon.0) 3213 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:28.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[28804]: cluster 2024-03-11T22:25:27.937520+0000 mon.a (mon.0) 3214 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-03-11T22:25:28.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:28 smithi049 bash[28804]: audit 2024-03-11T22:25:27.940331+0000 mon.a (mon.0) 3215 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134"}]: dispatch 2024-03-11T22:25:29.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:29 smithi187 bash[23415]: cluster 2024-03-11T22:25:28.931681+0000 mon.a (mon.0) 3216 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:29.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:29 smithi187 bash[23415]: audit 2024-03-11T22:25:28.933913+0000 mon.a (mon.0) 3217 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134"}]': finished 2024-03-11T22:25:29.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:29 smithi187 bash[23415]: cluster 2024-03-11T22:25:28.941814+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-03-11T22:25:29.499 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:25:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:25:29.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:29 smithi049 bash[21434]: cluster 2024-03-11T22:25:28.931681+0000 mon.a (mon.0) 3216 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:29.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:29 smithi049 bash[21434]: audit 2024-03-11T22:25:28.933913+0000 mon.a (mon.0) 3217 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134"}]': finished 2024-03-11T22:25:29.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:29 smithi049 bash[21434]: cluster 2024-03-11T22:25:28.941814+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-03-11T22:25:29.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:29 smithi049 bash[28804]: cluster 2024-03-11T22:25:28.931681+0000 mon.a (mon.0) 3216 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:29.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:29 smithi049 bash[28804]: audit 2024-03-11T22:25:28.933913+0000 mon.a (mon.0) 3217 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-134"}]': finished 2024-03-11T22:25:29.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:29 smithi049 bash[28804]: cluster 2024-03-11T22:25:28.941814+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-03-11T22:25:30.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:30 smithi187 bash[23415]: cluster 2024-03-11T22:25:28.408356+0000 mgr.y (mgr.14601) 656 : cluster 0 pgmap v1096: 268 pgs: 30 creating+peering, 238 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:30.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:30 smithi187 bash[23415]: audit 2024-03-11T22:25:29.280160+0000 mgr.y (mgr.14601) 657 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:30.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:30 smithi187 bash[23415]: cluster 2024-03-11T22:25:29.943085+0000 mon.a (mon.0) 3219 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-03-11T22:25:30.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:30 smithi049 bash[21434]: cluster 2024-03-11T22:25:28.408356+0000 mgr.y (mgr.14601) 656 : cluster 0 pgmap v1096: 268 pgs: 30 creating+peering, 238 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:30.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:30 smithi049 bash[21434]: audit 2024-03-11T22:25:29.280160+0000 mgr.y (mgr.14601) 657 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:30.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:30 smithi049 bash[21434]: cluster 2024-03-11T22:25:29.943085+0000 mon.a (mon.0) 3219 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-03-11T22:25:30.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:30 smithi049 bash[28804]: cluster 2024-03-11T22:25:28.408356+0000 mgr.y (mgr.14601) 656 : cluster 0 pgmap v1096: 268 pgs: 30 creating+peering, 238 active+clean; 582 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:30.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:30 smithi049 bash[28804]: audit 2024-03-11T22:25:29.280160+0000 mgr.y (mgr.14601) 657 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:30.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:30 smithi049 bash[28804]: cluster 2024-03-11T22:25:29.943085+0000 mon.a (mon.0) 3219 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-03-11T22:25:32.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:31 smithi187 bash[23415]: cluster 2024-03-11T22:25:30.409231+0000 mgr.y (mgr.14601) 658 : cluster 0 pgmap v1099: 236 pgs: 236 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:25:32.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:31 smithi187 bash[23415]: cluster 2024-03-11T22:25:30.952859+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-03-11T22:25:32.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:31 smithi187 bash[23415]: audit 2024-03-11T22:25:30.956914+0000 mon.a (mon.0) 3221 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:32.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:31 smithi049 bash[21434]: cluster 2024-03-11T22:25:30.409231+0000 mgr.y (mgr.14601) 658 : cluster 0 pgmap v1099: 236 pgs: 236 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:25:32.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:31 smithi049 bash[21434]: cluster 2024-03-11T22:25:30.952859+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-03-11T22:25:32.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:31 smithi049 bash[21434]: audit 2024-03-11T22:25:30.956914+0000 mon.a (mon.0) 3221 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:32.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:31 smithi049 bash[28804]: cluster 2024-03-11T22:25:30.409231+0000 mgr.y (mgr.14601) 658 : cluster 0 pgmap v1099: 236 pgs: 236 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-11T22:25:32.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:31 smithi049 bash[28804]: cluster 2024-03-11T22:25:30.952859+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-03-11T22:25:32.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:31 smithi049 bash[28804]: audit 2024-03-11T22:25:30.956914+0000 mon.a (mon.0) 3221 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:32.970 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:25:32 smithi187 bash[50671]: logger=sqlstore.transactions t=2024-03-11T22:25:32.516195589Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-11T22:25:33.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:32 smithi187 bash[23415]: audit 2024-03-11T22:25:31.949006+0000 mon.a (mon.0) 3222 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:33.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:32 smithi187 bash[23415]: cluster 2024-03-11T22:25:31.957028+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-03-11T22:25:33.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:32 smithi187 bash[23415]: audit 2024-03-11T22:25:31.964086+0000 mon.a (mon.0) 3224 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:33.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:32 smithi187 bash[23415]: audit 2024-03-11T22:25:32.951894+0000 mon.a (mon.0) 3225 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:33.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:32 smithi187 bash[23415]: cluster 2024-03-11T22:25:32.959211+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-03-11T22:25:33.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:32 smithi187 bash[23415]: audit 2024-03-11T22:25:32.961889+0000 mon.a (mon.0) 3227 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-136"}]: dispatch 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[21434]: audit 2024-03-11T22:25:31.949006+0000 mon.a (mon.0) 3222 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[21434]: cluster 2024-03-11T22:25:31.957028+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[21434]: audit 2024-03-11T22:25:31.964086+0000 mon.a (mon.0) 3224 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[21434]: audit 2024-03-11T22:25:32.951894+0000 mon.a (mon.0) 3225 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[21434]: cluster 2024-03-11T22:25:32.959211+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[21434]: audit 2024-03-11T22:25:32.961889+0000 mon.a (mon.0) 3227 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-136"}]: dispatch 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[28804]: audit 2024-03-11T22:25:31.949006+0000 mon.a (mon.0) 3222 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[28804]: cluster 2024-03-11T22:25:31.957028+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[28804]: audit 2024-03-11T22:25:31.964086+0000 mon.a (mon.0) 3224 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[28804]: audit 2024-03-11T22:25:32.951894+0000 mon.a (mon.0) 3225 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[28804]: cluster 2024-03-11T22:25:32.959211+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-03-11T22:25:33.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:32 smithi049 bash[28804]: audit 2024-03-11T22:25:32.961889+0000 mon.a (mon.0) 3227 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-136"}]: dispatch 2024-03-11T22:25:34.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[21434]: cluster 2024-03-11T22:25:32.410085+0000 mgr.y (mgr.14601) 659 : cluster 0 pgmap v1102: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-03-11T22:25:34.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[21434]: audit 2024-03-11T22:25:33.954790+0000 mon.a (mon.0) 3228 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-136"}]': finished 2024-03-11T22:25:34.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[21434]: cluster 2024-03-11T22:25:33.961346+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-03-11T22:25:34.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[21434]: audit 2024-03-11T22:25:33.962472+0000 mon.a (mon.0) 3230 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-136", "mode": "writeback"}]: dispatch 2024-03-11T22:25:34.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[28804]: cluster 2024-03-11T22:25:32.410085+0000 mgr.y (mgr.14601) 659 : cluster 0 pgmap v1102: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-03-11T22:25:34.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[28804]: audit 2024-03-11T22:25:33.954790+0000 mon.a (mon.0) 3228 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-136"}]': finished 2024-03-11T22:25:34.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[28804]: cluster 2024-03-11T22:25:33.961346+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-03-11T22:25:34.231 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:33 smithi049 bash[28804]: audit 2024-03-11T22:25:33.962472+0000 mon.a (mon.0) 3230 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-136", "mode": "writeback"}]: dispatch 2024-03-11T22:25:34.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:33 smithi187 bash[23415]: cluster 2024-03-11T22:25:32.410085+0000 mgr.y (mgr.14601) 659 : cluster 0 pgmap v1102: 268 pgs: 32 unknown, 236 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-03-11T22:25:34.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:33 smithi187 bash[23415]: audit 2024-03-11T22:25:33.954790+0000 mon.a (mon.0) 3228 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-136"}]': finished 2024-03-11T22:25:34.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:33 smithi187 bash[23415]: cluster 2024-03-11T22:25:33.961346+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-03-11T22:25:34.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:33 smithi187 bash[23415]: audit 2024-03-11T22:25:33.962472+0000 mon.a (mon.0) 3230 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-136", "mode": "writeback"}]: dispatch 2024-03-11T22:25:34.526 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:25:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:25:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:25:35.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:34 smithi187 bash[23415]: cluster 2024-03-11T22:25:34.955144+0000 mon.a (mon.0) 3231 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:35.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:34 smithi187 bash[23415]: audit 2024-03-11T22:25:34.957507+0000 mon.a (mon.0) 3232 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-136", "mode": "writeback"}]': finished 2024-03-11T22:25:35.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:34 smithi187 bash[23415]: cluster 2024-03-11T22:25:34.965060+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-03-11T22:25:35.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:34 smithi049 bash[21434]: cluster 2024-03-11T22:25:34.955144+0000 mon.a (mon.0) 3231 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:35.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:34 smithi049 bash[21434]: audit 2024-03-11T22:25:34.957507+0000 mon.a (mon.0) 3232 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-136", "mode": "writeback"}]': finished 2024-03-11T22:25:35.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:34 smithi049 bash[21434]: cluster 2024-03-11T22:25:34.965060+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-03-11T22:25:35.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:34 smithi049 bash[28804]: cluster 2024-03-11T22:25:34.955144+0000 mon.a (mon.0) 3231 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:25:35.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:34 smithi049 bash[28804]: audit 2024-03-11T22:25:34.957507+0000 mon.a (mon.0) 3232 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-136", "mode": "writeback"}]': finished 2024-03-11T22:25:35.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:34 smithi049 bash[28804]: cluster 2024-03-11T22:25:34.965060+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-03-11T22:25:36.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:35 smithi187 bash[23415]: cluster 2024-03-11T22:25:34.410983+0000 mgr.y (mgr.14601) 660 : cluster 0 pgmap v1105: 268 pgs: 268 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:36.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:35 smithi187 bash[23415]: audit 2024-03-11T22:25:35.102838+0000 mon.a (mon.0) 3234 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:36.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:35 smithi049 bash[21434]: cluster 2024-03-11T22:25:34.410983+0000 mgr.y (mgr.14601) 660 : cluster 0 pgmap v1105: 268 pgs: 268 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:36.276 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:35 smithi049 bash[21434]: audit 2024-03-11T22:25:35.102838+0000 mon.a (mon.0) 3234 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:36.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:35 smithi049 bash[28804]: cluster 2024-03-11T22:25:34.410983+0000 mgr.y (mgr.14601) 660 : cluster 0 pgmap v1105: 268 pgs: 268 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:36.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:35 smithi049 bash[28804]: audit 2024-03-11T22:25:35.102838+0000 mon.a (mon.0) 3234 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:37.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:37 smithi049 bash[21434]: audit 2024-03-11T22:25:35.994241+0000 mon.a (mon.0) 3235 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:37.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:37 smithi049 bash[21434]: cluster 2024-03-11T22:25:36.000652+0000 mon.a (mon.0) 3236 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-03-11T22:25:37.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:37 smithi049 bash[21434]: audit 2024-03-11T22:25:36.001615+0000 mon.a (mon.0) 3237 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136"}]: dispatch 2024-03-11T22:25:37.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:37 smithi049 bash[28804]: audit 2024-03-11T22:25:35.994241+0000 mon.a (mon.0) 3235 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:37.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:37 smithi049 bash[28804]: cluster 2024-03-11T22:25:36.000652+0000 mon.a (mon.0) 3236 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-03-11T22:25:37.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:37 smithi049 bash[28804]: audit 2024-03-11T22:25:36.001615+0000 mon.a (mon.0) 3237 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136"}]: dispatch 2024-03-11T22:25:37.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:37 smithi187 bash[23415]: audit 2024-03-11T22:25:35.994241+0000 mon.a (mon.0) 3235 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:25:37.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:37 smithi187 bash[23415]: cluster 2024-03-11T22:25:36.000652+0000 mon.a (mon.0) 3236 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-03-11T22:25:37.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:37 smithi187 bash[23415]: audit 2024-03-11T22:25:36.001615+0000 mon.a (mon.0) 3237 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136"}]: dispatch 2024-03-11T22:25:38.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:38 smithi187 bash[23415]: cluster 2024-03-11T22:25:36.411976+0000 mgr.y (mgr.14601) 661 : cluster 0 pgmap v1108: 268 pgs: 268 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:38.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:38 smithi187 bash[23415]: cluster 2024-03-11T22:25:36.995550+0000 mon.a (mon.0) 3238 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:38.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:38 smithi187 bash[23415]: audit 2024-03-11T22:25:37.003342+0000 mon.a (mon.0) 3239 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136"}]': finished 2024-03-11T22:25:38.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:38 smithi187 bash[23415]: cluster 2024-03-11T22:25:37.012769+0000 mon.a (mon.0) 3240 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-03-11T22:25:38.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[21434]: cluster 2024-03-11T22:25:36.411976+0000 mgr.y (mgr.14601) 661 : cluster 0 pgmap v1108: 268 pgs: 268 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:38.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[21434]: cluster 2024-03-11T22:25:36.995550+0000 mon.a (mon.0) 3238 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:38.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[21434]: audit 2024-03-11T22:25:37.003342+0000 mon.a (mon.0) 3239 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136"}]': finished 2024-03-11T22:25:38.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[21434]: cluster 2024-03-11T22:25:37.012769+0000 mon.a (mon.0) 3240 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-03-11T22:25:38.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[28804]: cluster 2024-03-11T22:25:36.411976+0000 mgr.y (mgr.14601) 661 : cluster 0 pgmap v1108: 268 pgs: 268 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:38.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[28804]: cluster 2024-03-11T22:25:36.995550+0000 mon.a (mon.0) 3238 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:25:38.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[28804]: audit 2024-03-11T22:25:37.003342+0000 mon.a (mon.0) 3239 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-136"}]': finished 2024-03-11T22:25:38.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:38 smithi049 bash[28804]: cluster 2024-03-11T22:25:37.012769+0000 mon.a (mon.0) 3240 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-03-11T22:25:39.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:25:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:25:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:39 smithi187 bash[23415]: cluster 2024-03-11T22:25:38.012754+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-03-11T22:25:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:39 smithi187 bash[23415]: cluster 2024-03-11T22:25:38.413014+0000 mgr.y (mgr.14601) 662 : cluster 0 pgmap v1111: 236 pgs: 236 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:39 smithi187 bash[23415]: cluster 2024-03-11T22:25:39.018251+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-03-11T22:25:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:39 smithi187 bash[23415]: audit 2024-03-11T22:25:39.021535+0000 mon.a (mon.0) 3243 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[28804]: cluster 2024-03-11T22:25:38.012754+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[28804]: cluster 2024-03-11T22:25:38.413014+0000 mgr.y (mgr.14601) 662 : cluster 0 pgmap v1111: 236 pgs: 236 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[28804]: cluster 2024-03-11T22:25:39.018251+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[28804]: audit 2024-03-11T22:25:39.021535+0000 mon.a (mon.0) 3243 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[21434]: cluster 2024-03-11T22:25:38.012754+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[21434]: cluster 2024-03-11T22:25:38.413014+0000 mgr.y (mgr.14601) 662 : cluster 0 pgmap v1111: 236 pgs: 236 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[21434]: cluster 2024-03-11T22:25:39.018251+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-03-11T22:25:39.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:39 smithi049 bash[21434]: audit 2024-03-11T22:25:39.021535+0000 mon.a (mon.0) 3243 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[28804]: audit 2024-03-11T22:25:39.291307+0000 mgr.y (mgr.14601) 663 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[28804]: audit 2024-03-11T22:25:40.013290+0000 mon.a (mon.0) 3244 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[28804]: cluster 2024-03-11T22:25:40.021169+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[28804]: audit 2024-03-11T22:25:40.025146+0000 mon.a (mon.0) 3246 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[21434]: audit 2024-03-11T22:25:39.291307+0000 mgr.y (mgr.14601) 663 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[21434]: audit 2024-03-11T22:25:40.013290+0000 mon.a (mon.0) 3244 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[21434]: cluster 2024-03-11T22:25:40.021169+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-03-11T22:25:41.277 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:41 smithi049 bash[21434]: audit 2024-03-11T22:25:40.025146+0000 mon.a (mon.0) 3246 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:41 smithi187 bash[23415]: audit 2024-03-11T22:25:39.291307+0000 mgr.y (mgr.14601) 663 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:41.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:41 smithi187 bash[23415]: audit 2024-03-11T22:25:40.013290+0000 mon.a (mon.0) 3244 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:41 smithi187 bash[23415]: cluster 2024-03-11T22:25:40.021169+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-03-11T22:25:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:41 smithi187 bash[23415]: audit 2024-03-11T22:25:40.025146+0000 mon.a (mon.0) 3246 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:42 smithi187 bash[23415]: cluster 2024-03-11T22:25:40.413946+0000 mgr.y (mgr.14601) 664 : cluster 0 pgmap v1114: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:25:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:42 smithi187 bash[23415]: audit 2024-03-11T22:25:41.023302+0000 mon.a (mon.0) 3247 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:42 smithi187 bash[23415]: cluster 2024-03-11T22:25:41.031525+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-03-11T22:25:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:42 smithi187 bash[23415]: audit 2024-03-11T22:25:41.032463+0000 mon.a (mon.0) 3249 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:25:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:42 smithi187 bash[23415]: audit 2024-03-11T22:25:41.985955+0000 mon.a (mon.0) 3250 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:42 smithi187 bash[23415]: audit 2024-03-11T22:25:41.989692+0000 mon.c (mon.2) 657 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[21434]: cluster 2024-03-11T22:25:40.413946+0000 mgr.y (mgr.14601) 664 : cluster 0 pgmap v1114: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[21434]: audit 2024-03-11T22:25:41.023302+0000 mon.a (mon.0) 3247 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[21434]: cluster 2024-03-11T22:25:41.031525+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[21434]: audit 2024-03-11T22:25:41.032463+0000 mon.a (mon.0) 3249 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[21434]: audit 2024-03-11T22:25:41.985955+0000 mon.a (mon.0) 3250 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[21434]: audit 2024-03-11T22:25:41.989692+0000 mon.c (mon.2) 657 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[28804]: cluster 2024-03-11T22:25:40.413946+0000 mgr.y (mgr.14601) 664 : cluster 0 pgmap v1114: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[28804]: audit 2024-03-11T22:25:41.023302+0000 mon.a (mon.0) 3247 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[28804]: cluster 2024-03-11T22:25:41.031525+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[28804]: audit 2024-03-11T22:25:41.032463+0000 mon.a (mon.0) 3249 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[28804]: audit 2024-03-11T22:25:41.985955+0000 mon.a (mon.0) 3250 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:25:42.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:42 smithi049 bash[28804]: audit 2024-03-11T22:25:41.989692+0000 mon.c (mon.2) 657 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:43.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:43 smithi187 bash[23415]: audit 2024-03-11T22:25:42.025693+0000 mon.a (mon.0) 3251 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:25:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:43 smithi187 bash[23415]: cluster 2024-03-11T22:25:42.032713+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-03-11T22:25:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:43 smithi187 bash[23415]: audit 2024-03-11T22:25:42.034757+0000 mon.a (mon.0) 3253 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:25:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:43 smithi187 bash[23415]: audit 2024-03-11T22:25:43.028400+0000 mon.a (mon.0) 3254 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:25:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:43 smithi187 bash[23415]: cluster 2024-03-11T22:25:43.034808+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[28804]: audit 2024-03-11T22:25:42.025693+0000 mon.a (mon.0) 3251 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[28804]: cluster 2024-03-11T22:25:42.032713+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[28804]: audit 2024-03-11T22:25:42.034757+0000 mon.a (mon.0) 3253 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[28804]: audit 2024-03-11T22:25:43.028400+0000 mon.a (mon.0) 3254 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[28804]: cluster 2024-03-11T22:25:43.034808+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[21434]: audit 2024-03-11T22:25:42.025693+0000 mon.a (mon.0) 3251 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[21434]: cluster 2024-03-11T22:25:42.032713+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[21434]: audit 2024-03-11T22:25:42.034757+0000 mon.a (mon.0) 3253 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[21434]: audit 2024-03-11T22:25:43.028400+0000 mon.a (mon.0) 3254 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:25:43.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:43 smithi049 bash[21434]: cluster 2024-03-11T22:25:43.034808+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-03-11T22:25:44.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:44 smithi187 bash[23415]: cluster 2024-03-11T22:25:42.414855+0000 mgr.y (mgr.14601) 665 : cluster 0 pgmap v1117: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 976 KiB/s wr, 0 op/s 2024-03-11T22:25:44.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:44 smithi187 bash[23415]: audit 2024-03-11T22:25:43.035565+0000 mon.a (mon.0) 3256 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:25:44.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:44 smithi187 bash[23415]: audit 2024-03-11T22:25:44.031266+0000 mon.a (mon.0) 3257 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:25:44.526 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:25:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:25:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:25:44.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:44 smithi049 bash[28804]: cluster 2024-03-11T22:25:42.414855+0000 mgr.y (mgr.14601) 665 : cluster 0 pgmap v1117: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 976 KiB/s wr, 0 op/s 2024-03-11T22:25:44.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:44 smithi049 bash[28804]: audit 2024-03-11T22:25:43.035565+0000 mon.a (mon.0) 3256 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:25:44.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:44 smithi049 bash[28804]: audit 2024-03-11T22:25:44.031266+0000 mon.a (mon.0) 3257 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:25:44.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:44 smithi049 bash[21434]: cluster 2024-03-11T22:25:42.414855+0000 mgr.y (mgr.14601) 665 : cluster 0 pgmap v1117: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 661 MiB used, 715 GiB / 715 GiB avail; 976 KiB/s wr, 0 op/s 2024-03-11T22:25:44.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:44 smithi049 bash[21434]: audit 2024-03-11T22:25:43.035565+0000 mon.a (mon.0) 3256 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-11T22:25:44.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:44 smithi049 bash[21434]: audit 2024-03-11T22:25:44.031266+0000 mon.a (mon.0) 3257 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-11T22:25:45.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:45 smithi187 bash[23415]: cluster 2024-03-11T22:25:44.040283+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-03-11T22:25:45.526 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:45 smithi049 bash[21434]: cluster 2024-03-11T22:25:44.040283+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-03-11T22:25:45.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:45 smithi049 bash[28804]: cluster 2024-03-11T22:25:44.040283+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-03-11T22:25:46.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:46 smithi187 bash[23415]: cluster 2024-03-11T22:25:44.415792+0000 mgr.y (mgr.14601) 666 : cluster 0 pgmap v1120: 268 pgs: 268 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:46.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:46 smithi187 bash[23415]: audit 2024-03-11T22:25:45.076096+0000 mon.a (mon.0) 3259 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:46.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:46 smithi187 bash[23415]: audit 2024-03-11T22:25:45.076977+0000 mon.a (mon.0) 3260 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138"}]: dispatch 2024-03-11T22:25:46.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:46 smithi049 bash[21434]: cluster 2024-03-11T22:25:44.415792+0000 mgr.y (mgr.14601) 666 : cluster 0 pgmap v1120: 268 pgs: 268 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:46.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:46 smithi049 bash[21434]: audit 2024-03-11T22:25:45.076096+0000 mon.a (mon.0) 3259 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:46.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:46 smithi049 bash[21434]: audit 2024-03-11T22:25:45.076977+0000 mon.a (mon.0) 3260 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138"}]: dispatch 2024-03-11T22:25:46.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:46 smithi049 bash[28804]: cluster 2024-03-11T22:25:44.415792+0000 mgr.y (mgr.14601) 666 : cluster 0 pgmap v1120: 268 pgs: 268 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:46.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:46 smithi049 bash[28804]: audit 2024-03-11T22:25:45.076096+0000 mon.a (mon.0) 3259 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:25:46.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:46 smithi049 bash[28804]: audit 2024-03-11T22:25:45.076977+0000 mon.a (mon.0) 3260 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138"}]: dispatch 2024-03-11T22:25:47.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:47 smithi187 bash[23415]: audit 2024-03-11T22:25:46.056132+0000 mon.a (mon.0) 3261 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138"}]': finished 2024-03-11T22:25:47.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:47 smithi187 bash[23415]: cluster 2024-03-11T22:25:46.063390+0000 mon.a (mon.0) 3262 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-03-11T22:25:47.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:47 smithi049 bash[21434]: audit 2024-03-11T22:25:46.056132+0000 mon.a (mon.0) 3261 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138"}]': finished 2024-03-11T22:25:47.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:47 smithi049 bash[21434]: cluster 2024-03-11T22:25:46.063390+0000 mon.a (mon.0) 3262 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-03-11T22:25:47.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:47 smithi049 bash[28804]: audit 2024-03-11T22:25:46.056132+0000 mon.a (mon.0) 3261 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-138"}]': finished 2024-03-11T22:25:47.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:47 smithi049 bash[28804]: cluster 2024-03-11T22:25:46.063390+0000 mon.a (mon.0) 3262 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-03-11T22:25:48.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:48 smithi187 bash[23415]: cluster 2024-03-11T22:25:46.416715+0000 mgr.y (mgr.14601) 667 : cluster 0 pgmap v1122: 268 pgs: 268 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:25:48.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:48 smithi187 bash[23415]: cluster 2024-03-11T22:25:47.068399+0000 mon.a (mon.0) 3263 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:48.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:48 smithi187 bash[23415]: cluster 2024-03-11T22:25:47.085772+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-03-11T22:25:48.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:48 smithi049 bash[21434]: cluster 2024-03-11T22:25:46.416715+0000 mgr.y (mgr.14601) 667 : cluster 0 pgmap v1122: 268 pgs: 268 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:25:48.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:48 smithi049 bash[21434]: cluster 2024-03-11T22:25:47.068399+0000 mon.a (mon.0) 3263 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:48.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:48 smithi049 bash[21434]: cluster 2024-03-11T22:25:47.085772+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-03-11T22:25:48.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:48 smithi049 bash[28804]: cluster 2024-03-11T22:25:46.416715+0000 mgr.y (mgr.14601) 667 : cluster 0 pgmap v1122: 268 pgs: 268 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:25:48.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:48 smithi049 bash[28804]: cluster 2024-03-11T22:25:47.068399+0000 mon.a (mon.0) 3263 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:48.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:48 smithi049 bash[28804]: cluster 2024-03-11T22:25:47.085772+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-03-11T22:25:49.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:25:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:25:49.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:49 smithi187 bash[23415]: cluster 2024-03-11T22:25:48.090449+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-03-11T22:25:49.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:49 smithi187 bash[23415]: audit 2024-03-11T22:25:48.097467+0000 mon.a (mon.0) 3266 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:49.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:49 smithi187 bash[23415]: audit 2024-03-11T22:25:49.085707+0000 mon.a (mon.0) 3267 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:49.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:49 smithi187 bash[23415]: cluster 2024-03-11T22:25:49.094498+0000 mon.a (mon.0) 3268 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-03-11T22:25:49.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:49 smithi187 bash[23415]: audit 2024-03-11T22:25:49.097636+0000 mon.a (mon.0) 3269 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:49.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[21434]: cluster 2024-03-11T22:25:48.090449+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-03-11T22:25:49.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[21434]: audit 2024-03-11T22:25:48.097467+0000 mon.a (mon.0) 3266 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:49.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[21434]: audit 2024-03-11T22:25:49.085707+0000 mon.a (mon.0) 3267 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:49.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[21434]: cluster 2024-03-11T22:25:49.094498+0000 mon.a (mon.0) 3268 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-03-11T22:25:49.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[21434]: audit 2024-03-11T22:25:49.097636+0000 mon.a (mon.0) 3269 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:49.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[28804]: cluster 2024-03-11T22:25:48.090449+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-03-11T22:25:49.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[28804]: audit 2024-03-11T22:25:48.097467+0000 mon.a (mon.0) 3266 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:25:49.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[28804]: audit 2024-03-11T22:25:49.085707+0000 mon.a (mon.0) 3267 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:25:49.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[28804]: cluster 2024-03-11T22:25:49.094498+0000 mon.a (mon.0) 3268 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-03-11T22:25:49.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:49 smithi049 bash[28804]: audit 2024-03-11T22:25:49.097636+0000 mon.a (mon.0) 3269 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:25:50.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:50 smithi187 bash[23415]: cluster 2024-03-11T22:25:48.417902+0000 mgr.y (mgr.14601) 668 : cluster 0 pgmap v1125: 268 pgs: 2 creating+peering, 30 unknown, 236 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:25:50.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:50 smithi187 bash[23415]: audit 2024-03-11T22:25:50.088402+0000 mon.a (mon.0) 3270 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:50.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:50 smithi187 bash[23415]: cluster 2024-03-11T22:25:50.095302+0000 mon.a (mon.0) 3271 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-03-11T22:25:50.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:50 smithi187 bash[23415]: audit 2024-03-11T22:25:50.098194+0000 mon.a (mon.0) 3272 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:25:50.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[21434]: cluster 2024-03-11T22:25:48.417902+0000 mgr.y (mgr.14601) 668 : cluster 0 pgmap v1125: 268 pgs: 2 creating+peering, 30 unknown, 236 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:25:50.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[21434]: audit 2024-03-11T22:25:50.088402+0000 mon.a (mon.0) 3270 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:50.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[21434]: cluster 2024-03-11T22:25:50.095302+0000 mon.a (mon.0) 3271 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-03-11T22:25:50.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[21434]: audit 2024-03-11T22:25:50.098194+0000 mon.a (mon.0) 3272 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:25:50.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[28804]: cluster 2024-03-11T22:25:48.417902+0000 mgr.y (mgr.14601) 668 : cluster 0 pgmap v1125: 268 pgs: 2 creating+peering, 30 unknown, 236 active+clean; 4.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:25:50.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[28804]: audit 2024-03-11T22:25:50.088402+0000 mon.a (mon.0) 3270 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:25:50.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[28804]: cluster 2024-03-11T22:25:50.095302+0000 mon.a (mon.0) 3271 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-03-11T22:25:50.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:50 smithi049 bash[28804]: audit 2024-03-11T22:25:50.098194+0000 mon.a (mon.0) 3272 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_count","val": "3"}]: dispatch 2024-03-11T22:25:51.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:51 smithi187 bash[23415]: audit 2024-03-11T22:25:49.295037+0000 mgr.y (mgr.14601) 669 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:51.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:51 smithi187 bash[23415]: audit 2024-03-11T22:25:51.091356+0000 mon.a (mon.0) 3273 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_count","val": "3"}]': finished 2024-03-11T22:25:51.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:51 smithi187 bash[23415]: cluster 2024-03-11T22:25:51.098830+0000 mon.a (mon.0) 3274 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-03-11T22:25:51.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:51 smithi187 bash[23415]: audit 2024-03-11T22:25:51.100215+0000 mon.a (mon.0) 3275 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:25:51.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[21434]: audit 2024-03-11T22:25:49.295037+0000 mgr.y (mgr.14601) 669 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:51.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[21434]: audit 2024-03-11T22:25:51.091356+0000 mon.a (mon.0) 3273 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_count","val": "3"}]': finished 2024-03-11T22:25:51.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[21434]: cluster 2024-03-11T22:25:51.098830+0000 mon.a (mon.0) 3274 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-03-11T22:25:51.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[21434]: audit 2024-03-11T22:25:51.100215+0000 mon.a (mon.0) 3275 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:25:51.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[28804]: audit 2024-03-11T22:25:49.295037+0000 mgr.y (mgr.14601) 669 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:25:51.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[28804]: audit 2024-03-11T22:25:51.091356+0000 mon.a (mon.0) 3273 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_count","val": "3"}]': finished 2024-03-11T22:25:51.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[28804]: cluster 2024-03-11T22:25:51.098830+0000 mon.a (mon.0) 3274 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-03-11T22:25:51.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:51 smithi049 bash[28804]: audit 2024-03-11T22:25:51.100215+0000 mon.a (mon.0) 3275 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_period","val": "3"}]: dispatch 2024-03-11T22:25:52.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:52 smithi187 bash[23415]: cluster 2024-03-11T22:25:50.419107+0000 mgr.y (mgr.14601) 670 : cluster 0 pgmap v1128: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:52.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:52 smithi187 bash[23415]: audit 2024-03-11T22:25:52.094060+0000 mon.a (mon.0) 3276 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_period","val": "3"}]': finished 2024-03-11T22:25:52.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:52 smithi187 bash[23415]: cluster 2024-03-11T22:25:52.101012+0000 mon.a (mon.0) 3277 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-03-11T22:25:52.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:52 smithi187 bash[23415]: audit 2024-03-11T22:25:52.102166+0000 mon.a (mon.0) 3278 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:25:52.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[28804]: cluster 2024-03-11T22:25:50.419107+0000 mgr.y (mgr.14601) 670 : cluster 0 pgmap v1128: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:52.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[28804]: audit 2024-03-11T22:25:52.094060+0000 mon.a (mon.0) 3276 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_period","val": "3"}]': finished 2024-03-11T22:25:52.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[28804]: cluster 2024-03-11T22:25:52.101012+0000 mon.a (mon.0) 3277 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-03-11T22:25:52.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[28804]: audit 2024-03-11T22:25:52.102166+0000 mon.a (mon.0) 3278 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:25:52.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[21434]: cluster 2024-03-11T22:25:50.419107+0000 mgr.y (mgr.14601) 670 : cluster 0 pgmap v1128: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:52.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[21434]: audit 2024-03-11T22:25:52.094060+0000 mon.a (mon.0) 3276 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_period","val": "3"}]': finished 2024-03-11T22:25:52.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[21434]: cluster 2024-03-11T22:25:52.101012+0000 mon.a (mon.0) 3277 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-03-11T22:25:52.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:52 smithi049 bash[21434]: audit 2024-03-11T22:25:52.102166+0000 mon.a (mon.0) 3278 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:25:54.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:54 smithi187 bash[23415]: cluster 2024-03-11T22:25:52.420036+0000 mgr.y (mgr.14601) 671 : cluster 0 pgmap v1131: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:54.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:54 smithi187 bash[23415]: audit 2024-03-11T22:25:53.097124+0000 mon.a (mon.0) 3279 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:25:54.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:54 smithi187 bash[23415]: cluster 2024-03-11T22:25:53.103860+0000 mon.a (mon.0) 3280 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-03-11T22:25:54.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:54 smithi187 bash[23415]: audit 2024-03-11T22:25:53.106048+0000 mon.a (mon.0) 3281 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:25:54.527 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:25:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:25:54.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[21434]: cluster 2024-03-11T22:25:52.420036+0000 mgr.y (mgr.14601) 671 : cluster 0 pgmap v1131: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:54.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[21434]: audit 2024-03-11T22:25:53.097124+0000 mon.a (mon.0) 3279 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:25:54.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[21434]: cluster 2024-03-11T22:25:53.103860+0000 mon.a (mon.0) 3280 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-03-11T22:25:54.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[21434]: audit 2024-03-11T22:25:53.106048+0000 mon.a (mon.0) 3281 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:25:54.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[28804]: cluster 2024-03-11T22:25:52.420036+0000 mgr.y (mgr.14601) 671 : cluster 0 pgmap v1131: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:25:54.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[28804]: audit 2024-03-11T22:25:53.097124+0000 mon.a (mon.0) 3279 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:25:54.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[28804]: cluster 2024-03-11T22:25:53.103860+0000 mon.a (mon.0) 3280 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-03-11T22:25:54.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:54 smithi049 bash[28804]: audit 2024-03-11T22:25:53.106048+0000 mon.a (mon.0) 3281 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-11T22:25:55.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:55 smithi187 bash[23415]: audit 2024-03-11T22:25:54.099454+0000 mon.a (mon.0) 3282 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-11T22:25:55.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:55 smithi187 bash[23415]: cluster 2024-03-11T22:25:54.106851+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-03-11T22:25:55.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:55 smithi049 bash[28804]: audit 2024-03-11T22:25:54.099454+0000 mon.a (mon.0) 3282 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-11T22:25:55.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:55 smithi049 bash[28804]: cluster 2024-03-11T22:25:54.106851+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-03-11T22:25:55.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:55 smithi049 bash[21434]: audit 2024-03-11T22:25:54.099454+0000 mon.a (mon.0) 3282 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-11T22:25:55.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:55 smithi049 bash[21434]: cluster 2024-03-11T22:25:54.106851+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-03-11T22:25:56.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:56 smithi187 bash[23415]: cluster 2024-03-11T22:25:54.420945+0000 mgr.y (mgr.14601) 672 : cluster 0 pgmap v1134: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:56.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:56 smithi187 bash[23415]: cluster 2024-03-11T22:25:55.845696+0000 mon.a (mon.0) 3284 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:56.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:56 smithi049 bash[28804]: cluster 2024-03-11T22:25:54.420945+0000 mgr.y (mgr.14601) 672 : cluster 0 pgmap v1134: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:56.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:56 smithi049 bash[28804]: cluster 2024-03-11T22:25:55.845696+0000 mon.a (mon.0) 3284 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:56.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:56 smithi049 bash[21434]: cluster 2024-03-11T22:25:54.420945+0000 mgr.y (mgr.14601) 672 : cluster 0 pgmap v1134: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:25:56.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:56 smithi049 bash[21434]: cluster 2024-03-11T22:25:55.845696+0000 mon.a (mon.0) 3284 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:25:57.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:57 smithi187 bash[23415]: audit 2024-03-11T22:25:57.024865+0000 mon.c (mon.2) 658 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:57.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:57 smithi049 bash[21434]: audit 2024-03-11T22:25:57.024865+0000 mon.c (mon.2) 658 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:57.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:57 smithi049 bash[28804]: audit 2024-03-11T22:25:57.024865+0000 mon.c (mon.2) 658 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:25:58.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:25:58 smithi187 bash[23415]: cluster 2024-03-11T22:25:56.422021+0000 mgr.y (mgr.14601) 673 : cluster 0 pgmap v1135: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 0 op/s 2024-03-11T22:25:58.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:25:58 smithi049 bash[21434]: cluster 2024-03-11T22:25:56.422021+0000 mgr.y (mgr.14601) 673 : cluster 0 pgmap v1135: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 0 op/s 2024-03-11T22:25:58.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:25:58 smithi049 bash[28804]: cluster 2024-03-11T22:25:56.422021+0000 mgr.y (mgr.14601) 673 : cluster 0 pgmap v1135: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 0 op/s 2024-03-11T22:25:59.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:25:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:26:00.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:00 smithi187 bash[23415]: cluster 2024-03-11T22:25:58.423120+0000 mgr.y (mgr.14601) 674 : cluster 0 pgmap v1136: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-11T22:26:00.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:00 smithi049 bash[21434]: cluster 2024-03-11T22:25:58.423120+0000 mgr.y (mgr.14601) 674 : cluster 0 pgmap v1136: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-11T22:26:00.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:00 smithi049 bash[28804]: cluster 2024-03-11T22:25:58.423120+0000 mgr.y (mgr.14601) 674 : cluster 0 pgmap v1136: 268 pgs: 268 active+clean; 4.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-11T22:26:01.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:01 smithi187 bash[23415]: audit 2024-03-11T22:25:59.306293+0000 mgr.y (mgr.14601) 675 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:01.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:01 smithi049 bash[21434]: audit 2024-03-11T22:25:59.306293+0000 mgr.y (mgr.14601) 675 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:01.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:01 smithi049 bash[28804]: audit 2024-03-11T22:25:59.306293+0000 mgr.y (mgr.14601) 675 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:02.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:02 smithi187 bash[23415]: cluster 2024-03-11T22:26:00.425570+0000 mgr.y (mgr.14601) 676 : cluster 0 pgmap v1137: 268 pgs: 268 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-03-11T22:26:02.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:02 smithi049 bash[21434]: cluster 2024-03-11T22:26:00.425570+0000 mgr.y (mgr.14601) 676 : cluster 0 pgmap v1137: 268 pgs: 268 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-03-11T22:26:02.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:02 smithi049 bash[28804]: cluster 2024-03-11T22:26:00.425570+0000 mgr.y (mgr.14601) 676 : cluster 0 pgmap v1137: 268 pgs: 268 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-03-11T22:26:04.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:04 smithi187 bash[23415]: cluster 2024-03-11T22:26:02.426561+0000 mgr.y (mgr.14601) 677 : cluster 0 pgmap v1138: 268 pgs: 268 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.4 KiB/s wr, 1 op/s 2024-03-11T22:26:04.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:04 smithi049 bash[21434]: cluster 2024-03-11T22:26:02.426561+0000 mgr.y (mgr.14601) 677 : cluster 0 pgmap v1138: 268 pgs: 268 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.4 KiB/s wr, 1 op/s 2024-03-11T22:26:04.527 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:04 smithi049 bash[28804]: cluster 2024-03-11T22:26:02.426561+0000 mgr.y (mgr.14601) 677 : cluster 0 pgmap v1138: 268 pgs: 268 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.4 KiB/s wr, 1 op/s 2024-03-11T22:26:04.527 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:26:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:26:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:26:06.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:06 smithi187 bash[23415]: cluster 2024-03-11T22:26:04.429354+0000 mgr.y (mgr.14601) 678 : cluster 0 pgmap v1139: 268 pgs: 268 active+clean; 4.5 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 991 B/s rd, 8.0 KiB/s wr, 2 op/s 2024-03-11T22:26:06.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:06 smithi049 bash[21434]: cluster 2024-03-11T22:26:04.429354+0000 mgr.y (mgr.14601) 678 : cluster 0 pgmap v1139: 268 pgs: 268 active+clean; 4.5 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 991 B/s rd, 8.0 KiB/s wr, 2 op/s 2024-03-11T22:26:06.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:06 smithi049 bash[28804]: cluster 2024-03-11T22:26:04.429354+0000 mgr.y (mgr.14601) 678 : cluster 0 pgmap v1139: 268 pgs: 268 active+clean; 4.5 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 991 B/s rd, 8.0 KiB/s wr, 2 op/s 2024-03-11T22:26:07.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:07 smithi187 bash[23415]: audit 2024-03-11T22:26:06.204938+0000 mon.a (mon.0) 3285 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:07.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:07 smithi187 bash[23415]: audit 2024-03-11T22:26:06.205793+0000 mon.a (mon.0) 3286 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140"}]: dispatch 2024-03-11T22:26:07.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:07 smithi049 bash[21434]: audit 2024-03-11T22:26:06.204938+0000 mon.a (mon.0) 3285 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:07.527 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:07 smithi049 bash[21434]: audit 2024-03-11T22:26:06.205793+0000 mon.a (mon.0) 3286 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140"}]: dispatch 2024-03-11T22:26:07.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:07 smithi049 bash[28804]: audit 2024-03-11T22:26:06.204938+0000 mon.a (mon.0) 3285 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:07.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:07 smithi049 bash[28804]: audit 2024-03-11T22:26:06.205793+0000 mon.a (mon.0) 3286 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140"}]: dispatch 2024-03-11T22:26:08.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:08 smithi187 bash[23415]: cluster 2024-03-11T22:26:06.430367+0000 mgr.y (mgr.14601) 679 : cluster 0 pgmap v1140: 268 pgs: 268 active+clean; 4.5 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-03-11T22:26:08.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:08 smithi187 bash[23415]: audit 2024-03-11T22:26:07.158919+0000 mon.a (mon.0) 3287 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140"}]': finished 2024-03-11T22:26:08.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:08 smithi187 bash[23415]: cluster 2024-03-11T22:26:07.166373+0000 mon.a (mon.0) 3288 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-03-11T22:26:09.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:08 smithi049 bash[21434]: cluster 2024-03-11T22:26:06.430367+0000 mgr.y (mgr.14601) 679 : cluster 0 pgmap v1140: 268 pgs: 268 active+clean; 4.5 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-03-11T22:26:09.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:08 smithi049 bash[21434]: audit 2024-03-11T22:26:07.158919+0000 mon.a (mon.0) 3287 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140"}]': finished 2024-03-11T22:26:09.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:08 smithi049 bash[21434]: cluster 2024-03-11T22:26:07.166373+0000 mon.a (mon.0) 3288 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-03-11T22:26:09.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:08 smithi049 bash[28804]: cluster 2024-03-11T22:26:06.430367+0000 mgr.y (mgr.14601) 679 : cluster 0 pgmap v1140: 268 pgs: 268 active+clean; 4.5 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-03-11T22:26:09.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:08 smithi049 bash[28804]: audit 2024-03-11T22:26:07.158919+0000 mon.a (mon.0) 3287 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-140"}]': finished 2024-03-11T22:26:09.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:08 smithi049 bash[28804]: cluster 2024-03-11T22:26:07.166373+0000 mon.a (mon.0) 3288 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-03-11T22:26:09.662 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:26:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:26:09.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:09 smithi187 bash[23415]: cluster 2024-03-11T22:26:08.180757+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-03-11T22:26:09.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:09 smithi187 bash[23415]: cluster 2024-03-11T22:26:08.431761+0000 mgr.y (mgr.14601) 680 : cluster 0 pgmap v1143: 236 pgs: 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:09.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:09 smithi187 bash[23415]: cluster 2024-03-11T22:26:09.185183+0000 mon.a (mon.0) 3290 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-03-11T22:26:09.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:09 smithi187 bash[23415]: audit 2024-03-11T22:26:09.189343+0000 mon.a (mon.0) 3291 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:10.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[21434]: cluster 2024-03-11T22:26:08.180757+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-03-11T22:26:10.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[21434]: cluster 2024-03-11T22:26:08.431761+0000 mgr.y (mgr.14601) 680 : cluster 0 pgmap v1143: 236 pgs: 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:10.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[21434]: cluster 2024-03-11T22:26:09.185183+0000 mon.a (mon.0) 3290 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-03-11T22:26:10.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[21434]: audit 2024-03-11T22:26:09.189343+0000 mon.a (mon.0) 3291 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:10.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[28804]: cluster 2024-03-11T22:26:08.180757+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-03-11T22:26:10.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[28804]: cluster 2024-03-11T22:26:08.431761+0000 mgr.y (mgr.14601) 680 : cluster 0 pgmap v1143: 236 pgs: 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:10.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[28804]: cluster 2024-03-11T22:26:09.185183+0000 mon.a (mon.0) 3290 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-03-11T22:26:10.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:09 smithi049 bash[28804]: audit 2024-03-11T22:26:09.189343+0000 mon.a (mon.0) 3291 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:10.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:10 smithi187 bash[23415]: audit 2024-03-11T22:26:09.314411+0000 mgr.y (mgr.14601) 681 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:10.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:10 smithi187 bash[23415]: audit 2024-03-11T22:26:10.181200+0000 mon.a (mon.0) 3292 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:10.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:10 smithi187 bash[23415]: cluster 2024-03-11T22:26:10.188346+0000 mon.a (mon.0) 3293 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-03-11T22:26:10.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:10 smithi187 bash[23415]: audit 2024-03-11T22:26:10.289694+0000 mon.a (mon.0) 3294 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:11.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[21434]: audit 2024-03-11T22:26:09.314411+0000 mgr.y (mgr.14601) 681 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:11.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[21434]: audit 2024-03-11T22:26:10.181200+0000 mon.a (mon.0) 3292 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:11.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[21434]: cluster 2024-03-11T22:26:10.188346+0000 mon.a (mon.0) 3293 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-03-11T22:26:11.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[21434]: audit 2024-03-11T22:26:10.289694+0000 mon.a (mon.0) 3294 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:11.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[28804]: audit 2024-03-11T22:26:09.314411+0000 mgr.y (mgr.14601) 681 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:11.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[28804]: audit 2024-03-11T22:26:10.181200+0000 mon.a (mon.0) 3292 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:11.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[28804]: cluster 2024-03-11T22:26:10.188346+0000 mon.a (mon.0) 3293 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-03-11T22:26:11.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:10 smithi049 bash[28804]: audit 2024-03-11T22:26:10.289694+0000 mon.a (mon.0) 3294 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:11.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:11 smithi187 bash[23415]: cluster 2024-03-11T22:26:10.432801+0000 mgr.y (mgr.14601) 682 : cluster 0 pgmap v1146: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:11.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:11 smithi187 bash[23415]: audit 2024-03-11T22:26:11.189636+0000 mon.a (mon.0) 3295 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:11.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:11 smithi187 bash[23415]: cluster 2024-03-11T22:26:11.196601+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-03-11T22:26:11.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:11 smithi187 bash[23415]: audit 2024-03-11T22:26:11.198671+0000 mon.a (mon.0) 3297 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[21434]: cluster 2024-03-11T22:26:10.432801+0000 mgr.y (mgr.14601) 682 : cluster 0 pgmap v1146: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[21434]: audit 2024-03-11T22:26:11.189636+0000 mon.a (mon.0) 3295 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[21434]: cluster 2024-03-11T22:26:11.196601+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[21434]: audit 2024-03-11T22:26:11.198671+0000 mon.a (mon.0) 3297 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[28804]: cluster 2024-03-11T22:26:10.432801+0000 mgr.y (mgr.14601) 682 : cluster 0 pgmap v1146: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[28804]: audit 2024-03-11T22:26:11.189636+0000 mon.a (mon.0) 3295 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[28804]: cluster 2024-03-11T22:26:11.196601+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-03-11T22:26:12.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:11 smithi049 bash[28804]: audit 2024-03-11T22:26:11.198671+0000 mon.a (mon.0) 3297 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:12.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:12 smithi187 bash[23415]: audit 2024-03-11T22:26:12.059835+0000 mon.c (mon.2) 659 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:12.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:12 smithi187 bash[23415]: audit 2024-03-11T22:26:12.192075+0000 mon.a (mon.0) 3298 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-142"}]': finished 2024-03-11T22:26:12.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:12 smithi187 bash[23415]: cluster 2024-03-11T22:26:12.199390+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-03-11T22:26:12.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:12 smithi187 bash[23415]: audit 2024-03-11T22:26:12.200432+0000 mon.a (mon.0) 3300 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-142", "mode": "writeback"}]: dispatch 2024-03-11T22:26:13.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[21434]: audit 2024-03-11T22:26:12.059835+0000 mon.c (mon.2) 659 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:13.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[21434]: audit 2024-03-11T22:26:12.192075+0000 mon.a (mon.0) 3298 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-142"}]': finished 2024-03-11T22:26:13.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[21434]: cluster 2024-03-11T22:26:12.199390+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-03-11T22:26:13.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[21434]: audit 2024-03-11T22:26:12.200432+0000 mon.a (mon.0) 3300 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-142", "mode": "writeback"}]: dispatch 2024-03-11T22:26:13.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[28804]: audit 2024-03-11T22:26:12.059835+0000 mon.c (mon.2) 659 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:13.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[28804]: audit 2024-03-11T22:26:12.192075+0000 mon.a (mon.0) 3298 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-142"}]': finished 2024-03-11T22:26:13.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[28804]: cluster 2024-03-11T22:26:12.199390+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-03-11T22:26:13.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:12 smithi049 bash[28804]: audit 2024-03-11T22:26:12.200432+0000 mon.a (mon.0) 3300 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-142", "mode": "writeback"}]: dispatch 2024-03-11T22:26:13.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:13 smithi187 bash[23415]: cluster 2024-03-11T22:26:12.433803+0000 mgr.y (mgr.14601) 683 : cluster 0 pgmap v1149: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:13.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:13 smithi187 bash[23415]: cluster 2024-03-11T22:26:13.193354+0000 mon.a (mon.0) 3301 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:13.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:13 smithi187 bash[23415]: audit 2024-03-11T22:26:13.201463+0000 mon.a (mon.0) 3302 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-142", "mode": "writeback"}]': finished 2024-03-11T22:26:13.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:13 smithi187 bash[23415]: cluster 2024-03-11T22:26:13.208089+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-03-11T22:26:13.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:13 smithi187 bash[23415]: audit 2024-03-11T22:26:13.209535+0000 mon.a (mon.0) 3304 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:26:14.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[21434]: cluster 2024-03-11T22:26:12.433803+0000 mgr.y (mgr.14601) 683 : cluster 0 pgmap v1149: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:14.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[21434]: cluster 2024-03-11T22:26:13.193354+0000 mon.a (mon.0) 3301 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:14.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[21434]: audit 2024-03-11T22:26:13.201463+0000 mon.a (mon.0) 3302 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-142", "mode": "writeback"}]': finished 2024-03-11T22:26:14.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[21434]: cluster 2024-03-11T22:26:13.208089+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-03-11T22:26:14.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[21434]: audit 2024-03-11T22:26:13.209535+0000 mon.a (mon.0) 3304 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:26:14.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[28804]: cluster 2024-03-11T22:26:12.433803+0000 mgr.y (mgr.14601) 683 : cluster 0 pgmap v1149: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:14.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[28804]: cluster 2024-03-11T22:26:13.193354+0000 mon.a (mon.0) 3301 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:14.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[28804]: audit 2024-03-11T22:26:13.201463+0000 mon.a (mon.0) 3302 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-142", "mode": "writeback"}]': finished 2024-03-11T22:26:14.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[28804]: cluster 2024-03-11T22:26:13.208089+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-03-11T22:26:14.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:13 smithi049 bash[28804]: audit 2024-03-11T22:26:13.209535+0000 mon.a (mon.0) 3304 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:26:14.527 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:26:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:26:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:26:15.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:15 smithi187 bash[23415]: audit 2024-03-11T22:26:14.204494+0000 mon.a (mon.0) 3305 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:26:15.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:15 smithi187 bash[23415]: cluster 2024-03-11T22:26:14.214385+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-03-11T22:26:15.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:15 smithi187 bash[23415]: audit 2024-03-11T22:26:14.216846+0000 mon.a (mon.0) 3307 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:26:15.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:15 smithi187 bash[23415]: cluster 2024-03-11T22:26:14.434832+0000 mgr.y (mgr.14601) 684 : cluster 0 pgmap v1152: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[21434]: audit 2024-03-11T22:26:14.204494+0000 mon.a (mon.0) 3305 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[21434]: cluster 2024-03-11T22:26:14.214385+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[21434]: audit 2024-03-11T22:26:14.216846+0000 mon.a (mon.0) 3307 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[21434]: cluster 2024-03-11T22:26:14.434832+0000 mgr.y (mgr.14601) 684 : cluster 0 pgmap v1152: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[28804]: audit 2024-03-11T22:26:14.204494+0000 mon.a (mon.0) 3305 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[28804]: cluster 2024-03-11T22:26:14.214385+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[28804]: audit 2024-03-11T22:26:14.216846+0000 mon.a (mon.0) 3307 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:26:15.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:15 smithi049 bash[28804]: cluster 2024-03-11T22:26:14.434832+0000 mgr.y (mgr.14601) 684 : cluster 0 pgmap v1152: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-11T22:26:16.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:16 smithi187 bash[23415]: audit 2024-03-11T22:26:15.213429+0000 mon.a (mon.0) 3308 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:26:16.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:16 smithi187 bash[23415]: cluster 2024-03-11T22:26:15.221817+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-03-11T22:26:16.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:16 smithi187 bash[23415]: audit 2024-03-11T22:26:15.222682+0000 mon.a (mon.0) 3310 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:26:16.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:16 smithi049 bash[21434]: audit 2024-03-11T22:26:15.213429+0000 mon.a (mon.0) 3308 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:26:16.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:16 smithi049 bash[21434]: cluster 2024-03-11T22:26:15.221817+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-03-11T22:26:16.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:16 smithi049 bash[21434]: audit 2024-03-11T22:26:15.222682+0000 mon.a (mon.0) 3310 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:26:16.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:16 smithi049 bash[28804]: audit 2024-03-11T22:26:15.213429+0000 mon.a (mon.0) 3308 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:26:16.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:16 smithi049 bash[28804]: cluster 2024-03-11T22:26:15.221817+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-03-11T22:26:16.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:16 smithi049 bash[28804]: audit 2024-03-11T22:26:15.222682+0000 mon.a (mon.0) 3310 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:26:17.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:17 smithi187 bash[23415]: cluster 2024-03-11T22:26:16.213816+0000 mon.a (mon.0) 3311 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:17.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:17 smithi187 bash[23415]: audit 2024-03-11T22:26:16.216336+0000 mon.a (mon.0) 3312 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:26:17.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:17 smithi187 bash[23415]: cluster 2024-03-11T22:26:16.223744+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-03-11T22:26:17.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:17 smithi187 bash[23415]: audit 2024-03-11T22:26:16.225518+0000 mon.a (mon.0) 3314 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:26:17.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:17 smithi187 bash[23415]: cluster 2024-03-11T22:26:16.435673+0000 mgr.y (mgr.14601) 685 : cluster 0 pgmap v1155: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-11T22:26:17.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[21434]: cluster 2024-03-11T22:26:16.213816+0000 mon.a (mon.0) 3311 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:17.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[21434]: audit 2024-03-11T22:26:16.216336+0000 mon.a (mon.0) 3312 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:26:17.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[21434]: cluster 2024-03-11T22:26:16.223744+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-03-11T22:26:17.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[21434]: audit 2024-03-11T22:26:16.225518+0000 mon.a (mon.0) 3314 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:26:17.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[21434]: cluster 2024-03-11T22:26:16.435673+0000 mgr.y (mgr.14601) 685 : cluster 0 pgmap v1155: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-11T22:26:17.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[28804]: cluster 2024-03-11T22:26:16.213816+0000 mon.a (mon.0) 3311 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:17.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[28804]: audit 2024-03-11T22:26:16.216336+0000 mon.a (mon.0) 3312 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:26:17.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[28804]: cluster 2024-03-11T22:26:16.223744+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-03-11T22:26:17.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[28804]: audit 2024-03-11T22:26:16.225518+0000 mon.a (mon.0) 3314 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:26:17.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:17 smithi049 bash[28804]: cluster 2024-03-11T22:26:16.435673+0000 mgr.y (mgr.14601) 685 : cluster 0 pgmap v1155: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-11T22:26:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:18 smithi187 bash[23415]: audit 2024-03-11T22:26:17.219051+0000 mon.a (mon.0) 3315 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:26:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:18 smithi187 bash[23415]: cluster 2024-03-11T22:26:17.226188+0000 mon.a (mon.0) 3316 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-03-11T22:26:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:18 smithi187 bash[23415]: audit 2024-03-11T22:26:17.229103+0000 mon.a (mon.0) 3317 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:26:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:18 smithi187 bash[23415]: audit 2024-03-11T22:26:18.221834+0000 mon.a (mon.0) 3318 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-11T22:26:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:18 smithi187 bash[23415]: cluster 2024-03-11T22:26:18.229888+0000 mon.a (mon.0) 3319 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-03-11T22:26:18.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:18 smithi187 bash[23415]: audit 2024-03-11T22:26:18.233218+0000 mon.a (mon.0) 3320 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:26:18.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[21434]: audit 2024-03-11T22:26:17.219051+0000 mon.a (mon.0) 3315 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:26:18.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[21434]: cluster 2024-03-11T22:26:17.226188+0000 mon.a (mon.0) 3316 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-03-11T22:26:18.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[21434]: audit 2024-03-11T22:26:17.229103+0000 mon.a (mon.0) 3317 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:26:18.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[21434]: audit 2024-03-11T22:26:18.221834+0000 mon.a (mon.0) 3318 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-11T22:26:18.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[21434]: cluster 2024-03-11T22:26:18.229888+0000 mon.a (mon.0) 3319 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-03-11T22:26:18.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[21434]: audit 2024-03-11T22:26:18.233218+0000 mon.a (mon.0) 3320 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:26:18.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[28804]: audit 2024-03-11T22:26:17.219051+0000 mon.a (mon.0) 3315 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:26:18.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[28804]: cluster 2024-03-11T22:26:17.226188+0000 mon.a (mon.0) 3316 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-03-11T22:26:18.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[28804]: audit 2024-03-11T22:26:17.229103+0000 mon.a (mon.0) 3317 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-11T22:26:18.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[28804]: audit 2024-03-11T22:26:18.221834+0000 mon.a (mon.0) 3318 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-11T22:26:18.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[28804]: cluster 2024-03-11T22:26:18.229888+0000 mon.a (mon.0) 3319 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-03-11T22:26:18.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:18 smithi049 bash[28804]: audit 2024-03-11T22:26:18.233218+0000 mon.a (mon.0) 3320 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-11T22:26:19.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:19 smithi049 bash[21434]: cluster 2024-03-11T22:26:18.436870+0000 mgr.y (mgr.14601) 686 : cluster 0 pgmap v1158: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:19.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:19 smithi049 bash[21434]: audit 2024-03-11T22:26:19.224516+0000 mon.a (mon.0) 3321 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-11T22:26:19.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:19 smithi049 bash[21434]: cluster 2024-03-11T22:26:19.231353+0000 mon.a (mon.0) 3322 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-03-11T22:26:19.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:19 smithi049 bash[28804]: cluster 2024-03-11T22:26:18.436870+0000 mgr.y (mgr.14601) 686 : cluster 0 pgmap v1158: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:19.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:19 smithi049 bash[28804]: audit 2024-03-11T22:26:19.224516+0000 mon.a (mon.0) 3321 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-11T22:26:19.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:19 smithi049 bash[28804]: cluster 2024-03-11T22:26:19.231353+0000 mon.a (mon.0) 3322 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-03-11T22:26:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:19 smithi187 bash[23415]: cluster 2024-03-11T22:26:18.436870+0000 mgr.y (mgr.14601) 686 : cluster 0 pgmap v1158: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:19 smithi187 bash[23415]: audit 2024-03-11T22:26:19.224516+0000 mon.a (mon.0) 3321 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-11T22:26:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:19 smithi187 bash[23415]: cluster 2024-03-11T22:26:19.231353+0000 mon.a (mon.0) 3322 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-03-11T22:26:19.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:26:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:26:20.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:20 smithi049 bash[21434]: audit 2024-03-11T22:26:19.325186+0000 mgr.y (mgr.14601) 687 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:20.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:20 smithi049 bash[21434]: audit 2024-03-11T22:26:19.330652+0000 mon.a (mon.0) 3323 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:20.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:20 smithi049 bash[28804]: audit 2024-03-11T22:26:19.325186+0000 mgr.y (mgr.14601) 687 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:20.528 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:20 smithi049 bash[28804]: audit 2024-03-11T22:26:19.330652+0000 mon.a (mon.0) 3323 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:20.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:20 smithi187 bash[23415]: audit 2024-03-11T22:26:19.325186+0000 mgr.y (mgr.14601) 687 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:20.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:20 smithi187 bash[23415]: audit 2024-03-11T22:26:19.330652+0000 mon.a (mon.0) 3323 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:21.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:21 smithi187 bash[23415]: audit 2024-03-11T22:26:20.268932+0000 mon.a (mon.0) 3324 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:26:21.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:21 smithi187 bash[23415]: cluster 2024-03-11T22:26:20.276731+0000 mon.a (mon.0) 3325 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-03-11T22:26:21.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:21 smithi187 bash[23415]: audit 2024-03-11T22:26:20.277564+0000 mon.a (mon.0) 3326 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:21.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:21 smithi187 bash[23415]: cluster 2024-03-11T22:26:20.437720+0000 mgr.y (mgr.14601) 688 : cluster 0 pgmap v1161: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:21.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:21 smithi187 bash[23415]: audit 2024-03-11T22:26:21.096757+0000 mon.c (mon.2) 660 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[21434]: audit 2024-03-11T22:26:20.268932+0000 mon.a (mon.0) 3324 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[21434]: cluster 2024-03-11T22:26:20.276731+0000 mon.a (mon.0) 3325 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[21434]: audit 2024-03-11T22:26:20.277564+0000 mon.a (mon.0) 3326 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[21434]: cluster 2024-03-11T22:26:20.437720+0000 mgr.y (mgr.14601) 688 : cluster 0 pgmap v1161: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[21434]: audit 2024-03-11T22:26:21.096757+0000 mon.c (mon.2) 660 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[28804]: audit 2024-03-11T22:26:20.268932+0000 mon.a (mon.0) 3324 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[28804]: cluster 2024-03-11T22:26:20.276731+0000 mon.a (mon.0) 3325 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[28804]: audit 2024-03-11T22:26:20.277564+0000 mon.a (mon.0) 3326 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[28804]: cluster 2024-03-11T22:26:20.437720+0000 mgr.y (mgr.14601) 688 : cluster 0 pgmap v1161: 268 pgs: 268 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:21.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:21 smithi049 bash[28804]: audit 2024-03-11T22:26:21.096757+0000 mon.c (mon.2) 660 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:26:23.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[21434]: audit 2024-03-11T22:26:21.279902+0000 mon.a (mon.0) 3327 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]': finished 2024-03-11T22:26:23.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[21434]: cluster 2024-03-11T22:26:21.287639+0000 mon.a (mon.0) 3328 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-03-11T22:26:23.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[21434]: audit 2024-03-11T22:26:21.359609+0000 mon.a (mon.0) 3329 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:23.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[21434]: audit 2024-03-11T22:26:21.360336+0000 mon.a (mon.0) 3330 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:23.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[21434]: audit 2024-03-11T22:26:21.830630+0000 mon.c (mon.2) 661 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[21434]: audit 2024-03-11T22:26:21.832260+0000 mon.c (mon.2) 662 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[21434]: audit 2024-03-11T22:26:21.842579+0000 mon.a (mon.0) 3331 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[28804]: audit 2024-03-11T22:26:21.279902+0000 mon.a (mon.0) 3327 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]': finished 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[28804]: cluster 2024-03-11T22:26:21.287639+0000 mon.a (mon.0) 3328 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[28804]: audit 2024-03-11T22:26:21.359609+0000 mon.a (mon.0) 3329 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[28804]: audit 2024-03-11T22:26:21.360336+0000 mon.a (mon.0) 3330 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[28804]: audit 2024-03-11T22:26:21.830630+0000 mon.c (mon.2) 661 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[28804]: audit 2024-03-11T22:26:21.832260+0000 mon.c (mon.2) 662 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:26:23.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:22 smithi049 bash[28804]: audit 2024-03-11T22:26:21.842579+0000 mon.a (mon.0) 3331 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:26:23.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:22 smithi187 bash[23415]: audit 2024-03-11T22:26:21.279902+0000 mon.a (mon.0) 3327 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]': finished 2024-03-11T22:26:23.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:22 smithi187 bash[23415]: cluster 2024-03-11T22:26:21.287639+0000 mon.a (mon.0) 3328 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-03-11T22:26:23.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:22 smithi187 bash[23415]: audit 2024-03-11T22:26:21.359609+0000 mon.a (mon.0) 3329 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:23.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:22 smithi187 bash[23415]: audit 2024-03-11T22:26:21.360336+0000 mon.a (mon.0) 3330 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-142"}]: dispatch 2024-03-11T22:26:23.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:22 smithi187 bash[23415]: audit 2024-03-11T22:26:21.830630+0000 mon.c (mon.2) 661 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:26:23.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:22 smithi187 bash[23415]: audit 2024-03-11T22:26:21.832260+0000 mon.c (mon.2) 662 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:26:23.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:22 smithi187 bash[23415]: audit 2024-03-11T22:26:21.842579+0000 mon.a (mon.0) 3331 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:26:24.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[21434]: cluster 2024-03-11T22:26:22.288993+0000 mon.a (mon.0) 3332 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-03-11T22:26:24.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[21434]: cluster 2024-03-11T22:26:22.438466+0000 mgr.y (mgr.14601) 689 : cluster 0 pgmap v1164: 236 pgs: 236 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:24.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[21434]: cluster 2024-03-11T22:26:23.293931+0000 mon.a (mon.0) 3333 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-03-11T22:26:24.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[21434]: audit 2024-03-11T22:26:23.298096+0000 mon.a (mon.0) 3334 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:24.028 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[28804]: cluster 2024-03-11T22:26:22.288993+0000 mon.a (mon.0) 3332 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-03-11T22:26:24.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[28804]: cluster 2024-03-11T22:26:22.438466+0000 mgr.y (mgr.14601) 689 : cluster 0 pgmap v1164: 236 pgs: 236 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:24.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[28804]: cluster 2024-03-11T22:26:23.293931+0000 mon.a (mon.0) 3333 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-03-11T22:26:24.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:23 smithi049 bash[28804]: audit 2024-03-11T22:26:23.298096+0000 mon.a (mon.0) 3334 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:24.248 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:23 smithi187 bash[23415]: cluster 2024-03-11T22:26:22.288993+0000 mon.a (mon.0) 3332 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-03-11T22:26:24.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:23 smithi187 bash[23415]: cluster 2024-03-11T22:26:22.438466+0000 mgr.y (mgr.14601) 689 : cluster 0 pgmap v1164: 236 pgs: 236 active+clean; 4.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:24.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:23 smithi187 bash[23415]: cluster 2024-03-11T22:26:23.293931+0000 mon.a (mon.0) 3333 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-03-11T22:26:24.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:23 smithi187 bash[23415]: audit 2024-03-11T22:26:23.298096+0000 mon.a (mon.0) 3334 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:24.528 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:26:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:26:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:26:25.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:25 smithi187 bash[23415]: audit 2024-03-11T22:26:24.289469+0000 mon.a (mon.0) 3335 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:25.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:25 smithi187 bash[23415]: cluster 2024-03-11T22:26:24.298154+0000 mon.a (mon.0) 3336 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-03-11T22:26:25.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:25 smithi187 bash[23415]: audit 2024-03-11T22:26:24.349299+0000 mon.a (mon.0) 3337 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:25.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:25 smithi187 bash[23415]: cluster 2024-03-11T22:26:24.439320+0000 mgr.y (mgr.14601) 690 : cluster 0 pgmap v1167: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:26:25.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[21434]: audit 2024-03-11T22:26:24.289469+0000 mon.a (mon.0) 3335 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:25.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[21434]: cluster 2024-03-11T22:26:24.298154+0000 mon.a (mon.0) 3336 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-03-11T22:26:25.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[21434]: audit 2024-03-11T22:26:24.349299+0000 mon.a (mon.0) 3337 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:25.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[21434]: cluster 2024-03-11T22:26:24.439320+0000 mgr.y (mgr.14601) 690 : cluster 0 pgmap v1167: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:26:25.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[28804]: audit 2024-03-11T22:26:24.289469+0000 mon.a (mon.0) 3335 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:25.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[28804]: cluster 2024-03-11T22:26:24.298154+0000 mon.a (mon.0) 3336 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-03-11T22:26:25.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[28804]: audit 2024-03-11T22:26:24.349299+0000 mon.a (mon.0) 3337 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:25.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:25 smithi049 bash[28804]: cluster 2024-03-11T22:26:24.439320+0000 mgr.y (mgr.14601) 690 : cluster 0 pgmap v1167: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:26:26.748 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:26 smithi187 bash[23415]: audit 2024-03-11T22:26:25.298728+0000 mon.a (mon.0) 3338 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:26.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:26 smithi187 bash[23415]: cluster 2024-03-11T22:26:25.307461+0000 mon.a (mon.0) 3339 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-03-11T22:26:26.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:26 smithi187 bash[23415]: audit 2024-03-11T22:26:25.308469+0000 mon.a (mon.0) 3340 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:26.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:26 smithi049 bash[21434]: audit 2024-03-11T22:26:25.298728+0000 mon.a (mon.0) 3338 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:26.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:26 smithi049 bash[21434]: cluster 2024-03-11T22:26:25.307461+0000 mon.a (mon.0) 3339 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-03-11T22:26:26.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:26 smithi049 bash[21434]: audit 2024-03-11T22:26:25.308469+0000 mon.a (mon.0) 3340 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:26.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:26 smithi049 bash[28804]: audit 2024-03-11T22:26:25.298728+0000 mon.a (mon.0) 3338 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:26.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:26 smithi049 bash[28804]: cluster 2024-03-11T22:26:25.307461+0000 mon.a (mon.0) 3339 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-03-11T22:26:26.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:26 smithi049 bash[28804]: audit 2024-03-11T22:26:25.308469+0000 mon.a (mon.0) 3340 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:27.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: audit 2024-03-11T22:26:26.301481+0000 mon.a (mon.0) 3341 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-144"}]': finished 2024-03-11T22:26:27.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: cluster 2024-03-11T22:26:26.308029+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-03-11T22:26:27.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: audit 2024-03-11T22:26:26.310707+0000 mon.a (mon.0) 3343 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-144", "mode": "readproxy"}]: dispatch 2024-03-11T22:26:27.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: cluster 2024-03-11T22:26:26.440274+0000 mgr.y (mgr.14601) 691 : cluster 0 pgmap v1170: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:26:27.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: audit 2024-03-11T22:26:27.094133+0000 mon.c (mon.2) 663 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:27.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: cluster 2024-03-11T22:26:27.301880+0000 mon.a (mon.0) 3344 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:27.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: audit 2024-03-11T22:26:27.304411+0000 mon.a (mon.0) 3345 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-144", "mode": "readproxy"}]': finished 2024-03-11T22:26:27.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:27 smithi187 bash[23415]: cluster 2024-03-11T22:26:27.311406+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-03-11T22:26:27.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: audit 2024-03-11T22:26:26.301481+0000 mon.a (mon.0) 3341 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-144"}]': finished 2024-03-11T22:26:27.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: cluster 2024-03-11T22:26:26.308029+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-03-11T22:26:27.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: audit 2024-03-11T22:26:26.310707+0000 mon.a (mon.0) 3343 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-144", "mode": "readproxy"}]: dispatch 2024-03-11T22:26:27.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: cluster 2024-03-11T22:26:26.440274+0000 mgr.y (mgr.14601) 691 : cluster 0 pgmap v1170: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: audit 2024-03-11T22:26:27.094133+0000 mon.c (mon.2) 663 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: cluster 2024-03-11T22:26:27.301880+0000 mon.a (mon.0) 3344 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: audit 2024-03-11T22:26:27.304411+0000 mon.a (mon.0) 3345 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-144", "mode": "readproxy"}]': finished 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[28804]: cluster 2024-03-11T22:26:27.311406+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: audit 2024-03-11T22:26:26.301481+0000 mon.a (mon.0) 3341 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-144"}]': finished 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: cluster 2024-03-11T22:26:26.308029+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: audit 2024-03-11T22:26:26.310707+0000 mon.a (mon.0) 3343 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-144", "mode": "readproxy"}]: dispatch 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: cluster 2024-03-11T22:26:26.440274+0000 mgr.y (mgr.14601) 691 : cluster 0 pgmap v1170: 268 pgs: 32 creating+peering, 236 active+clean; 4.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: audit 2024-03-11T22:26:27.094133+0000 mon.c (mon.2) 663 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: cluster 2024-03-11T22:26:27.301880+0000 mon.a (mon.0) 3344 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: audit 2024-03-11T22:26:27.304411+0000 mon.a (mon.0) 3345 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-144", "mode": "readproxy"}]': finished 2024-03-11T22:26:27.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:27 smithi049 bash[21434]: cluster 2024-03-11T22:26:27.311406+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-03-11T22:26:29.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:29 smithi187 bash[23415]: cluster 2024-03-11T22:26:28.441501+0000 mgr.y (mgr.14601) 692 : cluster 0 pgmap v1172: 268 pgs: 28 creating+peering, 240 active+clean; 4.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:29.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:26:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:26:29.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:29 smithi049 bash[21434]: cluster 2024-03-11T22:26:28.441501+0000 mgr.y (mgr.14601) 692 : cluster 0 pgmap v1172: 268 pgs: 28 creating+peering, 240 active+clean; 4.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:29.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:29 smithi049 bash[28804]: cluster 2024-03-11T22:26:28.441501+0000 mgr.y (mgr.14601) 692 : cluster 0 pgmap v1172: 268 pgs: 28 creating+peering, 240 active+clean; 4.4 MiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:30.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:30 smithi049 bash[21434]: audit 2024-03-11T22:26:29.332095+0000 mgr.y (mgr.14601) 693 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:30.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:30 smithi049 bash[28804]: audit 2024-03-11T22:26:29.332095+0000 mgr.y (mgr.14601) 693 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:30.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:30 smithi187 bash[23415]: audit 2024-03-11T22:26:29.332095+0000 mgr.y (mgr.14601) 693 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:31.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:31 smithi049 bash[28804]: cluster 2024-03-11T22:26:30.444008+0000 mgr.y (mgr.14601) 694 : cluster 0 pgmap v1173: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:26:31.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:31 smithi049 bash[21434]: cluster 2024-03-11T22:26:30.444008+0000 mgr.y (mgr.14601) 694 : cluster 0 pgmap v1173: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:26:31.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:31 smithi187 bash[23415]: cluster 2024-03-11T22:26:30.444008+0000 mgr.y (mgr.14601) 694 : cluster 0 pgmap v1173: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-03-11T22:26:33.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:33 smithi049 bash[28804]: cluster 2024-03-11T22:26:32.444868+0000 mgr.y (mgr.14601) 695 : cluster 0 pgmap v1174: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 860 B/s rd, 143 B/s wr, 0 op/s 2024-03-11T22:26:33.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:33 smithi049 bash[21434]: cluster 2024-03-11T22:26:32.444868+0000 mgr.y (mgr.14601) 695 : cluster 0 pgmap v1174: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 860 B/s rd, 143 B/s wr, 0 op/s 2024-03-11T22:26:33.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:33 smithi187 bash[23415]: cluster 2024-03-11T22:26:32.444868+0000 mgr.y (mgr.14601) 695 : cluster 0 pgmap v1174: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 860 B/s rd, 143 B/s wr, 0 op/s 2024-03-11T22:26:34.528 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:26:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:26:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:26:35.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:35 smithi049 bash[28804]: cluster 2024-03-11T22:26:34.447432+0000 mgr.y (mgr.14601) 696 : cluster 0 pgmap v1175: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 125 B/s wr, 1 op/s 2024-03-11T22:26:35.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:35 smithi049 bash[21434]: cluster 2024-03-11T22:26:34.447432+0000 mgr.y (mgr.14601) 696 : cluster 0 pgmap v1175: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 125 B/s wr, 1 op/s 2024-03-11T22:26:35.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:35 smithi187 bash[23415]: cluster 2024-03-11T22:26:34.447432+0000 mgr.y (mgr.14601) 696 : cluster 0 pgmap v1175: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 125 B/s wr, 1 op/s 2024-03-11T22:26:37.778 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:37 smithi049 bash[28804]: cluster 2024-03-11T22:26:36.448380+0000 mgr.y (mgr.14601) 697 : cluster 0 pgmap v1176: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:26:37.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:37 smithi049 bash[21434]: cluster 2024-03-11T22:26:36.448380+0000 mgr.y (mgr.14601) 697 : cluster 0 pgmap v1176: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:26:37.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:37 smithi187 bash[23415]: cluster 2024-03-11T22:26:36.448380+0000 mgr.y (mgr.14601) 697 : cluster 0 pgmap v1176: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-03-11T22:26:38.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:38 smithi049 bash[21434]: audit 2024-03-11T22:26:37.640563+0000 mon.a (mon.0) 3347 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:38.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:38 smithi049 bash[28804]: audit 2024-03-11T22:26:37.640563+0000 mon.a (mon.0) 3347 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:38.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:38 smithi187 bash[23415]: audit 2024-03-11T22:26:37.640563+0000 mon.a (mon.0) 3347 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:39.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:26:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:26:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:39 smithi187 bash[23415]: cluster 2024-03-11T22:26:38.449559+0000 mgr.y (mgr.14601) 698 : cluster 0 pgmap v1177: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 91 B/s wr, 1 op/s 2024-03-11T22:26:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:39 smithi187 bash[23415]: audit 2024-03-11T22:26:38.533753+0000 mon.a (mon.0) 3348 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:26:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:39 smithi187 bash[23415]: cluster 2024-03-11T22:26:38.540433+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-03-11T22:26:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:39 smithi187 bash[23415]: audit 2024-03-11T22:26:38.541762+0000 mon.a (mon.0) 3350 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:40.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[21434]: cluster 2024-03-11T22:26:38.449559+0000 mgr.y (mgr.14601) 698 : cluster 0 pgmap v1177: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 91 B/s wr, 1 op/s 2024-03-11T22:26:40.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[21434]: audit 2024-03-11T22:26:38.533753+0000 mon.a (mon.0) 3348 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:26:40.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[21434]: cluster 2024-03-11T22:26:38.540433+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-03-11T22:26:40.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[21434]: audit 2024-03-11T22:26:38.541762+0000 mon.a (mon.0) 3350 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:40.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[28804]: cluster 2024-03-11T22:26:38.449559+0000 mgr.y (mgr.14601) 698 : cluster 0 pgmap v1177: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 91 B/s wr, 1 op/s 2024-03-11T22:26:40.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[28804]: audit 2024-03-11T22:26:38.533753+0000 mon.a (mon.0) 3348 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:26:40.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[28804]: cluster 2024-03-11T22:26:38.540433+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-03-11T22:26:40.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:39 smithi049 bash[28804]: audit 2024-03-11T22:26:38.541762+0000 mon.a (mon.0) 3350 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:41.278 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[28804]: audit 2024-03-11T22:26:39.343240+0000 mgr.y (mgr.14601) 699 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[28804]: cluster 2024-03-11T22:26:39.534022+0000 mon.a (mon.0) 3351 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[28804]: audit 2024-03-11T22:26:39.536633+0000 mon.a (mon.0) 3352 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]': finished 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[28804]: cluster 2024-03-11T22:26:39.543186+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[28804]: audit 2024-03-11T22:26:39.620189+0000 mon.a (mon.0) 3354 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[28804]: audit 2024-03-11T22:26:39.621079+0000 mon.a (mon.0) 3355 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[21434]: audit 2024-03-11T22:26:39.343240+0000 mgr.y (mgr.14601) 699 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[21434]: cluster 2024-03-11T22:26:39.534022+0000 mon.a (mon.0) 3351 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[21434]: audit 2024-03-11T22:26:39.536633+0000 mon.a (mon.0) 3352 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]': finished 2024-03-11T22:26:41.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[21434]: cluster 2024-03-11T22:26:39.543186+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-03-11T22:26:41.280 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[21434]: audit 2024-03-11T22:26:39.620189+0000 mon.a (mon.0) 3354 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:41.280 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:41 smithi049 bash[21434]: audit 2024-03-11T22:26:39.621079+0000 mon.a (mon.0) 3355 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:41 smithi187 bash[23415]: audit 2024-03-11T22:26:39.343240+0000 mgr.y (mgr.14601) 699 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:41 smithi187 bash[23415]: cluster 2024-03-11T22:26:39.534022+0000 mon.a (mon.0) 3351 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:41 smithi187 bash[23415]: audit 2024-03-11T22:26:39.536633+0000 mon.a (mon.0) 3352 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]': finished 2024-03-11T22:26:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:41 smithi187 bash[23415]: cluster 2024-03-11T22:26:39.543186+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-03-11T22:26:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:41 smithi187 bash[23415]: audit 2024-03-11T22:26:39.620189+0000 mon.a (mon.0) 3354 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:26:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:41 smithi187 bash[23415]: audit 2024-03-11T22:26:39.621079+0000 mon.a (mon.0) 3355 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-144"}]: dispatch 2024-03-11T22:26:42.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[28804]: cluster 2024-03-11T22:26:40.450423+0000 mgr.y (mgr.14601) 700 : cluster 0 pgmap v1180: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:42.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[28804]: cluster 2024-03-11T22:26:40.548111+0000 mon.a (mon.0) 3356 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:26:42.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[28804]: cluster 2024-03-11T22:26:40.556018+0000 mon.a (mon.0) 3357 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-03-11T22:26:42.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[28804]: cluster 2024-03-11T22:26:41.560647+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-03-11T22:26:42.279 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[28804]: audit 2024-03-11T22:26:41.563360+0000 mon.a (mon.0) 3359 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:42.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[21434]: cluster 2024-03-11T22:26:40.450423+0000 mgr.y (mgr.14601) 700 : cluster 0 pgmap v1180: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:42.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[21434]: cluster 2024-03-11T22:26:40.548111+0000 mon.a (mon.0) 3356 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:26:42.280 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[21434]: cluster 2024-03-11T22:26:40.556018+0000 mon.a (mon.0) 3357 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-03-11T22:26:42.280 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[21434]: cluster 2024-03-11T22:26:41.560647+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-03-11T22:26:42.280 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:42 smithi049 bash[21434]: audit 2024-03-11T22:26:41.563360+0000 mon.a (mon.0) 3359 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:42 smithi187 bash[23415]: cluster 2024-03-11T22:26:40.450423+0000 mgr.y (mgr.14601) 700 : cluster 0 pgmap v1180: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:26:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:42 smithi187 bash[23415]: cluster 2024-03-11T22:26:40.548111+0000 mon.a (mon.0) 3356 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:26:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:42 smithi187 bash[23415]: cluster 2024-03-11T22:26:40.556018+0000 mon.a (mon.0) 3357 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-03-11T22:26:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:42 smithi187 bash[23415]: cluster 2024-03-11T22:26:41.560647+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-03-11T22:26:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:42 smithi187 bash[23415]: audit 2024-03-11T22:26:41.563360+0000 mon.a (mon.0) 3359 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:26:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:43 smithi187 bash[23415]: audit 2024-03-11T22:26:42.128221+0000 mon.c (mon.2) 664 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:43 smithi187 bash[23415]: audit 2024-03-11T22:26:42.556482+0000 mon.a (mon.0) 3360 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:43 smithi187 bash[23415]: cluster 2024-03-11T22:26:42.564599+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-03-11T22:26:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:43 smithi187 bash[23415]: audit 2024-03-11T22:26:42.621804+0000 mon.a (mon.0) 3362 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:43.528 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[21434]: audit 2024-03-11T22:26:42.128221+0000 mon.c (mon.2) 664 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:43.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[21434]: audit 2024-03-11T22:26:42.556482+0000 mon.a (mon.0) 3360 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:43.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[21434]: cluster 2024-03-11T22:26:42.564599+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-03-11T22:26:43.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[21434]: audit 2024-03-11T22:26:42.621804+0000 mon.a (mon.0) 3362 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:43.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[28804]: audit 2024-03-11T22:26:42.128221+0000 mon.c (mon.2) 664 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:43.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[28804]: audit 2024-03-11T22:26:42.556482+0000 mon.a (mon.0) 3360 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:26:43.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[28804]: cluster 2024-03-11T22:26:42.564599+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-03-11T22:26:43.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:43 smithi049 bash[28804]: audit 2024-03-11T22:26:42.621804+0000 mon.a (mon.0) 3362 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:26:44.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:44 smithi187 bash[23415]: cluster 2024-03-11T22:26:42.451323+0000 mgr.y (mgr.14601) 701 : cluster 0 pgmap v1183: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:44.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:44 smithi187 bash[23415]: audit 2024-03-11T22:26:43.559117+0000 mon.a (mon.0) 3363 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:44.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:44 smithi187 bash[23415]: cluster 2024-03-11T22:26:43.566083+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-03-11T22:26:44.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:44 smithi187 bash[23415]: audit 2024-03-11T22:26:43.567527+0000 mon.a (mon.0) 3365 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:26:44.529 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:26:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:26:44.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[28804]: cluster 2024-03-11T22:26:42.451323+0000 mgr.y (mgr.14601) 701 : cluster 0 pgmap v1183: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:44.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[28804]: audit 2024-03-11T22:26:43.559117+0000 mon.a (mon.0) 3363 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:44.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[28804]: cluster 2024-03-11T22:26:43.566083+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-03-11T22:26:44.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[28804]: audit 2024-03-11T22:26:43.567527+0000 mon.a (mon.0) 3365 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:26:44.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[21434]: cluster 2024-03-11T22:26:42.451323+0000 mgr.y (mgr.14601) 701 : cluster 0 pgmap v1183: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-03-11T22:26:44.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[21434]: audit 2024-03-11T22:26:43.559117+0000 mon.a (mon.0) 3363 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:26:44.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[21434]: cluster 2024-03-11T22:26:43.566083+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-03-11T22:26:44.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:44 smithi049 bash[21434]: audit 2024-03-11T22:26:43.567527+0000 mon.a (mon.0) 3365 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:26:45.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:45 smithi187 bash[23415]: cluster 2024-03-11T22:26:44.453815+0000 mgr.y (mgr.14601) 702 : cluster 0 pgmap v1186: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:26:45.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:45 smithi187 bash[23415]: audit 2024-03-11T22:26:44.561856+0000 mon.a (mon.0) 3366 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-146"}]': finished 2024-03-11T22:26:45.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:45 smithi187 bash[23415]: cluster 2024-03-11T22:26:44.568471+0000 mon.a (mon.0) 3367 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-03-11T22:26:45.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:45 smithi187 bash[23415]: audit 2024-03-11T22:26:44.571417+0000 mon.a (mon.0) 3368 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-146", "mode": "writeback"}]: dispatch 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[21434]: cluster 2024-03-11T22:26:44.453815+0000 mgr.y (mgr.14601) 702 : cluster 0 pgmap v1186: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[21434]: audit 2024-03-11T22:26:44.561856+0000 mon.a (mon.0) 3366 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-146"}]': finished 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[21434]: cluster 2024-03-11T22:26:44.568471+0000 mon.a (mon.0) 3367 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[21434]: audit 2024-03-11T22:26:44.571417+0000 mon.a (mon.0) 3368 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-146", "mode": "writeback"}]: dispatch 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[28804]: cluster 2024-03-11T22:26:44.453815+0000 mgr.y (mgr.14601) 702 : cluster 0 pgmap v1186: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[28804]: audit 2024-03-11T22:26:44.561856+0000 mon.a (mon.0) 3366 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi049-64247-111", "overlaypool": "test-rados-api-smithi049-64247-146"}]': finished 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[28804]: cluster 2024-03-11T22:26:44.568471+0000 mon.a (mon.0) 3367 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-03-11T22:26:46.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:45 smithi049 bash[28804]: audit 2024-03-11T22:26:44.571417+0000 mon.a (mon.0) 3368 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-146", "mode": "writeback"}]: dispatch 2024-03-11T22:26:46.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:46 smithi187 bash[23415]: cluster 2024-03-11T22:26:45.562731+0000 mon.a (mon.0) 3369 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:46.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:46 smithi187 bash[23415]: audit 2024-03-11T22:26:45.572410+0000 mon.a (mon.0) 3370 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-146", "mode": "writeback"}]': finished 2024-03-11T22:26:46.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:46 smithi187 bash[23415]: cluster 2024-03-11T22:26:45.578539+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-03-11T22:26:46.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:46 smithi187 bash[23415]: audit 2024-03-11T22:26:45.674323+0000 mon.a (mon.0) 3372 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:26:46.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:46 smithi187 bash[23415]: cluster 2024-03-11T22:26:46.026664+0000 mon.a (mon.0) 3373 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[21434]: cluster 2024-03-11T22:26:45.562731+0000 mon.a (mon.0) 3369 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[21434]: audit 2024-03-11T22:26:45.572410+0000 mon.a (mon.0) 3370 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-146", "mode": "writeback"}]': finished 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[21434]: cluster 2024-03-11T22:26:45.578539+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[21434]: audit 2024-03-11T22:26:45.674323+0000 mon.a (mon.0) 3372 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[21434]: cluster 2024-03-11T22:26:46.026664+0000 mon.a (mon.0) 3373 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[28804]: cluster 2024-03-11T22:26:45.562731+0000 mon.a (mon.0) 3369 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[28804]: audit 2024-03-11T22:26:45.572410+0000 mon.a (mon.0) 3370 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi049-64247-146", "mode": "writeback"}]': finished 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[28804]: cluster 2024-03-11T22:26:45.578539+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-03-11T22:26:47.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[28804]: audit 2024-03-11T22:26:45.674323+0000 mon.a (mon.0) 3372 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_count","val": "2"}]: dispatch 2024-03-11T22:26:47.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:46 smithi049 bash[28804]: cluster 2024-03-11T22:26:46.026664+0000 mon.a (mon.0) 3373 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:26:47.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:47 smithi187 bash[23415]: cluster 2024-03-11T22:26:46.454778+0000 mgr.y (mgr.14601) 703 : cluster 0 pgmap v1189: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:26:47.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:47 smithi187 bash[23415]: audit 2024-03-11T22:26:46.574723+0000 mon.a (mon.0) 3374 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:26:47.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:47 smithi187 bash[23415]: cluster 2024-03-11T22:26:46.582454+0000 mon.a (mon.0) 3375 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-03-11T22:26:47.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:47 smithi187 bash[23415]: audit 2024-03-11T22:26:46.583981+0000 mon.a (mon.0) 3376 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[21434]: cluster 2024-03-11T22:26:46.454778+0000 mgr.y (mgr.14601) 703 : cluster 0 pgmap v1189: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[21434]: audit 2024-03-11T22:26:46.574723+0000 mon.a (mon.0) 3374 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[21434]: cluster 2024-03-11T22:26:46.582454+0000 mon.a (mon.0) 3375 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[21434]: audit 2024-03-11T22:26:46.583981+0000 mon.a (mon.0) 3376 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[28804]: cluster 2024-03-11T22:26:46.454778+0000 mgr.y (mgr.14601) 703 : cluster 0 pgmap v1189: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[28804]: audit 2024-03-11T22:26:46.574723+0000 mon.a (mon.0) 3374 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_count","val": "2"}]': finished 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[28804]: cluster 2024-03-11T22:26:46.582454+0000 mon.a (mon.0) 3375 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-03-11T22:26:48.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:47 smithi049 bash[28804]: audit 2024-03-11T22:26:46.583981+0000 mon.a (mon.0) 3376 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_period","val": "600"}]: dispatch 2024-03-11T22:26:48.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:48 smithi187 bash[23415]: audit 2024-03-11T22:26:47.577733+0000 mon.a (mon.0) 3377 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:26:48.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:48 smithi187 bash[23415]: cluster 2024-03-11T22:26:47.585050+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-03-11T22:26:48.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:48 smithi187 bash[23415]: audit 2024-03-11T22:26:47.587336+0000 mon.a (mon.0) 3379 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:26:48.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:48 smithi187 bash[23415]: cluster 2024-03-11T22:26:48.577857+0000 mon.a (mon.0) 3380 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:48.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:48 smithi187 bash[23415]: audit 2024-03-11T22:26:48.580586+0000 mon.a (mon.0) 3381 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:26:48.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:48 smithi187 bash[23415]: cluster 2024-03-11T22:26:48.587515+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-03-11T22:26:49.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:48 smithi187 bash[23415]: audit 2024-03-11T22:26:48.588430+0000 mon.a (mon.0) 3383 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:26:49.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[21434]: audit 2024-03-11T22:26:47.577733+0000 mon.a (mon.0) 3377 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:26:49.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[21434]: cluster 2024-03-11T22:26:47.585050+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-03-11T22:26:49.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[21434]: audit 2024-03-11T22:26:47.587336+0000 mon.a (mon.0) 3379 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:26:49.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[21434]: cluster 2024-03-11T22:26:48.577857+0000 mon.a (mon.0) 3380 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:49.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[21434]: audit 2024-03-11T22:26:48.580586+0000 mon.a (mon.0) 3381 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:26:49.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[21434]: cluster 2024-03-11T22:26:48.587515+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-03-11T22:26:49.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[21434]: audit 2024-03-11T22:26:48.588430+0000 mon.a (mon.0) 3383 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:26:49.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[28804]: audit 2024-03-11T22:26:47.577733+0000 mon.a (mon.0) 3377 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_period","val": "600"}]': finished 2024-03-11T22:26:49.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[28804]: cluster 2024-03-11T22:26:47.585050+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-03-11T22:26:49.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[28804]: audit 2024-03-11T22:26:47.587336+0000 mon.a (mon.0) 3379 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-11T22:26:49.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[28804]: cluster 2024-03-11T22:26:48.577857+0000 mon.a (mon.0) 3380 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-11T22:26:49.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[28804]: audit 2024-03-11T22:26:48.580586+0000 mon.a (mon.0) 3381 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "hit_set_type","val": "bloom"}]': finished 2024-03-11T22:26:49.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[28804]: cluster 2024-03-11T22:26:48.587515+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-03-11T22:26:49.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:48 smithi049 bash[28804]: audit 2024-03-11T22:26:48.588430+0000 mon.a (mon.0) 3383 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-11T22:26:49.603 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:26:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:26:49.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:49 smithi187 bash[23415]: cluster 2024-03-11T22:26:48.455943+0000 mgr.y (mgr.14601) 704 : cluster 0 pgmap v1192: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-11T22:26:49.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:49 smithi187 bash[23415]: audit 2024-03-11T22:26:49.583487+0000 mon.a (mon.0) 3384 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:26:49.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:49 smithi187 bash[23415]: cluster 2024-03-11T22:26:49.590792+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-03-11T22:26:49.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:49 smithi187 bash[23415]: audit 2024-03-11T22:26:49.592704+0000 mon.a (mon.0) 3386 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:26:50.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[21434]: cluster 2024-03-11T22:26:48.455943+0000 mgr.y (mgr.14601) 704 : cluster 0 pgmap v1192: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-11T22:26:50.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[21434]: audit 2024-03-11T22:26:49.583487+0000 mon.a (mon.0) 3384 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:26:50.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[21434]: cluster 2024-03-11T22:26:49.590792+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-03-11T22:26:50.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[21434]: audit 2024-03-11T22:26:49.592704+0000 mon.a (mon.0) 3386 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:26:50.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[28804]: cluster 2024-03-11T22:26:48.455943+0000 mgr.y (mgr.14601) 704 : cluster 0 pgmap v1192: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-11T22:26:50.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[28804]: audit 2024-03-11T22:26:49.583487+0000 mon.a (mon.0) 3384 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-11T22:26:50.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[28804]: cluster 2024-03-11T22:26:49.590792+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-03-11T22:26:50.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:49 smithi049 bash[28804]: audit 2024-03-11T22:26:49.592704+0000 mon.a (mon.0) 3386 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "target_max_objects","val": "1"}]: dispatch 2024-03-11T22:26:50.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:50 smithi187 bash[23415]: audit 2024-03-11T22:26:49.349480+0000 mgr.y (mgr.14601) 705 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:50.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:50 smithi187 bash[23415]: audit 2024-03-11T22:26:50.586419+0000 mon.a (mon.0) 3387 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "target_max_objects","val": "1"}]': finished 2024-03-11T22:26:50.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:50 smithi187 bash[23415]: cluster 2024-03-11T22:26:50.593331+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-03-11T22:26:51.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:50 smithi049 bash[21434]: audit 2024-03-11T22:26:49.349480+0000 mgr.y (mgr.14601) 705 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:51.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:50 smithi049 bash[21434]: audit 2024-03-11T22:26:50.586419+0000 mon.a (mon.0) 3387 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "target_max_objects","val": "1"}]': finished 2024-03-11T22:26:51.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:50 smithi049 bash[21434]: cluster 2024-03-11T22:26:50.593331+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-03-11T22:26:51.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:50 smithi049 bash[28804]: audit 2024-03-11T22:26:49.349480+0000 mgr.y (mgr.14601) 705 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:26:51.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:50 smithi049 bash[28804]: audit 2024-03-11T22:26:50.586419+0000 mon.a (mon.0) 3387 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-146","var": "target_max_objects","val": "1"}]': finished 2024-03-11T22:26:51.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:50 smithi049 bash[28804]: cluster 2024-03-11T22:26:50.593331+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-03-11T22:26:51.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:51 smithi187 bash[23415]: cluster 2024-03-11T22:26:50.456781+0000 mgr.y (mgr.14601) 706 : cluster 0 pgmap v1195: 268 pgs: 268 active+clean; 4.4 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:26:52.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:51 smithi049 bash[21434]: cluster 2024-03-11T22:26:50.456781+0000 mgr.y (mgr.14601) 706 : cluster 0 pgmap v1195: 268 pgs: 268 active+clean; 4.4 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:26:52.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:51 smithi049 bash[28804]: cluster 2024-03-11T22:26:50.456781+0000 mgr.y (mgr.14601) 706 : cluster 0 pgmap v1195: 268 pgs: 268 active+clean; 4.4 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:26:52.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:52 smithi187 bash[23415]: cluster 2024-03-11T22:26:52.617724+0000 mon.a (mon.0) 3389 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-11T22:26:53.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:52 smithi049 bash[21434]: cluster 2024-03-11T22:26:52.617724+0000 mon.a (mon.0) 3389 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-11T22:26:53.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:52 smithi049 bash[28804]: cluster 2024-03-11T22:26:52.617724+0000 mon.a (mon.0) 3389 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-11T22:26:53.998 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:53 smithi187 bash[23415]: cluster 2024-03-11T22:26:52.457755+0000 mgr.y (mgr.14601) 707 : cluster 0 pgmap v1197: 268 pgs: 268 active+clean; 4.4 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:26:54.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:53 smithi049 bash[21434]: cluster 2024-03-11T22:26:52.457755+0000 mgr.y (mgr.14601) 707 : cluster 0 pgmap v1197: 268 pgs: 268 active+clean; 4.4 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:26:54.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:53 smithi049 bash[28804]: cluster 2024-03-11T22:26:52.457755+0000 mgr.y (mgr.14601) 707 : cluster 0 pgmap v1197: 268 pgs: 268 active+clean; 4.4 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:26:54.528 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:26:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:26:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:26:55.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:55 smithi187 bash[23415]: cluster 2024-03-11T22:26:54.460393+0000 mgr.y (mgr.14601) 708 : cluster 0 pgmap v1198: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:26:56.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:55 smithi049 bash[21434]: cluster 2024-03-11T22:26:54.460393+0000 mgr.y (mgr.14601) 708 : cluster 0 pgmap v1198: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:26:56.029 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:55 smithi049 bash[28804]: cluster 2024-03-11T22:26:54.460393+0000 mgr.y (mgr.14601) 708 : cluster 0 pgmap v1198: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:26:58.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:58 smithi187 bash[23415]: cluster 2024-03-11T22:26:56.461338+0000 mgr.y (mgr.14601) 709 : cluster 0 pgmap v1199: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:26:58.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:58 smithi187 bash[23415]: audit 2024-03-11T22:26:57.169919+0000 mon.a (mon.0) 3390 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:26:58.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:26:58 smithi187 bash[23415]: audit 2024-03-11T22:26:57.173126+0000 mon.c (mon.2) 665 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:58.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:58 smithi049 bash[28804]: cluster 2024-03-11T22:26:56.461338+0000 mgr.y (mgr.14601) 709 : cluster 0 pgmap v1199: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:26:58.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:58 smithi049 bash[28804]: audit 2024-03-11T22:26:57.169919+0000 mon.a (mon.0) 3390 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:26:58.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:26:58 smithi049 bash[28804]: audit 2024-03-11T22:26:57.173126+0000 mon.c (mon.2) 665 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:58.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:58 smithi049 bash[21434]: cluster 2024-03-11T22:26:56.461338+0000 mgr.y (mgr.14601) 709 : cluster 0 pgmap v1199: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-11T22:26:58.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:58 smithi049 bash[21434]: audit 2024-03-11T22:26:57.169919+0000 mon.a (mon.0) 3390 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:26:58.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:26:58 smithi049 bash[21434]: audit 2024-03-11T22:26:57.173126+0000 mon.c (mon.2) 665 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:26:59.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:26:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:27:00.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:00 smithi187 bash[23415]: cluster 2024-03-11T22:26:58.462578+0000 mgr.y (mgr.14601) 710 : cluster 0 pgmap v1200: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:27:00.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:00 smithi049 bash[28804]: cluster 2024-03-11T22:26:58.462578+0000 mgr.y (mgr.14601) 710 : cluster 0 pgmap v1200: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:27:00.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:00 smithi049 bash[21434]: cluster 2024-03-11T22:26:58.462578+0000 mgr.y (mgr.14601) 710 : cluster 0 pgmap v1200: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:27:01.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:01 smithi187 bash[23415]: audit 2024-03-11T22:26:59.357301+0000 mgr.y (mgr.14601) 711 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:01.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:01 smithi187 bash[23415]: audit 2024-03-11T22:27:00.616986+0000 mon.a (mon.0) 3391 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:01.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:01 smithi049 bash[21434]: audit 2024-03-11T22:26:59.357301+0000 mgr.y (mgr.14601) 711 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:01.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:01 smithi049 bash[21434]: audit 2024-03-11T22:27:00.616986+0000 mon.a (mon.0) 3391 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:01.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:01 smithi049 bash[28804]: audit 2024-03-11T22:26:59.357301+0000 mgr.y (mgr.14601) 711 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:01.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:01 smithi049 bash[28804]: audit 2024-03-11T22:27:00.616986+0000 mon.a (mon.0) 3391 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:02.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:02 smithi187 bash[23415]: cluster 2024-03-11T22:27:00.465079+0000 mgr.y (mgr.14601) 712 : cluster 0 pgmap v1201: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:27:02.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:02 smithi187 bash[23415]: audit 2024-03-11T22:27:01.180342+0000 mon.a (mon.0) 3392 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:02.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:02 smithi187 bash[23415]: cluster 2024-03-11T22:27:01.188516+0000 mon.a (mon.0) 3393 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-03-11T22:27:02.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:02 smithi187 bash[23415]: audit 2024-03-11T22:27:01.189775+0000 mon.a (mon.0) 3394 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:27:02.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[28804]: cluster 2024-03-11T22:27:00.465079+0000 mgr.y (mgr.14601) 712 : cluster 0 pgmap v1201: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:27:02.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[28804]: audit 2024-03-11T22:27:01.180342+0000 mon.a (mon.0) 3392 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:02.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[28804]: cluster 2024-03-11T22:27:01.188516+0000 mon.a (mon.0) 3393 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-03-11T22:27:02.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[28804]: audit 2024-03-11T22:27:01.189775+0000 mon.a (mon.0) 3394 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:27:02.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[21434]: cluster 2024-03-11T22:27:00.465079+0000 mgr.y (mgr.14601) 712 : cluster 0 pgmap v1201: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-11T22:27:02.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[21434]: audit 2024-03-11T22:27:01.180342+0000 mon.a (mon.0) 3392 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:02.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[21434]: cluster 2024-03-11T22:27:01.188516+0000 mon.a (mon.0) 3393 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-03-11T22:27:02.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:02 smithi049 bash[21434]: audit 2024-03-11T22:27:01.189775+0000 mon.a (mon.0) 3394 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:27:03.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:03 smithi187 bash[23415]: audit 2024-03-11T22:27:02.182924+0000 mon.a (mon.0) 3395 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]': finished 2024-03-11T22:27:03.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:03 smithi187 bash[23415]: cluster 2024-03-11T22:27:02.191038+0000 mon.a (mon.0) 3396 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-03-11T22:27:03.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:03 smithi187 bash[23415]: audit 2024-03-11T22:27:02.296776+0000 mon.a (mon.0) 3397 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:03.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:03 smithi187 bash[23415]: audit 2024-03-11T22:27:02.297665+0000 mon.a (mon.0) 3398 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:27:03.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:03 smithi187 bash[23415]: cluster 2024-03-11T22:27:02.465931+0000 mgr.y (mgr.14601) 713 : cluster 0 pgmap v1204: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:27:03.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[21434]: audit 2024-03-11T22:27:02.182924+0000 mon.a (mon.0) 3395 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]': finished 2024-03-11T22:27:03.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[21434]: cluster 2024-03-11T22:27:02.191038+0000 mon.a (mon.0) 3396 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-03-11T22:27:03.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[21434]: audit 2024-03-11T22:27:02.296776+0000 mon.a (mon.0) 3397 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:03.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[21434]: audit 2024-03-11T22:27:02.297665+0000 mon.a (mon.0) 3398 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:27:03.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[21434]: cluster 2024-03-11T22:27:02.465931+0000 mgr.y (mgr.14601) 713 : cluster 0 pgmap v1204: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:27:03.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[28804]: audit 2024-03-11T22:27:02.182924+0000 mon.a (mon.0) 3395 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]': finished 2024-03-11T22:27:03.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[28804]: cluster 2024-03-11T22:27:02.191038+0000 mon.a (mon.0) 3396 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-03-11T22:27:03.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[28804]: audit 2024-03-11T22:27:02.296776+0000 mon.a (mon.0) 3397 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:03.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[28804]: audit 2024-03-11T22:27:02.297665+0000 mon.a (mon.0) 3398 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-146"}]: dispatch 2024-03-11T22:27:03.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:03 smithi049 bash[28804]: cluster 2024-03-11T22:27:02.465931+0000 mgr.y (mgr.14601) 713 : cluster 0 pgmap v1204: 268 pgs: 268 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:27:04.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:04 smithi187 bash[23415]: cluster 2024-03-11T22:27:03.196194+0000 mon.a (mon.0) 3399 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:04.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:04 smithi187 bash[23415]: cluster 2024-03-11T22:27:03.196247+0000 mon.a (mon.0) 3400 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-11T22:27:04.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:04 smithi187 bash[23415]: cluster 2024-03-11T22:27:03.214191+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-03-11T22:27:04.529 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:27:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:27:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:27:04.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:04 smithi049 bash[21434]: cluster 2024-03-11T22:27:03.196194+0000 mon.a (mon.0) 3399 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:04.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:04 smithi049 bash[21434]: cluster 2024-03-11T22:27:03.196247+0000 mon.a (mon.0) 3400 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-11T22:27:04.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:04 smithi049 bash[21434]: cluster 2024-03-11T22:27:03.214191+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-03-11T22:27:04.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:04 smithi049 bash[28804]: cluster 2024-03-11T22:27:03.196194+0000 mon.a (mon.0) 3399 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:04.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:04 smithi049 bash[28804]: cluster 2024-03-11T22:27:03.196247+0000 mon.a (mon.0) 3400 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-11T22:27:04.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:04 smithi049 bash[28804]: cluster 2024-03-11T22:27:03.214191+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-03-11T22:27:05.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:05 smithi187 bash[23415]: cluster 2024-03-11T22:27:04.232273+0000 mon.a (mon.0) 3402 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-03-11T22:27:05.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:05 smithi187 bash[23415]: audit 2024-03-11T22:27:04.239729+0000 mon.a (mon.0) 3403 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:05.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:05 smithi187 bash[23415]: cluster 2024-03-11T22:27:04.466867+0000 mgr.y (mgr.14601) 714 : cluster 0 pgmap v1207: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:27:05.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:05 smithi049 bash[28804]: cluster 2024-03-11T22:27:04.232273+0000 mon.a (mon.0) 3402 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-03-11T22:27:05.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:05 smithi049 bash[28804]: audit 2024-03-11T22:27:04.239729+0000 mon.a (mon.0) 3403 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:05.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:05 smithi049 bash[28804]: cluster 2024-03-11T22:27:04.466867+0000 mgr.y (mgr.14601) 714 : cluster 0 pgmap v1207: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:27:05.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:05 smithi049 bash[21434]: cluster 2024-03-11T22:27:04.232273+0000 mon.a (mon.0) 3402 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-03-11T22:27:05.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:05 smithi049 bash[21434]: audit 2024-03-11T22:27:04.239729+0000 mon.a (mon.0) 3403 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:05.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:05 smithi049 bash[21434]: cluster 2024-03-11T22:27:04.466867+0000 mgr.y (mgr.14601) 714 : cluster 0 pgmap v1207: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:27:06.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:06 smithi187 bash[23415]: audit 2024-03-11T22:27:05.226928+0000 mon.a (mon.0) 3404 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:06.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:06 smithi187 bash[23415]: cluster 2024-03-11T22:27:05.234690+0000 mon.a (mon.0) 3405 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-03-11T22:27:06.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:06 smithi187 bash[23415]: audit 2024-03-11T22:27:05.289630+0000 mon.a (mon.0) 3406 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:27:06.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:06 smithi049 bash[21434]: audit 2024-03-11T22:27:05.226928+0000 mon.a (mon.0) 3404 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:06.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:06 smithi049 bash[21434]: cluster 2024-03-11T22:27:05.234690+0000 mon.a (mon.0) 3405 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-03-11T22:27:06.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:06 smithi049 bash[21434]: audit 2024-03-11T22:27:05.289630+0000 mon.a (mon.0) 3406 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:27:06.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:06 smithi049 bash[28804]: audit 2024-03-11T22:27:05.226928+0000 mon.a (mon.0) 3404 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:06.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:06 smithi049 bash[28804]: cluster 2024-03-11T22:27:05.234690+0000 mon.a (mon.0) 3405 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-03-11T22:27:06.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:06 smithi049 bash[28804]: audit 2024-03-11T22:27:05.289630+0000 mon.a (mon.0) 3406 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-11T22:27:07.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[21434]: audit 2024-03-11T22:27:06.250221+0000 mon.a (mon.0) 3407 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:27:07.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[21434]: cluster 2024-03-11T22:27:06.256826+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-03-11T22:27:07.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[21434]: audit 2024-03-11T22:27:06.273828+0000 mon.a (mon.0) 3409 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]: dispatch 2024-03-11T22:27:07.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[21434]: cluster 2024-03-11T22:27:06.467723+0000 mgr.y (mgr.14601) 715 : cluster 0 pgmap v1210: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:27:07.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[28804]: audit 2024-03-11T22:27:06.250221+0000 mon.a (mon.0) 3407 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:27:07.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[28804]: cluster 2024-03-11T22:27:06.256826+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-03-11T22:27:07.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[28804]: audit 2024-03-11T22:27:06.273828+0000 mon.a (mon.0) 3409 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]: dispatch 2024-03-11T22:27:07.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:07 smithi049 bash[28804]: cluster 2024-03-11T22:27:06.467723+0000 mgr.y (mgr.14601) 715 : cluster 0 pgmap v1210: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:27:07.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:07 smithi187 bash[23415]: audit 2024-03-11T22:27:06.250221+0000 mon.a (mon.0) 3407 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148", "force_nonempty": "--force-nonempty" }]': finished 2024-03-11T22:27:07.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:07 smithi187 bash[23415]: cluster 2024-03-11T22:27:06.256826+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-03-11T22:27:07.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:07 smithi187 bash[23415]: audit 2024-03-11T22:27:06.273828+0000 mon.a (mon.0) 3409 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]: dispatch 2024-03-11T22:27:07.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:07 smithi187 bash[23415]: cluster 2024-03-11T22:27:06.467723+0000 mgr.y (mgr.14601) 715 : cluster 0 pgmap v1210: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-11T22:27:08.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[21434]: audit 2024-03-11T22:27:07.259785+0000 mon.a (mon.0) 3410 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]': finished 2024-03-11T22:27:08.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[21434]: cluster 2024-03-11T22:27:07.269176+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-03-11T22:27:08.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[21434]: audit 2024-03-11T22:27:07.344550+0000 mon.a (mon.0) 3412 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:08.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[21434]: audit 2024-03-11T22:27:07.345494+0000 mon.a (mon.0) 3413 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]: dispatch 2024-03-11T22:27:08.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[28804]: audit 2024-03-11T22:27:07.259785+0000 mon.a (mon.0) 3410 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]': finished 2024-03-11T22:27:08.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[28804]: cluster 2024-03-11T22:27:07.269176+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-03-11T22:27:08.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[28804]: audit 2024-03-11T22:27:07.344550+0000 mon.a (mon.0) 3412 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:08.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:08 smithi049 bash[28804]: audit 2024-03-11T22:27:07.345494+0000 mon.a (mon.0) 3413 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]: dispatch 2024-03-11T22:27:08.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:08 smithi187 bash[23415]: audit 2024-03-11T22:27:07.259785+0000 mon.a (mon.0) 3410 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]': finished 2024-03-11T22:27:08.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:08 smithi187 bash[23415]: cluster 2024-03-11T22:27:07.269176+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-03-11T22:27:08.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:08 smithi187 bash[23415]: audit 2024-03-11T22:27:07.344550+0000 mon.a (mon.0) 3412 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:08.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:08 smithi187 bash[23415]: audit 2024-03-11T22:27:07.345494+0000 mon.a (mon.0) 3413 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-148"}]: dispatch 2024-03-11T22:27:09.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:27:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:27:09.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:09 smithi187 bash[23415]: cluster 2024-03-11T22:27:08.277381+0000 mon.a (mon.0) 3414 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-03-11T22:27:09.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:09 smithi187 bash[23415]: cluster 2024-03-11T22:27:08.468763+0000 mgr.y (mgr.14601) 716 : cluster 0 pgmap v1213: 236 pgs: 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:09.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:09 smithi049 bash[21434]: cluster 2024-03-11T22:27:08.277381+0000 mon.a (mon.0) 3414 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-03-11T22:27:09.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:09 smithi049 bash[21434]: cluster 2024-03-11T22:27:08.468763+0000 mgr.y (mgr.14601) 716 : cluster 0 pgmap v1213: 236 pgs: 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:09.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:09 smithi049 bash[28804]: cluster 2024-03-11T22:27:08.277381+0000 mon.a (mon.0) 3414 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-03-11T22:27:09.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:09 smithi049 bash[28804]: cluster 2024-03-11T22:27:08.468763+0000 mgr.y (mgr.14601) 716 : cluster 0 pgmap v1213: 236 pgs: 236 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:10.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:10 smithi187 bash[23415]: cluster 2024-03-11T22:27:09.291907+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-03-11T22:27:10.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:10 smithi187 bash[23415]: audit 2024-03-11T22:27:09.317914+0000 mon.a (mon.0) 3416 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:10.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:10 smithi187 bash[23415]: audit 2024-03-11T22:27:09.368564+0000 mgr.y (mgr.14601) 717 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:10.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:10 smithi049 bash[21434]: cluster 2024-03-11T22:27:09.291907+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-03-11T22:27:10.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:10 smithi049 bash[21434]: audit 2024-03-11T22:27:09.317914+0000 mon.a (mon.0) 3416 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:10.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:10 smithi049 bash[21434]: audit 2024-03-11T22:27:09.368564+0000 mgr.y (mgr.14601) 717 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:10.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:10 smithi049 bash[28804]: cluster 2024-03-11T22:27:09.291907+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-03-11T22:27:10.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:10 smithi049 bash[28804]: audit 2024-03-11T22:27:09.317914+0000 mon.a (mon.0) 3416 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:10.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:10 smithi049 bash[28804]: audit 2024-03-11T22:27:09.368564+0000 mgr.y (mgr.14601) 717 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:11.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:11 smithi187 bash[23415]: audit 2024-03-11T22:27:10.294096+0000 mon.a (mon.0) 3417 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:11.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:11 smithi187 bash[23415]: cluster 2024-03-11T22:27:10.301726+0000 mon.a (mon.0) 3418 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-03-11T22:27:11.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:11 smithi187 bash[23415]: audit 2024-03-11T22:27:10.384837+0000 mon.a (mon.0) 3419 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:11.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:11 smithi187 bash[23415]: audit 2024-03-11T22:27:10.385448+0000 mon.a (mon.0) 3420 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-150"}]: dispatch 2024-03-11T22:27:11.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:11 smithi187 bash[23415]: cluster 2024-03-11T22:27:10.469347+0000 mgr.y (mgr.14601) 718 : cluster 0 pgmap v1216: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:27:11.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:11 smithi187 bash[23415]: cluster 2024-03-11T22:27:11.037946+0000 mon.a (mon.0) 3421 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:11.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[21434]: audit 2024-03-11T22:27:10.294096+0000 mon.a (mon.0) 3417 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:11.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[21434]: cluster 2024-03-11T22:27:10.301726+0000 mon.a (mon.0) 3418 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-03-11T22:27:11.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[21434]: audit 2024-03-11T22:27:10.384837+0000 mon.a (mon.0) 3419 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:11.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[21434]: audit 2024-03-11T22:27:10.385448+0000 mon.a (mon.0) 3420 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-150"}]: dispatch 2024-03-11T22:27:11.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[21434]: cluster 2024-03-11T22:27:10.469347+0000 mgr.y (mgr.14601) 718 : cluster 0 pgmap v1216: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:27:11.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[21434]: cluster 2024-03-11T22:27:11.037946+0000 mon.a (mon.0) 3421 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:11.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[28804]: audit 2024-03-11T22:27:10.294096+0000 mon.a (mon.0) 3417 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:11.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[28804]: cluster 2024-03-11T22:27:10.301726+0000 mon.a (mon.0) 3418 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-03-11T22:27:11.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[28804]: audit 2024-03-11T22:27:10.384837+0000 mon.a (mon.0) 3419 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:11.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[28804]: audit 2024-03-11T22:27:10.385448+0000 mon.a (mon.0) 3420 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-150"}]: dispatch 2024-03-11T22:27:11.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[28804]: cluster 2024-03-11T22:27:10.469347+0000 mgr.y (mgr.14601) 718 : cluster 0 pgmap v1216: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-11T22:27:11.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:11 smithi049 bash[28804]: cluster 2024-03-11T22:27:11.037946+0000 mon.a (mon.0) 3421 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:12.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:12 smithi187 bash[23415]: cluster 2024-03-11T22:27:11.311554+0000 mon.a (mon.0) 3422 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-03-11T22:27:12.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:12 smithi187 bash[23415]: audit 2024-03-11T22:27:12.218729+0000 mon.a (mon.0) 3423 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:27:12.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:12 smithi187 bash[23415]: audit 2024-03-11T22:27:12.221591+0000 mon.c (mon.2) 666 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:12.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:12 smithi049 bash[21434]: cluster 2024-03-11T22:27:11.311554+0000 mon.a (mon.0) 3422 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-03-11T22:27:12.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:12 smithi049 bash[21434]: audit 2024-03-11T22:27:12.218729+0000 mon.a (mon.0) 3423 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:27:12.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:12 smithi049 bash[21434]: audit 2024-03-11T22:27:12.221591+0000 mon.c (mon.2) 666 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:12.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:12 smithi049 bash[28804]: cluster 2024-03-11T22:27:11.311554+0000 mon.a (mon.0) 3422 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-03-11T22:27:12.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:12 smithi049 bash[28804]: audit 2024-03-11T22:27:12.218729+0000 mon.a (mon.0) 3423 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:27:12.779 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:12 smithi049 bash[28804]: audit 2024-03-11T22:27:12.221591+0000 mon.c (mon.2) 666 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:13.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:13 smithi187 bash[23415]: cluster 2024-03-11T22:27:12.313955+0000 mon.a (mon.0) 3424 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-03-11T22:27:13.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:13 smithi187 bash[23415]: audit 2024-03-11T22:27:12.320809+0000 mon.a (mon.0) 3425 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:13.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:13 smithi187 bash[23415]: cluster 2024-03-11T22:27:12.470229+0000 mgr.y (mgr.14601) 719 : cluster 0 pgmap v1219: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-03-11T22:27:13.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:13 smithi187 bash[23415]: audit 2024-03-11T22:27:13.309497+0000 mon.a (mon.0) 3426 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:13.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:13 smithi187 bash[23415]: cluster 2024-03-11T22:27:13.317234+0000 mon.a (mon.0) 3427 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-03-11T22:27:13.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[21434]: cluster 2024-03-11T22:27:12.313955+0000 mon.a (mon.0) 3424 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-03-11T22:27:13.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[21434]: audit 2024-03-11T22:27:12.320809+0000 mon.a (mon.0) 3425 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:13.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[21434]: cluster 2024-03-11T22:27:12.470229+0000 mgr.y (mgr.14601) 719 : cluster 0 pgmap v1219: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-03-11T22:27:13.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[21434]: audit 2024-03-11T22:27:13.309497+0000 mon.a (mon.0) 3426 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:13.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[21434]: cluster 2024-03-11T22:27:13.317234+0000 mon.a (mon.0) 3427 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-03-11T22:27:13.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[28804]: cluster 2024-03-11T22:27:12.313955+0000 mon.a (mon.0) 3424 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-03-11T22:27:13.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[28804]: audit 2024-03-11T22:27:12.320809+0000 mon.a (mon.0) 3425 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:13.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[28804]: cluster 2024-03-11T22:27:12.470229+0000 mgr.y (mgr.14601) 719 : cluster 0 pgmap v1219: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 511 B/s wr, 0 op/s 2024-03-11T22:27:13.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[28804]: audit 2024-03-11T22:27:13.309497+0000 mon.a (mon.0) 3426 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:13.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:13 smithi049 bash[28804]: cluster 2024-03-11T22:27:13.317234+0000 mon.a (mon.0) 3427 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-03-11T22:27:14.529 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:27:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:27:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:27:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:14 smithi187 bash[23415]: audit 2024-03-11T22:27:13.426744+0000 mon.a (mon.0) 3428 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:14 smithi187 bash[23415]: audit 2024-03-11T22:27:13.427349+0000 mon.a (mon.0) 3429 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-152"}]: dispatch 2024-03-11T22:27:15.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:14 smithi187 bash[23415]: cluster 2024-03-11T22:27:14.319965+0000 mon.a (mon.0) 3430 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-03-11T22:27:15.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:14 smithi049 bash[21434]: audit 2024-03-11T22:27:13.426744+0000 mon.a (mon.0) 3428 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:15.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:14 smithi049 bash[21434]: audit 2024-03-11T22:27:13.427349+0000 mon.a (mon.0) 3429 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-152"}]: dispatch 2024-03-11T22:27:15.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:14 smithi049 bash[21434]: cluster 2024-03-11T22:27:14.319965+0000 mon.a (mon.0) 3430 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-03-11T22:27:15.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:14 smithi049 bash[28804]: audit 2024-03-11T22:27:13.426744+0000 mon.a (mon.0) 3428 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:15.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:14 smithi049 bash[28804]: audit 2024-03-11T22:27:13.427349+0000 mon.a (mon.0) 3429 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-152"}]: dispatch 2024-03-11T22:27:15.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:14 smithi049 bash[28804]: cluster 2024-03-11T22:27:14.319965+0000 mon.a (mon.0) 3430 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-03-11T22:27:16.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:15 smithi187 bash[23415]: cluster 2024-03-11T22:27:14.471046+0000 mgr.y (mgr.14601) 720 : cluster 0 pgmap v1222: 236 pgs: 236 active+clean; 4.4 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:27:16.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:15 smithi187 bash[23415]: cluster 2024-03-11T22:27:15.329136+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-03-11T22:27:16.249 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:15 smithi187 bash[23415]: audit 2024-03-11T22:27:15.334061+0000 mon.a (mon.0) 3432 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:16.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:15 smithi049 bash[21434]: cluster 2024-03-11T22:27:14.471046+0000 mgr.y (mgr.14601) 720 : cluster 0 pgmap v1222: 236 pgs: 236 active+clean; 4.4 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:27:16.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:15 smithi049 bash[21434]: cluster 2024-03-11T22:27:15.329136+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-03-11T22:27:16.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:15 smithi049 bash[21434]: audit 2024-03-11T22:27:15.334061+0000 mon.a (mon.0) 3432 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:16.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:15 smithi049 bash[28804]: cluster 2024-03-11T22:27:14.471046+0000 mgr.y (mgr.14601) 720 : cluster 0 pgmap v1222: 236 pgs: 236 active+clean; 4.4 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:27:16.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:15 smithi049 bash[28804]: cluster 2024-03-11T22:27:15.329136+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-03-11T22:27:16.280 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:15 smithi049 bash[28804]: audit 2024-03-11T22:27:15.334061+0000 mon.a (mon.0) 3432 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-11T22:27:17.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:17 smithi187 bash[23415]: audit 2024-03-11T22:27:16.325147+0000 mon.a (mon.0) 3433 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:17.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:17 smithi187 bash[23415]: cluster 2024-03-11T22:27:16.332830+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-03-11T22:27:17.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:17 smithi187 bash[23415]: audit 2024-03-11T22:27:16.337504+0000 mon.a (mon.0) 3435 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-111","var": "dedup_tier","val": "test-rados-api-smithi049-64247-154"}]: dispatch 2024-03-11T22:27:17.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:17 smithi187 bash[23415]: audit 2024-03-11T22:27:16.417709+0000 mon.a (mon.0) 3436 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:17.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:17 smithi187 bash[23415]: audit 2024-03-11T22:27:16.418385+0000 mon.a (mon.0) 3437 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-154"}]: dispatch 2024-03-11T22:27:17.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:17 smithi187 bash[23415]: cluster 2024-03-11T22:27:16.471928+0000 mgr.y (mgr.14601) 721 : cluster 0 pgmap v1225: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:27:17.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[21434]: audit 2024-03-11T22:27:16.325147+0000 mon.a (mon.0) 3433 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:17.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[21434]: cluster 2024-03-11T22:27:16.332830+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-03-11T22:27:17.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[21434]: audit 2024-03-11T22:27:16.337504+0000 mon.a (mon.0) 3435 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-111","var": "dedup_tier","val": "test-rados-api-smithi049-64247-154"}]: dispatch 2024-03-11T22:27:17.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[21434]: audit 2024-03-11T22:27:16.417709+0000 mon.a (mon.0) 3436 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:17.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[21434]: audit 2024-03-11T22:27:16.418385+0000 mon.a (mon.0) 3437 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-154"}]: dispatch 2024-03-11T22:27:17.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[21434]: cluster 2024-03-11T22:27:16.471928+0000 mgr.y (mgr.14601) 721 : cluster 0 pgmap v1225: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:27:17.781 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[28804]: audit 2024-03-11T22:27:16.325147+0000 mon.a (mon.0) 3433 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi049-64247-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-11T22:27:17.781 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[28804]: cluster 2024-03-11T22:27:16.332830+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-03-11T22:27:17.781 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[28804]: audit 2024-03-11T22:27:16.337504+0000 mon.a (mon.0) 3435 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi049-64247-111","var": "dedup_tier","val": "test-rados-api-smithi049-64247-154"}]: dispatch 2024-03-11T22:27:17.781 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[28804]: audit 2024-03-11T22:27:16.417709+0000 mon.a (mon.0) 3436 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:17.781 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[28804]: audit 2024-03-11T22:27:16.418385+0000 mon.a (mon.0) 3437 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi049-64247-111", "tierpool": "test-rados-api-smithi049-64247-154"}]: dispatch 2024-03-11T22:27:17.781 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:17 smithi049 bash[28804]: cluster 2024-03-11T22:27:16.471928+0000 mgr.y (mgr.14601) 721 : cluster 0 pgmap v1225: 268 pgs: 32 unknown, 236 active+clean; 4.4 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-11T22:27:18.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:18 smithi187 bash[23415]: cluster 2024-03-11T22:27:17.342797+0000 mon.a (mon.0) 3438 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-03-11T22:27:18.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:18 smithi049 bash[21434]: cluster 2024-03-11T22:27:17.342797+0000 mon.a (mon.0) 3438 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-03-11T22:27:18.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:18 smithi049 bash[28804]: cluster 2024-03-11T22:27:17.342797+0000 mon.a (mon.0) 3438 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-03-11T22:27:19.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:27:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:27:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:19 smithi187 bash[23415]: cluster 2024-03-11T22:27:18.344336+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-03-11T22:27:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:19 smithi187 bash[23415]: audit 2024-03-11T22:27:18.348013+0000 mon.a (mon.0) 3440 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:19 smithi187 bash[23415]: cluster 2024-03-11T22:27:18.473018+0000 mgr.y (mgr.14601) 722 : cluster 0 pgmap v1228: 228 pgs: 228 active+clean; 582 KiB data, 740 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:19 smithi187 bash[23415]: audit 2024-03-11T22:27:19.339642+0000 mon.a (mon.0) 3441 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:19.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:19 smithi187 bash[23415]: cluster 2024-03-11T22:27:19.347644+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-03-11T22:27:19.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[21434]: cluster 2024-03-11T22:27:18.344336+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-03-11T22:27:19.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[21434]: audit 2024-03-11T22:27:18.348013+0000 mon.a (mon.0) 3440 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:19.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[21434]: cluster 2024-03-11T22:27:18.473018+0000 mgr.y (mgr.14601) 722 : cluster 0 pgmap v1228: 228 pgs: 228 active+clean; 582 KiB data, 740 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:19.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[21434]: audit 2024-03-11T22:27:19.339642+0000 mon.a (mon.0) 3441 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:19.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[21434]: cluster 2024-03-11T22:27:19.347644+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-03-11T22:27:19.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[28804]: cluster 2024-03-11T22:27:18.344336+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-03-11T22:27:19.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[28804]: audit 2024-03-11T22:27:18.348013+0000 mon.a (mon.0) 3440 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:19.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[28804]: cluster 2024-03-11T22:27:18.473018+0000 mgr.y (mgr.14601) 722 : cluster 0 pgmap v1228: 228 pgs: 228 active+clean; 582 KiB data, 740 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:19.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[28804]: audit 2024-03-11T22:27:19.339642+0000 mon.a (mon.0) 3441 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:19.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:19 smithi049 bash[28804]: cluster 2024-03-11T22:27:19.347644+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7760 ms) 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13045 ms) 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8075 ms) 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13133 ms) 2024-03-11T22:27:20.368 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7860 ms) 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8060 ms) 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: hmm, no HitSet yet 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: ok, hit_set contains 329:602f83fe:::foo:head 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9073 ms) 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-03-11T22:27:20.369 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: first is 1710195955 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,1710195960,1710195961,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,1710195960,1710195961,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,1710195960,1710195961,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,1710195960,1710195961,1710195963,1710195964,0 2024-03-11T22:27:20.370 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,1710195960,1710195961,1710195963,1710195964,0 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195955,1710195957,1710195958,1710195960,1710195961,1710195963,1710195964,0 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: got ls 1710195958,1710195960,1710195961,1710195963,1710195964,1710195966,1710195967,0 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: first now 1710195958, trimmed 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (21097 ms) 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: foo0 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14106 ms) 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (18268 ms) 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22658 ms) 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-03-11T22:27:20.371 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5062 ms) 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3044 ms) 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (2999 ms) 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3023 ms) 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (232829 ms total) 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (888080 ms total) 2024-03-11T22:27:20.372 INFO:tasks.workunit.client.0.smithi049.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-03-11T22:27:20.378 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.378 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64082 2024-03-11T22:27:20.378 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64082 2024-03-11T22:27:20.378 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.378 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64258 2024-03-11T22:27:20.378 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64258 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64616 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64616 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64433 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64433 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64325 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64325 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64188 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64188 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64407 2024-03-11T22:27:20.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64407 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64734 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64734 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64776 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64776 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64218 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64218 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64713 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64713 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.380 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64528 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64528 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64066 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64066 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64098 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64098 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64550 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64550 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64058 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64058 2024-03-11T22:27:20.381 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64074 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64074 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64862 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64862 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64270 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64270 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64922 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64922 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64373 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64373 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64727 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64727 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=65018 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 65018 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64282 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64282 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64574 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64574 2024-03-11T22:27:20.383 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64832 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64832 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64722 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64722 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64888 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64888 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64516 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64516 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64250 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64250 2024-03-11T22:27:20.384 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64937 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64937 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64453 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64453 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64050 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64050 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64090 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64090 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64417 2024-03-11T22:27:20.385 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64417 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64104 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64104 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64461 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64461 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64469 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64469 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=64805 2024-03-11T22:27:20.386 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 64805 2024-03-11T22:27:20.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:20 smithi187 bash[23415]: audit 2024-03-11T22:27:19.348466+0000 mon.a (mon.0) 3443 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:20.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:20 smithi187 bash[23415]: cluster 2024-03-11T22:27:19.349762+0000 mon.a (mon.0) 3444 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:20.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:20 smithi187 bash[23415]: audit 2024-03-11T22:27:19.376959+0000 mgr.y (mgr.14601) 723 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:20.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:20 smithi187 bash[23415]: audit 2024-03-11T22:27:20.343115+0000 mon.a (mon.0) 3445 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:20.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:20 smithi187 bash[23415]: cluster 2024-03-11T22:27:20.351127+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-03-11T22:27:20.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[21434]: audit 2024-03-11T22:27:19.348466+0000 mon.a (mon.0) 3443 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:20.779 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[21434]: cluster 2024-03-11T22:27:19.349762+0000 mon.a (mon.0) 3444 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[21434]: audit 2024-03-11T22:27:19.376959+0000 mgr.y (mgr.14601) 723 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[21434]: audit 2024-03-11T22:27:20.343115+0000 mon.a (mon.0) 3445 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[21434]: cluster 2024-03-11T22:27:20.351127+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[28804]: audit 2024-03-11T22:27:19.348466+0000 mon.a (mon.0) 3443 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]: dispatch 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[28804]: cluster 2024-03-11T22:27:19.349762+0000 mon.a (mon.0) 3444 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[28804]: audit 2024-03-11T22:27:19.376959+0000 mgr.y (mgr.14601) 723 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[28804]: audit 2024-03-11T22:27:20.343115+0000 mon.a (mon.0) 3445 : audit 1 from='client.? v1:172.21.15.49:0/3378267435' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi049-64247-111"}]': finished 2024-03-11T22:27:20.780 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:20 smithi049 bash[28804]: cluster 2024-03-11T22:27:20.351127+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-03-11T22:27:22.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:22 smithi187 bash[23415]: cluster 2024-03-11T22:27:20.473834+0000 mgr.y (mgr.14601) 724 : cluster 0 pgmap v1231: 228 pgs: 228 active+clean; 582 KiB data, 744 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:22.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:22 smithi187 bash[23415]: audit 2024-03-11T22:27:21.935463+0000 mon.c (mon.2) 667 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:27:22.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:22 smithi049 bash[21434]: cluster 2024-03-11T22:27:20.473834+0000 mgr.y (mgr.14601) 724 : cluster 0 pgmap v1231: 228 pgs: 228 active+clean; 582 KiB data, 744 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:22.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:22 smithi049 bash[21434]: audit 2024-03-11T22:27:21.935463+0000 mon.c (mon.2) 667 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:27:22.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:22 smithi049 bash[28804]: cluster 2024-03-11T22:27:20.473834+0000 mgr.y (mgr.14601) 724 : cluster 0 pgmap v1231: 228 pgs: 228 active+clean; 582 KiB data, 744 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:22.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:22 smithi049 bash[28804]: audit 2024-03-11T22:27:21.935463+0000 mon.c (mon.2) 667 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:27:23.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:23 smithi187 bash[23415]: audit 2024-03-11T22:27:22.677481+0000 mon.c (mon.2) 668 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:27:23.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:23 smithi187 bash[23415]: audit 2024-03-11T22:27:22.678823+0000 mon.c (mon.2) 669 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:27:23.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:23 smithi187 bash[23415]: audit 2024-03-11T22:27:22.688334+0000 mon.a (mon.0) 3447 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:27:23.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:23 smithi049 bash[21434]: audit 2024-03-11T22:27:22.677481+0000 mon.c (mon.2) 668 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:27:23.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:23 smithi049 bash[21434]: audit 2024-03-11T22:27:22.678823+0000 mon.c (mon.2) 669 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:27:23.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:23 smithi049 bash[21434]: audit 2024-03-11T22:27:22.688334+0000 mon.a (mon.0) 3447 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:27:23.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:23 smithi049 bash[28804]: audit 2024-03-11T22:27:22.677481+0000 mon.c (mon.2) 668 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:27:23.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:23 smithi049 bash[28804]: audit 2024-03-11T22:27:22.678823+0000 mon.c (mon.2) 669 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:27:23.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:23 smithi049 bash[28804]: audit 2024-03-11T22:27:22.688334+0000 mon.a (mon.0) 3447 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:27:24.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:24 smithi187 bash[23415]: cluster 2024-03-11T22:27:22.474446+0000 mgr.y (mgr.14601) 725 : cluster 0 pgmap v1232: 228 pgs: 228 active+clean; 582 KiB data, 744 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:24.529 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:27:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:27:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:27:24.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:24 smithi049 bash[21434]: cluster 2024-03-11T22:27:22.474446+0000 mgr.y (mgr.14601) 725 : cluster 0 pgmap v1232: 228 pgs: 228 active+clean; 582 KiB data, 744 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:24.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:24 smithi049 bash[28804]: cluster 2024-03-11T22:27:22.474446+0000 mgr.y (mgr.14601) 725 : cluster 0 pgmap v1232: 228 pgs: 228 active+clean; 582 KiB data, 744 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:27:26.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:26 smithi187 bash[23415]: cluster 2024-03-11T22:27:24.476769+0000 mgr.y (mgr.14601) 726 : cluster 0 pgmap v1233: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-11T22:27:26.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:26 smithi049 bash[21434]: cluster 2024-03-11T22:27:24.476769+0000 mgr.y (mgr.14601) 726 : cluster 0 pgmap v1233: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-11T22:27:26.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:26 smithi049 bash[28804]: cluster 2024-03-11T22:27:24.476769+0000 mgr.y (mgr.14601) 726 : cluster 0 pgmap v1233: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-11T22:27:28.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:28 smithi187 bash[23415]: cluster 2024-03-11T22:27:26.477573+0000 mgr.y (mgr.14601) 727 : cluster 0 pgmap v1234: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:27:28.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:28 smithi187 bash[23415]: audit 2024-03-11T22:27:27.256611+0000 mon.c (mon.2) 670 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:28.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:28 smithi049 bash[21434]: cluster 2024-03-11T22:27:26.477573+0000 mgr.y (mgr.14601) 727 : cluster 0 pgmap v1234: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:27:28.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:28 smithi049 bash[21434]: audit 2024-03-11T22:27:27.256611+0000 mon.c (mon.2) 670 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:28.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:28 smithi049 bash[28804]: cluster 2024-03-11T22:27:26.477573+0000 mgr.y (mgr.14601) 727 : cluster 0 pgmap v1234: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:27:28.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:28 smithi049 bash[28804]: audit 2024-03-11T22:27:27.256611+0000 mon.c (mon.2) 670 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:29.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:27:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:27:30.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:30 smithi187 bash[23415]: cluster 2024-03-11T22:27:28.478588+0000 mgr.y (mgr.14601) 728 : cluster 0 pgmap v1235: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:27:30.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:30 smithi049 bash[21434]: cluster 2024-03-11T22:27:28.478588+0000 mgr.y (mgr.14601) 728 : cluster 0 pgmap v1235: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:27:30.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:30 smithi049 bash[28804]: cluster 2024-03-11T22:27:28.478588+0000 mgr.y (mgr.14601) 728 : cluster 0 pgmap v1235: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:27:31.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:31 smithi187 bash[23415]: audit 2024-03-11T22:27:29.388202+0000 mgr.y (mgr.14601) 729 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:31.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:31 smithi049 bash[21434]: audit 2024-03-11T22:27:29.388202+0000 mgr.y (mgr.14601) 729 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:31.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:31 smithi049 bash[28804]: audit 2024-03-11T22:27:29.388202+0000 mgr.y (mgr.14601) 729 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:32.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:32 smithi187 bash[23415]: cluster 2024-03-11T22:27:30.480668+0000 mgr.y (mgr.14601) 730 : cluster 0 pgmap v1236: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-11T22:27:32.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:32 smithi049 bash[21434]: cluster 2024-03-11T22:27:30.480668+0000 mgr.y (mgr.14601) 730 : cluster 0 pgmap v1236: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-11T22:27:32.529 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:32 smithi049 bash[28804]: cluster 2024-03-11T22:27:30.480668+0000 mgr.y (mgr.14601) 730 : cluster 0 pgmap v1236: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-11T22:27:34.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:34 smithi187 bash[23415]: cluster 2024-03-11T22:27:32.481811+0000 mgr.y (mgr.14601) 731 : cluster 0 pgmap v1237: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:34.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:34 smithi049 bash[21434]: cluster 2024-03-11T22:27:32.481811+0000 mgr.y (mgr.14601) 731 : cluster 0 pgmap v1237: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:34.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:27:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:27:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:27:34.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:34 smithi049 bash[28804]: cluster 2024-03-11T22:27:32.481811+0000 mgr.y (mgr.14601) 731 : cluster 0 pgmap v1237: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:36.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:36 smithi187 bash[23415]: cluster 2024-03-11T22:27:34.483998+0000 mgr.y (mgr.14601) 732 : cluster 0 pgmap v1238: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:36.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:36 smithi049 bash[21434]: cluster 2024-03-11T22:27:34.483998+0000 mgr.y (mgr.14601) 732 : cluster 0 pgmap v1238: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:36.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:36 smithi049 bash[28804]: cluster 2024-03-11T22:27:34.483998+0000 mgr.y (mgr.14601) 732 : cluster 0 pgmap v1238: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:38.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:38 smithi187 bash[23415]: cluster 2024-03-11T22:27:36.484873+0000 mgr.y (mgr.14601) 733 : cluster 0 pgmap v1239: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:38.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:38 smithi049 bash[21434]: cluster 2024-03-11T22:27:36.484873+0000 mgr.y (mgr.14601) 733 : cluster 0 pgmap v1239: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:38.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:38 smithi049 bash[28804]: cluster 2024-03-11T22:27:36.484873+0000 mgr.y (mgr.14601) 733 : cluster 0 pgmap v1239: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:39.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:27:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:27:40.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:40 smithi187 bash[23415]: cluster 2024-03-11T22:27:38.486000+0000 mgr.y (mgr.14601) 734 : cluster 0 pgmap v1240: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:40.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:40 smithi049 bash[21434]: cluster 2024-03-11T22:27:38.486000+0000 mgr.y (mgr.14601) 734 : cluster 0 pgmap v1240: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:40.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:40 smithi049 bash[28804]: cluster 2024-03-11T22:27:38.486000+0000 mgr.y (mgr.14601) 734 : cluster 0 pgmap v1240: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:41.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:41 smithi187 bash[23415]: audit 2024-03-11T22:27:39.396861+0000 mgr.y (mgr.14601) 735 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:41.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:41 smithi049 bash[21434]: audit 2024-03-11T22:27:39.396861+0000 mgr.y (mgr.14601) 735 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:41.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:41 smithi049 bash[28804]: audit 2024-03-11T22:27:39.396861+0000 mgr.y (mgr.14601) 735 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:42.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:42 smithi187 bash[23415]: cluster 2024-03-11T22:27:40.488546+0000 mgr.y (mgr.14601) 736 : cluster 0 pgmap v1241: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:42.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:42 smithi049 bash[21434]: cluster 2024-03-11T22:27:40.488546+0000 mgr.y (mgr.14601) 736 : cluster 0 pgmap v1241: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:42.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:42 smithi049 bash[28804]: cluster 2024-03-11T22:27:40.488546+0000 mgr.y (mgr.14601) 736 : cluster 0 pgmap v1241: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:43.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:43 smithi187 bash[23415]: audit 2024-03-11T22:27:42.290176+0000 mon.c (mon.2) 671 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:43.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:43 smithi049 bash[21434]: audit 2024-03-11T22:27:42.290176+0000 mon.c (mon.2) 671 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:43.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:43 smithi049 bash[28804]: audit 2024-03-11T22:27:42.290176+0000 mon.c (mon.2) 671 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:44.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:44 smithi187 bash[23415]: cluster 2024-03-11T22:27:42.489422+0000 mgr.y (mgr.14601) 737 : cluster 0 pgmap v1242: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:44.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:44 smithi049 bash[21434]: cluster 2024-03-11T22:27:42.489422+0000 mgr.y (mgr.14601) 737 : cluster 0 pgmap v1242: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:44.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:44 smithi049 bash[28804]: cluster 2024-03-11T22:27:42.489422+0000 mgr.y (mgr.14601) 737 : cluster 0 pgmap v1242: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:44.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:27:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:27:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:27:46.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:46 smithi187 bash[23415]: cluster 2024-03-11T22:27:44.491657+0000 mgr.y (mgr.14601) 738 : cluster 0 pgmap v1243: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:46.529 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:46 smithi049 bash[21434]: cluster 2024-03-11T22:27:44.491657+0000 mgr.y (mgr.14601) 738 : cluster 0 pgmap v1243: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:46.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:46 smithi049 bash[28804]: cluster 2024-03-11T22:27:44.491657+0000 mgr.y (mgr.14601) 738 : cluster 0 pgmap v1243: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:48.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:48 smithi187 bash[23415]: cluster 2024-03-11T22:27:46.492450+0000 mgr.y (mgr.14601) 739 : cluster 0 pgmap v1244: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:48.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:48 smithi049 bash[21434]: cluster 2024-03-11T22:27:46.492450+0000 mgr.y (mgr.14601) 739 : cluster 0 pgmap v1244: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:48.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:48 smithi049 bash[28804]: cluster 2024-03-11T22:27:46.492450+0000 mgr.y (mgr.14601) 739 : cluster 0 pgmap v1244: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:49.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:27:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:27:50.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:50 smithi187 bash[23415]: cluster 2024-03-11T22:27:48.493542+0000 mgr.y (mgr.14601) 740 : cluster 0 pgmap v1245: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:50.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:50 smithi049 bash[21434]: cluster 2024-03-11T22:27:48.493542+0000 mgr.y (mgr.14601) 740 : cluster 0 pgmap v1245: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:50.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:50 smithi049 bash[28804]: cluster 2024-03-11T22:27:48.493542+0000 mgr.y (mgr.14601) 740 : cluster 0 pgmap v1245: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:51.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:51 smithi187 bash[23415]: audit 2024-03-11T22:27:49.408175+0000 mgr.y (mgr.14601) 741 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:51.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:51 smithi049 bash[21434]: audit 2024-03-11T22:27:49.408175+0000 mgr.y (mgr.14601) 741 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:51.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:51 smithi049 bash[28804]: audit 2024-03-11T22:27:49.408175+0000 mgr.y (mgr.14601) 741 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:27:52.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:52 smithi187 bash[23415]: cluster 2024-03-11T22:27:50.495573+0000 mgr.y (mgr.14601) 742 : cluster 0 pgmap v1246: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:52.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:52 smithi049 bash[21434]: cluster 2024-03-11T22:27:50.495573+0000 mgr.y (mgr.14601) 742 : cluster 0 pgmap v1246: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:52.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:52 smithi049 bash[28804]: cluster 2024-03-11T22:27:50.495573+0000 mgr.y (mgr.14601) 742 : cluster 0 pgmap v1246: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:54.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:54 smithi187 bash[23415]: cluster 2024-03-11T22:27:52.496433+0000 mgr.y (mgr.14601) 743 : cluster 0 pgmap v1247: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:54.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:54 smithi049 bash[21434]: cluster 2024-03-11T22:27:52.496433+0000 mgr.y (mgr.14601) 743 : cluster 0 pgmap v1247: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:54.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:27:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:27:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:27:54.531 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:54 smithi049 bash[28804]: cluster 2024-03-11T22:27:52.496433+0000 mgr.y (mgr.14601) 743 : cluster 0 pgmap v1247: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:56.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:56 smithi187 bash[23415]: cluster 2024-03-11T22:27:54.498750+0000 mgr.y (mgr.14601) 744 : cluster 0 pgmap v1248: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:56.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:56 smithi049 bash[21434]: cluster 2024-03-11T22:27:54.498750+0000 mgr.y (mgr.14601) 744 : cluster 0 pgmap v1248: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:56.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:56 smithi049 bash[28804]: cluster 2024-03-11T22:27:54.498750+0000 mgr.y (mgr.14601) 744 : cluster 0 pgmap v1248: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:27:58.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:58 smithi187 bash[23415]: cluster 2024-03-11T22:27:56.499527+0000 mgr.y (mgr.14601) 745 : cluster 0 pgmap v1249: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:58.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:27:58 smithi187 bash[23415]: audit 2024-03-11T22:27:57.323307+0000 mon.c (mon.2) 672 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:58.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:58 smithi049 bash[21434]: cluster 2024-03-11T22:27:56.499527+0000 mgr.y (mgr.14601) 745 : cluster 0 pgmap v1249: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:58.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:27:58 smithi049 bash[21434]: audit 2024-03-11T22:27:57.323307+0000 mon.c (mon.2) 672 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:58.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:58 smithi049 bash[28804]: cluster 2024-03-11T22:27:56.499527+0000 mgr.y (mgr.14601) 745 : cluster 0 pgmap v1249: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:27:58.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:27:58 smithi049 bash[28804]: audit 2024-03-11T22:27:57.323307+0000 mon.c (mon.2) 672 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:27:59.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:27:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:28:00.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:00 smithi187 bash[23415]: cluster 2024-03-11T22:27:58.500614+0000 mgr.y (mgr.14601) 746 : cluster 0 pgmap v1250: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:00.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:00 smithi049 bash[21434]: cluster 2024-03-11T22:27:58.500614+0000 mgr.y (mgr.14601) 746 : cluster 0 pgmap v1250: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:00.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:00 smithi049 bash[28804]: cluster 2024-03-11T22:27:58.500614+0000 mgr.y (mgr.14601) 746 : cluster 0 pgmap v1250: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:01.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:01 smithi187 bash[23415]: audit 2024-03-11T22:27:59.419432+0000 mgr.y (mgr.14601) 747 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:01.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:01 smithi049 bash[21434]: audit 2024-03-11T22:27:59.419432+0000 mgr.y (mgr.14601) 747 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:01.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:01 smithi049 bash[28804]: audit 2024-03-11T22:27:59.419432+0000 mgr.y (mgr.14601) 747 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:02.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:02 smithi187 bash[23415]: cluster 2024-03-11T22:28:00.502692+0000 mgr.y (mgr.14601) 748 : cluster 0 pgmap v1251: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:02.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:02 smithi049 bash[21434]: cluster 2024-03-11T22:28:00.502692+0000 mgr.y (mgr.14601) 748 : cluster 0 pgmap v1251: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:02.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:02 smithi049 bash[28804]: cluster 2024-03-11T22:28:00.502692+0000 mgr.y (mgr.14601) 748 : cluster 0 pgmap v1251: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:04.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:04 smithi187 bash[23415]: cluster 2024-03-11T22:28:02.503486+0000 mgr.y (mgr.14601) 749 : cluster 0 pgmap v1252: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:04.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:04 smithi049 bash[21434]: cluster 2024-03-11T22:28:02.503486+0000 mgr.y (mgr.14601) 749 : cluster 0 pgmap v1252: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:04.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:28:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:28:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:28:04.531 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:04 smithi049 bash[28804]: cluster 2024-03-11T22:28:02.503486+0000 mgr.y (mgr.14601) 749 : cluster 0 pgmap v1252: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:06.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:06 smithi187 bash[23415]: cluster 2024-03-11T22:28:04.506070+0000 mgr.y (mgr.14601) 750 : cluster 0 pgmap v1253: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:06.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:06 smithi049 bash[21434]: cluster 2024-03-11T22:28:04.506070+0000 mgr.y (mgr.14601) 750 : cluster 0 pgmap v1253: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:06.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:06 smithi049 bash[28804]: cluster 2024-03-11T22:28:04.506070+0000 mgr.y (mgr.14601) 750 : cluster 0 pgmap v1253: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:08.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:08 smithi187 bash[23415]: cluster 2024-03-11T22:28:06.506942+0000 mgr.y (mgr.14601) 751 : cluster 0 pgmap v1254: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:08.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:08 smithi049 bash[28804]: cluster 2024-03-11T22:28:06.506942+0000 mgr.y (mgr.14601) 751 : cluster 0 pgmap v1254: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:08.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:08 smithi049 bash[21434]: cluster 2024-03-11T22:28:06.506942+0000 mgr.y (mgr.14601) 751 : cluster 0 pgmap v1254: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:09.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:28:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:28:10.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:10 smithi187 bash[23415]: cluster 2024-03-11T22:28:08.508045+0000 mgr.y (mgr.14601) 752 : cluster 0 pgmap v1255: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:10.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:10 smithi049 bash[28804]: cluster 2024-03-11T22:28:08.508045+0000 mgr.y (mgr.14601) 752 : cluster 0 pgmap v1255: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:10.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:10 smithi049 bash[21434]: cluster 2024-03-11T22:28:08.508045+0000 mgr.y (mgr.14601) 752 : cluster 0 pgmap v1255: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:11.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:11 smithi187 bash[23415]: audit 2024-03-11T22:28:09.430779+0000 mgr.y (mgr.14601) 753 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:11.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:11 smithi049 bash[28804]: audit 2024-03-11T22:28:09.430779+0000 mgr.y (mgr.14601) 753 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:11.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:11 smithi049 bash[21434]: audit 2024-03-11T22:28:09.430779+0000 mgr.y (mgr.14601) 753 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:12.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:12 smithi187 bash[23415]: cluster 2024-03-11T22:28:10.510188+0000 mgr.y (mgr.14601) 754 : cluster 0 pgmap v1256: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:12.530 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:12 smithi049 bash[21434]: cluster 2024-03-11T22:28:10.510188+0000 mgr.y (mgr.14601) 754 : cluster 0 pgmap v1256: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:12.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:12 smithi049 bash[28804]: cluster 2024-03-11T22:28:10.510188+0000 mgr.y (mgr.14601) 754 : cluster 0 pgmap v1256: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:13.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:13 smithi187 bash[23415]: audit 2024-03-11T22:28:12.357816+0000 mon.c (mon.2) 673 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:13.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:13 smithi187 bash[23415]: cluster 2024-03-11T22:28:12.511009+0000 mgr.y (mgr.14601) 755 : cluster 0 pgmap v1257: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:13.530 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:13 smithi049 bash[28804]: audit 2024-03-11T22:28:12.357816+0000 mon.c (mon.2) 673 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:13.531 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:13 smithi049 bash[28804]: cluster 2024-03-11T22:28:12.511009+0000 mgr.y (mgr.14601) 755 : cluster 0 pgmap v1257: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:13.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:13 smithi049 bash[21434]: audit 2024-03-11T22:28:12.357816+0000 mon.c (mon.2) 673 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:13.531 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:13 smithi049 bash[21434]: cluster 2024-03-11T22:28:12.511009+0000 mgr.y (mgr.14601) 755 : cluster 0 pgmap v1257: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:14.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:28:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:28:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:28:15.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:15 smithi187 bash[23415]: cluster 2024-03-11T22:28:14.513370+0000 mgr.y (mgr.14601) 756 : cluster 0 pgmap v1258: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:16.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:15 smithi049 bash[21434]: cluster 2024-03-11T22:28:14.513370+0000 mgr.y (mgr.14601) 756 : cluster 0 pgmap v1258: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:16.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:15 smithi049 bash[28804]: cluster 2024-03-11T22:28:14.513370+0000 mgr.y (mgr.14601) 756 : cluster 0 pgmap v1258: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:17.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:17 smithi187 bash[23415]: cluster 2024-03-11T22:28:16.514223+0000 mgr.y (mgr.14601) 757 : cluster 0 pgmap v1259: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:18.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:17 smithi049 bash[21434]: cluster 2024-03-11T22:28:16.514223+0000 mgr.y (mgr.14601) 757 : cluster 0 pgmap v1259: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:18.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:17 smithi049 bash[28804]: cluster 2024-03-11T22:28:16.514223+0000 mgr.y (mgr.14601) 757 : cluster 0 pgmap v1259: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:19.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:28:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:28:19.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:19 smithi187 bash[23415]: cluster 2024-03-11T22:28:18.515247+0000 mgr.y (mgr.14601) 758 : cluster 0 pgmap v1260: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:20.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:19 smithi049 bash[21434]: cluster 2024-03-11T22:28:18.515247+0000 mgr.y (mgr.14601) 758 : cluster 0 pgmap v1260: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:20.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:19 smithi049 bash[28804]: cluster 2024-03-11T22:28:18.515247+0000 mgr.y (mgr.14601) 758 : cluster 0 pgmap v1260: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:20.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:20 smithi187 bash[23415]: audit 2024-03-11T22:28:19.442042+0000 mgr.y (mgr.14601) 759 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:21.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:20 smithi049 bash[21434]: audit 2024-03-11T22:28:19.442042+0000 mgr.y (mgr.14601) 759 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:21.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:20 smithi049 bash[28804]: audit 2024-03-11T22:28:19.442042+0000 mgr.y (mgr.14601) 759 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:21.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:21 smithi187 bash[23415]: cluster 2024-03-11T22:28:20.517583+0000 mgr.y (mgr.14601) 760 : cluster 0 pgmap v1261: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:22.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:21 smithi049 bash[21434]: cluster 2024-03-11T22:28:20.517583+0000 mgr.y (mgr.14601) 760 : cluster 0 pgmap v1261: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:22.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:21 smithi049 bash[28804]: cluster 2024-03-11T22:28:20.517583+0000 mgr.y (mgr.14601) 760 : cluster 0 pgmap v1261: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:24.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:23 smithi187 bash[23415]: cluster 2024-03-11T22:28:22.518454+0000 mgr.y (mgr.14601) 761 : cluster 0 pgmap v1262: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:24.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:23 smithi187 bash[23415]: audit 2024-03-11T22:28:22.767372+0000 mon.c (mon.2) 674 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:28:24.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:23 smithi187 bash[23415]: audit 2024-03-11T22:28:23.500285+0000 mon.c (mon.2) 675 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:28:24.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:23 smithi187 bash[23415]: audit 2024-03-11T22:28:23.501704+0000 mon.c (mon.2) 676 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:28:24.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:23 smithi187 bash[23415]: audit 2024-03-11T22:28:23.511825+0000 mon.a (mon.0) 3448 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:28:24.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[21434]: cluster 2024-03-11T22:28:22.518454+0000 mgr.y (mgr.14601) 761 : cluster 0 pgmap v1262: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[21434]: audit 2024-03-11T22:28:22.767372+0000 mon.c (mon.2) 674 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[21434]: audit 2024-03-11T22:28:23.500285+0000 mon.c (mon.2) 675 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[21434]: audit 2024-03-11T22:28:23.501704+0000 mon.c (mon.2) 676 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[21434]: audit 2024-03-11T22:28:23.511825+0000 mon.a (mon.0) 3448 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[28804]: cluster 2024-03-11T22:28:22.518454+0000 mgr.y (mgr.14601) 761 : cluster 0 pgmap v1262: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[28804]: audit 2024-03-11T22:28:22.767372+0000 mon.c (mon.2) 674 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[28804]: audit 2024-03-11T22:28:23.500285+0000 mon.c (mon.2) 675 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[28804]: audit 2024-03-11T22:28:23.501704+0000 mon.c (mon.2) 676 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:28:24.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:23 smithi049 bash[28804]: audit 2024-03-11T22:28:23.511825+0000 mon.a (mon.0) 3448 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:28:24.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:28:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:28:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:28:25.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:25 smithi187 bash[23415]: cluster 2024-03-11T22:28:24.520824+0000 mgr.y (mgr.14601) 762 : cluster 0 pgmap v1263: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:28:26.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:25 smithi049 bash[21434]: cluster 2024-03-11T22:28:24.520824+0000 mgr.y (mgr.14601) 762 : cluster 0 pgmap v1263: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:28:26.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:25 smithi049 bash[28804]: cluster 2024-03-11T22:28:24.520824+0000 mgr.y (mgr.14601) 762 : cluster 0 pgmap v1263: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:28:28.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:27 smithi187 bash[23415]: cluster 2024-03-11T22:28:26.521838+0000 mgr.y (mgr.14601) 763 : cluster 0 pgmap v1264: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:28:28.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:27 smithi187 bash[23415]: audit 2024-03-11T22:28:27.392918+0000 mon.c (mon.2) 677 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:28.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:27 smithi049 bash[28804]: cluster 2024-03-11T22:28:26.521838+0000 mgr.y (mgr.14601) 763 : cluster 0 pgmap v1264: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:28:28.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:27 smithi049 bash[28804]: audit 2024-03-11T22:28:27.392918+0000 mon.c (mon.2) 677 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:28.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:27 smithi049 bash[21434]: cluster 2024-03-11T22:28:26.521838+0000 mgr.y (mgr.14601) 763 : cluster 0 pgmap v1264: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:28:28.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:27 smithi049 bash[21434]: audit 2024-03-11T22:28:27.392918+0000 mon.c (mon.2) 677 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:29.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:29 smithi187 bash[23415]: cluster 2024-03-11T22:28:28.522932+0000 mgr.y (mgr.14601) 764 : cluster 0 pgmap v1265: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-11T22:28:29.750 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:28:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:28:30.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:29 smithi049 bash[21434]: cluster 2024-03-11T22:28:28.522932+0000 mgr.y (mgr.14601) 764 : cluster 0 pgmap v1265: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-11T22:28:30.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:29 smithi049 bash[28804]: cluster 2024-03-11T22:28:28.522932+0000 mgr.y (mgr.14601) 764 : cluster 0 pgmap v1265: 228 pgs: 228 active+clean; 582 KiB data, 739 MiB used, 714 GiB / 715 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-11T22:28:30.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:30 smithi187 bash[23415]: audit 2024-03-11T22:28:29.452588+0000 mgr.y (mgr.14601) 765 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:31.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:30 smithi049 bash[21434]: audit 2024-03-11T22:28:29.452588+0000 mgr.y (mgr.14601) 765 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:31.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:30 smithi049 bash[28804]: audit 2024-03-11T22:28:29.452588+0000 mgr.y (mgr.14601) 765 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:31.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:31 smithi187 bash[23415]: cluster 2024-03-11T22:28:30.525067+0000 mgr.y (mgr.14601) 766 : cluster 0 pgmap v1266: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:32.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:31 smithi049 bash[21434]: cluster 2024-03-11T22:28:30.525067+0000 mgr.y (mgr.14601) 766 : cluster 0 pgmap v1266: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:32.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:31 smithi049 bash[28804]: cluster 2024-03-11T22:28:30.525067+0000 mgr.y (mgr.14601) 766 : cluster 0 pgmap v1266: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:34.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:33 smithi187 bash[23415]: cluster 2024-03-11T22:28:32.525871+0000 mgr.y (mgr.14601) 767 : cluster 0 pgmap v1267: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:34.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:33 smithi049 bash[21434]: cluster 2024-03-11T22:28:32.525871+0000 mgr.y (mgr.14601) 767 : cluster 0 pgmap v1267: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:34.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:33 smithi049 bash[28804]: cluster 2024-03-11T22:28:32.525871+0000 mgr.y (mgr.14601) 767 : cluster 0 pgmap v1267: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:34.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:28:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:28:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:28:35.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:35 smithi187 bash[23415]: cluster 2024-03-11T22:28:34.528119+0000 mgr.y (mgr.14601) 768 : cluster 0 pgmap v1268: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:36.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:35 smithi049 bash[21434]: cluster 2024-03-11T22:28:34.528119+0000 mgr.y (mgr.14601) 768 : cluster 0 pgmap v1268: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:36.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:35 smithi049 bash[28804]: cluster 2024-03-11T22:28:34.528119+0000 mgr.y (mgr.14601) 768 : cluster 0 pgmap v1268: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:28:37.999 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:37 smithi187 bash[23415]: cluster 2024-03-11T22:28:36.528931+0000 mgr.y (mgr.14601) 769 : cluster 0 pgmap v1269: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 58 op/s 2024-03-11T22:28:38.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:37 smithi049 bash[21434]: cluster 2024-03-11T22:28:36.528931+0000 mgr.y (mgr.14601) 769 : cluster 0 pgmap v1269: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 58 op/s 2024-03-11T22:28:38.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:37 smithi049 bash[28804]: cluster 2024-03-11T22:28:36.528931+0000 mgr.y (mgr.14601) 769 : cluster 0 pgmap v1269: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 58 op/s 2024-03-11T22:28:39.749 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:39 smithi187 bash[23415]: cluster 2024-03-11T22:28:38.530145+0000 mgr.y (mgr.14601) 770 : cluster 0 pgmap v1270: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-03-11T22:28:39.750 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:28:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:28:40.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:39 smithi049 bash[28804]: cluster 2024-03-11T22:28:38.530145+0000 mgr.y (mgr.14601) 770 : cluster 0 pgmap v1270: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-03-11T22:28:40.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:39 smithi049 bash[21434]: cluster 2024-03-11T22:28:38.530145+0000 mgr.y (mgr.14601) 770 : cluster 0 pgmap v1270: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-03-11T22:28:41.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:40 smithi187 bash[23415]: audit 2024-03-11T22:28:39.456913+0000 mgr.y (mgr.14601) 771 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:41.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:40 smithi049 bash[21434]: audit 2024-03-11T22:28:39.456913+0000 mgr.y (mgr.14601) 771 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:41.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:40 smithi049 bash[28804]: audit 2024-03-11T22:28:39.456913+0000 mgr.y (mgr.14601) 771 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:42.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:41 smithi187 bash[23415]: cluster 2024-03-11T22:28:40.532380+0000 mgr.y (mgr.14601) 772 : cluster 0 pgmap v1271: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 48 op/s 2024-03-11T22:28:42.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:41 smithi049 bash[21434]: cluster 2024-03-11T22:28:40.532380+0000 mgr.y (mgr.14601) 772 : cluster 0 pgmap v1271: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 48 op/s 2024-03-11T22:28:42.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:41 smithi049 bash[28804]: cluster 2024-03-11T22:28:40.532380+0000 mgr.y (mgr.14601) 772 : cluster 0 pgmap v1271: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 48 op/s 2024-03-11T22:28:43.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:42 smithi187 bash[23415]: audit 2024-03-11T22:28:42.426731+0000 mon.c (mon.2) 678 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:43.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:42 smithi049 bash[21434]: audit 2024-03-11T22:28:42.426731+0000 mon.c (mon.2) 678 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:43.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:42 smithi049 bash[28804]: audit 2024-03-11T22:28:42.426731+0000 mon.c (mon.2) 678 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:44.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:43 smithi187 bash[23415]: cluster 2024-03-11T22:28:42.533219+0000 mgr.y (mgr.14601) 773 : cluster 0 pgmap v1272: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:44.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:43 smithi049 bash[28804]: cluster 2024-03-11T22:28:42.533219+0000 mgr.y (mgr.14601) 773 : cluster 0 pgmap v1272: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:44.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:43 smithi049 bash[21434]: cluster 2024-03-11T22:28:42.533219+0000 mgr.y (mgr.14601) 773 : cluster 0 pgmap v1272: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:44.530 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:28:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:28:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:28:46.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:45 smithi187 bash[23415]: cluster 2024-03-11T22:28:44.535470+0000 mgr.y (mgr.14601) 774 : cluster 0 pgmap v1273: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:46.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:45 smithi049 bash[28804]: cluster 2024-03-11T22:28:44.535470+0000 mgr.y (mgr.14601) 774 : cluster 0 pgmap v1273: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:46.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:45 smithi049 bash[21434]: cluster 2024-03-11T22:28:44.535470+0000 mgr.y (mgr.14601) 774 : cluster 0 pgmap v1273: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:48.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:47 smithi187 bash[23415]: cluster 2024-03-11T22:28:46.536288+0000 mgr.y (mgr.14601) 775 : cluster 0 pgmap v1274: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:48.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:47 smithi049 bash[21434]: cluster 2024-03-11T22:28:46.536288+0000 mgr.y (mgr.14601) 775 : cluster 0 pgmap v1274: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:48.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:47 smithi049 bash[28804]: cluster 2024-03-11T22:28:46.536288+0000 mgr.y (mgr.14601) 775 : cluster 0 pgmap v1274: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:49.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:49 smithi187 bash[23415]: cluster 2024-03-11T22:28:48.537363+0000 mgr.y (mgr.14601) 776 : cluster 0 pgmap v1275: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:49.750 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:28:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:28:50.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:49 smithi049 bash[21434]: cluster 2024-03-11T22:28:48.537363+0000 mgr.y (mgr.14601) 776 : cluster 0 pgmap v1275: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:50.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:49 smithi049 bash[28804]: cluster 2024-03-11T22:28:48.537363+0000 mgr.y (mgr.14601) 776 : cluster 0 pgmap v1275: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:51.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:50 smithi187 bash[23415]: audit 2024-03-11T22:28:49.460914+0000 mgr.y (mgr.14601) 777 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:51.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:50 smithi049 bash[21434]: audit 2024-03-11T22:28:49.460914+0000 mgr.y (mgr.14601) 777 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:51.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:50 smithi049 bash[28804]: audit 2024-03-11T22:28:49.460914+0000 mgr.y (mgr.14601) 777 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:28:52.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:51 smithi187 bash[23415]: cluster 2024-03-11T22:28:50.539411+0000 mgr.y (mgr.14601) 778 : cluster 0 pgmap v1276: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:52.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:51 smithi049 bash[21434]: cluster 2024-03-11T22:28:50.539411+0000 mgr.y (mgr.14601) 778 : cluster 0 pgmap v1276: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:52.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:51 smithi049 bash[28804]: cluster 2024-03-11T22:28:50.539411+0000 mgr.y (mgr.14601) 778 : cluster 0 pgmap v1276: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:54.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:53 smithi187 bash[23415]: cluster 2024-03-11T22:28:52.540247+0000 mgr.y (mgr.14601) 779 : cluster 0 pgmap v1277: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:54.030 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:53 smithi049 bash[28804]: cluster 2024-03-11T22:28:52.540247+0000 mgr.y (mgr.14601) 779 : cluster 0 pgmap v1277: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:54.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:53 smithi049 bash[21434]: cluster 2024-03-11T22:28:52.540247+0000 mgr.y (mgr.14601) 779 : cluster 0 pgmap v1277: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:54.531 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:28:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:28:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:28:56.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:55 smithi187 bash[23415]: cluster 2024-03-11T22:28:54.542515+0000 mgr.y (mgr.14601) 780 : cluster 0 pgmap v1278: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:56.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:55 smithi049 bash[21434]: cluster 2024-03-11T22:28:54.542515+0000 mgr.y (mgr.14601) 780 : cluster 0 pgmap v1278: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:56.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:55 smithi049 bash[28804]: cluster 2024-03-11T22:28:54.542515+0000 mgr.y (mgr.14601) 780 : cluster 0 pgmap v1278: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:28:58.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:57 smithi187 bash[23415]: cluster 2024-03-11T22:28:56.543297+0000 mgr.y (mgr.14601) 781 : cluster 0 pgmap v1279: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:58.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:57 smithi187 bash[23415]: audit 2024-03-11T22:28:57.460587+0000 mon.c (mon.2) 679 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:58.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:57 smithi049 bash[21434]: cluster 2024-03-11T22:28:56.543297+0000 mgr.y (mgr.14601) 781 : cluster 0 pgmap v1279: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:58.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:57 smithi049 bash[21434]: audit 2024-03-11T22:28:57.460587+0000 mon.c (mon.2) 679 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:58.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:57 smithi049 bash[28804]: cluster 2024-03-11T22:28:56.543297+0000 mgr.y (mgr.14601) 781 : cluster 0 pgmap v1279: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:28:58.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:57 smithi049 bash[28804]: audit 2024-03-11T22:28:57.460587+0000 mon.c (mon.2) 679 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:28:59.750 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:28:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:28:59.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:28:59 smithi187 bash[23415]: cluster 2024-03-11T22:28:58.544503+0000 mgr.y (mgr.14601) 782 : cluster 0 pgmap v1280: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:00.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:28:59 smithi049 bash[21434]: cluster 2024-03-11T22:28:58.544503+0000 mgr.y (mgr.14601) 782 : cluster 0 pgmap v1280: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:00.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:28:59 smithi049 bash[28804]: cluster 2024-03-11T22:28:58.544503+0000 mgr.y (mgr.14601) 782 : cluster 0 pgmap v1280: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:01.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:00 smithi187 bash[23415]: audit 2024-03-11T22:28:59.472295+0000 mgr.y (mgr.14601) 783 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:01.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:00 smithi049 bash[21434]: audit 2024-03-11T22:28:59.472295+0000 mgr.y (mgr.14601) 783 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:01.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:00 smithi049 bash[28804]: audit 2024-03-11T22:28:59.472295+0000 mgr.y (mgr.14601) 783 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:02.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:01 smithi187 bash[23415]: cluster 2024-03-11T22:29:00.546600+0000 mgr.y (mgr.14601) 784 : cluster 0 pgmap v1281: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:02.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:01 smithi049 bash[21434]: cluster 2024-03-11T22:29:00.546600+0000 mgr.y (mgr.14601) 784 : cluster 0 pgmap v1281: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:02.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:01 smithi049 bash[28804]: cluster 2024-03-11T22:29:00.546600+0000 mgr.y (mgr.14601) 784 : cluster 0 pgmap v1281: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:04.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:03 smithi187 bash[23415]: cluster 2024-03-11T22:29:02.547550+0000 mgr.y (mgr.14601) 785 : cluster 0 pgmap v1282: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:04.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:03 smithi049 bash[21434]: cluster 2024-03-11T22:29:02.547550+0000 mgr.y (mgr.14601) 785 : cluster 0 pgmap v1282: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:04.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:03 smithi049 bash[28804]: cluster 2024-03-11T22:29:02.547550+0000 mgr.y (mgr.14601) 785 : cluster 0 pgmap v1282: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:04.531 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:29:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:29:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:29:06.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:05 smithi187 bash[23415]: cluster 2024-03-11T22:29:04.549865+0000 mgr.y (mgr.14601) 786 : cluster 0 pgmap v1283: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:06.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:05 smithi049 bash[28804]: cluster 2024-03-11T22:29:04.549865+0000 mgr.y (mgr.14601) 786 : cluster 0 pgmap v1283: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:06.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:05 smithi049 bash[21434]: cluster 2024-03-11T22:29:04.549865+0000 mgr.y (mgr.14601) 786 : cluster 0 pgmap v1283: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:08.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:07 smithi187 bash[23415]: cluster 2024-03-11T22:29:06.550731+0000 mgr.y (mgr.14601) 787 : cluster 0 pgmap v1284: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:08.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:07 smithi049 bash[21434]: cluster 2024-03-11T22:29:06.550731+0000 mgr.y (mgr.14601) 787 : cluster 0 pgmap v1284: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:08.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:07 smithi049 bash[28804]: cluster 2024-03-11T22:29:06.550731+0000 mgr.y (mgr.14601) 787 : cluster 0 pgmap v1284: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:09.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:09 smithi187 bash[23415]: cluster 2024-03-11T22:29:08.551788+0000 mgr.y (mgr.14601) 788 : cluster 0 pgmap v1285: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:09.750 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:29:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:29:10.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:09 smithi049 bash[21434]: cluster 2024-03-11T22:29:08.551788+0000 mgr.y (mgr.14601) 788 : cluster 0 pgmap v1285: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:10.035 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:09 smithi049 bash[28804]: cluster 2024-03-11T22:29:08.551788+0000 mgr.y (mgr.14601) 788 : cluster 0 pgmap v1285: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:11.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:10 smithi187 bash[23415]: audit 2024-03-11T22:29:09.483594+0000 mgr.y (mgr.14601) 789 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:11.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:10 smithi049 bash[21434]: audit 2024-03-11T22:29:09.483594+0000 mgr.y (mgr.14601) 789 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:11.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:10 smithi049 bash[28804]: audit 2024-03-11T22:29:09.483594+0000 mgr.y (mgr.14601) 789 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:12.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:11 smithi187 bash[23415]: cluster 2024-03-11T22:29:10.554002+0000 mgr.y (mgr.14601) 790 : cluster 0 pgmap v1286: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:12.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:11 smithi049 bash[21434]: cluster 2024-03-11T22:29:10.554002+0000 mgr.y (mgr.14601) 790 : cluster 0 pgmap v1286: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:12.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:11 smithi049 bash[28804]: cluster 2024-03-11T22:29:10.554002+0000 mgr.y (mgr.14601) 790 : cluster 0 pgmap v1286: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:13.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:12 smithi187 bash[23415]: audit 2024-03-11T22:29:12.494865+0000 mon.c (mon.2) 680 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:13.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:12 smithi049 bash[21434]: audit 2024-03-11T22:29:12.494865+0000 mon.c (mon.2) 680 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:13.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:12 smithi049 bash[28804]: audit 2024-03-11T22:29:12.494865+0000 mon.c (mon.2) 680 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:14.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:13 smithi187 bash[23415]: cluster 2024-03-11T22:29:12.554858+0000 mgr.y (mgr.14601) 791 : cluster 0 pgmap v1287: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:14.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:13 smithi049 bash[21434]: cluster 2024-03-11T22:29:12.554858+0000 mgr.y (mgr.14601) 791 : cluster 0 pgmap v1287: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:14.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:13 smithi049 bash[28804]: cluster 2024-03-11T22:29:12.554858+0000 mgr.y (mgr.14601) 791 : cluster 0 pgmap v1287: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:14.531 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:29:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:29:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:29:16.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:15 smithi187 bash[23415]: cluster 2024-03-11T22:29:14.557280+0000 mgr.y (mgr.14601) 792 : cluster 0 pgmap v1288: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:16.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:15 smithi049 bash[21434]: cluster 2024-03-11T22:29:14.557280+0000 mgr.y (mgr.14601) 792 : cluster 0 pgmap v1288: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:16.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:15 smithi049 bash[28804]: cluster 2024-03-11T22:29:14.557280+0000 mgr.y (mgr.14601) 792 : cluster 0 pgmap v1288: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:18.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:17 smithi049 bash[21434]: cluster 2024-03-11T22:29:16.558213+0000 mgr.y (mgr.14601) 793 : cluster 0 pgmap v1289: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:18.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:17 smithi049 bash[28804]: cluster 2024-03-11T22:29:16.558213+0000 mgr.y (mgr.14601) 793 : cluster 0 pgmap v1289: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:18.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:17 smithi187 bash[23415]: cluster 2024-03-11T22:29:16.558213+0000 mgr.y (mgr.14601) 793 : cluster 0 pgmap v1289: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:19.750 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:29:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:29:20.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:19 smithi049 bash[21434]: cluster 2024-03-11T22:29:18.559421+0000 mgr.y (mgr.14601) 794 : cluster 0 pgmap v1290: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:20.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:19 smithi049 bash[28804]: cluster 2024-03-11T22:29:18.559421+0000 mgr.y (mgr.14601) 794 : cluster 0 pgmap v1290: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:20.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:19 smithi187 bash[23415]: cluster 2024-03-11T22:29:18.559421+0000 mgr.y (mgr.14601) 794 : cluster 0 pgmap v1290: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:21.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:20 smithi049 bash[21434]: audit 2024-03-11T22:29:19.494993+0000 mgr.y (mgr.14601) 795 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:21.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:20 smithi049 bash[28804]: audit 2024-03-11T22:29:19.494993+0000 mgr.y (mgr.14601) 795 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:21.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:20 smithi187 bash[23415]: audit 2024-03-11T22:29:19.494993+0000 mgr.y (mgr.14601) 795 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:22.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:21 smithi049 bash[28804]: cluster 2024-03-11T22:29:20.561562+0000 mgr.y (mgr.14601) 796 : cluster 0 pgmap v1291: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:22.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:21 smithi049 bash[21434]: cluster 2024-03-11T22:29:20.561562+0000 mgr.y (mgr.14601) 796 : cluster 0 pgmap v1291: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:22.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:21 smithi187 bash[23415]: cluster 2024-03-11T22:29:20.561562+0000 mgr.y (mgr.14601) 796 : cluster 0 pgmap v1291: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:24.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:23 smithi049 bash[21434]: cluster 2024-03-11T22:29:22.562379+0000 mgr.y (mgr.14601) 797 : cluster 0 pgmap v1292: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:24.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:23 smithi049 bash[21434]: audit 2024-03-11T22:29:23.609706+0000 mon.c (mon.2) 681 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:29:24.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:23 smithi049 bash[28804]: cluster 2024-03-11T22:29:22.562379+0000 mgr.y (mgr.14601) 797 : cluster 0 pgmap v1292: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:24.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:23 smithi049 bash[28804]: audit 2024-03-11T22:29:23.609706+0000 mon.c (mon.2) 681 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:29:24.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:23 smithi187 bash[23415]: cluster 2024-03-11T22:29:22.562379+0000 mgr.y (mgr.14601) 797 : cluster 0 pgmap v1292: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:24.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:23 smithi187 bash[23415]: audit 2024-03-11T22:29:23.609706+0000 mon.c (mon.2) 681 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:29:24.531 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:29:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:29:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:29:25.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:24 smithi049 bash[21434]: audit 2024-03-11T22:29:24.338253+0000 mon.c (mon.2) 682 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:29:25.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:24 smithi049 bash[21434]: audit 2024-03-11T22:29:24.339786+0000 mon.c (mon.2) 683 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:29:25.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:24 smithi049 bash[21434]: audit 2024-03-11T22:29:24.349741+0000 mon.a (mon.0) 3449 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:29:25.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:24 smithi049 bash[28804]: audit 2024-03-11T22:29:24.338253+0000 mon.c (mon.2) 682 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:29:25.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:24 smithi049 bash[28804]: audit 2024-03-11T22:29:24.339786+0000 mon.c (mon.2) 683 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:29:25.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:24 smithi049 bash[28804]: audit 2024-03-11T22:29:24.349741+0000 mon.a (mon.0) 3449 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:29:25.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:24 smithi187 bash[23415]: audit 2024-03-11T22:29:24.338253+0000 mon.c (mon.2) 682 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:29:25.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:24 smithi187 bash[23415]: audit 2024-03-11T22:29:24.339786+0000 mon.c (mon.2) 683 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:29:25.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:24 smithi187 bash[23415]: audit 2024-03-11T22:29:24.349741+0000 mon.a (mon.0) 3449 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:29:26.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:25 smithi049 bash[21434]: cluster 2024-03-11T22:29:24.564564+0000 mgr.y (mgr.14601) 798 : cluster 0 pgmap v1293: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:26.031 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:25 smithi049 bash[28804]: cluster 2024-03-11T22:29:24.564564+0000 mgr.y (mgr.14601) 798 : cluster 0 pgmap v1293: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:26.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:25 smithi187 bash[23415]: cluster 2024-03-11T22:29:24.564564+0000 mgr.y (mgr.14601) 798 : cluster 0 pgmap v1293: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:28.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:27 smithi049 bash[21434]: cluster 2024-03-11T22:29:26.565409+0000 mgr.y (mgr.14601) 799 : cluster 0 pgmap v1294: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:28.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:27 smithi049 bash[21434]: audit 2024-03-11T22:29:27.528925+0000 mon.c (mon.2) 684 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:28.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:27 smithi049 bash[28804]: cluster 2024-03-11T22:29:26.565409+0000 mgr.y (mgr.14601) 799 : cluster 0 pgmap v1294: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:28.032 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:27 smithi049 bash[28804]: audit 2024-03-11T22:29:27.528925+0000 mon.c (mon.2) 684 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:28.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:27 smithi187 bash[23415]: cluster 2024-03-11T22:29:26.565409+0000 mgr.y (mgr.14601) 799 : cluster 0 pgmap v1294: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:28.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:27 smithi187 bash[23415]: audit 2024-03-11T22:29:27.528925+0000 mon.c (mon.2) 684 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:29.785 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:29:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:29:30.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:29 smithi187 bash[23415]: cluster 2024-03-11T22:29:28.566782+0000 mgr.y (mgr.14601) 800 : cluster 0 pgmap v1295: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:30.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:29 smithi049 bash[21434]: cluster 2024-03-11T22:29:28.566782+0000 mgr.y (mgr.14601) 800 : cluster 0 pgmap v1295: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:30.281 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:29 smithi049 bash[28804]: cluster 2024-03-11T22:29:28.566782+0000 mgr.y (mgr.14601) 800 : cluster 0 pgmap v1295: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:31.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:30 smithi187 bash[23415]: audit 2024-03-11T22:29:29.501158+0000 mgr.y (mgr.14601) 801 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:31.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:30 smithi049 bash[21434]: audit 2024-03-11T22:29:29.501158+0000 mgr.y (mgr.14601) 801 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:31.281 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:30 smithi049 bash[28804]: audit 2024-03-11T22:29:29.501158+0000 mgr.y (mgr.14601) 801 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:32.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:31 smithi187 bash[23415]: cluster 2024-03-11T22:29:30.568917+0000 mgr.y (mgr.14601) 802 : cluster 0 pgmap v1296: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:32.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:31 smithi049 bash[21434]: cluster 2024-03-11T22:29:30.568917+0000 mgr.y (mgr.14601) 802 : cluster 0 pgmap v1296: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:32.281 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:31 smithi049 bash[28804]: cluster 2024-03-11T22:29:30.568917+0000 mgr.y (mgr.14601) 802 : cluster 0 pgmap v1296: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:34.232 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:33 smithi049 bash[28804]: cluster 2024-03-11T22:29:32.569872+0000 mgr.y (mgr.14601) 803 : cluster 0 pgmap v1297: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:34.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:33 smithi049 bash[21434]: cluster 2024-03-11T22:29:32.569872+0000 mgr.y (mgr.14601) 803 : cluster 0 pgmap v1297: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:34.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:33 smithi187 bash[23415]: cluster 2024-03-11T22:29:32.569872+0000 mgr.y (mgr.14601) 803 : cluster 0 pgmap v1297: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:34.531 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:29:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:29:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:29:36.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:35 smithi187 bash[23415]: cluster 2024-03-11T22:29:34.572208+0000 mgr.y (mgr.14601) 804 : cluster 0 pgmap v1298: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:36.281 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:35 smithi049 bash[28804]: cluster 2024-03-11T22:29:34.572208+0000 mgr.y (mgr.14601) 804 : cluster 0 pgmap v1298: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:36.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:35 smithi049 bash[21434]: cluster 2024-03-11T22:29:34.572208+0000 mgr.y (mgr.14601) 804 : cluster 0 pgmap v1298: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:38.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:37 smithi187 bash[23415]: cluster 2024-03-11T22:29:36.573061+0000 mgr.y (mgr.14601) 805 : cluster 0 pgmap v1299: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:38.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:37 smithi049 bash[21434]: cluster 2024-03-11T22:29:36.573061+0000 mgr.y (mgr.14601) 805 : cluster 0 pgmap v1299: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:38.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:37 smithi049 bash[28804]: cluster 2024-03-11T22:29:36.573061+0000 mgr.y (mgr.14601) 805 : cluster 0 pgmap v1299: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:39.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:29:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:29:40.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:39 smithi187 bash[23415]: cluster 2024-03-11T22:29:38.574081+0000 mgr.y (mgr.14601) 806 : cluster 0 pgmap v1300: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:40.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:39 smithi049 bash[21434]: cluster 2024-03-11T22:29:38.574081+0000 mgr.y (mgr.14601) 806 : cluster 0 pgmap v1300: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:40.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:39 smithi049 bash[28804]: cluster 2024-03-11T22:29:38.574081+0000 mgr.y (mgr.14601) 806 : cluster 0 pgmap v1300: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:41.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:40 smithi187 bash[23415]: audit 2024-03-11T22:29:39.504158+0000 mgr.y (mgr.14601) 807 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:41.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:40 smithi049 bash[21434]: audit 2024-03-11T22:29:39.504158+0000 mgr.y (mgr.14601) 807 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:41.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:40 smithi049 bash[28804]: audit 2024-03-11T22:29:39.504158+0000 mgr.y (mgr.14601) 807 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:42.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:41 smithi187 bash[23415]: cluster 2024-03-11T22:29:40.576175+0000 mgr.y (mgr.14601) 808 : cluster 0 pgmap v1301: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:42.281 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:41 smithi049 bash[28804]: cluster 2024-03-11T22:29:40.576175+0000 mgr.y (mgr.14601) 808 : cluster 0 pgmap v1301: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:42.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:41 smithi049 bash[21434]: cluster 2024-03-11T22:29:40.576175+0000 mgr.y (mgr.14601) 808 : cluster 0 pgmap v1301: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:43.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:42 smithi187 bash[23415]: audit 2024-03-11T22:29:42.564632+0000 mon.c (mon.2) 685 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:43.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:42 smithi049 bash[21434]: audit 2024-03-11T22:29:42.564632+0000 mon.c (mon.2) 685 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:43.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:42 smithi049 bash[28804]: audit 2024-03-11T22:29:42.564632+0000 mon.c (mon.2) 685 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:44.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:43 smithi049 bash[21434]: cluster 2024-03-11T22:29:42.576987+0000 mgr.y (mgr.14601) 809 : cluster 0 pgmap v1302: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:44.232 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:43 smithi049 bash[28804]: cluster 2024-03-11T22:29:42.576987+0000 mgr.y (mgr.14601) 809 : cluster 0 pgmap v1302: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:44.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:43 smithi187 bash[23415]: cluster 2024-03-11T22:29:42.576987+0000 mgr.y (mgr.14601) 809 : cluster 0 pgmap v1302: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:44.531 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:29:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:29:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:29:46.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:45 smithi187 bash[23415]: cluster 2024-03-11T22:29:44.579278+0000 mgr.y (mgr.14601) 810 : cluster 0 pgmap v1303: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:46.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:45 smithi049 bash[21434]: cluster 2024-03-11T22:29:44.579278+0000 mgr.y (mgr.14601) 810 : cluster 0 pgmap v1303: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:46.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:45 smithi049 bash[28804]: cluster 2024-03-11T22:29:44.579278+0000 mgr.y (mgr.14601) 810 : cluster 0 pgmap v1303: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:48.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:47 smithi187 bash[23415]: cluster 2024-03-11T22:29:46.580114+0000 mgr.y (mgr.14601) 811 : cluster 0 pgmap v1304: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:48.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:47 smithi049 bash[21434]: cluster 2024-03-11T22:29:46.580114+0000 mgr.y (mgr.14601) 811 : cluster 0 pgmap v1304: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:48.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:47 smithi049 bash[28804]: cluster 2024-03-11T22:29:46.580114+0000 mgr.y (mgr.14601) 811 : cluster 0 pgmap v1304: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:49.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:29:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:29:50.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:49 smithi187 bash[23415]: cluster 2024-03-11T22:29:48.581255+0000 mgr.y (mgr.14601) 812 : cluster 0 pgmap v1305: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:50.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:49 smithi049 bash[21434]: cluster 2024-03-11T22:29:48.581255+0000 mgr.y (mgr.14601) 812 : cluster 0 pgmap v1305: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:50.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:49 smithi049 bash[28804]: cluster 2024-03-11T22:29:48.581255+0000 mgr.y (mgr.14601) 812 : cluster 0 pgmap v1305: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:51.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:50 smithi187 bash[23415]: audit 2024-03-11T22:29:49.515357+0000 mgr.y (mgr.14601) 813 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:51.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:50 smithi049 bash[21434]: audit 2024-03-11T22:29:49.515357+0000 mgr.y (mgr.14601) 813 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:51.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:50 smithi049 bash[28804]: audit 2024-03-11T22:29:49.515357+0000 mgr.y (mgr.14601) 813 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:29:52.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:51 smithi187 bash[23415]: cluster 2024-03-11T22:29:50.583307+0000 mgr.y (mgr.14601) 814 : cluster 0 pgmap v1306: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:52.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:51 smithi049 bash[21434]: cluster 2024-03-11T22:29:50.583307+0000 mgr.y (mgr.14601) 814 : cluster 0 pgmap v1306: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:52.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:51 smithi049 bash[28804]: cluster 2024-03-11T22:29:50.583307+0000 mgr.y (mgr.14601) 814 : cluster 0 pgmap v1306: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:54.232 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:53 smithi049 bash[28804]: cluster 2024-03-11T22:29:52.584179+0000 mgr.y (mgr.14601) 815 : cluster 0 pgmap v1307: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:54.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:53 smithi049 bash[21434]: cluster 2024-03-11T22:29:52.584179+0000 mgr.y (mgr.14601) 815 : cluster 0 pgmap v1307: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:54.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:53 smithi187 bash[23415]: cluster 2024-03-11T22:29:52.584179+0000 mgr.y (mgr.14601) 815 : cluster 0 pgmap v1307: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:54.531 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:29:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:29:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:29:56.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:55 smithi187 bash[23415]: cluster 2024-03-11T22:29:54.586493+0000 mgr.y (mgr.14601) 816 : cluster 0 pgmap v1308: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:56.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:55 smithi049 bash[21434]: cluster 2024-03-11T22:29:54.586493+0000 mgr.y (mgr.14601) 816 : cluster 0 pgmap v1308: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:56.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:55 smithi049 bash[28804]: cluster 2024-03-11T22:29:54.586493+0000 mgr.y (mgr.14601) 816 : cluster 0 pgmap v1308: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:29:58.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:57 smithi187 bash[23415]: cluster 2024-03-11T22:29:56.587345+0000 mgr.y (mgr.14601) 817 : cluster 0 pgmap v1309: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:58.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:57 smithi187 bash[23415]: audit 2024-03-11T22:29:57.598384+0000 mon.c (mon.2) 686 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:58.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:57 smithi049 bash[28804]: cluster 2024-03-11T22:29:56.587345+0000 mgr.y (mgr.14601) 817 : cluster 0 pgmap v1309: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:58.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:57 smithi049 bash[28804]: audit 2024-03-11T22:29:57.598384+0000 mon.c (mon.2) 686 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:58.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:57 smithi049 bash[21434]: cluster 2024-03-11T22:29:56.587345+0000 mgr.y (mgr.14601) 817 : cluster 0 pgmap v1309: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:29:58.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:57 smithi049 bash[21434]: audit 2024-03-11T22:29:57.598384+0000 mon.c (mon.2) 686 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:29:59.874 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:29:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:30:00.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:29:59 smithi187 bash[23415]: cluster 2024-03-11T22:29:58.588609+0000 mgr.y (mgr.14601) 818 : cluster 0 pgmap v1310: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:00.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:29:59 smithi049 bash[21434]: cluster 2024-03-11T22:29:58.588609+0000 mgr.y (mgr.14601) 818 : cluster 0 pgmap v1310: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:00.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:29:59 smithi049 bash[28804]: cluster 2024-03-11T22:29:58.588609+0000 mgr.y (mgr.14601) 818 : cluster 0 pgmap v1310: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:01.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:00 smithi187 bash[23415]: audit 2024-03-11T22:29:59.526530+0000 mgr.y (mgr.14601) 819 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:00 smithi187 bash[23415]: cluster 2024-03-11T22:30:00.000175+0000 mon.a (mon.0) 3450 : cluster 3 Health detail: HEALTH_WARN 3 pool(s) do not have an application enabled 2024-03-11T22:30:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:00 smithi187 bash[23415]: cluster 2024-03-11T22:30:00.000240+0000 mon.a (mon.0) 3451 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-03-11T22:30:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:00 smithi187 bash[23415]: cluster 2024-03-11T22:30:00.000263+0000 mon.a (mon.0) 3452 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-11T22:30:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:00 smithi187 bash[23415]: cluster 2024-03-11T22:30:00.000283+0000 mon.a (mon.0) 3453 : cluster 3 application not enabled on pool 'ListObjectssmithi049-64810-1' 2024-03-11T22:30:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:00 smithi187 bash[23415]: cluster 2024-03-11T22:30:00.000304+0000 mon.a (mon.0) 3454 : cluster 3 application not enabled on pool 'AssertExistssmithi049-65057-1' 2024-03-11T22:30:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:00 smithi187 bash[23415]: cluster 2024-03-11T22:30:00.000344+0000 mon.a (mon.0) 3455 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-11T22:30:01.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[21434]: audit 2024-03-11T22:29:59.526530+0000 mgr.y (mgr.14601) 819 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:01.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[21434]: cluster 2024-03-11T22:30:00.000175+0000 mon.a (mon.0) 3450 : cluster 3 Health detail: HEALTH_WARN 3 pool(s) do not have an application enabled 2024-03-11T22:30:01.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[21434]: cluster 2024-03-11T22:30:00.000240+0000 mon.a (mon.0) 3451 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-03-11T22:30:01.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[21434]: cluster 2024-03-11T22:30:00.000263+0000 mon.a (mon.0) 3452 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-11T22:30:01.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[21434]: cluster 2024-03-11T22:30:00.000283+0000 mon.a (mon.0) 3453 : cluster 3 application not enabled on pool 'ListObjectssmithi049-64810-1' 2024-03-11T22:30:01.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[21434]: cluster 2024-03-11T22:30:00.000304+0000 mon.a (mon.0) 3454 : cluster 3 application not enabled on pool 'AssertExistssmithi049-65057-1' 2024-03-11T22:30:01.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[21434]: cluster 2024-03-11T22:30:00.000344+0000 mon.a (mon.0) 3455 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-11T22:30:01.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[28804]: audit 2024-03-11T22:29:59.526530+0000 mgr.y (mgr.14601) 819 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:01.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[28804]: cluster 2024-03-11T22:30:00.000175+0000 mon.a (mon.0) 3450 : cluster 3 Health detail: HEALTH_WARN 3 pool(s) do not have an application enabled 2024-03-11T22:30:01.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[28804]: cluster 2024-03-11T22:30:00.000240+0000 mon.a (mon.0) 3451 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-03-11T22:30:01.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[28804]: cluster 2024-03-11T22:30:00.000263+0000 mon.a (mon.0) 3452 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-11T22:30:01.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[28804]: cluster 2024-03-11T22:30:00.000283+0000 mon.a (mon.0) 3453 : cluster 3 application not enabled on pool 'ListObjectssmithi049-64810-1' 2024-03-11T22:30:01.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[28804]: cluster 2024-03-11T22:30:00.000304+0000 mon.a (mon.0) 3454 : cluster 3 application not enabled on pool 'AssertExistssmithi049-65057-1' 2024-03-11T22:30:01.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:00 smithi049 bash[28804]: cluster 2024-03-11T22:30:00.000344+0000 mon.a (mon.0) 3455 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-11T22:30:02.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:01 smithi187 bash[23415]: cluster 2024-03-11T22:30:00.590860+0000 mgr.y (mgr.14601) 820 : cluster 0 pgmap v1311: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:02.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:01 smithi049 bash[21434]: cluster 2024-03-11T22:30:00.590860+0000 mgr.y (mgr.14601) 820 : cluster 0 pgmap v1311: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:02.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:01 smithi049 bash[28804]: cluster 2024-03-11T22:30:00.590860+0000 mgr.y (mgr.14601) 820 : cluster 0 pgmap v1311: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:04.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:03 smithi049 bash[21434]: cluster 2024-03-11T22:30:02.591718+0000 mgr.y (mgr.14601) 821 : cluster 0 pgmap v1312: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:04.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:03 smithi049 bash[28804]: cluster 2024-03-11T22:30:02.591718+0000 mgr.y (mgr.14601) 821 : cluster 0 pgmap v1312: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:04.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:03 smithi187 bash[23415]: cluster 2024-03-11T22:30:02.591718+0000 mgr.y (mgr.14601) 821 : cluster 0 pgmap v1312: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:04.532 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:30:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:30:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:30:06.250 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:05 smithi187 bash[23415]: cluster 2024-03-11T22:30:04.594102+0000 mgr.y (mgr.14601) 822 : cluster 0 pgmap v1313: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:06.282 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:05 smithi049 bash[21434]: cluster 2024-03-11T22:30:04.594102+0000 mgr.y (mgr.14601) 822 : cluster 0 pgmap v1313: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:06.282 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:05 smithi049 bash[28804]: cluster 2024-03-11T22:30:04.594102+0000 mgr.y (mgr.14601) 822 : cluster 0 pgmap v1313: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:08.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:08 smithi187 bash[23415]: cluster 2024-03-11T22:30:06.595051+0000 mgr.y (mgr.14601) 823 : cluster 0 pgmap v1314: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:08.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:08 smithi049 bash[21434]: cluster 2024-03-11T22:30:06.595051+0000 mgr.y (mgr.14601) 823 : cluster 0 pgmap v1314: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:08.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:08 smithi049 bash[28804]: cluster 2024-03-11T22:30:06.595051+0000 mgr.y (mgr.14601) 823 : cluster 0 pgmap v1314: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:10.000 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:30:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:30:10.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:10 smithi187 bash[23415]: cluster 2024-03-11T22:30:08.596216+0000 mgr.y (mgr.14601) 824 : cluster 0 pgmap v1315: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:10.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:10 smithi049 bash[28804]: cluster 2024-03-11T22:30:08.596216+0000 mgr.y (mgr.14601) 824 : cluster 0 pgmap v1315: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:10.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:10 smithi049 bash[21434]: cluster 2024-03-11T22:30:08.596216+0000 mgr.y (mgr.14601) 824 : cluster 0 pgmap v1315: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:11.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:11 smithi187 bash[23415]: audit 2024-03-11T22:30:09.537779+0000 mgr.y (mgr.14601) 825 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:11.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:11 smithi049 bash[21434]: audit 2024-03-11T22:30:09.537779+0000 mgr.y (mgr.14601) 825 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:11.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:11 smithi049 bash[28804]: audit 2024-03-11T22:30:09.537779+0000 mgr.y (mgr.14601) 825 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:12.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:12 smithi187 bash[23415]: cluster 2024-03-11T22:30:10.598323+0000 mgr.y (mgr.14601) 826 : cluster 0 pgmap v1316: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:12.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:12 smithi049 bash[21434]: cluster 2024-03-11T22:30:10.598323+0000 mgr.y (mgr.14601) 826 : cluster 0 pgmap v1316: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:12.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:12 smithi049 bash[28804]: cluster 2024-03-11T22:30:10.598323+0000 mgr.y (mgr.14601) 826 : cluster 0 pgmap v1316: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:13.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:13 smithi187 bash[23415]: audit 2024-03-11T22:30:12.632643+0000 mon.c (mon.2) 687 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:13.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:13 smithi049 bash[21434]: audit 2024-03-11T22:30:12.632643+0000 mon.c (mon.2) 687 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:13.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:13 smithi049 bash[28804]: audit 2024-03-11T22:30:12.632643+0000 mon.c (mon.2) 687 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:14.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:14 smithi187 bash[23415]: cluster 2024-03-11T22:30:12.599187+0000 mgr.y (mgr.14601) 827 : cluster 0 pgmap v1317: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:14.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:14 smithi049 bash[21434]: cluster 2024-03-11T22:30:12.599187+0000 mgr.y (mgr.14601) 827 : cluster 0 pgmap v1317: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:14.532 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:30:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:30:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:30:14.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:14 smithi049 bash[28804]: cluster 2024-03-11T22:30:12.599187+0000 mgr.y (mgr.14601) 827 : cluster 0 pgmap v1317: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:16.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:16 smithi187 bash[23415]: cluster 2024-03-11T22:30:14.601525+0000 mgr.y (mgr.14601) 828 : cluster 0 pgmap v1318: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:16.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:16 smithi049 bash[21434]: cluster 2024-03-11T22:30:14.601525+0000 mgr.y (mgr.14601) 828 : cluster 0 pgmap v1318: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:16.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:16 smithi049 bash[28804]: cluster 2024-03-11T22:30:14.601525+0000 mgr.y (mgr.14601) 828 : cluster 0 pgmap v1318: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:18.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:18 smithi187 bash[23415]: cluster 2024-03-11T22:30:16.602348+0000 mgr.y (mgr.14601) 829 : cluster 0 pgmap v1319: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:18.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:18 smithi049 bash[21434]: cluster 2024-03-11T22:30:16.602348+0000 mgr.y (mgr.14601) 829 : cluster 0 pgmap v1319: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:18.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:18 smithi049 bash[28804]: cluster 2024-03-11T22:30:16.602348+0000 mgr.y (mgr.14601) 829 : cluster 0 pgmap v1319: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:20.000 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:30:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:30:20.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:20 smithi187 bash[23415]: cluster 2024-03-11T22:30:18.603540+0000 mgr.y (mgr.14601) 830 : cluster 0 pgmap v1320: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:20.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:20 smithi049 bash[21434]: cluster 2024-03-11T22:30:18.603540+0000 mgr.y (mgr.14601) 830 : cluster 0 pgmap v1320: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:20.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:20 smithi049 bash[28804]: cluster 2024-03-11T22:30:18.603540+0000 mgr.y (mgr.14601) 830 : cluster 0 pgmap v1320: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:21.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:21 smithi187 bash[23415]: audit 2024-03-11T22:30:19.544736+0000 mgr.y (mgr.14601) 831 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:21.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:21 smithi049 bash[21434]: audit 2024-03-11T22:30:19.544736+0000 mgr.y (mgr.14601) 831 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:21.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:21 smithi049 bash[28804]: audit 2024-03-11T22:30:19.544736+0000 mgr.y (mgr.14601) 831 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:22.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:22 smithi187 bash[23415]: cluster 2024-03-11T22:30:20.605823+0000 mgr.y (mgr.14601) 832 : cluster 0 pgmap v1321: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:22.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:22 smithi049 bash[21434]: cluster 2024-03-11T22:30:20.605823+0000 mgr.y (mgr.14601) 832 : cluster 0 pgmap v1321: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:22.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:22 smithi049 bash[28804]: cluster 2024-03-11T22:30:20.605823+0000 mgr.y (mgr.14601) 832 : cluster 0 pgmap v1321: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:24.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:24 smithi187 bash[23415]: cluster 2024-03-11T22:30:22.606816+0000 mgr.y (mgr.14601) 833 : cluster 0 pgmap v1322: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:24.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:24 smithi049 bash[21434]: cluster 2024-03-11T22:30:22.606816+0000 mgr.y (mgr.14601) 833 : cluster 0 pgmap v1322: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:24.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:24 smithi049 bash[28804]: cluster 2024-03-11T22:30:22.606816+0000 mgr.y (mgr.14601) 833 : cluster 0 pgmap v1322: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:24.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:30:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:30:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:30:25.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:25 smithi187 bash[23415]: audit 2024-03-11T22:30:24.429291+0000 mon.c (mon.2) 688 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:30:25.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:25 smithi187 bash[23415]: audit 2024-03-11T22:30:25.014908+0000 mon.a (mon.0) 3456 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:25.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:25 smithi187 bash[23415]: audit 2024-03-11T22:30:25.038999+0000 mon.a (mon.0) 3457 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:25.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:25 smithi049 bash[28804]: audit 2024-03-11T22:30:24.429291+0000 mon.c (mon.2) 688 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:30:25.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:25 smithi049 bash[28804]: audit 2024-03-11T22:30:25.014908+0000 mon.a (mon.0) 3456 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:25.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:25 smithi049 bash[28804]: audit 2024-03-11T22:30:25.038999+0000 mon.a (mon.0) 3457 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:25.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:25 smithi049 bash[21434]: audit 2024-03-11T22:30:24.429291+0000 mon.c (mon.2) 688 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:30:25.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:25 smithi049 bash[21434]: audit 2024-03-11T22:30:25.014908+0000 mon.a (mon.0) 3456 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:25.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:25 smithi049 bash[21434]: audit 2024-03-11T22:30:25.038999+0000 mon.a (mon.0) 3457 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:26.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:26 smithi187 bash[23415]: cluster 2024-03-11T22:30:24.609173+0000 mgr.y (mgr.14601) 834 : cluster 0 pgmap v1323: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:26.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:26 smithi187 bash[23415]: audit 2024-03-11T22:30:25.849323+0000 mon.c (mon.2) 689 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:30:26.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:26 smithi187 bash[23415]: audit 2024-03-11T22:30:25.851263+0000 mon.c (mon.2) 690 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:30:26.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:26 smithi187 bash[23415]: audit 2024-03-11T22:30:25.863123+0000 mon.a (mon.0) 3458 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:26.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[28804]: cluster 2024-03-11T22:30:24.609173+0000 mgr.y (mgr.14601) 834 : cluster 0 pgmap v1323: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:26.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[28804]: audit 2024-03-11T22:30:25.849323+0000 mon.c (mon.2) 689 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:30:26.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[28804]: audit 2024-03-11T22:30:25.851263+0000 mon.c (mon.2) 690 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:30:26.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[28804]: audit 2024-03-11T22:30:25.863123+0000 mon.a (mon.0) 3458 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:26.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[21434]: cluster 2024-03-11T22:30:24.609173+0000 mgr.y (mgr.14601) 834 : cluster 0 pgmap v1323: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:26.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[21434]: audit 2024-03-11T22:30:25.849323+0000 mon.c (mon.2) 689 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:30:26.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[21434]: audit 2024-03-11T22:30:25.851263+0000 mon.c (mon.2) 690 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:30:26.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:26 smithi049 bash[21434]: audit 2024-03-11T22:30:25.863123+0000 mon.a (mon.0) 3458 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:30:28.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:28 smithi187 bash[23415]: cluster 2024-03-11T22:30:26.609967+0000 mgr.y (mgr.14601) 835 : cluster 0 pgmap v1324: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:28.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:28 smithi187 bash[23415]: audit 2024-03-11T22:30:27.665701+0000 mon.c (mon.2) 691 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:28.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:28 smithi049 bash[21434]: cluster 2024-03-11T22:30:26.609967+0000 mgr.y (mgr.14601) 835 : cluster 0 pgmap v1324: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:28.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:28 smithi049 bash[21434]: audit 2024-03-11T22:30:27.665701+0000 mon.c (mon.2) 691 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:28.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:28 smithi049 bash[28804]: cluster 2024-03-11T22:30:26.609967+0000 mgr.y (mgr.14601) 835 : cluster 0 pgmap v1324: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:28.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:28 smithi049 bash[28804]: audit 2024-03-11T22:30:27.665701+0000 mon.c (mon.2) 691 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:30.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:30:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:30:30.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:30 smithi187 bash[23415]: cluster 2024-03-11T22:30:28.611059+0000 mgr.y (mgr.14601) 836 : cluster 0 pgmap v1325: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:30.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:30 smithi049 bash[21434]: cluster 2024-03-11T22:30:28.611059+0000 mgr.y (mgr.14601) 836 : cluster 0 pgmap v1325: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:30.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:30 smithi049 bash[28804]: cluster 2024-03-11T22:30:28.611059+0000 mgr.y (mgr.14601) 836 : cluster 0 pgmap v1325: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:31.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:31 smithi187 bash[23415]: audit 2024-03-11T22:30:29.547628+0000 mgr.y (mgr.14601) 837 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:31.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:31 smithi049 bash[21434]: audit 2024-03-11T22:30:29.547628+0000 mgr.y (mgr.14601) 837 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:31.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:31 smithi049 bash[28804]: audit 2024-03-11T22:30:29.547628+0000 mgr.y (mgr.14601) 837 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:32.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:32 smithi187 bash[23415]: cluster 2024-03-11T22:30:30.613256+0000 mgr.y (mgr.14601) 838 : cluster 0 pgmap v1326: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:32.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:32 smithi049 bash[21434]: cluster 2024-03-11T22:30:30.613256+0000 mgr.y (mgr.14601) 838 : cluster 0 pgmap v1326: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:32.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:32 smithi049 bash[28804]: cluster 2024-03-11T22:30:30.613256+0000 mgr.y (mgr.14601) 838 : cluster 0 pgmap v1326: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:34.194 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:30:33 smithi187 bash[50671]: logger=cleanup t=2024-03-11T22:30:33.749916776Z level=info msg="Completed cleanup jobs" duration=134.818799ms 2024-03-11T22:30:34.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:34 smithi187 bash[23415]: cluster 2024-03-11T22:30:32.614208+0000 mgr.y (mgr.14601) 839 : cluster 0 pgmap v1327: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:34.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:34 smithi049 bash[21434]: cluster 2024-03-11T22:30:32.614208+0000 mgr.y (mgr.14601) 839 : cluster 0 pgmap v1327: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:34.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:34 smithi049 bash[28804]: cluster 2024-03-11T22:30:32.614208+0000 mgr.y (mgr.14601) 839 : cluster 0 pgmap v1327: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:34.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:30:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:30:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:30:36.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:36 smithi187 bash[23415]: cluster 2024-03-11T22:30:34.616465+0000 mgr.y (mgr.14601) 840 : cluster 0 pgmap v1328: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:36.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:36 smithi049 bash[21434]: cluster 2024-03-11T22:30:34.616465+0000 mgr.y (mgr.14601) 840 : cluster 0 pgmap v1328: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:36.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:36 smithi049 bash[28804]: cluster 2024-03-11T22:30:34.616465+0000 mgr.y (mgr.14601) 840 : cluster 0 pgmap v1328: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:38.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:38 smithi187 bash[23415]: cluster 2024-03-11T22:30:36.617331+0000 mgr.y (mgr.14601) 841 : cluster 0 pgmap v1329: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:38.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:38 smithi049 bash[21434]: cluster 2024-03-11T22:30:36.617331+0000 mgr.y (mgr.14601) 841 : cluster 0 pgmap v1329: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:38.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:38 smithi049 bash[28804]: cluster 2024-03-11T22:30:36.617331+0000 mgr.y (mgr.14601) 841 : cluster 0 pgmap v1329: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:40.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:30:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:30:40.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:40 smithi187 bash[23415]: cluster 2024-03-11T22:30:38.618482+0000 mgr.y (mgr.14601) 842 : cluster 0 pgmap v1330: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:40.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:40 smithi049 bash[21434]: cluster 2024-03-11T22:30:38.618482+0000 mgr.y (mgr.14601) 842 : cluster 0 pgmap v1330: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:40.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:40 smithi049 bash[28804]: cluster 2024-03-11T22:30:38.618482+0000 mgr.y (mgr.14601) 842 : cluster 0 pgmap v1330: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:41.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:41 smithi187 bash[23415]: audit 2024-03-11T22:30:39.555613+0000 mgr.y (mgr.14601) 843 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:41.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:41 smithi049 bash[21434]: audit 2024-03-11T22:30:39.555613+0000 mgr.y (mgr.14601) 843 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:41.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:41 smithi049 bash[28804]: audit 2024-03-11T22:30:39.555613+0000 mgr.y (mgr.14601) 843 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:42.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:42 smithi187 bash[23415]: cluster 2024-03-11T22:30:40.620506+0000 mgr.y (mgr.14601) 844 : cluster 0 pgmap v1331: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:42.532 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:42 smithi049 bash[28804]: cluster 2024-03-11T22:30:40.620506+0000 mgr.y (mgr.14601) 844 : cluster 0 pgmap v1331: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:42.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:42 smithi049 bash[21434]: cluster 2024-03-11T22:30:40.620506+0000 mgr.y (mgr.14601) 844 : cluster 0 pgmap v1331: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:43.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:43 smithi187 bash[23415]: audit 2024-03-11T22:30:42.698784+0000 mon.c (mon.2) 692 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:43.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:43 smithi049 bash[21434]: audit 2024-03-11T22:30:42.698784+0000 mon.c (mon.2) 692 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:43.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:43 smithi049 bash[28804]: audit 2024-03-11T22:30:42.698784+0000 mon.c (mon.2) 692 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:44.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:44 smithi187 bash[23415]: cluster 2024-03-11T22:30:42.621396+0000 mgr.y (mgr.14601) 845 : cluster 0 pgmap v1332: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:44.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:44 smithi049 bash[21434]: cluster 2024-03-11T22:30:42.621396+0000 mgr.y (mgr.14601) 845 : cluster 0 pgmap v1332: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:44.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:44 smithi049 bash[28804]: cluster 2024-03-11T22:30:42.621396+0000 mgr.y (mgr.14601) 845 : cluster 0 pgmap v1332: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:44.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:30:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:30:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:30:45.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:45 smithi049 bash[21434]: cluster 2024-03-11T22:30:44.623668+0000 mgr.y (mgr.14601) 846 : cluster 0 pgmap v1333: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:45.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:45 smithi049 bash[28804]: cluster 2024-03-11T22:30:44.623668+0000 mgr.y (mgr.14601) 846 : cluster 0 pgmap v1333: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:45.750 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:45 smithi187 bash[23415]: cluster 2024-03-11T22:30:44.623668+0000 mgr.y (mgr.14601) 846 : cluster 0 pgmap v1333: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:48.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:47 smithi187 bash[23415]: cluster 2024-03-11T22:30:46.624579+0000 mgr.y (mgr.14601) 847 : cluster 0 pgmap v1334: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:48.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:47 smithi049 bash[21434]: cluster 2024-03-11T22:30:46.624579+0000 mgr.y (mgr.14601) 847 : cluster 0 pgmap v1334: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:48.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:47 smithi049 bash[28804]: cluster 2024-03-11T22:30:46.624579+0000 mgr.y (mgr.14601) 847 : cluster 0 pgmap v1334: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:50.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:49 smithi187 bash[23415]: cluster 2024-03-11T22:30:48.625711+0000 mgr.y (mgr.14601) 848 : cluster 0 pgmap v1335: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:50.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:30:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:30:50.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:49 smithi049 bash[21434]: cluster 2024-03-11T22:30:48.625711+0000 mgr.y (mgr.14601) 848 : cluster 0 pgmap v1335: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:50.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:49 smithi049 bash[28804]: cluster 2024-03-11T22:30:48.625711+0000 mgr.y (mgr.14601) 848 : cluster 0 pgmap v1335: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:51.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:50 smithi187 bash[23415]: audit 2024-03-11T22:30:49.563561+0000 mgr.y (mgr.14601) 849 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:51.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:50 smithi049 bash[21434]: audit 2024-03-11T22:30:49.563561+0000 mgr.y (mgr.14601) 849 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:51.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:50 smithi049 bash[28804]: audit 2024-03-11T22:30:49.563561+0000 mgr.y (mgr.14601) 849 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:30:52.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:51 smithi187 bash[23415]: cluster 2024-03-11T22:30:50.627796+0000 mgr.y (mgr.14601) 850 : cluster 0 pgmap v1336: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:52.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:51 smithi049 bash[21434]: cluster 2024-03-11T22:30:50.627796+0000 mgr.y (mgr.14601) 850 : cluster 0 pgmap v1336: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:52.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:51 smithi049 bash[28804]: cluster 2024-03-11T22:30:50.627796+0000 mgr.y (mgr.14601) 850 : cluster 0 pgmap v1336: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:54.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:53 smithi187 bash[23415]: cluster 2024-03-11T22:30:52.628636+0000 mgr.y (mgr.14601) 851 : cluster 0 pgmap v1337: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:54.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:53 smithi049 bash[21434]: cluster 2024-03-11T22:30:52.628636+0000 mgr.y (mgr.14601) 851 : cluster 0 pgmap v1337: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:54.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:53 smithi049 bash[28804]: cluster 2024-03-11T22:30:52.628636+0000 mgr.y (mgr.14601) 851 : cluster 0 pgmap v1337: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:54.532 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:30:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:30:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:30:56.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:55 smithi187 bash[23415]: cluster 2024-03-11T22:30:54.631051+0000 mgr.y (mgr.14601) 852 : cluster 0 pgmap v1338: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:56.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:55 smithi049 bash[21434]: cluster 2024-03-11T22:30:54.631051+0000 mgr.y (mgr.14601) 852 : cluster 0 pgmap v1338: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:56.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:55 smithi049 bash[28804]: cluster 2024-03-11T22:30:54.631051+0000 mgr.y (mgr.14601) 852 : cluster 0 pgmap v1338: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:30:58.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:57 smithi187 bash[23415]: cluster 2024-03-11T22:30:56.631953+0000 mgr.y (mgr.14601) 853 : cluster 0 pgmap v1339: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:58.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:57 smithi049 bash[21434]: cluster 2024-03-11T22:30:56.631953+0000 mgr.y (mgr.14601) 853 : cluster 0 pgmap v1339: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:58.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:57 smithi049 bash[28804]: cluster 2024-03-11T22:30:56.631953+0000 mgr.y (mgr.14601) 853 : cluster 0 pgmap v1339: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:30:59.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:58 smithi187 bash[23415]: audit 2024-03-11T22:30:57.731738+0000 mon.c (mon.2) 693 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:59.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:58 smithi049 bash[21434]: audit 2024-03-11T22:30:57.731738+0000 mon.c (mon.2) 693 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:30:59.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:58 smithi049 bash[28804]: audit 2024-03-11T22:30:57.731738+0000 mon.c (mon.2) 693 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:00.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:30:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:31:00.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:30:59 smithi187 bash[23415]: cluster 2024-03-11T22:30:58.633080+0000 mgr.y (mgr.14601) 854 : cluster 0 pgmap v1340: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:00.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:30:59 smithi049 bash[21434]: cluster 2024-03-11T22:30:58.633080+0000 mgr.y (mgr.14601) 854 : cluster 0 pgmap v1340: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:00.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:30:59 smithi049 bash[28804]: cluster 2024-03-11T22:30:58.633080+0000 mgr.y (mgr.14601) 854 : cluster 0 pgmap v1340: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:01.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:00 smithi187 bash[23415]: audit 2024-03-11T22:30:59.574870+0000 mgr.y (mgr.14601) 855 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:01.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:00 smithi049 bash[21434]: audit 2024-03-11T22:30:59.574870+0000 mgr.y (mgr.14601) 855 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:01.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:00 smithi049 bash[28804]: audit 2024-03-11T22:30:59.574870+0000 mgr.y (mgr.14601) 855 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:02.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:02 smithi187 bash[23415]: cluster 2024-03-11T22:31:00.635126+0000 mgr.y (mgr.14601) 856 : cluster 0 pgmap v1341: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:02.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:02 smithi049 bash[21434]: cluster 2024-03-11T22:31:00.635126+0000 mgr.y (mgr.14601) 856 : cluster 0 pgmap v1341: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:02.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:02 smithi049 bash[28804]: cluster 2024-03-11T22:31:00.635126+0000 mgr.y (mgr.14601) 856 : cluster 0 pgmap v1341: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:04.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:04 smithi187 bash[23415]: cluster 2024-03-11T22:31:02.635944+0000 mgr.y (mgr.14601) 857 : cluster 0 pgmap v1342: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:04.532 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:04 smithi049 bash[21434]: cluster 2024-03-11T22:31:02.635944+0000 mgr.y (mgr.14601) 857 : cluster 0 pgmap v1342: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:04.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:04 smithi049 bash[28804]: cluster 2024-03-11T22:31:02.635944+0000 mgr.y (mgr.14601) 857 : cluster 0 pgmap v1342: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:04.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:31:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:31:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:31:06.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:06 smithi187 bash[23415]: cluster 2024-03-11T22:31:04.638250+0000 mgr.y (mgr.14601) 858 : cluster 0 pgmap v1343: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:06.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:06 smithi049 bash[21434]: cluster 2024-03-11T22:31:04.638250+0000 mgr.y (mgr.14601) 858 : cluster 0 pgmap v1343: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:06.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:06 smithi049 bash[28804]: cluster 2024-03-11T22:31:04.638250+0000 mgr.y (mgr.14601) 858 : cluster 0 pgmap v1343: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:08.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:08 smithi187 bash[23415]: cluster 2024-03-11T22:31:06.639080+0000 mgr.y (mgr.14601) 859 : cluster 0 pgmap v1344: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:08.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:08 smithi049 bash[28804]: cluster 2024-03-11T22:31:06.639080+0000 mgr.y (mgr.14601) 859 : cluster 0 pgmap v1344: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:08.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:08 smithi049 bash[21434]: cluster 2024-03-11T22:31:06.639080+0000 mgr.y (mgr.14601) 859 : cluster 0 pgmap v1344: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:10.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:31:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:31:10.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:10 smithi187 bash[23415]: cluster 2024-03-11T22:31:08.640189+0000 mgr.y (mgr.14601) 860 : cluster 0 pgmap v1345: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:10.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:10 smithi049 bash[28804]: cluster 2024-03-11T22:31:08.640189+0000 mgr.y (mgr.14601) 860 : cluster 0 pgmap v1345: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:10.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:10 smithi049 bash[21434]: cluster 2024-03-11T22:31:08.640189+0000 mgr.y (mgr.14601) 860 : cluster 0 pgmap v1345: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:11.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:11 smithi187 bash[23415]: audit 2024-03-11T22:31:09.586242+0000 mgr.y (mgr.14601) 861 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:11.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:11 smithi049 bash[21434]: audit 2024-03-11T22:31:09.586242+0000 mgr.y (mgr.14601) 861 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:11.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:11 smithi049 bash[28804]: audit 2024-03-11T22:31:09.586242+0000 mgr.y (mgr.14601) 861 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:12.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:12 smithi187 bash[23415]: cluster 2024-03-11T22:31:10.642303+0000 mgr.y (mgr.14601) 862 : cluster 0 pgmap v1346: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:12.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:12 smithi049 bash[21434]: cluster 2024-03-11T22:31:10.642303+0000 mgr.y (mgr.14601) 862 : cluster 0 pgmap v1346: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:12.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:12 smithi049 bash[28804]: cluster 2024-03-11T22:31:10.642303+0000 mgr.y (mgr.14601) 862 : cluster 0 pgmap v1346: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:13.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:13 smithi187 bash[23415]: audit 2024-03-11T22:31:12.764629+0000 mon.c (mon.2) 694 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:13.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:13 smithi049 bash[21434]: audit 2024-03-11T22:31:12.764629+0000 mon.c (mon.2) 694 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:13.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:13 smithi049 bash[28804]: audit 2024-03-11T22:31:12.764629+0000 mon.c (mon.2) 694 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:14.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:14 smithi187 bash[23415]: cluster 2024-03-11T22:31:12.643150+0000 mgr.y (mgr.14601) 863 : cluster 0 pgmap v1347: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:14.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:14 smithi049 bash[21434]: cluster 2024-03-11T22:31:12.643150+0000 mgr.y (mgr.14601) 863 : cluster 0 pgmap v1347: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:14.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:31:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:31:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:31:14.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:14 smithi049 bash[28804]: cluster 2024-03-11T22:31:12.643150+0000 mgr.y (mgr.14601) 863 : cluster 0 pgmap v1347: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:16.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:16 smithi187 bash[23415]: cluster 2024-03-11T22:31:14.645436+0000 mgr.y (mgr.14601) 864 : cluster 0 pgmap v1348: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:16.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:16 smithi049 bash[21434]: cluster 2024-03-11T22:31:14.645436+0000 mgr.y (mgr.14601) 864 : cluster 0 pgmap v1348: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:16.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:16 smithi049 bash[28804]: cluster 2024-03-11T22:31:14.645436+0000 mgr.y (mgr.14601) 864 : cluster 0 pgmap v1348: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:18.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:18 smithi187 bash[23415]: cluster 2024-03-11T22:31:16.646283+0000 mgr.y (mgr.14601) 865 : cluster 0 pgmap v1349: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:18.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:18 smithi049 bash[21434]: cluster 2024-03-11T22:31:16.646283+0000 mgr.y (mgr.14601) 865 : cluster 0 pgmap v1349: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:18.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:18 smithi049 bash[28804]: cluster 2024-03-11T22:31:16.646283+0000 mgr.y (mgr.14601) 865 : cluster 0 pgmap v1349: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:20.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:31:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:31:20.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:20 smithi187 bash[23415]: cluster 2024-03-11T22:31:18.647372+0000 mgr.y (mgr.14601) 866 : cluster 0 pgmap v1350: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:20.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:20 smithi049 bash[21434]: cluster 2024-03-11T22:31:18.647372+0000 mgr.y (mgr.14601) 866 : cluster 0 pgmap v1350: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:20.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:20 smithi049 bash[28804]: cluster 2024-03-11T22:31:18.647372+0000 mgr.y (mgr.14601) 866 : cluster 0 pgmap v1350: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:21.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:21 smithi187 bash[23415]: audit 2024-03-11T22:31:19.595227+0000 mgr.y (mgr.14601) 867 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:21.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:21 smithi049 bash[21434]: audit 2024-03-11T22:31:19.595227+0000 mgr.y (mgr.14601) 867 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:21.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:21 smithi049 bash[28804]: audit 2024-03-11T22:31:19.595227+0000 mgr.y (mgr.14601) 867 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:22.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:22 smithi187 bash[23415]: cluster 2024-03-11T22:31:20.649510+0000 mgr.y (mgr.14601) 868 : cluster 0 pgmap v1351: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:22.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:22 smithi049 bash[21434]: cluster 2024-03-11T22:31:20.649510+0000 mgr.y (mgr.14601) 868 : cluster 0 pgmap v1351: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:22.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:22 smithi049 bash[28804]: cluster 2024-03-11T22:31:20.649510+0000 mgr.y (mgr.14601) 868 : cluster 0 pgmap v1351: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:24.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:24 smithi187 bash[23415]: cluster 2024-03-11T22:31:22.650344+0000 mgr.y (mgr.14601) 869 : cluster 0 pgmap v1352: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:24.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:24 smithi049 bash[21434]: cluster 2024-03-11T22:31:22.650344+0000 mgr.y (mgr.14601) 869 : cluster 0 pgmap v1352: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:24.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:24 smithi049 bash[28804]: cluster 2024-03-11T22:31:22.650344+0000 mgr.y (mgr.14601) 869 : cluster 0 pgmap v1352: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:24.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:31:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:31:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:31:26.500 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:26 smithi187 bash[23415]: cluster 2024-03-11T22:31:24.652637+0000 mgr.y (mgr.14601) 870 : cluster 0 pgmap v1353: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:26.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:26 smithi187 bash[23415]: audit 2024-03-11T22:31:25.958776+0000 mon.c (mon.2) 695 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:31:26.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:26 smithi049 bash[21434]: cluster 2024-03-11T22:31:24.652637+0000 mgr.y (mgr.14601) 870 : cluster 0 pgmap v1353: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:26.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:26 smithi049 bash[21434]: audit 2024-03-11T22:31:25.958776+0000 mon.c (mon.2) 695 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:31:26.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:26 smithi049 bash[28804]: cluster 2024-03-11T22:31:24.652637+0000 mgr.y (mgr.14601) 870 : cluster 0 pgmap v1353: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:26.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:26 smithi049 bash[28804]: audit 2024-03-11T22:31:25.958776+0000 mon.c (mon.2) 695 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:31:27.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:27 smithi187 bash[23415]: audit 2024-03-11T22:31:26.484578+0000 mon.a (mon.0) 3459 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:27.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:27 smithi187 bash[23415]: audit 2024-03-11T22:31:26.491299+0000 mon.a (mon.0) 3460 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:27.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:27 smithi187 bash[23415]: cluster 2024-03-11T22:31:26.653534+0000 mgr.y (mgr.14601) 871 : cluster 0 pgmap v1354: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:27.783 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:27 smithi049 bash[28804]: audit 2024-03-11T22:31:26.484578+0000 mon.a (mon.0) 3459 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:27.783 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:27 smithi049 bash[28804]: audit 2024-03-11T22:31:26.491299+0000 mon.a (mon.0) 3460 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:27.783 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:27 smithi049 bash[28804]: cluster 2024-03-11T22:31:26.653534+0000 mgr.y (mgr.14601) 871 : cluster 0 pgmap v1354: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:27.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:27 smithi049 bash[21434]: audit 2024-03-11T22:31:26.484578+0000 mon.a (mon.0) 3459 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:27.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:27 smithi049 bash[21434]: audit 2024-03-11T22:31:26.491299+0000 mon.a (mon.0) 3460 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:27.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:27 smithi049 bash[21434]: cluster 2024-03-11T22:31:26.653534+0000 mgr.y (mgr.14601) 871 : cluster 0 pgmap v1354: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:28.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:28 smithi187 bash[23415]: audit 2024-03-11T22:31:27.798725+0000 mon.c (mon.2) 696 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:28.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:28 smithi049 bash[21434]: audit 2024-03-11T22:31:27.798725+0000 mon.c (mon.2) 696 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:28.783 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:28 smithi049 bash[28804]: audit 2024-03-11T22:31:27.798725+0000 mon.c (mon.2) 696 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:29.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:29 smithi049 bash[21434]: cluster 2024-03-11T22:31:28.654768+0000 mgr.y (mgr.14601) 872 : cluster 0 pgmap v1355: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:29.783 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:29 smithi049 bash[28804]: cluster 2024-03-11T22:31:28.654768+0000 mgr.y (mgr.14601) 872 : cluster 0 pgmap v1355: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:30.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:29 smithi187 bash[23415]: cluster 2024-03-11T22:31:28.654768+0000 mgr.y (mgr.14601) 872 : cluster 0 pgmap v1355: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:30.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:31:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:31:30.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:30 smithi049 bash[21434]: audit 2024-03-11T22:31:29.603260+0000 mgr.y (mgr.14601) 873 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:30.783 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:30 smithi049 bash[28804]: audit 2024-03-11T22:31:29.603260+0000 mgr.y (mgr.14601) 873 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:31.000 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:30 smithi187 bash[23415]: audit 2024-03-11T22:31:29.603260+0000 mgr.y (mgr.14601) 873 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:31.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:31 smithi049 bash[21434]: cluster 2024-03-11T22:31:30.656725+0000 mgr.y (mgr.14601) 874 : cluster 0 pgmap v1356: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:31.783 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:31 smithi049 bash[28804]: cluster 2024-03-11T22:31:30.656725+0000 mgr.y (mgr.14601) 874 : cluster 0 pgmap v1356: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:32.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:31 smithi187 bash[23415]: cluster 2024-03-11T22:31:30.656725+0000 mgr.y (mgr.14601) 874 : cluster 0 pgmap v1356: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:33.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:32 smithi187 bash[23415]: audit 2024-03-11T22:31:31.652181+0000 mon.a (mon.0) 3461 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:32 smithi187 bash[23415]: audit 2024-03-11T22:31:31.666330+0000 mon.a (mon.0) 3462 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:32 smithi187 bash[23415]: audit 2024-03-11T22:31:32.555389+0000 mon.a (mon.0) 3463 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:32 smithi187 bash[23415]: audit 2024-03-11T22:31:32.571970+0000 mon.a (mon.0) 3464 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[21434]: audit 2024-03-11T22:31:31.652181+0000 mon.a (mon.0) 3461 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[21434]: audit 2024-03-11T22:31:31.666330+0000 mon.a (mon.0) 3462 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[21434]: audit 2024-03-11T22:31:32.555389+0000 mon.a (mon.0) 3463 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[21434]: audit 2024-03-11T22:31:32.571970+0000 mon.a (mon.0) 3464 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[28804]: audit 2024-03-11T22:31:31.652181+0000 mon.a (mon.0) 3461 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[28804]: audit 2024-03-11T22:31:31.666330+0000 mon.a (mon.0) 3462 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[28804]: audit 2024-03-11T22:31:32.555389+0000 mon.a (mon.0) 3463 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:33.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:32 smithi049 bash[28804]: audit 2024-03-11T22:31:32.571970+0000 mon.a (mon.0) 3464 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:34.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:33 smithi187 bash[23415]: cluster 2024-03-11T22:31:32.657546+0000 mgr.y (mgr.14601) 875 : cluster 0 pgmap v1357: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:34.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:33 smithi187 bash[23415]: audit 2024-03-11T22:31:33.249787+0000 mon.c (mon.2) 697 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:31:34.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:33 smithi187 bash[23415]: audit 2024-03-11T22:31:33.251582+0000 mon.c (mon.2) 698 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:31:34.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:33 smithi187 bash[23415]: audit 2024-03-11T22:31:33.262484+0000 mon.a (mon.0) 3465 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:34.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[21434]: cluster 2024-03-11T22:31:32.657546+0000 mgr.y (mgr.14601) 875 : cluster 0 pgmap v1357: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:34.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[21434]: audit 2024-03-11T22:31:33.249787+0000 mon.c (mon.2) 697 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:31:34.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[21434]: audit 2024-03-11T22:31:33.251582+0000 mon.c (mon.2) 698 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:31:34.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[21434]: audit 2024-03-11T22:31:33.262484+0000 mon.a (mon.0) 3465 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:34.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[28804]: cluster 2024-03-11T22:31:32.657546+0000 mgr.y (mgr.14601) 875 : cluster 0 pgmap v1357: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:34.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[28804]: audit 2024-03-11T22:31:33.249787+0000 mon.c (mon.2) 697 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:31:34.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[28804]: audit 2024-03-11T22:31:33.251582+0000 mon.c (mon.2) 698 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:31:34.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:33 smithi049 bash[28804]: audit 2024-03-11T22:31:33.262484+0000 mon.a (mon.0) 3465 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:31:34.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:31:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:31:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:31:36.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:35 smithi187 bash[23415]: cluster 2024-03-11T22:31:34.659910+0000 mgr.y (mgr.14601) 876 : cluster 0 pgmap v1358: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:36.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:35 smithi049 bash[21434]: cluster 2024-03-11T22:31:34.659910+0000 mgr.y (mgr.14601) 876 : cluster 0 pgmap v1358: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:36.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:35 smithi049 bash[28804]: cluster 2024-03-11T22:31:34.659910+0000 mgr.y (mgr.14601) 876 : cluster 0 pgmap v1358: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:38.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:37 smithi187 bash[23415]: cluster 2024-03-11T22:31:36.660820+0000 mgr.y (mgr.14601) 877 : cluster 0 pgmap v1359: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:38.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:37 smithi049 bash[21434]: cluster 2024-03-11T22:31:36.660820+0000 mgr.y (mgr.14601) 877 : cluster 0 pgmap v1359: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:38.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:37 smithi049 bash[28804]: cluster 2024-03-11T22:31:36.660820+0000 mgr.y (mgr.14601) 877 : cluster 0 pgmap v1359: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:40.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:39 smithi187 bash[23415]: cluster 2024-03-11T22:31:38.662158+0000 mgr.y (mgr.14601) 878 : cluster 0 pgmap v1360: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:40.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:31:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:31:40.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:39 smithi049 bash[21434]: cluster 2024-03-11T22:31:38.662158+0000 mgr.y (mgr.14601) 878 : cluster 0 pgmap v1360: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:40.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:39 smithi049 bash[28804]: cluster 2024-03-11T22:31:38.662158+0000 mgr.y (mgr.14601) 878 : cluster 0 pgmap v1360: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:41.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:40 smithi187 bash[23415]: audit 2024-03-11T22:31:39.612827+0000 mgr.y (mgr.14601) 879 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:41.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:40 smithi049 bash[21434]: audit 2024-03-11T22:31:39.612827+0000 mgr.y (mgr.14601) 879 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:41.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:40 smithi049 bash[28804]: audit 2024-03-11T22:31:39.612827+0000 mgr.y (mgr.14601) 879 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:42.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:41 smithi187 bash[23415]: cluster 2024-03-11T22:31:40.664072+0000 mgr.y (mgr.14601) 880 : cluster 0 pgmap v1361: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:42.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:41 smithi049 bash[21434]: cluster 2024-03-11T22:31:40.664072+0000 mgr.y (mgr.14601) 880 : cluster 0 pgmap v1361: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:42.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:41 smithi049 bash[28804]: cluster 2024-03-11T22:31:40.664072+0000 mgr.y (mgr.14601) 880 : cluster 0 pgmap v1361: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:44.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:43 smithi187 bash[23415]: cluster 2024-03-11T22:31:42.664897+0000 mgr.y (mgr.14601) 881 : cluster 0 pgmap v1362: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:44.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:43 smithi187 bash[23415]: audit 2024-03-11T22:31:42.831739+0000 mon.c (mon.2) 699 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:44.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:43 smithi049 bash[21434]: cluster 2024-03-11T22:31:42.664897+0000 mgr.y (mgr.14601) 881 : cluster 0 pgmap v1362: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:44.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:43 smithi049 bash[21434]: audit 2024-03-11T22:31:42.831739+0000 mon.c (mon.2) 699 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:44.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:43 smithi049 bash[28804]: cluster 2024-03-11T22:31:42.664897+0000 mgr.y (mgr.14601) 881 : cluster 0 pgmap v1362: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:44.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:43 smithi049 bash[28804]: audit 2024-03-11T22:31:42.831739+0000 mon.c (mon.2) 699 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:44.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:31:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:31:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:31:46.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:45 smithi187 bash[23415]: cluster 2024-03-11T22:31:44.667493+0000 mgr.y (mgr.14601) 882 : cluster 0 pgmap v1363: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:46.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:45 smithi049 bash[21434]: cluster 2024-03-11T22:31:44.667493+0000 mgr.y (mgr.14601) 882 : cluster 0 pgmap v1363: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:46.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:45 smithi049 bash[28804]: cluster 2024-03-11T22:31:44.667493+0000 mgr.y (mgr.14601) 882 : cluster 0 pgmap v1363: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:48.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:47 smithi049 bash[21434]: cluster 2024-03-11T22:31:46.668344+0000 mgr.y (mgr.14601) 883 : cluster 0 pgmap v1364: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:48.033 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:47 smithi049 bash[28804]: cluster 2024-03-11T22:31:46.668344+0000 mgr.y (mgr.14601) 883 : cluster 0 pgmap v1364: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:48.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:47 smithi187 bash[23415]: cluster 2024-03-11T22:31:46.668344+0000 mgr.y (mgr.14601) 883 : cluster 0 pgmap v1364: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:50.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:49 smithi187 bash[23415]: cluster 2024-03-11T22:31:48.669621+0000 mgr.y (mgr.14601) 884 : cluster 0 pgmap v1365: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:50.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:31:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:31:50.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:49 smithi049 bash[21434]: cluster 2024-03-11T22:31:48.669621+0000 mgr.y (mgr.14601) 884 : cluster 0 pgmap v1365: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:50.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:49 smithi049 bash[28804]: cluster 2024-03-11T22:31:48.669621+0000 mgr.y (mgr.14601) 884 : cluster 0 pgmap v1365: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:51.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:50 smithi049 bash[21434]: audit 2024-03-11T22:31:49.623086+0000 mgr.y (mgr.14601) 885 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:51.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:50 smithi049 bash[28804]: audit 2024-03-11T22:31:49.623086+0000 mgr.y (mgr.14601) 885 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:51.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:50 smithi187 bash[23415]: audit 2024-03-11T22:31:49.623086+0000 mgr.y (mgr.14601) 885 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:31:52.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:51 smithi049 bash[21434]: cluster 2024-03-11T22:31:50.671536+0000 mgr.y (mgr.14601) 886 : cluster 0 pgmap v1366: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:52.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:51 smithi049 bash[28804]: cluster 2024-03-11T22:31:50.671536+0000 mgr.y (mgr.14601) 886 : cluster 0 pgmap v1366: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:52.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:51 smithi187 bash[23415]: cluster 2024-03-11T22:31:50.671536+0000 mgr.y (mgr.14601) 886 : cluster 0 pgmap v1366: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:54.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:53 smithi049 bash[21434]: cluster 2024-03-11T22:31:52.672382+0000 mgr.y (mgr.14601) 887 : cluster 0 pgmap v1367: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:54.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:53 smithi049 bash[28804]: cluster 2024-03-11T22:31:52.672382+0000 mgr.y (mgr.14601) 887 : cluster 0 pgmap v1367: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:54.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:53 smithi187 bash[23415]: cluster 2024-03-11T22:31:52.672382+0000 mgr.y (mgr.14601) 887 : cluster 0 pgmap v1367: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:54.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:31:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:31:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:31:56.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:55 smithi049 bash[21434]: cluster 2024-03-11T22:31:54.674700+0000 mgr.y (mgr.14601) 888 : cluster 0 pgmap v1368: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:56.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:55 smithi049 bash[28804]: cluster 2024-03-11T22:31:54.674700+0000 mgr.y (mgr.14601) 888 : cluster 0 pgmap v1368: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:56.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:55 smithi187 bash[23415]: cluster 2024-03-11T22:31:54.674700+0000 mgr.y (mgr.14601) 888 : cluster 0 pgmap v1368: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:31:58.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:57 smithi049 bash[21434]: cluster 2024-03-11T22:31:56.675519+0000 mgr.y (mgr.14601) 889 : cluster 0 pgmap v1369: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:58.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:57 smithi049 bash[28804]: cluster 2024-03-11T22:31:56.675519+0000 mgr.y (mgr.14601) 889 : cluster 0 pgmap v1369: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:58.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:57 smithi187 bash[23415]: cluster 2024-03-11T22:31:56.675519+0000 mgr.y (mgr.14601) 889 : cluster 0 pgmap v1369: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:31:59.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:58 smithi049 bash[21434]: audit 2024-03-11T22:31:57.864919+0000 mon.c (mon.2) 700 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:59.034 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:58 smithi049 bash[28804]: audit 2024-03-11T22:31:57.864919+0000 mon.c (mon.2) 700 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:31:59.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:58 smithi187 bash[23415]: audit 2024-03-11T22:31:57.864919+0000 mon.c (mon.2) 700 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:00.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:31:59 smithi187 bash[23415]: cluster 2024-03-11T22:31:58.676782+0000 mgr.y (mgr.14601) 890 : cluster 0 pgmap v1370: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:00.002 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:31:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:32:00.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:31:59 smithi049 bash[21434]: cluster 2024-03-11T22:31:58.676782+0000 mgr.y (mgr.14601) 890 : cluster 0 pgmap v1370: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:00.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:31:59 smithi049 bash[28804]: cluster 2024-03-11T22:31:58.676782+0000 mgr.y (mgr.14601) 890 : cluster 0 pgmap v1370: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:00 smithi187 bash[23415]: audit 2024-03-11T22:31:59.630958+0000 mgr.y (mgr.14601) 891 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:01.283 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:00 smithi049 bash[28804]: audit 2024-03-11T22:31:59.630958+0000 mgr.y (mgr.14601) 891 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:01.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:00 smithi049 bash[21434]: audit 2024-03-11T22:31:59.630958+0000 mgr.y (mgr.14601) 891 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:02.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:01 smithi187 bash[23415]: cluster 2024-03-11T22:32:00.678793+0000 mgr.y (mgr.14601) 892 : cluster 0 pgmap v1371: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:02.283 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:01 smithi049 bash[28804]: cluster 2024-03-11T22:32:00.678793+0000 mgr.y (mgr.14601) 892 : cluster 0 pgmap v1371: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:02.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:01 smithi049 bash[21434]: cluster 2024-03-11T22:32:00.678793+0000 mgr.y (mgr.14601) 892 : cluster 0 pgmap v1371: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:04.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:03 smithi049 bash[21434]: cluster 2024-03-11T22:32:02.679813+0000 mgr.y (mgr.14601) 893 : cluster 0 pgmap v1372: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:04.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:03 smithi049 bash[28804]: cluster 2024-03-11T22:32:02.679813+0000 mgr.y (mgr.14601) 893 : cluster 0 pgmap v1372: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:04.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:03 smithi187 bash[23415]: cluster 2024-03-11T22:32:02.679813+0000 mgr.y (mgr.14601) 893 : cluster 0 pgmap v1372: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:04.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:32:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:32:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:32:06.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:05 smithi187 bash[23415]: cluster 2024-03-11T22:32:04.682076+0000 mgr.y (mgr.14601) 894 : cluster 0 pgmap v1373: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:06.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:05 smithi049 bash[21434]: cluster 2024-03-11T22:32:04.682076+0000 mgr.y (mgr.14601) 894 : cluster 0 pgmap v1373: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:06.283 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:05 smithi049 bash[28804]: cluster 2024-03-11T22:32:04.682076+0000 mgr.y (mgr.14601) 894 : cluster 0 pgmap v1373: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:08.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:07 smithi187 bash[23415]: cluster 2024-03-11T22:32:06.682911+0000 mgr.y (mgr.14601) 895 : cluster 0 pgmap v1374: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:08.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:07 smithi049 bash[21434]: cluster 2024-03-11T22:32:06.682911+0000 mgr.y (mgr.14601) 895 : cluster 0 pgmap v1374: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:08.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:07 smithi049 bash[28804]: cluster 2024-03-11T22:32:06.682911+0000 mgr.y (mgr.14601) 895 : cluster 0 pgmap v1374: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:10.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:09 smithi187 bash[23415]: cluster 2024-03-11T22:32:08.684266+0000 mgr.y (mgr.14601) 896 : cluster 0 pgmap v1375: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:10.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:32:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:32:10.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:09 smithi049 bash[21434]: cluster 2024-03-11T22:32:08.684266+0000 mgr.y (mgr.14601) 896 : cluster 0 pgmap v1375: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:10.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:09 smithi049 bash[28804]: cluster 2024-03-11T22:32:08.684266+0000 mgr.y (mgr.14601) 896 : cluster 0 pgmap v1375: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:11.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:10 smithi187 bash[23415]: audit 2024-03-11T22:32:09.642252+0000 mgr.y (mgr.14601) 897 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:11.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:10 smithi049 bash[21434]: audit 2024-03-11T22:32:09.642252+0000 mgr.y (mgr.14601) 897 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:11.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:10 smithi049 bash[28804]: audit 2024-03-11T22:32:09.642252+0000 mgr.y (mgr.14601) 897 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:12.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:11 smithi187 bash[23415]: cluster 2024-03-11T22:32:10.686041+0000 mgr.y (mgr.14601) 898 : cluster 0 pgmap v1376: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:12.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:11 smithi049 bash[21434]: cluster 2024-03-11T22:32:10.686041+0000 mgr.y (mgr.14601) 898 : cluster 0 pgmap v1376: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:12.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:11 smithi049 bash[28804]: cluster 2024-03-11T22:32:10.686041+0000 mgr.y (mgr.14601) 898 : cluster 0 pgmap v1376: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:14.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:13 smithi049 bash[21434]: cluster 2024-03-11T22:32:12.686879+0000 mgr.y (mgr.14601) 899 : cluster 0 pgmap v1377: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:14.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:13 smithi049 bash[21434]: audit 2024-03-11T22:32:12.898254+0000 mon.c (mon.2) 701 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:14.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:13 smithi049 bash[28804]: cluster 2024-03-11T22:32:12.686879+0000 mgr.y (mgr.14601) 899 : cluster 0 pgmap v1377: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:14.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:13 smithi049 bash[28804]: audit 2024-03-11T22:32:12.898254+0000 mon.c (mon.2) 701 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:14.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:13 smithi187 bash[23415]: cluster 2024-03-11T22:32:12.686879+0000 mgr.y (mgr.14601) 899 : cluster 0 pgmap v1377: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:14.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:13 smithi187 bash[23415]: audit 2024-03-11T22:32:12.898254+0000 mon.c (mon.2) 701 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:14.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:32:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:32:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:32:16.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:15 smithi187 bash[23415]: cluster 2024-03-11T22:32:14.689204+0000 mgr.y (mgr.14601) 900 : cluster 0 pgmap v1378: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:16.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:15 smithi049 bash[21434]: cluster 2024-03-11T22:32:14.689204+0000 mgr.y (mgr.14601) 900 : cluster 0 pgmap v1378: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:16.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:15 smithi049 bash[28804]: cluster 2024-03-11T22:32:14.689204+0000 mgr.y (mgr.14601) 900 : cluster 0 pgmap v1378: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:18.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:17 smithi187 bash[23415]: cluster 2024-03-11T22:32:16.690067+0000 mgr.y (mgr.14601) 901 : cluster 0 pgmap v1379: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:18.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:17 smithi049 bash[21434]: cluster 2024-03-11T22:32:16.690067+0000 mgr.y (mgr.14601) 901 : cluster 0 pgmap v1379: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:18.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:17 smithi049 bash[28804]: cluster 2024-03-11T22:32:16.690067+0000 mgr.y (mgr.14601) 901 : cluster 0 pgmap v1379: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:20.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:19 smithi187 bash[23415]: cluster 2024-03-11T22:32:18.691434+0000 mgr.y (mgr.14601) 902 : cluster 0 pgmap v1380: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:20.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:32:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:32:20.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:19 smithi049 bash[21434]: cluster 2024-03-11T22:32:18.691434+0000 mgr.y (mgr.14601) 902 : cluster 0 pgmap v1380: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:20.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:19 smithi049 bash[28804]: cluster 2024-03-11T22:32:18.691434+0000 mgr.y (mgr.14601) 902 : cluster 0 pgmap v1380: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:21.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:20 smithi187 bash[23415]: audit 2024-03-11T22:32:19.650870+0000 mgr.y (mgr.14601) 903 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:21.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:20 smithi049 bash[21434]: audit 2024-03-11T22:32:19.650870+0000 mgr.y (mgr.14601) 903 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:21.283 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:20 smithi049 bash[28804]: audit 2024-03-11T22:32:19.650870+0000 mgr.y (mgr.14601) 903 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:22.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:21 smithi187 bash[23415]: cluster 2024-03-11T22:32:20.693315+0000 mgr.y (mgr.14601) 904 : cluster 0 pgmap v1381: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:22.283 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:21 smithi049 bash[28804]: cluster 2024-03-11T22:32:20.693315+0000 mgr.y (mgr.14601) 904 : cluster 0 pgmap v1381: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:22.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:21 smithi049 bash[21434]: cluster 2024-03-11T22:32:20.693315+0000 mgr.y (mgr.14601) 904 : cluster 0 pgmap v1381: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:24.234 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:23 smithi049 bash[28804]: cluster 2024-03-11T22:32:22.694269+0000 mgr.y (mgr.14601) 905 : cluster 0 pgmap v1382: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:24.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:23 smithi049 bash[21434]: cluster 2024-03-11T22:32:22.694269+0000 mgr.y (mgr.14601) 905 : cluster 0 pgmap v1382: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:24.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:23 smithi187 bash[23415]: cluster 2024-03-11T22:32:22.694269+0000 mgr.y (mgr.14601) 905 : cluster 0 pgmap v1382: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:24.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:32:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:32:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:32:26.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:25 smithi187 bash[23415]: cluster 2024-03-11T22:32:24.696629+0000 mgr.y (mgr.14601) 906 : cluster 0 pgmap v1383: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:26.283 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:25 smithi049 bash[28804]: cluster 2024-03-11T22:32:24.696629+0000 mgr.y (mgr.14601) 906 : cluster 0 pgmap v1383: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:26.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:25 smithi049 bash[21434]: cluster 2024-03-11T22:32:24.696629+0000 mgr.y (mgr.14601) 906 : cluster 0 pgmap v1383: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:28.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:27 smithi187 bash[23415]: cluster 2024-03-11T22:32:26.697488+0000 mgr.y (mgr.14601) 907 : cluster 0 pgmap v1384: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:28.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:27 smithi049 bash[21434]: cluster 2024-03-11T22:32:26.697488+0000 mgr.y (mgr.14601) 907 : cluster 0 pgmap v1384: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:28.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:27 smithi049 bash[28804]: cluster 2024-03-11T22:32:26.697488+0000 mgr.y (mgr.14601) 907 : cluster 0 pgmap v1384: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:29.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:28 smithi187 bash[23415]: audit 2024-03-11T22:32:27.932583+0000 mon.c (mon.2) 702 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:29.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:28 smithi049 bash[21434]: audit 2024-03-11T22:32:27.932583+0000 mon.c (mon.2) 702 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:29.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:28 smithi049 bash[28804]: audit 2024-03-11T22:32:27.932583+0000 mon.c (mon.2) 702 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:30.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:29 smithi187 bash[23415]: cluster 2024-03-11T22:32:28.698993+0000 mgr.y (mgr.14601) 908 : cluster 0 pgmap v1385: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:30.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:32:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:32:30.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:29 smithi049 bash[21434]: cluster 2024-03-11T22:32:28.698993+0000 mgr.y (mgr.14601) 908 : cluster 0 pgmap v1385: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:30.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:29 smithi049 bash[28804]: cluster 2024-03-11T22:32:28.698993+0000 mgr.y (mgr.14601) 908 : cluster 0 pgmap v1385: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:31.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:30 smithi187 bash[23415]: audit 2024-03-11T22:32:29.662147+0000 mgr.y (mgr.14601) 909 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:31.283 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:30 smithi049 bash[28804]: audit 2024-03-11T22:32:29.662147+0000 mgr.y (mgr.14601) 909 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:31.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:30 smithi049 bash[21434]: audit 2024-03-11T22:32:29.662147+0000 mgr.y (mgr.14601) 909 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:32.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:31 smithi187 bash[23415]: cluster 2024-03-11T22:32:30.700649+0000 mgr.y (mgr.14601) 910 : cluster 0 pgmap v1386: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:32.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:31 smithi049 bash[21434]: cluster 2024-03-11T22:32:30.700649+0000 mgr.y (mgr.14601) 910 : cluster 0 pgmap v1386: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:32.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:31 smithi049 bash[28804]: cluster 2024-03-11T22:32:30.700649+0000 mgr.y (mgr.14601) 910 : cluster 0 pgmap v1386: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:34.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:33 smithi049 bash[21434]: cluster 2024-03-11T22:32:32.701481+0000 mgr.y (mgr.14601) 911 : cluster 0 pgmap v1387: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:34.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:33 smithi049 bash[21434]: audit 2024-03-11T22:32:33.357786+0000 mon.c (mon.2) 703 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:32:34.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:33 smithi049 bash[28804]: cluster 2024-03-11T22:32:32.701481+0000 mgr.y (mgr.14601) 911 : cluster 0 pgmap v1387: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:34.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:33 smithi049 bash[28804]: audit 2024-03-11T22:32:33.357786+0000 mon.c (mon.2) 703 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:32:34.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:33 smithi187 bash[23415]: cluster 2024-03-11T22:32:32.701481+0000 mgr.y (mgr.14601) 911 : cluster 0 pgmap v1387: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:34.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:33 smithi187 bash[23415]: audit 2024-03-11T22:32:33.357786+0000 mon.c (mon.2) 703 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:32:34.533 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:32:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:32:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:32:35.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:34 smithi187 bash[23415]: audit 2024-03-11T22:32:34.090427+0000 mon.c (mon.2) 704 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:32:35.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:34 smithi187 bash[23415]: audit 2024-03-11T22:32:34.092263+0000 mon.c (mon.2) 705 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:32:35.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:34 smithi187 bash[23415]: audit 2024-03-11T22:32:34.103096+0000 mon.a (mon.0) 3466 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:32:35.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:34 smithi049 bash[21434]: audit 2024-03-11T22:32:34.090427+0000 mon.c (mon.2) 704 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:32:35.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:34 smithi049 bash[21434]: audit 2024-03-11T22:32:34.092263+0000 mon.c (mon.2) 705 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:32:35.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:34 smithi049 bash[21434]: audit 2024-03-11T22:32:34.103096+0000 mon.a (mon.0) 3466 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:32:35.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:34 smithi049 bash[28804]: audit 2024-03-11T22:32:34.090427+0000 mon.c (mon.2) 704 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:32:35.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:34 smithi049 bash[28804]: audit 2024-03-11T22:32:34.092263+0000 mon.c (mon.2) 705 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:32:35.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:34 smithi049 bash[28804]: audit 2024-03-11T22:32:34.103096+0000 mon.a (mon.0) 3466 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:32:36.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:36 smithi187 bash[23415]: cluster 2024-03-11T22:32:34.703728+0000 mgr.y (mgr.14601) 912 : cluster 0 pgmap v1388: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:36.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:36 smithi049 bash[21434]: cluster 2024-03-11T22:32:34.703728+0000 mgr.y (mgr.14601) 912 : cluster 0 pgmap v1388: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:36.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:36 smithi049 bash[28804]: cluster 2024-03-11T22:32:34.703728+0000 mgr.y (mgr.14601) 912 : cluster 0 pgmap v1388: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:38.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:38 smithi187 bash[23415]: cluster 2024-03-11T22:32:36.704567+0000 mgr.y (mgr.14601) 913 : cluster 0 pgmap v1389: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:38.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:38 smithi049 bash[21434]: cluster 2024-03-11T22:32:36.704567+0000 mgr.y (mgr.14601) 913 : cluster 0 pgmap v1389: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:38.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:38 smithi049 bash[28804]: cluster 2024-03-11T22:32:36.704567+0000 mgr.y (mgr.14601) 913 : cluster 0 pgmap v1389: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:40.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:32:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:32:40.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:40 smithi187 bash[23415]: cluster 2024-03-11T22:32:38.706093+0000 mgr.y (mgr.14601) 914 : cluster 0 pgmap v1390: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:40.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:40 smithi049 bash[21434]: cluster 2024-03-11T22:32:38.706093+0000 mgr.y (mgr.14601) 914 : cluster 0 pgmap v1390: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:40.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:40 smithi049 bash[28804]: cluster 2024-03-11T22:32:38.706093+0000 mgr.y (mgr.14601) 914 : cluster 0 pgmap v1390: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:41.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:41 smithi187 bash[23415]: audit 2024-03-11T22:32:39.673410+0000 mgr.y (mgr.14601) 915 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:41.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:41 smithi049 bash[21434]: audit 2024-03-11T22:32:39.673410+0000 mgr.y (mgr.14601) 915 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:41.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:41 smithi049 bash[28804]: audit 2024-03-11T22:32:39.673410+0000 mgr.y (mgr.14601) 915 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:42.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:42 smithi187 bash[23415]: cluster 2024-03-11T22:32:40.707734+0000 mgr.y (mgr.14601) 916 : cluster 0 pgmap v1391: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:42.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:42 smithi049 bash[28804]: cluster 2024-03-11T22:32:40.707734+0000 mgr.y (mgr.14601) 916 : cluster 0 pgmap v1391: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:42.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:42 smithi049 bash[21434]: cluster 2024-03-11T22:32:40.707734+0000 mgr.y (mgr.14601) 916 : cluster 0 pgmap v1391: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:43.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:43 smithi187 bash[23415]: audit 2024-03-11T22:32:42.967462+0000 mon.c (mon.2) 706 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:43.533 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:43 smithi049 bash[28804]: audit 2024-03-11T22:32:42.967462+0000 mon.c (mon.2) 706 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:43.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:43 smithi049 bash[21434]: audit 2024-03-11T22:32:42.967462+0000 mon.c (mon.2) 706 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:44.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:44 smithi187 bash[23415]: cluster 2024-03-11T22:32:42.708574+0000 mgr.y (mgr.14601) 917 : cluster 0 pgmap v1392: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:44.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:44 smithi049 bash[21434]: cluster 2024-03-11T22:32:42.708574+0000 mgr.y (mgr.14601) 917 : cluster 0 pgmap v1392: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:44.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:44 smithi049 bash[28804]: cluster 2024-03-11T22:32:42.708574+0000 mgr.y (mgr.14601) 917 : cluster 0 pgmap v1392: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:44.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:32:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:32:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:32:46.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:46 smithi187 bash[23415]: cluster 2024-03-11T22:32:44.710980+0000 mgr.y (mgr.14601) 918 : cluster 0 pgmap v1393: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:46.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:46 smithi049 bash[21434]: cluster 2024-03-11T22:32:44.710980+0000 mgr.y (mgr.14601) 918 : cluster 0 pgmap v1393: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:46.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:46 smithi049 bash[28804]: cluster 2024-03-11T22:32:44.710980+0000 mgr.y (mgr.14601) 918 : cluster 0 pgmap v1393: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:48.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:48 smithi187 bash[23415]: cluster 2024-03-11T22:32:46.711898+0000 mgr.y (mgr.14601) 919 : cluster 0 pgmap v1394: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:48.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:48 smithi049 bash[21434]: cluster 2024-03-11T22:32:46.711898+0000 mgr.y (mgr.14601) 919 : cluster 0 pgmap v1394: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:48.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:48 smithi049 bash[28804]: cluster 2024-03-11T22:32:46.711898+0000 mgr.y (mgr.14601) 919 : cluster 0 pgmap v1394: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:50.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:32:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:32:50.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:50 smithi187 bash[23415]: cluster 2024-03-11T22:32:48.713639+0000 mgr.y (mgr.14601) 920 : cluster 0 pgmap v1395: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:50.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:50 smithi049 bash[21434]: cluster 2024-03-11T22:32:48.713639+0000 mgr.y (mgr.14601) 920 : cluster 0 pgmap v1395: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:50.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:50 smithi049 bash[28804]: cluster 2024-03-11T22:32:48.713639+0000 mgr.y (mgr.14601) 920 : cluster 0 pgmap v1395: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:51.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:51 smithi187 bash[23415]: audit 2024-03-11T22:32:49.680615+0000 mgr.y (mgr.14601) 921 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:51.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:51 smithi049 bash[21434]: audit 2024-03-11T22:32:49.680615+0000 mgr.y (mgr.14601) 921 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:51.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:51 smithi049 bash[28804]: audit 2024-03-11T22:32:49.680615+0000 mgr.y (mgr.14601) 921 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:32:52.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:52 smithi187 bash[23415]: cluster 2024-03-11T22:32:50.715108+0000 mgr.y (mgr.14601) 922 : cluster 0 pgmap v1396: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:52.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:52 smithi049 bash[21434]: cluster 2024-03-11T22:32:50.715108+0000 mgr.y (mgr.14601) 922 : cluster 0 pgmap v1396: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:52.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:52 smithi049 bash[28804]: cluster 2024-03-11T22:32:50.715108+0000 mgr.y (mgr.14601) 922 : cluster 0 pgmap v1396: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:54.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:54 smithi187 bash[23415]: cluster 2024-03-11T22:32:52.716002+0000 mgr.y (mgr.14601) 923 : cluster 0 pgmap v1397: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:54.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:32:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:32:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:32:54.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:54 smithi049 bash[28804]: cluster 2024-03-11T22:32:52.716002+0000 mgr.y (mgr.14601) 923 : cluster 0 pgmap v1397: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:54.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:54 smithi049 bash[21434]: cluster 2024-03-11T22:32:52.716002+0000 mgr.y (mgr.14601) 923 : cluster 0 pgmap v1397: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:56.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:56 smithi187 bash[23415]: cluster 2024-03-11T22:32:54.718323+0000 mgr.y (mgr.14601) 924 : cluster 0 pgmap v1398: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:56.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:56 smithi049 bash[28804]: cluster 2024-03-11T22:32:54.718323+0000 mgr.y (mgr.14601) 924 : cluster 0 pgmap v1398: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:56.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:56 smithi049 bash[21434]: cluster 2024-03-11T22:32:54.718323+0000 mgr.y (mgr.14601) 924 : cluster 0 pgmap v1398: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:32:58.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:58 smithi187 bash[23415]: cluster 2024-03-11T22:32:56.719098+0000 mgr.y (mgr.14601) 925 : cluster 0 pgmap v1399: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:58.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:32:58 smithi187 bash[23415]: audit 2024-03-11T22:32:58.000727+0000 mon.c (mon.2) 707 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:58.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:58 smithi049 bash[28804]: cluster 2024-03-11T22:32:56.719098+0000 mgr.y (mgr.14601) 925 : cluster 0 pgmap v1399: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:58.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:32:58 smithi049 bash[28804]: audit 2024-03-11T22:32:58.000727+0000 mon.c (mon.2) 707 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:32:58.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:58 smithi049 bash[21434]: cluster 2024-03-11T22:32:56.719098+0000 mgr.y (mgr.14601) 925 : cluster 0 pgmap v1399: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:32:58.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:32:58 smithi049 bash[21434]: audit 2024-03-11T22:32:58.000727+0000 mon.c (mon.2) 707 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:00.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:32:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:33:00.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:00 smithi187 bash[23415]: cluster 2024-03-11T22:32:58.720694+0000 mgr.y (mgr.14601) 926 : cluster 0 pgmap v1400: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:00.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:00 smithi049 bash[21434]: cluster 2024-03-11T22:32:58.720694+0000 mgr.y (mgr.14601) 926 : cluster 0 pgmap v1400: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:00.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:00 smithi049 bash[28804]: cluster 2024-03-11T22:32:58.720694+0000 mgr.y (mgr.14601) 926 : cluster 0 pgmap v1400: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:01.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:01 smithi187 bash[23415]: audit 2024-03-11T22:32:59.690812+0000 mgr.y (mgr.14601) 927 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:01.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:01 smithi049 bash[21434]: audit 2024-03-11T22:32:59.690812+0000 mgr.y (mgr.14601) 927 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:01.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:01 smithi049 bash[28804]: audit 2024-03-11T22:32:59.690812+0000 mgr.y (mgr.14601) 927 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:02.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:02 smithi187 bash[23415]: cluster 2024-03-11T22:33:00.722189+0000 mgr.y (mgr.14601) 928 : cluster 0 pgmap v1401: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:02.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:02 smithi049 bash[21434]: cluster 2024-03-11T22:33:00.722189+0000 mgr.y (mgr.14601) 928 : cluster 0 pgmap v1401: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:02.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:02 smithi049 bash[28804]: cluster 2024-03-11T22:33:00.722189+0000 mgr.y (mgr.14601) 928 : cluster 0 pgmap v1401: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:04.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:04 smithi187 bash[23415]: cluster 2024-03-11T22:33:02.723000+0000 mgr.y (mgr.14601) 929 : cluster 0 pgmap v1402: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:04.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:04 smithi049 bash[21434]: cluster 2024-03-11T22:33:02.723000+0000 mgr.y (mgr.14601) 929 : cluster 0 pgmap v1402: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:04.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:33:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:33:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:33:04.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:04 smithi049 bash[28804]: cluster 2024-03-11T22:33:02.723000+0000 mgr.y (mgr.14601) 929 : cluster 0 pgmap v1402: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:06.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:06 smithi187 bash[23415]: cluster 2024-03-11T22:33:04.725412+0000 mgr.y (mgr.14601) 930 : cluster 0 pgmap v1403: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:06.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:06 smithi049 bash[21434]: cluster 2024-03-11T22:33:04.725412+0000 mgr.y (mgr.14601) 930 : cluster 0 pgmap v1403: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:06.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:06 smithi049 bash[28804]: cluster 2024-03-11T22:33:04.725412+0000 mgr.y (mgr.14601) 930 : cluster 0 pgmap v1403: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:08.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:08 smithi187 bash[23415]: cluster 2024-03-11T22:33:06.726357+0000 mgr.y (mgr.14601) 931 : cluster 0 pgmap v1404: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:08.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:08 smithi049 bash[21434]: cluster 2024-03-11T22:33:06.726357+0000 mgr.y (mgr.14601) 931 : cluster 0 pgmap v1404: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:08.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:08 smithi049 bash[28804]: cluster 2024-03-11T22:33:06.726357+0000 mgr.y (mgr.14601) 931 : cluster 0 pgmap v1404: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:10.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:33:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:33:10.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:10 smithi187 bash[23415]: cluster 2024-03-11T22:33:08.728084+0000 mgr.y (mgr.14601) 932 : cluster 0 pgmap v1405: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:10.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:10 smithi049 bash[21434]: cluster 2024-03-11T22:33:08.728084+0000 mgr.y (mgr.14601) 932 : cluster 0 pgmap v1405: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:10.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:10 smithi049 bash[28804]: cluster 2024-03-11T22:33:08.728084+0000 mgr.y (mgr.14601) 932 : cluster 0 pgmap v1405: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:11.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:11 smithi187 bash[23415]: audit 2024-03-11T22:33:09.702149+0000 mgr.y (mgr.14601) 933 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:11.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:11 smithi049 bash[21434]: audit 2024-03-11T22:33:09.702149+0000 mgr.y (mgr.14601) 933 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:11.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:11 smithi049 bash[28804]: audit 2024-03-11T22:33:09.702149+0000 mgr.y (mgr.14601) 933 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:12.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:12 smithi187 bash[23415]: cluster 2024-03-11T22:33:10.729571+0000 mgr.y (mgr.14601) 934 : cluster 0 pgmap v1406: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:12.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:12 smithi049 bash[21434]: cluster 2024-03-11T22:33:10.729571+0000 mgr.y (mgr.14601) 934 : cluster 0 pgmap v1406: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:12.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:12 smithi049 bash[28804]: cluster 2024-03-11T22:33:10.729571+0000 mgr.y (mgr.14601) 934 : cluster 0 pgmap v1406: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:13.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:13 smithi187 bash[23415]: audit 2024-03-11T22:33:13.033927+0000 mon.c (mon.2) 708 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:13.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:13 smithi049 bash[21434]: audit 2024-03-11T22:33:13.033927+0000 mon.c (mon.2) 708 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:13.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:13 smithi049 bash[28804]: audit 2024-03-11T22:33:13.033927+0000 mon.c (mon.2) 708 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:14.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:14 smithi187 bash[23415]: cluster 2024-03-11T22:33:12.730354+0000 mgr.y (mgr.14601) 935 : cluster 0 pgmap v1407: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:14.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:14 smithi049 bash[21434]: cluster 2024-03-11T22:33:12.730354+0000 mgr.y (mgr.14601) 935 : cluster 0 pgmap v1407: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:14.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:14 smithi049 bash[28804]: cluster 2024-03-11T22:33:12.730354+0000 mgr.y (mgr.14601) 935 : cluster 0 pgmap v1407: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:14.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:33:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:33:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:33:16.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:16 smithi187 bash[23415]: cluster 2024-03-11T22:33:14.732689+0000 mgr.y (mgr.14601) 936 : cluster 0 pgmap v1408: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:16.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:16 smithi049 bash[21434]: cluster 2024-03-11T22:33:14.732689+0000 mgr.y (mgr.14601) 936 : cluster 0 pgmap v1408: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:16.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:16 smithi049 bash[28804]: cluster 2024-03-11T22:33:14.732689+0000 mgr.y (mgr.14601) 936 : cluster 0 pgmap v1408: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:18.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:18 smithi187 bash[23415]: cluster 2024-03-11T22:33:16.733603+0000 mgr.y (mgr.14601) 937 : cluster 0 pgmap v1409: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:18.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:18 smithi049 bash[21434]: cluster 2024-03-11T22:33:16.733603+0000 mgr.y (mgr.14601) 937 : cluster 0 pgmap v1409: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:18.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:18 smithi049 bash[28804]: cluster 2024-03-11T22:33:16.733603+0000 mgr.y (mgr.14601) 937 : cluster 0 pgmap v1409: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:20.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:33:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:33:20.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:20 smithi187 bash[23415]: cluster 2024-03-11T22:33:18.735409+0000 mgr.y (mgr.14601) 938 : cluster 0 pgmap v1410: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:20.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:20 smithi049 bash[21434]: cluster 2024-03-11T22:33:18.735409+0000 mgr.y (mgr.14601) 938 : cluster 0 pgmap v1410: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:20.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:20 smithi049 bash[28804]: cluster 2024-03-11T22:33:18.735409+0000 mgr.y (mgr.14601) 938 : cluster 0 pgmap v1410: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:21.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:21 smithi187 bash[23415]: audit 2024-03-11T22:33:19.710820+0000 mgr.y (mgr.14601) 939 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:21.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:21 smithi049 bash[21434]: audit 2024-03-11T22:33:19.710820+0000 mgr.y (mgr.14601) 939 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:21.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:21 smithi049 bash[28804]: audit 2024-03-11T22:33:19.710820+0000 mgr.y (mgr.14601) 939 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:22.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:22 smithi187 bash[23415]: cluster 2024-03-11T22:33:20.736916+0000 mgr.y (mgr.14601) 940 : cluster 0 pgmap v1411: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:22.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:22 smithi049 bash[21434]: cluster 2024-03-11T22:33:20.736916+0000 mgr.y (mgr.14601) 940 : cluster 0 pgmap v1411: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:22.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:22 smithi049 bash[28804]: cluster 2024-03-11T22:33:20.736916+0000 mgr.y (mgr.14601) 940 : cluster 0 pgmap v1411: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:24.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:24 smithi049 bash[21434]: cluster 2024-03-11T22:33:22.737861+0000 mgr.y (mgr.14601) 941 : cluster 0 pgmap v1412: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:24.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:33:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:33:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:33:24.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:24 smithi049 bash[28804]: cluster 2024-03-11T22:33:22.737861+0000 mgr.y (mgr.14601) 941 : cluster 0 pgmap v1412: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:24.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:24 smithi187 bash[23415]: cluster 2024-03-11T22:33:22.737861+0000 mgr.y (mgr.14601) 941 : cluster 0 pgmap v1412: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:26.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:26 smithi049 bash[21434]: cluster 2024-03-11T22:33:24.740201+0000 mgr.y (mgr.14601) 942 : cluster 0 pgmap v1413: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:26.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:26 smithi049 bash[28804]: cluster 2024-03-11T22:33:24.740201+0000 mgr.y (mgr.14601) 942 : cluster 0 pgmap v1413: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:26.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:26 smithi187 bash[23415]: cluster 2024-03-11T22:33:24.740201+0000 mgr.y (mgr.14601) 942 : cluster 0 pgmap v1413: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:28.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:28 smithi049 bash[21434]: cluster 2024-03-11T22:33:26.741071+0000 mgr.y (mgr.14601) 943 : cluster 0 pgmap v1414: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:28.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:28 smithi049 bash[21434]: audit 2024-03-11T22:33:28.067362+0000 mon.c (mon.2) 709 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:28.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:28 smithi049 bash[28804]: cluster 2024-03-11T22:33:26.741071+0000 mgr.y (mgr.14601) 943 : cluster 0 pgmap v1414: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:28.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:28 smithi049 bash[28804]: audit 2024-03-11T22:33:28.067362+0000 mon.c (mon.2) 709 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:28.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:28 smithi187 bash[23415]: cluster 2024-03-11T22:33:26.741071+0000 mgr.y (mgr.14601) 943 : cluster 0 pgmap v1414: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:28.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:28 smithi187 bash[23415]: audit 2024-03-11T22:33:28.067362+0000 mon.c (mon.2) 709 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:30.001 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:33:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:33:30.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:30 smithi049 bash[21434]: cluster 2024-03-11T22:33:28.742761+0000 mgr.y (mgr.14601) 944 : cluster 0 pgmap v1415: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:30.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:30 smithi049 bash[28804]: cluster 2024-03-11T22:33:28.742761+0000 mgr.y (mgr.14601) 944 : cluster 0 pgmap v1415: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:30.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:30 smithi187 bash[23415]: cluster 2024-03-11T22:33:28.742761+0000 mgr.y (mgr.14601) 944 : cluster 0 pgmap v1415: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:31.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:31 smithi049 bash[21434]: audit 2024-03-11T22:33:29.718103+0000 mgr.y (mgr.14601) 945 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:31.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:31 smithi049 bash[21434]: cluster 2024-03-11T22:33:30.744370+0000 mgr.y (mgr.14601) 946 : cluster 0 pgmap v1416: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:31.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:31 smithi049 bash[28804]: audit 2024-03-11T22:33:29.718103+0000 mgr.y (mgr.14601) 945 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:31.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:31 smithi049 bash[28804]: cluster 2024-03-11T22:33:30.744370+0000 mgr.y (mgr.14601) 946 : cluster 0 pgmap v1416: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:31.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:31 smithi187 bash[23415]: audit 2024-03-11T22:33:29.718103+0000 mgr.y (mgr.14601) 945 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:31.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:31 smithi187 bash[23415]: cluster 2024-03-11T22:33:30.744370+0000 mgr.y (mgr.14601) 946 : cluster 0 pgmap v1416: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:34.235 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:33 smithi049 bash[28804]: cluster 2024-03-11T22:33:32.745255+0000 mgr.y (mgr.14601) 947 : cluster 0 pgmap v1417: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:34.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:33 smithi049 bash[21434]: cluster 2024-03-11T22:33:32.745255+0000 mgr.y (mgr.14601) 947 : cluster 0 pgmap v1417: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:34.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:33 smithi187 bash[23415]: cluster 2024-03-11T22:33:32.745255+0000 mgr.y (mgr.14601) 947 : cluster 0 pgmap v1417: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:34.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:33:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:33:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:33:35.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:34 smithi187 bash[23415]: audit 2024-03-11T22:33:34.195186+0000 mon.c (mon.2) 710 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:33:35.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:34 smithi049 bash[28804]: audit 2024-03-11T22:33:34.195186+0000 mon.c (mon.2) 710 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:33:35.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:34 smithi049 bash[21434]: audit 2024-03-11T22:33:34.195186+0000 mon.c (mon.2) 710 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:33:36.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:35 smithi187 bash[23415]: cluster 2024-03-11T22:33:34.746448+0000 mgr.y (mgr.14601) 948 : cluster 0 pgmap v1418: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:36.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:35 smithi187 bash[23415]: audit 2024-03-11T22:33:34.930064+0000 mon.c (mon.2) 711 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:33:36.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:35 smithi187 bash[23415]: audit 2024-03-11T22:33:34.931614+0000 mon.c (mon.2) 712 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:33:36.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:35 smithi187 bash[23415]: audit 2024-03-11T22:33:34.940134+0000 mon.a (mon.0) 3467 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:33:36.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[28804]: cluster 2024-03-11T22:33:34.746448+0000 mgr.y (mgr.14601) 948 : cluster 0 pgmap v1418: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:36.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[28804]: audit 2024-03-11T22:33:34.930064+0000 mon.c (mon.2) 711 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:33:36.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[28804]: audit 2024-03-11T22:33:34.931614+0000 mon.c (mon.2) 712 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:33:36.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[28804]: audit 2024-03-11T22:33:34.940134+0000 mon.a (mon.0) 3467 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:33:36.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[21434]: cluster 2024-03-11T22:33:34.746448+0000 mgr.y (mgr.14601) 948 : cluster 0 pgmap v1418: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:36.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[21434]: audit 2024-03-11T22:33:34.930064+0000 mon.c (mon.2) 711 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:33:36.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[21434]: audit 2024-03-11T22:33:34.931614+0000 mon.c (mon.2) 712 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:33:36.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:35 smithi049 bash[21434]: audit 2024-03-11T22:33:34.940134+0000 mon.a (mon.0) 3467 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:33:38.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:37 smithi187 bash[23415]: cluster 2024-03-11T22:33:36.747355+0000 mgr.y (mgr.14601) 949 : cluster 0 pgmap v1419: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:38.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:37 smithi049 bash[28804]: cluster 2024-03-11T22:33:36.747355+0000 mgr.y (mgr.14601) 949 : cluster 0 pgmap v1419: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:38.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:37 smithi049 bash[21434]: cluster 2024-03-11T22:33:36.747355+0000 mgr.y (mgr.14601) 949 : cluster 0 pgmap v1419: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:40.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:39 smithi187 bash[23415]: cluster 2024-03-11T22:33:38.749425+0000 mgr.y (mgr.14601) 950 : cluster 0 pgmap v1420: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:40.002 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:33:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:33:40.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:39 smithi049 bash[21434]: cluster 2024-03-11T22:33:38.749425+0000 mgr.y (mgr.14601) 950 : cluster 0 pgmap v1420: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:40.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:39 smithi049 bash[28804]: cluster 2024-03-11T22:33:38.749425+0000 mgr.y (mgr.14601) 950 : cluster 0 pgmap v1420: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:41.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:40 smithi187 bash[23415]: audit 2024-03-11T22:33:39.729374+0000 mgr.y (mgr.14601) 951 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:41.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:40 smithi049 bash[28804]: audit 2024-03-11T22:33:39.729374+0000 mgr.y (mgr.14601) 951 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:41.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:40 smithi049 bash[21434]: audit 2024-03-11T22:33:39.729374+0000 mgr.y (mgr.14601) 951 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:42.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:41 smithi187 bash[23415]: cluster 2024-03-11T22:33:40.750525+0000 mgr.y (mgr.14601) 952 : cluster 0 pgmap v1421: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:42.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:41 smithi049 bash[28804]: cluster 2024-03-11T22:33:40.750525+0000 mgr.y (mgr.14601) 952 : cluster 0 pgmap v1421: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:42.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:41 smithi049 bash[21434]: cluster 2024-03-11T22:33:40.750525+0000 mgr.y (mgr.14601) 952 : cluster 0 pgmap v1421: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:44.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:43 smithi049 bash[28804]: cluster 2024-03-11T22:33:42.751336+0000 mgr.y (mgr.14601) 953 : cluster 0 pgmap v1422: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:44.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:43 smithi049 bash[28804]: audit 2024-03-11T22:33:43.101310+0000 mon.c (mon.2) 713 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:44.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:43 smithi049 bash[21434]: cluster 2024-03-11T22:33:42.751336+0000 mgr.y (mgr.14601) 953 : cluster 0 pgmap v1422: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:44.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:43 smithi049 bash[21434]: audit 2024-03-11T22:33:43.101310+0000 mon.c (mon.2) 713 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:44.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:43 smithi187 bash[23415]: cluster 2024-03-11T22:33:42.751336+0000 mgr.y (mgr.14601) 953 : cluster 0 pgmap v1422: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:44.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:43 smithi187 bash[23415]: audit 2024-03-11T22:33:43.101310+0000 mon.c (mon.2) 713 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:44.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:33:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:33:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:33:46.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:45 smithi187 bash[23415]: cluster 2024-03-11T22:33:44.753977+0000 mgr.y (mgr.14601) 954 : cluster 0 pgmap v1423: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:46.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:45 smithi049 bash[21434]: cluster 2024-03-11T22:33:44.753977+0000 mgr.y (mgr.14601) 954 : cluster 0 pgmap v1423: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:46.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:45 smithi049 bash[28804]: cluster 2024-03-11T22:33:44.753977+0000 mgr.y (mgr.14601) 954 : cluster 0 pgmap v1423: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:48.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:47 smithi187 bash[23415]: cluster 2024-03-11T22:33:46.754792+0000 mgr.y (mgr.14601) 955 : cluster 0 pgmap v1424: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:48.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:47 smithi049 bash[21434]: cluster 2024-03-11T22:33:46.754792+0000 mgr.y (mgr.14601) 955 : cluster 0 pgmap v1424: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:48.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:47 smithi049 bash[28804]: cluster 2024-03-11T22:33:46.754792+0000 mgr.y (mgr.14601) 955 : cluster 0 pgmap v1424: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:50.002 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:49 smithi187 bash[23415]: cluster 2024-03-11T22:33:48.757062+0000 mgr.y (mgr.14601) 956 : cluster 0 pgmap v1425: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:50.002 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:33:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:33:50.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:49 smithi049 bash[21434]: cluster 2024-03-11T22:33:48.757062+0000 mgr.y (mgr.14601) 956 : cluster 0 pgmap v1425: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:50.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:49 smithi049 bash[28804]: cluster 2024-03-11T22:33:48.757062+0000 mgr.y (mgr.14601) 956 : cluster 0 pgmap v1425: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:51.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:50 smithi187 bash[23415]: audit 2024-03-11T22:33:49.738390+0000 mgr.y (mgr.14601) 957 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:51.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:50 smithi049 bash[21434]: audit 2024-03-11T22:33:49.738390+0000 mgr.y (mgr.14601) 957 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:51.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:50 smithi049 bash[28804]: audit 2024-03-11T22:33:49.738390+0000 mgr.y (mgr.14601) 957 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:33:52.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:51 smithi187 bash[23415]: cluster 2024-03-11T22:33:50.757942+0000 mgr.y (mgr.14601) 958 : cluster 0 pgmap v1426: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:52.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:51 smithi049 bash[21434]: cluster 2024-03-11T22:33:50.757942+0000 mgr.y (mgr.14601) 958 : cluster 0 pgmap v1426: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:52.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:51 smithi049 bash[28804]: cluster 2024-03-11T22:33:50.757942+0000 mgr.y (mgr.14601) 958 : cluster 0 pgmap v1426: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:54.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:53 smithi049 bash[21434]: cluster 2024-03-11T22:33:52.758756+0000 mgr.y (mgr.14601) 959 : cluster 0 pgmap v1427: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:54.234 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:53 smithi049 bash[28804]: cluster 2024-03-11T22:33:52.758756+0000 mgr.y (mgr.14601) 959 : cluster 0 pgmap v1427: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:54.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:53 smithi187 bash[23415]: cluster 2024-03-11T22:33:52.758756+0000 mgr.y (mgr.14601) 959 : cluster 0 pgmap v1427: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:54.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:33:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:33:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:33:56.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:55 smithi187 bash[23415]: cluster 2024-03-11T22:33:54.761062+0000 mgr.y (mgr.14601) 960 : cluster 0 pgmap v1428: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:56.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:55 smithi049 bash[28804]: cluster 2024-03-11T22:33:54.761062+0000 mgr.y (mgr.14601) 960 : cluster 0 pgmap v1428: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:56.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:55 smithi049 bash[21434]: cluster 2024-03-11T22:33:54.761062+0000 mgr.y (mgr.14601) 960 : cluster 0 pgmap v1428: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:33:58.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:57 smithi187 bash[23415]: cluster 2024-03-11T22:33:56.761908+0000 mgr.y (mgr.14601) 961 : cluster 0 pgmap v1429: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:58.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:57 smithi049 bash[21434]: cluster 2024-03-11T22:33:56.761908+0000 mgr.y (mgr.14601) 961 : cluster 0 pgmap v1429: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:58.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:57 smithi049 bash[28804]: cluster 2024-03-11T22:33:56.761908+0000 mgr.y (mgr.14601) 961 : cluster 0 pgmap v1429: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:33:59.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:58 smithi187 bash[23415]: audit 2024-03-11T22:33:58.136243+0000 mon.c (mon.2) 714 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:59.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:58 smithi049 bash[28804]: audit 2024-03-11T22:33:58.136243+0000 mon.c (mon.2) 714 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:33:59.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:58 smithi049 bash[21434]: audit 2024-03-11T22:33:58.136243+0000 mon.c (mon.2) 714 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:00.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:33:59 smithi187 bash[23415]: cluster 2024-03-11T22:33:58.764048+0000 mgr.y (mgr.14601) 962 : cluster 0 pgmap v1430: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:00.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:33:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:34:00.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:33:59 smithi049 bash[28804]: cluster 2024-03-11T22:33:58.764048+0000 mgr.y (mgr.14601) 962 : cluster 0 pgmap v1430: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:00.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:33:59 smithi049 bash[21434]: cluster 2024-03-11T22:33:58.764048+0000 mgr.y (mgr.14601) 962 : cluster 0 pgmap v1430: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:01.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:00 smithi187 bash[23415]: audit 2024-03-11T22:33:59.749840+0000 mgr.y (mgr.14601) 963 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:01.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:00 smithi049 bash[28804]: audit 2024-03-11T22:33:59.749840+0000 mgr.y (mgr.14601) 963 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:01.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:00 smithi049 bash[21434]: audit 2024-03-11T22:33:59.749840+0000 mgr.y (mgr.14601) 963 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:02.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:01 smithi187 bash[23415]: cluster 2024-03-11T22:34:00.764888+0000 mgr.y (mgr.14601) 964 : cluster 0 pgmap v1431: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:02.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:01 smithi049 bash[21434]: cluster 2024-03-11T22:34:00.764888+0000 mgr.y (mgr.14601) 964 : cluster 0 pgmap v1431: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:02.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:01 smithi049 bash[28804]: cluster 2024-03-11T22:34:00.764888+0000 mgr.y (mgr.14601) 964 : cluster 0 pgmap v1431: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:04.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:03 smithi049 bash[28804]: cluster 2024-03-11T22:34:02.765729+0000 mgr.y (mgr.14601) 965 : cluster 0 pgmap v1432: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:04.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:03 smithi049 bash[21434]: cluster 2024-03-11T22:34:02.765729+0000 mgr.y (mgr.14601) 965 : cluster 0 pgmap v1432: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:04.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:03 smithi187 bash[23415]: cluster 2024-03-11T22:34:02.765729+0000 mgr.y (mgr.14601) 965 : cluster 0 pgmap v1432: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:04.534 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:34:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:34:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:34:06.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:05 smithi187 bash[23415]: cluster 2024-03-11T22:34:04.767957+0000 mgr.y (mgr.14601) 966 : cluster 0 pgmap v1433: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:06.284 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:05 smithi049 bash[21434]: cluster 2024-03-11T22:34:04.767957+0000 mgr.y (mgr.14601) 966 : cluster 0 pgmap v1433: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:06.284 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:05 smithi049 bash[28804]: cluster 2024-03-11T22:34:04.767957+0000 mgr.y (mgr.14601) 966 : cluster 0 pgmap v1433: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:08.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:08 smithi187 bash[23415]: cluster 2024-03-11T22:34:06.768792+0000 mgr.y (mgr.14601) 967 : cluster 0 pgmap v1434: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:08.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:08 smithi049 bash[28804]: cluster 2024-03-11T22:34:06.768792+0000 mgr.y (mgr.14601) 967 : cluster 0 pgmap v1434: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:08.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:08 smithi049 bash[21434]: cluster 2024-03-11T22:34:06.768792+0000 mgr.y (mgr.14601) 967 : cluster 0 pgmap v1434: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:10.171 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:34:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:34:10.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:10 smithi187 bash[23415]: cluster 2024-03-11T22:34:08.770990+0000 mgr.y (mgr.14601) 968 : cluster 0 pgmap v1435: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:10.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:10 smithi049 bash[21434]: cluster 2024-03-11T22:34:08.770990+0000 mgr.y (mgr.14601) 968 : cluster 0 pgmap v1435: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:10.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:10 smithi049 bash[28804]: cluster 2024-03-11T22:34:08.770990+0000 mgr.y (mgr.14601) 968 : cluster 0 pgmap v1435: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:11.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:11 smithi187 bash[23415]: audit 2024-03-11T22:34:09.758534+0000 mgr.y (mgr.14601) 969 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:11.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:11 smithi049 bash[21434]: audit 2024-03-11T22:34:09.758534+0000 mgr.y (mgr.14601) 969 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:11.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:11 smithi049 bash[28804]: audit 2024-03-11T22:34:09.758534+0000 mgr.y (mgr.14601) 969 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:12.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:12 smithi187 bash[23415]: cluster 2024-03-11T22:34:10.771790+0000 mgr.y (mgr.14601) 970 : cluster 0 pgmap v1436: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:12.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:12 smithi049 bash[21434]: cluster 2024-03-11T22:34:10.771790+0000 mgr.y (mgr.14601) 970 : cluster 0 pgmap v1436: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:12.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:12 smithi049 bash[28804]: cluster 2024-03-11T22:34:10.771790+0000 mgr.y (mgr.14601) 970 : cluster 0 pgmap v1436: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:13.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:13 smithi187 bash[23415]: audit 2024-03-11T22:34:13.169675+0000 mon.c (mon.2) 715 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:13.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:13 smithi049 bash[21434]: audit 2024-03-11T22:34:13.169675+0000 mon.c (mon.2) 715 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:13.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:13 smithi049 bash[28804]: audit 2024-03-11T22:34:13.169675+0000 mon.c (mon.2) 715 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:14.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:14 smithi187 bash[23415]: cluster 2024-03-11T22:34:12.772593+0000 mgr.y (mgr.14601) 971 : cluster 0 pgmap v1437: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:14.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:14 smithi049 bash[21434]: cluster 2024-03-11T22:34:12.772593+0000 mgr.y (mgr.14601) 971 : cluster 0 pgmap v1437: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:14.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:34:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:34:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:34:14.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:14 smithi049 bash[28804]: cluster 2024-03-11T22:34:12.772593+0000 mgr.y (mgr.14601) 971 : cluster 0 pgmap v1437: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:16.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:16 smithi187 bash[23415]: cluster 2024-03-11T22:34:14.774848+0000 mgr.y (mgr.14601) 972 : cluster 0 pgmap v1438: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:16.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:16 smithi049 bash[21434]: cluster 2024-03-11T22:34:14.774848+0000 mgr.y (mgr.14601) 972 : cluster 0 pgmap v1438: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:16.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:16 smithi049 bash[28804]: cluster 2024-03-11T22:34:14.774848+0000 mgr.y (mgr.14601) 972 : cluster 0 pgmap v1438: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:18.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:18 smithi187 bash[23415]: cluster 2024-03-11T22:34:16.775692+0000 mgr.y (mgr.14601) 973 : cluster 0 pgmap v1439: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:18.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:18 smithi049 bash[21434]: cluster 2024-03-11T22:34:16.775692+0000 mgr.y (mgr.14601) 973 : cluster 0 pgmap v1439: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:18.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:18 smithi049 bash[28804]: cluster 2024-03-11T22:34:16.775692+0000 mgr.y (mgr.14601) 973 : cluster 0 pgmap v1439: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:20.205 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:34:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:34:20.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:20 smithi187 bash[23415]: cluster 2024-03-11T22:34:18.777812+0000 mgr.y (mgr.14601) 974 : cluster 0 pgmap v1440: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:20.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:20 smithi049 bash[21434]: cluster 2024-03-11T22:34:18.777812+0000 mgr.y (mgr.14601) 974 : cluster 0 pgmap v1440: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:20.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:20 smithi049 bash[28804]: cluster 2024-03-11T22:34:18.777812+0000 mgr.y (mgr.14601) 974 : cluster 0 pgmap v1440: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:21.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:21 smithi187 bash[23415]: audit 2024-03-11T22:34:19.760798+0000 mgr.y (mgr.14601) 975 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:21.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:21 smithi049 bash[21434]: audit 2024-03-11T22:34:19.760798+0000 mgr.y (mgr.14601) 975 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:21.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:21 smithi049 bash[28804]: audit 2024-03-11T22:34:19.760798+0000 mgr.y (mgr.14601) 975 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:22.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:22 smithi187 bash[23415]: cluster 2024-03-11T22:34:20.778548+0000 mgr.y (mgr.14601) 976 : cluster 0 pgmap v1441: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:22.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:22 smithi049 bash[28804]: cluster 2024-03-11T22:34:20.778548+0000 mgr.y (mgr.14601) 976 : cluster 0 pgmap v1441: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:22.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:22 smithi049 bash[21434]: cluster 2024-03-11T22:34:20.778548+0000 mgr.y (mgr.14601) 976 : cluster 0 pgmap v1441: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:24.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:24 smithi187 bash[23415]: cluster 2024-03-11T22:34:22.779471+0000 mgr.y (mgr.14601) 977 : cluster 0 pgmap v1442: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:24.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:24 smithi049 bash[21434]: cluster 2024-03-11T22:34:22.779471+0000 mgr.y (mgr.14601) 977 : cluster 0 pgmap v1442: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:24.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:34:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:34:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:34:24.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:24 smithi049 bash[28804]: cluster 2024-03-11T22:34:22.779471+0000 mgr.y (mgr.14601) 977 : cluster 0 pgmap v1442: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:26.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:26 smithi187 bash[23415]: cluster 2024-03-11T22:34:24.781773+0000 mgr.y (mgr.14601) 978 : cluster 0 pgmap v1443: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:26.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:26 smithi049 bash[28804]: cluster 2024-03-11T22:34:24.781773+0000 mgr.y (mgr.14601) 978 : cluster 0 pgmap v1443: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:26.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:26 smithi049 bash[21434]: cluster 2024-03-11T22:34:24.781773+0000 mgr.y (mgr.14601) 978 : cluster 0 pgmap v1443: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:28.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:28 smithi187 bash[23415]: cluster 2024-03-11T22:34:26.782571+0000 mgr.y (mgr.14601) 979 : cluster 0 pgmap v1444: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:28.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:28 smithi187 bash[23415]: audit 2024-03-11T22:34:28.204476+0000 mon.c (mon.2) 716 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:28.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:28 smithi049 bash[28804]: cluster 2024-03-11T22:34:26.782571+0000 mgr.y (mgr.14601) 979 : cluster 0 pgmap v1444: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:28.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:28 smithi049 bash[28804]: audit 2024-03-11T22:34:28.204476+0000 mon.c (mon.2) 716 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:28.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:28 smithi049 bash[21434]: cluster 2024-03-11T22:34:26.782571+0000 mgr.y (mgr.14601) 979 : cluster 0 pgmap v1444: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:28.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:28 smithi049 bash[21434]: audit 2024-03-11T22:34:28.204476+0000 mon.c (mon.2) 716 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:30.232 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:34:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:34:30.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:30 smithi187 bash[23415]: cluster 2024-03-11T22:34:28.784724+0000 mgr.y (mgr.14601) 980 : cluster 0 pgmap v1445: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:30.534 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:30 smithi049 bash[28804]: cluster 2024-03-11T22:34:28.784724+0000 mgr.y (mgr.14601) 980 : cluster 0 pgmap v1445: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:30.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:30 smithi049 bash[21434]: cluster 2024-03-11T22:34:28.784724+0000 mgr.y (mgr.14601) 980 : cluster 0 pgmap v1445: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:31.501 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:31 smithi187 bash[23415]: audit 2024-03-11T22:34:29.769497+0000 mgr.y (mgr.14601) 981 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:31.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:31 smithi049 bash[21434]: audit 2024-03-11T22:34:29.769497+0000 mgr.y (mgr.14601) 981 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:31.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:31 smithi049 bash[28804]: audit 2024-03-11T22:34:29.769497+0000 mgr.y (mgr.14601) 981 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:32.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:32 smithi187 bash[23415]: cluster 2024-03-11T22:34:30.785591+0000 mgr.y (mgr.14601) 982 : cluster 0 pgmap v1446: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:32.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:32 smithi049 bash[21434]: cluster 2024-03-11T22:34:30.785591+0000 mgr.y (mgr.14601) 982 : cluster 0 pgmap v1446: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:32.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:32 smithi049 bash[28804]: cluster 2024-03-11T22:34:30.785591+0000 mgr.y (mgr.14601) 982 : cluster 0 pgmap v1446: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:34.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:34 smithi187 bash[23415]: cluster 2024-03-11T22:34:32.786365+0000 mgr.y (mgr.14601) 983 : cluster 0 pgmap v1447: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:34.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:34 smithi049 bash[21434]: cluster 2024-03-11T22:34:32.786365+0000 mgr.y (mgr.14601) 983 : cluster 0 pgmap v1447: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:34.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:34:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:34:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:34:34.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:34 smithi049 bash[28804]: cluster 2024-03-11T22:34:32.786365+0000 mgr.y (mgr.14601) 983 : cluster 0 pgmap v1447: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:35.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:35 smithi049 bash[21434]: audit 2024-03-11T22:34:35.031591+0000 mon.c (mon.2) 717 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:34:35.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:35 smithi049 bash[28804]: audit 2024-03-11T22:34:35.031591+0000 mon.c (mon.2) 717 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:34:35.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:35 smithi187 bash[23415]: audit 2024-03-11T22:34:35.031591+0000 mon.c (mon.2) 717 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:34:36.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:36 smithi049 bash[28804]: cluster 2024-03-11T22:34:34.788624+0000 mgr.y (mgr.14601) 984 : cluster 0 pgmap v1448: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:36.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:36 smithi049 bash[21434]: cluster 2024-03-11T22:34:34.788624+0000 mgr.y (mgr.14601) 984 : cluster 0 pgmap v1448: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:36.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:36 smithi187 bash[23415]: cluster 2024-03-11T22:34:34.788624+0000 mgr.y (mgr.14601) 984 : cluster 0 pgmap v1448: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:38.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:38 smithi049 bash[21434]: cluster 2024-03-11T22:34:36.789429+0000 mgr.y (mgr.14601) 985 : cluster 0 pgmap v1449: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:38.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:38 smithi049 bash[28804]: cluster 2024-03-11T22:34:36.789429+0000 mgr.y (mgr.14601) 985 : cluster 0 pgmap v1449: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:38.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:38 smithi187 bash[23415]: cluster 2024-03-11T22:34:36.789429+0000 mgr.y (mgr.14601) 985 : cluster 0 pgmap v1449: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:40.251 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:34:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:34:40.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:40 smithi049 bash[21434]: cluster 2024-03-11T22:34:38.790946+0000 mgr.y (mgr.14601) 986 : cluster 0 pgmap v1450: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:40.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:40 smithi049 bash[28804]: cluster 2024-03-11T22:34:38.790946+0000 mgr.y (mgr.14601) 986 : cluster 0 pgmap v1450: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:40.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:40 smithi187 bash[23415]: cluster 2024-03-11T22:34:38.790946+0000 mgr.y (mgr.14601) 986 : cluster 0 pgmap v1450: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:41.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:41 smithi049 bash[21434]: audit 2024-03-11T22:34:39.780775+0000 mgr.y (mgr.14601) 987 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:41.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:41 smithi049 bash[28804]: audit 2024-03-11T22:34:39.780775+0000 mgr.y (mgr.14601) 987 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:41.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:41 smithi187 bash[23415]: audit 2024-03-11T22:34:39.780775+0000 mgr.y (mgr.14601) 987 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:42.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:42 smithi049 bash[21434]: cluster 2024-03-11T22:34:40.791469+0000 mgr.y (mgr.14601) 988 : cluster 0 pgmap v1451: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:42.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:42 smithi049 bash[28804]: cluster 2024-03-11T22:34:40.791469+0000 mgr.y (mgr.14601) 988 : cluster 0 pgmap v1451: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:42.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:42 smithi187 bash[23415]: cluster 2024-03-11T22:34:40.791469+0000 mgr.y (mgr.14601) 988 : cluster 0 pgmap v1451: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:43.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:43 smithi049 bash[28804]: audit 2024-03-11T22:34:43.240526+0000 mon.c (mon.2) 718 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:43.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:43 smithi049 bash[21434]: audit 2024-03-11T22:34:43.240526+0000 mon.c (mon.2) 718 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:43.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:43 smithi187 bash[23415]: audit 2024-03-11T22:34:43.240526+0000 mon.c (mon.2) 718 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:44.534 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:44 smithi049 bash[21434]: cluster 2024-03-11T22:34:42.792282+0000 mgr.y (mgr.14601) 989 : cluster 0 pgmap v1452: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:44.535 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:44 smithi049 bash[28804]: cluster 2024-03-11T22:34:42.792282+0000 mgr.y (mgr.14601) 989 : cluster 0 pgmap v1452: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:44.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:34:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:34:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:34:44.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:44 smithi187 bash[23415]: cluster 2024-03-11T22:34:42.792282+0000 mgr.y (mgr.14601) 989 : cluster 0 pgmap v1452: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:45.751 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:45 smithi187 bash[23415]: cluster 2024-03-11T22:34:44.793493+0000 mgr.y (mgr.14601) 990 : cluster 0 pgmap v1453: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:45.784 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:45 smithi049 bash[28804]: cluster 2024-03-11T22:34:44.793493+0000 mgr.y (mgr.14601) 990 : cluster 0 pgmap v1453: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:45.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:45 smithi049 bash[21434]: cluster 2024-03-11T22:34:44.793493+0000 mgr.y (mgr.14601) 990 : cluster 0 pgmap v1453: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:46.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[21434]: audit 2024-03-11T22:34:45.517762+0000 mon.a (mon.0) 3468 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:46.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[21434]: audit 2024-03-11T22:34:45.533014+0000 mon.a (mon.0) 3469 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:46.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[21434]: audit 2024-03-11T22:34:45.536929+0000 mon.c (mon.2) 719 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:34:46.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[21434]: audit 2024-03-11T22:34:45.538614+0000 mon.c (mon.2) 720 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:34:46.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[21434]: audit 2024-03-11T22:34:45.548905+0000 mon.a (mon.0) 3470 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:46.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[28804]: audit 2024-03-11T22:34:45.517762+0000 mon.a (mon.0) 3468 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:46.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[28804]: audit 2024-03-11T22:34:45.533014+0000 mon.a (mon.0) 3469 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:46.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[28804]: audit 2024-03-11T22:34:45.536929+0000 mon.c (mon.2) 719 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:34:46.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[28804]: audit 2024-03-11T22:34:45.538614+0000 mon.c (mon.2) 720 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:34:46.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:46 smithi049 bash[28804]: audit 2024-03-11T22:34:45.548905+0000 mon.a (mon.0) 3470 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:47.002 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:46 smithi187 bash[23415]: audit 2024-03-11T22:34:45.517762+0000 mon.a (mon.0) 3468 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:47.002 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:46 smithi187 bash[23415]: audit 2024-03-11T22:34:45.533014+0000 mon.a (mon.0) 3469 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:47.002 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:46 smithi187 bash[23415]: audit 2024-03-11T22:34:45.536929+0000 mon.c (mon.2) 719 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:34:47.002 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:46 smithi187 bash[23415]: audit 2024-03-11T22:34:45.538614+0000 mon.c (mon.2) 720 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:34:47.002 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:46 smithi187 bash[23415]: audit 2024-03-11T22:34:45.548905+0000 mon.a (mon.0) 3470 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:34:47.785 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:47 smithi049 bash[28804]: cluster 2024-03-11T22:34:46.794355+0000 mgr.y (mgr.14601) 991 : cluster 0 pgmap v1454: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:47.785 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:47 smithi049 bash[21434]: cluster 2024-03-11T22:34:46.794355+0000 mgr.y (mgr.14601) 991 : cluster 0 pgmap v1454: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:48.002 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:47 smithi187 bash[23415]: cluster 2024-03-11T22:34:46.794355+0000 mgr.y (mgr.14601) 991 : cluster 0 pgmap v1454: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:50.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:49 smithi187 bash[23415]: cluster 2024-03-11T22:34:48.796540+0000 mgr.y (mgr.14601) 992 : cluster 0 pgmap v1455: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:50.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:34:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:34:50.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:49 smithi049 bash[21434]: cluster 2024-03-11T22:34:48.796540+0000 mgr.y (mgr.14601) 992 : cluster 0 pgmap v1455: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:50.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:49 smithi049 bash[28804]: cluster 2024-03-11T22:34:48.796540+0000 mgr.y (mgr.14601) 992 : cluster 0 pgmap v1455: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:51.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:50 smithi187 bash[23415]: audit 2024-03-11T22:34:49.792006+0000 mgr.y (mgr.14601) 993 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:51.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:50 smithi049 bash[21434]: audit 2024-03-11T22:34:49.792006+0000 mgr.y (mgr.14601) 993 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:51.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:50 smithi049 bash[28804]: audit 2024-03-11T22:34:49.792006+0000 mgr.y (mgr.14601) 993 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:34:52.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:51 smithi187 bash[23415]: cluster 2024-03-11T22:34:50.797504+0000 mgr.y (mgr.14601) 994 : cluster 0 pgmap v1456: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:52.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:51 smithi049 bash[21434]: cluster 2024-03-11T22:34:50.797504+0000 mgr.y (mgr.14601) 994 : cluster 0 pgmap v1456: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:52.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:51 smithi049 bash[28804]: cluster 2024-03-11T22:34:50.797504+0000 mgr.y (mgr.14601) 994 : cluster 0 pgmap v1456: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:54.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:53 smithi049 bash[21434]: cluster 2024-03-11T22:34:52.798481+0000 mgr.y (mgr.14601) 995 : cluster 0 pgmap v1457: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:54.235 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:53 smithi049 bash[28804]: cluster 2024-03-11T22:34:52.798481+0000 mgr.y (mgr.14601) 995 : cluster 0 pgmap v1457: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:54.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:53 smithi187 bash[23415]: cluster 2024-03-11T22:34:52.798481+0000 mgr.y (mgr.14601) 995 : cluster 0 pgmap v1457: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:54.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:34:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:34:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:34:56.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:55 smithi187 bash[23415]: cluster 2024-03-11T22:34:54.800897+0000 mgr.y (mgr.14601) 996 : cluster 0 pgmap v1458: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:56.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:55 smithi049 bash[21434]: cluster 2024-03-11T22:34:54.800897+0000 mgr.y (mgr.14601) 996 : cluster 0 pgmap v1458: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:56.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:55 smithi049 bash[28804]: cluster 2024-03-11T22:34:54.800897+0000 mgr.y (mgr.14601) 996 : cluster 0 pgmap v1458: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:34:58.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:57 smithi187 bash[23415]: cluster 2024-03-11T22:34:56.801779+0000 mgr.y (mgr.14601) 997 : cluster 0 pgmap v1459: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:58.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:57 smithi049 bash[21434]: cluster 2024-03-11T22:34:56.801779+0000 mgr.y (mgr.14601) 997 : cluster 0 pgmap v1459: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:58.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:57 smithi049 bash[28804]: cluster 2024-03-11T22:34:56.801779+0000 mgr.y (mgr.14601) 997 : cluster 0 pgmap v1459: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:34:59.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:58 smithi187 bash[23415]: audit 2024-03-11T22:34:58.276023+0000 mon.c (mon.2) 721 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:59.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:58 smithi049 bash[21434]: audit 2024-03-11T22:34:58.276023+0000 mon.c (mon.2) 721 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:34:59.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:58 smithi049 bash[28804]: audit 2024-03-11T22:34:58.276023+0000 mon.c (mon.2) 721 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:00.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:34:59 smithi187 bash[23415]: cluster 2024-03-11T22:34:58.803916+0000 mgr.y (mgr.14601) 998 : cluster 0 pgmap v1460: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:00.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:34:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:35:00.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:34:59 smithi049 bash[21434]: cluster 2024-03-11T22:34:58.803916+0000 mgr.y (mgr.14601) 998 : cluster 0 pgmap v1460: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:00.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:34:59 smithi049 bash[28804]: cluster 2024-03-11T22:34:58.803916+0000 mgr.y (mgr.14601) 998 : cluster 0 pgmap v1460: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:01.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:00 smithi187 bash[23415]: audit 2024-03-11T22:34:59.803228+0000 mgr.y (mgr.14601) 999 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:01.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:00 smithi049 bash[21434]: audit 2024-03-11T22:34:59.803228+0000 mgr.y (mgr.14601) 999 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:01.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:00 smithi049 bash[28804]: audit 2024-03-11T22:34:59.803228+0000 mgr.y (mgr.14601) 999 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:02.001 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:01 smithi187 bash[23415]: cluster 2024-03-11T22:35:00.804759+0000 mgr.y (mgr.14601) 1000 : cluster 0 pgmap v1461: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:02.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:01 smithi049 bash[21434]: cluster 2024-03-11T22:35:00.804759+0000 mgr.y (mgr.14601) 1000 : cluster 0 pgmap v1461: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:02.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:01 smithi049 bash[28804]: cluster 2024-03-11T22:35:00.804759+0000 mgr.y (mgr.14601) 1000 : cluster 0 pgmap v1461: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:04.234 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:03 smithi049 bash[28804]: cluster 2024-03-11T22:35:02.805546+0000 mgr.y (mgr.14601) 1001 : cluster 0 pgmap v1462: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:04.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:03 smithi049 bash[21434]: cluster 2024-03-11T22:35:02.805546+0000 mgr.y (mgr.14601) 1001 : cluster 0 pgmap v1462: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:04.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:03 smithi187 bash[23415]: cluster 2024-03-11T22:35:02.805546+0000 mgr.y (mgr.14601) 1001 : cluster 0 pgmap v1462: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:04.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:35:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:35:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:35:06.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:05 smithi187 bash[23415]: cluster 2024-03-11T22:35:04.807842+0000 mgr.y (mgr.14601) 1002 : cluster 0 pgmap v1463: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:06.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:05 smithi049 bash[21434]: cluster 2024-03-11T22:35:04.807842+0000 mgr.y (mgr.14601) 1002 : cluster 0 pgmap v1463: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:06.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:05 smithi049 bash[28804]: cluster 2024-03-11T22:35:04.807842+0000 mgr.y (mgr.14601) 1002 : cluster 0 pgmap v1463: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:08.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:07 smithi187 bash[23415]: cluster 2024-03-11T22:35:06.808706+0000 mgr.y (mgr.14601) 1003 : cluster 0 pgmap v1464: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:08.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:07 smithi049 bash[21434]: cluster 2024-03-11T22:35:06.808706+0000 mgr.y (mgr.14601) 1003 : cluster 0 pgmap v1464: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:08.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:07 smithi049 bash[28804]: cluster 2024-03-11T22:35:06.808706+0000 mgr.y (mgr.14601) 1003 : cluster 0 pgmap v1464: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:10.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:09 smithi187 bash[23415]: cluster 2024-03-11T22:35:08.810929+0000 mgr.y (mgr.14601) 1004 : cluster 0 pgmap v1465: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:10.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:35:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:35:10.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:09 smithi049 bash[21434]: cluster 2024-03-11T22:35:08.810929+0000 mgr.y (mgr.14601) 1004 : cluster 0 pgmap v1465: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:10.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:09 smithi049 bash[28804]: cluster 2024-03-11T22:35:08.810929+0000 mgr.y (mgr.14601) 1004 : cluster 0 pgmap v1465: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:11.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:10 smithi187 bash[23415]: audit 2024-03-11T22:35:09.814015+0000 mgr.y (mgr.14601) 1005 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:11.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:10 smithi049 bash[21434]: audit 2024-03-11T22:35:09.814015+0000 mgr.y (mgr.14601) 1005 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:11.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:10 smithi049 bash[28804]: audit 2024-03-11T22:35:09.814015+0000 mgr.y (mgr.14601) 1005 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:12.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:11 smithi187 bash[23415]: cluster 2024-03-11T22:35:10.811831+0000 mgr.y (mgr.14601) 1006 : cluster 0 pgmap v1466: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:12.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:11 smithi049 bash[21434]: cluster 2024-03-11T22:35:10.811831+0000 mgr.y (mgr.14601) 1006 : cluster 0 pgmap v1466: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:12.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:11 smithi049 bash[28804]: cluster 2024-03-11T22:35:10.811831+0000 mgr.y (mgr.14601) 1006 : cluster 0 pgmap v1466: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:14.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:13 smithi049 bash[21434]: cluster 2024-03-11T22:35:12.812652+0000 mgr.y (mgr.14601) 1007 : cluster 0 pgmap v1467: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:14.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:13 smithi049 bash[21434]: audit 2024-03-11T22:35:13.310968+0000 mon.c (mon.2) 722 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:14.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:13 smithi049 bash[28804]: cluster 2024-03-11T22:35:12.812652+0000 mgr.y (mgr.14601) 1007 : cluster 0 pgmap v1467: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:14.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:13 smithi049 bash[28804]: audit 2024-03-11T22:35:13.310968+0000 mon.c (mon.2) 722 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:14.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:13 smithi187 bash[23415]: cluster 2024-03-11T22:35:12.812652+0000 mgr.y (mgr.14601) 1007 : cluster 0 pgmap v1467: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:14.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:13 smithi187 bash[23415]: audit 2024-03-11T22:35:13.310968+0000 mon.c (mon.2) 722 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:14.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:35:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:35:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:35:16.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:15 smithi187 bash[23415]: cluster 2024-03-11T22:35:14.814906+0000 mgr.y (mgr.14601) 1008 : cluster 0 pgmap v1468: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:16.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:15 smithi049 bash[21434]: cluster 2024-03-11T22:35:14.814906+0000 mgr.y (mgr.14601) 1008 : cluster 0 pgmap v1468: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:16.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:15 smithi049 bash[28804]: cluster 2024-03-11T22:35:14.814906+0000 mgr.y (mgr.14601) 1008 : cluster 0 pgmap v1468: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:18.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:17 smithi187 bash[23415]: cluster 2024-03-11T22:35:16.815788+0000 mgr.y (mgr.14601) 1009 : cluster 0 pgmap v1469: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:18.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:17 smithi049 bash[21434]: cluster 2024-03-11T22:35:16.815788+0000 mgr.y (mgr.14601) 1009 : cluster 0 pgmap v1469: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:18.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:17 smithi049 bash[28804]: cluster 2024-03-11T22:35:16.815788+0000 mgr.y (mgr.14601) 1009 : cluster 0 pgmap v1469: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:20.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:19 smithi187 bash[23415]: cluster 2024-03-11T22:35:18.818024+0000 mgr.y (mgr.14601) 1010 : cluster 0 pgmap v1470: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:20.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:35:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:35:20.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:19 smithi049 bash[21434]: cluster 2024-03-11T22:35:18.818024+0000 mgr.y (mgr.14601) 1010 : cluster 0 pgmap v1470: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:20.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:19 smithi049 bash[28804]: cluster 2024-03-11T22:35:18.818024+0000 mgr.y (mgr.14601) 1010 : cluster 0 pgmap v1470: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:21.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:20 smithi187 bash[23415]: audit 2024-03-11T22:35:19.821902+0000 mgr.y (mgr.14601) 1011 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:21.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:20 smithi049 bash[21434]: audit 2024-03-11T22:35:19.821902+0000 mgr.y (mgr.14601) 1011 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:21.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:20 smithi049 bash[28804]: audit 2024-03-11T22:35:19.821902+0000 mgr.y (mgr.14601) 1011 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:22.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:21 smithi187 bash[23415]: cluster 2024-03-11T22:35:20.818877+0000 mgr.y (mgr.14601) 1012 : cluster 0 pgmap v1471: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:22.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:21 smithi049 bash[21434]: cluster 2024-03-11T22:35:20.818877+0000 mgr.y (mgr.14601) 1012 : cluster 0 pgmap v1471: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:22.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:21 smithi049 bash[28804]: cluster 2024-03-11T22:35:20.818877+0000 mgr.y (mgr.14601) 1012 : cluster 0 pgmap v1471: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:24.233 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:23 smithi049 bash[28804]: cluster 2024-03-11T22:35:22.819713+0000 mgr.y (mgr.14601) 1013 : cluster 0 pgmap v1472: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:24.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:23 smithi049 bash[21434]: cluster 2024-03-11T22:35:22.819713+0000 mgr.y (mgr.14601) 1013 : cluster 0 pgmap v1472: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:24.251 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:23 smithi187 bash[23415]: cluster 2024-03-11T22:35:22.819713+0000 mgr.y (mgr.14601) 1013 : cluster 0 pgmap v1472: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-11T22:35:24.535 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:35:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:35:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:35:26.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:25 smithi187 bash[23415]: cluster 2024-03-11T22:35:24.821991+0000 mgr.y (mgr.14601) 1014 : cluster 0 pgmap v1473: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:26.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:25 smithi049 bash[21434]: cluster 2024-03-11T22:35:24.821991+0000 mgr.y (mgr.14601) 1014 : cluster 0 pgmap v1473: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:26.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:25 smithi049 bash[28804]: cluster 2024-03-11T22:35:24.821991+0000 mgr.y (mgr.14601) 1014 : cluster 0 pgmap v1473: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:28.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:27 smithi187 bash[23415]: cluster 2024-03-11T22:35:26.822835+0000 mgr.y (mgr.14601) 1015 : cluster 0 pgmap v1474: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:28.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:27 smithi049 bash[21434]: cluster 2024-03-11T22:35:26.822835+0000 mgr.y (mgr.14601) 1015 : cluster 0 pgmap v1474: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:28.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:27 smithi049 bash[28804]: cluster 2024-03-11T22:35:26.822835+0000 mgr.y (mgr.14601) 1015 : cluster 0 pgmap v1474: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:29.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:28 smithi187 bash[23415]: audit 2024-03-11T22:35:28.344438+0000 mon.c (mon.2) 723 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:29.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:28 smithi049 bash[21434]: audit 2024-03-11T22:35:28.344438+0000 mon.c (mon.2) 723 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:29.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:28 smithi049 bash[28804]: audit 2024-03-11T22:35:28.344438+0000 mon.c (mon.2) 723 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:30.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:29 smithi187 bash[23415]: cluster 2024-03-11T22:35:28.824896+0000 mgr.y (mgr.14601) 1016 : cluster 0 pgmap v1475: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:30.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:35:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:35:30.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:29 smithi049 bash[21434]: cluster 2024-03-11T22:35:28.824896+0000 mgr.y (mgr.14601) 1016 : cluster 0 pgmap v1475: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:30.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:29 smithi049 bash[28804]: cluster 2024-03-11T22:35:28.824896+0000 mgr.y (mgr.14601) 1016 : cluster 0 pgmap v1475: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:31.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:30 smithi187 bash[23415]: audit 2024-03-11T22:35:29.829897+0000 mgr.y (mgr.14601) 1017 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:31.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:30 smithi049 bash[21434]: audit 2024-03-11T22:35:29.829897+0000 mgr.y (mgr.14601) 1017 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:31.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:30 smithi049 bash[28804]: audit 2024-03-11T22:35:29.829897+0000 mgr.y (mgr.14601) 1017 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:32.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:31 smithi187 bash[23415]: cluster 2024-03-11T22:35:30.825743+0000 mgr.y (mgr.14601) 1018 : cluster 0 pgmap v1476: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:32.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:31 smithi049 bash[21434]: cluster 2024-03-11T22:35:30.825743+0000 mgr.y (mgr.14601) 1018 : cluster 0 pgmap v1476: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:32.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:31 smithi049 bash[28804]: cluster 2024-03-11T22:35:30.825743+0000 mgr.y (mgr.14601) 1018 : cluster 0 pgmap v1476: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:34.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:33 smithi187 bash[23415]: cluster 2024-03-11T22:35:32.826519+0000 mgr.y (mgr.14601) 1019 : cluster 0 pgmap v1477: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:34.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:33 smithi049 bash[21434]: cluster 2024-03-11T22:35:32.826519+0000 mgr.y (mgr.14601) 1019 : cluster 0 pgmap v1477: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:34.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:33 smithi049 bash[28804]: cluster 2024-03-11T22:35:32.826519+0000 mgr.y (mgr.14601) 1019 : cluster 0 pgmap v1477: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:34.286 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:35:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:35:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:35:36.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:35 smithi187 bash[23415]: cluster 2024-03-11T22:35:34.828799+0000 mgr.y (mgr.14601) 1020 : cluster 0 pgmap v1478: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:36.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:35 smithi049 bash[21434]: cluster 2024-03-11T22:35:34.828799+0000 mgr.y (mgr.14601) 1020 : cluster 0 pgmap v1478: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:36.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:35 smithi049 bash[28804]: cluster 2024-03-11T22:35:34.828799+0000 mgr.y (mgr.14601) 1020 : cluster 0 pgmap v1478: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:38.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:37 smithi049 bash[21434]: cluster 2024-03-11T22:35:36.829761+0000 mgr.y (mgr.14601) 1021 : cluster 0 pgmap v1479: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:38.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:37 smithi049 bash[28804]: cluster 2024-03-11T22:35:36.829761+0000 mgr.y (mgr.14601) 1021 : cluster 0 pgmap v1479: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:38.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:37 smithi187 bash[23415]: cluster 2024-03-11T22:35:36.829761+0000 mgr.y (mgr.14601) 1021 : cluster 0 pgmap v1479: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:40.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:40 smithi187 bash[23415]: cluster 2024-03-11T22:35:38.831906+0000 mgr.y (mgr.14601) 1022 : cluster 0 pgmap v1480: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:40.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:35:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:35:40.285 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:40 smithi049 bash[28804]: cluster 2024-03-11T22:35:38.831906+0000 mgr.y (mgr.14601) 1022 : cluster 0 pgmap v1480: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:40.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:40 smithi049 bash[21434]: cluster 2024-03-11T22:35:38.831906+0000 mgr.y (mgr.14601) 1022 : cluster 0 pgmap v1480: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:41.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:41 smithi049 bash[21434]: audit 2024-03-11T22:35:39.833568+0000 mgr.y (mgr.14601) 1023 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:41.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:41 smithi049 bash[28804]: audit 2024-03-11T22:35:39.833568+0000 mgr.y (mgr.14601) 1023 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:41.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:41 smithi187 bash[23415]: audit 2024-03-11T22:35:39.833568+0000 mgr.y (mgr.14601) 1023 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:42.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:42 smithi049 bash[21434]: cluster 2024-03-11T22:35:40.832742+0000 mgr.y (mgr.14601) 1024 : cluster 0 pgmap v1481: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:42.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:42 smithi049 bash[28804]: cluster 2024-03-11T22:35:40.832742+0000 mgr.y (mgr.14601) 1024 : cluster 0 pgmap v1481: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:42.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:42 smithi187 bash[23415]: cluster 2024-03-11T22:35:40.832742+0000 mgr.y (mgr.14601) 1024 : cluster 0 pgmap v1481: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:44.286 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:35:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:35:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:35:44.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:44 smithi049 bash[21434]: cluster 2024-03-11T22:35:42.833622+0000 mgr.y (mgr.14601) 1025 : cluster 0 pgmap v1482: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:44.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:44 smithi049 bash[21434]: audit 2024-03-11T22:35:43.382207+0000 mon.c (mon.2) 724 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:44.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:44 smithi049 bash[28804]: cluster 2024-03-11T22:35:42.833622+0000 mgr.y (mgr.14601) 1025 : cluster 0 pgmap v1482: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:44.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:44 smithi049 bash[28804]: audit 2024-03-11T22:35:43.382207+0000 mon.c (mon.2) 724 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:44.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:44 smithi187 bash[23415]: cluster 2024-03-11T22:35:42.833622+0000 mgr.y (mgr.14601) 1025 : cluster 0 pgmap v1482: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:44.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:44 smithi187 bash[23415]: audit 2024-03-11T22:35:43.382207+0000 mon.c (mon.2) 724 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:46.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:46 smithi049 bash[21434]: cluster 2024-03-11T22:35:44.835886+0000 mgr.y (mgr.14601) 1026 : cluster 0 pgmap v1483: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:46.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:46 smithi049 bash[21434]: audit 2024-03-11T22:35:45.643771+0000 mon.c (mon.2) 725 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:35:46.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:46 smithi049 bash[28804]: cluster 2024-03-11T22:35:44.835886+0000 mgr.y (mgr.14601) 1026 : cluster 0 pgmap v1483: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:46.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:46 smithi049 bash[28804]: audit 2024-03-11T22:35:45.643771+0000 mon.c (mon.2) 725 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:35:46.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:46 smithi187 bash[23415]: cluster 2024-03-11T22:35:44.835886+0000 mgr.y (mgr.14601) 1026 : cluster 0 pgmap v1483: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:46.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:46 smithi187 bash[23415]: audit 2024-03-11T22:35:45.643771+0000 mon.c (mon.2) 725 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:35:47.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:47 smithi049 bash[21434]: audit 2024-03-11T22:35:46.377854+0000 mon.c (mon.2) 726 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:35:47.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:47 smithi049 bash[21434]: audit 2024-03-11T22:35:46.379810+0000 mon.c (mon.2) 727 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:35:47.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:47 smithi049 bash[21434]: audit 2024-03-11T22:35:46.390631+0000 mon.a (mon.0) 3471 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:35:47.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:47 smithi049 bash[28804]: audit 2024-03-11T22:35:46.377854+0000 mon.c (mon.2) 726 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:35:47.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:47 smithi049 bash[28804]: audit 2024-03-11T22:35:46.379810+0000 mon.c (mon.2) 727 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:35:47.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:47 smithi049 bash[28804]: audit 2024-03-11T22:35:46.390631+0000 mon.a (mon.0) 3471 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:35:47.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:47 smithi187 bash[23415]: audit 2024-03-11T22:35:46.377854+0000 mon.c (mon.2) 726 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:35:47.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:47 smithi187 bash[23415]: audit 2024-03-11T22:35:46.379810+0000 mon.c (mon.2) 727 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:35:47.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:47 smithi187 bash[23415]: audit 2024-03-11T22:35:46.390631+0000 mon.a (mon.0) 3471 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:35:48.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:48 smithi049 bash[21434]: cluster 2024-03-11T22:35:46.836728+0000 mgr.y (mgr.14601) 1027 : cluster 0 pgmap v1484: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:48.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:48 smithi049 bash[28804]: cluster 2024-03-11T22:35:46.836728+0000 mgr.y (mgr.14601) 1027 : cluster 0 pgmap v1484: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:48.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:48 smithi187 bash[23415]: cluster 2024-03-11T22:35:46.836728+0000 mgr.y (mgr.14601) 1027 : cluster 0 pgmap v1484: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:50.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:50 smithi187 bash[23415]: cluster 2024-03-11T22:35:48.838926+0000 mgr.y (mgr.14601) 1028 : cluster 0 pgmap v1485: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:50.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:35:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:35:50.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:50 smithi049 bash[21434]: cluster 2024-03-11T22:35:48.838926+0000 mgr.y (mgr.14601) 1028 : cluster 0 pgmap v1485: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:50.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:50 smithi049 bash[28804]: cluster 2024-03-11T22:35:48.838926+0000 mgr.y (mgr.14601) 1028 : cluster 0 pgmap v1485: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:51.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:51 smithi187 bash[23415]: audit 2024-03-11T22:35:49.840437+0000 mgr.y (mgr.14601) 1029 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:51.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:51 smithi049 bash[21434]: audit 2024-03-11T22:35:49.840437+0000 mgr.y (mgr.14601) 1029 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:51.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:51 smithi049 bash[28804]: audit 2024-03-11T22:35:49.840437+0000 mgr.y (mgr.14601) 1029 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:35:52.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:52 smithi187 bash[23415]: cluster 2024-03-11T22:35:50.839747+0000 mgr.y (mgr.14601) 1030 : cluster 0 pgmap v1486: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:52.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:52 smithi049 bash[21434]: cluster 2024-03-11T22:35:50.839747+0000 mgr.y (mgr.14601) 1030 : cluster 0 pgmap v1486: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:52.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:52 smithi049 bash[28804]: cluster 2024-03-11T22:35:50.839747+0000 mgr.y (mgr.14601) 1030 : cluster 0 pgmap v1486: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:54.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:54 smithi187 bash[23415]: cluster 2024-03-11T22:35:52.840747+0000 mgr.y (mgr.14601) 1031 : cluster 0 pgmap v1487: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:54.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:35:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:35:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:35:54.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:54 smithi049 bash[28804]: cluster 2024-03-11T22:35:52.840747+0000 mgr.y (mgr.14601) 1031 : cluster 0 pgmap v1487: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:54 smithi049 bash[21434]: cluster 2024-03-11T22:35:52.840747+0000 mgr.y (mgr.14601) 1031 : cluster 0 pgmap v1487: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:56.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:56 smithi187 bash[23415]: cluster 2024-03-11T22:35:54.843177+0000 mgr.y (mgr.14601) 1032 : cluster 0 pgmap v1488: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:56.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:56 smithi049 bash[28804]: cluster 2024-03-11T22:35:54.843177+0000 mgr.y (mgr.14601) 1032 : cluster 0 pgmap v1488: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:56.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:56 smithi049 bash[21434]: cluster 2024-03-11T22:35:54.843177+0000 mgr.y (mgr.14601) 1032 : cluster 0 pgmap v1488: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:35:58.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:58 smithi187 bash[23415]: cluster 2024-03-11T22:35:56.844166+0000 mgr.y (mgr.14601) 1033 : cluster 0 pgmap v1489: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:58.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:58 smithi049 bash[21434]: cluster 2024-03-11T22:35:56.844166+0000 mgr.y (mgr.14601) 1033 : cluster 0 pgmap v1489: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:58.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:58 smithi049 bash[28804]: cluster 2024-03-11T22:35:56.844166+0000 mgr.y (mgr.14601) 1033 : cluster 0 pgmap v1489: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:35:59.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:35:59 smithi187 bash[23415]: audit 2024-03-11T22:35:58.416977+0000 mon.c (mon.2) 728 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:59.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:35:59 smithi049 bash[21434]: audit 2024-03-11T22:35:58.416977+0000 mon.c (mon.2) 728 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:35:59.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:35:59 smithi049 bash[28804]: audit 2024-03-11T22:35:58.416977+0000 mon.c (mon.2) 728 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:00.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:00 smithi187 bash[23415]: cluster 2024-03-11T22:35:58.846316+0000 mgr.y (mgr.14601) 1034 : cluster 0 pgmap v1490: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:00.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:35:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:36:00.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:00 smithi049 bash[21434]: cluster 2024-03-11T22:35:58.846316+0000 mgr.y (mgr.14601) 1034 : cluster 0 pgmap v1490: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:00.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:00 smithi049 bash[28804]: cluster 2024-03-11T22:35:58.846316+0000 mgr.y (mgr.14601) 1034 : cluster 0 pgmap v1490: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:01.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:01 smithi187 bash[23415]: audit 2024-03-11T22:35:59.851928+0000 mgr.y (mgr.14601) 1035 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:01.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:01 smithi049 bash[28804]: audit 2024-03-11T22:35:59.851928+0000 mgr.y (mgr.14601) 1035 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:01.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:01 smithi049 bash[21434]: audit 2024-03-11T22:35:59.851928+0000 mgr.y (mgr.14601) 1035 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:02.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:02 smithi187 bash[23415]: cluster 2024-03-11T22:36:00.847110+0000 mgr.y (mgr.14601) 1036 : cluster 0 pgmap v1491: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:02.535 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:02 smithi049 bash[21434]: cluster 2024-03-11T22:36:00.847110+0000 mgr.y (mgr.14601) 1036 : cluster 0 pgmap v1491: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:02.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:02 smithi049 bash[28804]: cluster 2024-03-11T22:36:00.847110+0000 mgr.y (mgr.14601) 1036 : cluster 0 pgmap v1491: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:04.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:04 smithi187 bash[23415]: cluster 2024-03-11T22:36:02.847922+0000 mgr.y (mgr.14601) 1037 : cluster 0 pgmap v1492: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:04 smithi049 bash[21434]: cluster 2024-03-11T22:36:02.847922+0000 mgr.y (mgr.14601) 1037 : cluster 0 pgmap v1492: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:04.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:36:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:36:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:36:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:04 smithi049 bash[28804]: cluster 2024-03-11T22:36:02.847922+0000 mgr.y (mgr.14601) 1037 : cluster 0 pgmap v1492: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:06.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:06 smithi187 bash[23415]: cluster 2024-03-11T22:36:04.850216+0000 mgr.y (mgr.14601) 1038 : cluster 0 pgmap v1493: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:06.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:06 smithi049 bash[21434]: cluster 2024-03-11T22:36:04.850216+0000 mgr.y (mgr.14601) 1038 : cluster 0 pgmap v1493: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:06.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:06 smithi049 bash[28804]: cluster 2024-03-11T22:36:04.850216+0000 mgr.y (mgr.14601) 1038 : cluster 0 pgmap v1493: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:08.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:08 smithi187 bash[23415]: cluster 2024-03-11T22:36:06.851056+0000 mgr.y (mgr.14601) 1039 : cluster 0 pgmap v1494: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:08.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:08 smithi049 bash[21434]: cluster 2024-03-11T22:36:06.851056+0000 mgr.y (mgr.14601) 1039 : cluster 0 pgmap v1494: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:08.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:08 smithi049 bash[28804]: cluster 2024-03-11T22:36:06.851056+0000 mgr.y (mgr.14601) 1039 : cluster 0 pgmap v1494: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:10.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:36:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:36:10.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:10 smithi187 bash[23415]: cluster 2024-03-11T22:36:08.853151+0000 mgr.y (mgr.14601) 1040 : cluster 0 pgmap v1495: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:10.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:10 smithi049 bash[28804]: cluster 2024-03-11T22:36:08.853151+0000 mgr.y (mgr.14601) 1040 : cluster 0 pgmap v1495: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:10.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:10 smithi049 bash[21434]: cluster 2024-03-11T22:36:08.853151+0000 mgr.y (mgr.14601) 1040 : cluster 0 pgmap v1495: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:11.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:11 smithi187 bash[23415]: audit 2024-03-11T22:36:09.863397+0000 mgr.y (mgr.14601) 1041 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:11.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:11 smithi049 bash[28804]: audit 2024-03-11T22:36:09.863397+0000 mgr.y (mgr.14601) 1041 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:11.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:11 smithi049 bash[21434]: audit 2024-03-11T22:36:09.863397+0000 mgr.y (mgr.14601) 1041 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:12.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:12 smithi187 bash[23415]: cluster 2024-03-11T22:36:10.854001+0000 mgr.y (mgr.14601) 1042 : cluster 0 pgmap v1496: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:12.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:12 smithi049 bash[21434]: cluster 2024-03-11T22:36:10.854001+0000 mgr.y (mgr.14601) 1042 : cluster 0 pgmap v1496: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:12.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:12 smithi049 bash[28804]: cluster 2024-03-11T22:36:10.854001+0000 mgr.y (mgr.14601) 1042 : cluster 0 pgmap v1496: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:14.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:14 smithi187 bash[23415]: cluster 2024-03-11T22:36:12.854835+0000 mgr.y (mgr.14601) 1043 : cluster 0 pgmap v1497: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:14.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:14 smithi187 bash[23415]: audit 2024-03-11T22:36:13.453555+0000 mon.c (mon.2) 729 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:14.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:36:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:36:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:36:14.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:14 smithi049 bash[21434]: cluster 2024-03-11T22:36:12.854835+0000 mgr.y (mgr.14601) 1043 : cluster 0 pgmap v1497: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:14.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:14 smithi049 bash[21434]: audit 2024-03-11T22:36:13.453555+0000 mon.c (mon.2) 729 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:14.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:14 smithi049 bash[28804]: cluster 2024-03-11T22:36:12.854835+0000 mgr.y (mgr.14601) 1043 : cluster 0 pgmap v1497: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:14.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:14 smithi049 bash[28804]: audit 2024-03-11T22:36:13.453555+0000 mon.c (mon.2) 729 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:16.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:16 smithi187 bash[23415]: cluster 2024-03-11T22:36:14.857140+0000 mgr.y (mgr.14601) 1044 : cluster 0 pgmap v1498: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:16.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:16 smithi049 bash[21434]: cluster 2024-03-11T22:36:14.857140+0000 mgr.y (mgr.14601) 1044 : cluster 0 pgmap v1498: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:16.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:16 smithi049 bash[28804]: cluster 2024-03-11T22:36:14.857140+0000 mgr.y (mgr.14601) 1044 : cluster 0 pgmap v1498: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:18.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:18 smithi187 bash[23415]: cluster 2024-03-11T22:36:16.857965+0000 mgr.y (mgr.14601) 1045 : cluster 0 pgmap v1499: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:18.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:18 smithi049 bash[21434]: cluster 2024-03-11T22:36:16.857965+0000 mgr.y (mgr.14601) 1045 : cluster 0 pgmap v1499: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:18.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:18 smithi049 bash[28804]: cluster 2024-03-11T22:36:16.857965+0000 mgr.y (mgr.14601) 1045 : cluster 0 pgmap v1499: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:20.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:36:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:36:20.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:20 smithi187 bash[23415]: cluster 2024-03-11T22:36:18.860116+0000 mgr.y (mgr.14601) 1046 : cluster 0 pgmap v1500: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:20.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:20 smithi049 bash[21434]: cluster 2024-03-11T22:36:18.860116+0000 mgr.y (mgr.14601) 1046 : cluster 0 pgmap v1500: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:20.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:20 smithi049 bash[28804]: cluster 2024-03-11T22:36:18.860116+0000 mgr.y (mgr.14601) 1046 : cluster 0 pgmap v1500: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:21.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:21 smithi187 bash[23415]: audit 2024-03-11T22:36:19.874853+0000 mgr.y (mgr.14601) 1047 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:21.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:21 smithi049 bash[21434]: audit 2024-03-11T22:36:19.874853+0000 mgr.y (mgr.14601) 1047 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:21.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:21 smithi049 bash[28804]: audit 2024-03-11T22:36:19.874853+0000 mgr.y (mgr.14601) 1047 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:22.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:22 smithi187 bash[23415]: cluster 2024-03-11T22:36:20.860854+0000 mgr.y (mgr.14601) 1048 : cluster 0 pgmap v1501: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:22.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:22 smithi049 bash[21434]: cluster 2024-03-11T22:36:20.860854+0000 mgr.y (mgr.14601) 1048 : cluster 0 pgmap v1501: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:22.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:22 smithi049 bash[28804]: cluster 2024-03-11T22:36:20.860854+0000 mgr.y (mgr.14601) 1048 : cluster 0 pgmap v1501: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:24.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:24 smithi187 bash[23415]: cluster 2024-03-11T22:36:22.861729+0000 mgr.y (mgr.14601) 1049 : cluster 0 pgmap v1502: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:24 smithi049 bash[21434]: cluster 2024-03-11T22:36:22.861729+0000 mgr.y (mgr.14601) 1049 : cluster 0 pgmap v1502: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:24.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:24 smithi049 bash[28804]: cluster 2024-03-11T22:36:22.861729+0000 mgr.y (mgr.14601) 1049 : cluster 0 pgmap v1502: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:24.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:36:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:36:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:36:26.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:26 smithi187 bash[23415]: cluster 2024-03-11T22:36:24.863998+0000 mgr.y (mgr.14601) 1050 : cluster 0 pgmap v1503: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:26.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:26 smithi049 bash[21434]: cluster 2024-03-11T22:36:24.863998+0000 mgr.y (mgr.14601) 1050 : cluster 0 pgmap v1503: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:26.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:26 smithi049 bash[28804]: cluster 2024-03-11T22:36:24.863998+0000 mgr.y (mgr.14601) 1050 : cluster 0 pgmap v1503: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:28.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:28 smithi187 bash[23415]: cluster 2024-03-11T22:36:26.864840+0000 mgr.y (mgr.14601) 1051 : cluster 0 pgmap v1504: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:28.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:28 smithi049 bash[21434]: cluster 2024-03-11T22:36:26.864840+0000 mgr.y (mgr.14601) 1051 : cluster 0 pgmap v1504: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:28.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:28 smithi049 bash[28804]: cluster 2024-03-11T22:36:26.864840+0000 mgr.y (mgr.14601) 1051 : cluster 0 pgmap v1504: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:29.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:29 smithi187 bash[23415]: audit 2024-03-11T22:36:28.488545+0000 mon.c (mon.2) 730 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:29.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:29 smithi049 bash[21434]: audit 2024-03-11T22:36:28.488545+0000 mon.c (mon.2) 730 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:29.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:29 smithi049 bash[28804]: audit 2024-03-11T22:36:28.488545+0000 mon.c (mon.2) 730 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:30.158 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:36:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:36:30.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:30 smithi187 bash[23415]: cluster 2024-03-11T22:36:28.866973+0000 mgr.y (mgr.14601) 1052 : cluster 0 pgmap v1505: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:30.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:30 smithi049 bash[21434]: cluster 2024-03-11T22:36:28.866973+0000 mgr.y (mgr.14601) 1052 : cluster 0 pgmap v1505: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:30.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:30 smithi049 bash[28804]: cluster 2024-03-11T22:36:28.866973+0000 mgr.y (mgr.14601) 1052 : cluster 0 pgmap v1505: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:31.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:31 smithi187 bash[23415]: audit 2024-03-11T22:36:29.886262+0000 mgr.y (mgr.14601) 1053 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:31.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:31 smithi049 bash[21434]: audit 2024-03-11T22:36:29.886262+0000 mgr.y (mgr.14601) 1053 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:31.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:31 smithi049 bash[28804]: audit 2024-03-11T22:36:29.886262+0000 mgr.y (mgr.14601) 1053 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:32.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:32 smithi187 bash[23415]: cluster 2024-03-11T22:36:30.867795+0000 mgr.y (mgr.14601) 1054 : cluster 0 pgmap v1506: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:32.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:32 smithi049 bash[21434]: cluster 2024-03-11T22:36:30.867795+0000 mgr.y (mgr.14601) 1054 : cluster 0 pgmap v1506: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:32.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:32 smithi049 bash[28804]: cluster 2024-03-11T22:36:30.867795+0000 mgr.y (mgr.14601) 1054 : cluster 0 pgmap v1506: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:34.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:34 smithi187 bash[23415]: cluster 2024-03-11T22:36:32.868625+0000 mgr.y (mgr.14601) 1055 : cluster 0 pgmap v1507: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:34 smithi049 bash[21434]: cluster 2024-03-11T22:36:32.868625+0000 mgr.y (mgr.14601) 1055 : cluster 0 pgmap v1507: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:34.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:34 smithi049 bash[28804]: cluster 2024-03-11T22:36:32.868625+0000 mgr.y (mgr.14601) 1055 : cluster 0 pgmap v1507: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:34.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:36:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:36:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:36:36.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:36 smithi187 bash[23415]: cluster 2024-03-11T22:36:34.870849+0000 mgr.y (mgr.14601) 1056 : cluster 0 pgmap v1508: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:36.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:36 smithi049 bash[21434]: cluster 2024-03-11T22:36:34.870849+0000 mgr.y (mgr.14601) 1056 : cluster 0 pgmap v1508: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:36.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:36 smithi049 bash[28804]: cluster 2024-03-11T22:36:34.870849+0000 mgr.y (mgr.14601) 1056 : cluster 0 pgmap v1508: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:38.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:38 smithi187 bash[23415]: cluster 2024-03-11T22:36:36.871630+0000 mgr.y (mgr.14601) 1057 : cluster 0 pgmap v1509: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:38.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:38 smithi049 bash[21434]: cluster 2024-03-11T22:36:36.871630+0000 mgr.y (mgr.14601) 1057 : cluster 0 pgmap v1509: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:38.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:38 smithi049 bash[28804]: cluster 2024-03-11T22:36:36.871630+0000 mgr.y (mgr.14601) 1057 : cluster 0 pgmap v1509: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:40.186 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:36:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:36:40.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:40 smithi187 bash[23415]: cluster 2024-03-11T22:36:38.873838+0000 mgr.y (mgr.14601) 1058 : cluster 0 pgmap v1510: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:40.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:40 smithi049 bash[21434]: cluster 2024-03-11T22:36:38.873838+0000 mgr.y (mgr.14601) 1058 : cluster 0 pgmap v1510: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:40.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:40 smithi049 bash[28804]: cluster 2024-03-11T22:36:38.873838+0000 mgr.y (mgr.14601) 1058 : cluster 0 pgmap v1510: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:41.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:41 smithi187 bash[23415]: audit 2024-03-11T22:36:39.897672+0000 mgr.y (mgr.14601) 1059 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:41.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:41 smithi049 bash[21434]: audit 2024-03-11T22:36:39.897672+0000 mgr.y (mgr.14601) 1059 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:41.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:41 smithi049 bash[28804]: audit 2024-03-11T22:36:39.897672+0000 mgr.y (mgr.14601) 1059 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:42.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:42 smithi187 bash[23415]: cluster 2024-03-11T22:36:40.874657+0000 mgr.y (mgr.14601) 1060 : cluster 0 pgmap v1511: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:42.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:42 smithi049 bash[21434]: cluster 2024-03-11T22:36:40.874657+0000 mgr.y (mgr.14601) 1060 : cluster 0 pgmap v1511: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:42.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:42 smithi049 bash[28804]: cluster 2024-03-11T22:36:40.874657+0000 mgr.y (mgr.14601) 1060 : cluster 0 pgmap v1511: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:44.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:44 smithi187 bash[23415]: cluster 2024-03-11T22:36:42.875481+0000 mgr.y (mgr.14601) 1061 : cluster 0 pgmap v1512: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:44.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:44 smithi187 bash[23415]: audit 2024-03-11T22:36:43.524425+0000 mon.c (mon.2) 731 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:44.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:44 smithi049 bash[28804]: cluster 2024-03-11T22:36:42.875481+0000 mgr.y (mgr.14601) 1061 : cluster 0 pgmap v1512: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:44.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:44 smithi049 bash[28804]: audit 2024-03-11T22:36:43.524425+0000 mon.c (mon.2) 731 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:44.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:44 smithi049 bash[21434]: cluster 2024-03-11T22:36:42.875481+0000 mgr.y (mgr.14601) 1061 : cluster 0 pgmap v1512: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:44.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:44 smithi049 bash[21434]: audit 2024-03-11T22:36:43.524425+0000 mon.c (mon.2) 731 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:44.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:36:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:36:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:36:46.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:46 smithi187 bash[23415]: cluster 2024-03-11T22:36:44.877753+0000 mgr.y (mgr.14601) 1062 : cluster 0 pgmap v1513: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:46.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:46 smithi049 bash[21434]: cluster 2024-03-11T22:36:44.877753+0000 mgr.y (mgr.14601) 1062 : cluster 0 pgmap v1513: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:46.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:46 smithi049 bash[28804]: cluster 2024-03-11T22:36:44.877753+0000 mgr.y (mgr.14601) 1062 : cluster 0 pgmap v1513: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:47.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:47 smithi187 bash[23415]: audit 2024-03-11T22:36:46.485541+0000 mon.c (mon.2) 732 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:36:47.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:47 smithi049 bash[21434]: audit 2024-03-11T22:36:46.485541+0000 mon.c (mon.2) 732 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:36:47.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:47 smithi049 bash[28804]: audit 2024-03-11T22:36:46.485541+0000 mon.c (mon.2) 732 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:36:48.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:48 smithi187 bash[23415]: cluster 2024-03-11T22:36:46.878559+0000 mgr.y (mgr.14601) 1063 : cluster 0 pgmap v1514: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:48.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:48 smithi187 bash[23415]: audit 2024-03-11T22:36:47.223053+0000 mon.c (mon.2) 733 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:36:48.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:48 smithi187 bash[23415]: audit 2024-03-11T22:36:47.225129+0000 mon.c (mon.2) 734 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:36:48.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:48 smithi187 bash[23415]: audit 2024-03-11T22:36:47.235506+0000 mon.a (mon.0) 3472 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:36:48.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[28804]: cluster 2024-03-11T22:36:46.878559+0000 mgr.y (mgr.14601) 1063 : cluster 0 pgmap v1514: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:48.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[28804]: audit 2024-03-11T22:36:47.223053+0000 mon.c (mon.2) 733 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:36:48.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[28804]: audit 2024-03-11T22:36:47.225129+0000 mon.c (mon.2) 734 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:36:48.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[28804]: audit 2024-03-11T22:36:47.235506+0000 mon.a (mon.0) 3472 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:36:48.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[21434]: cluster 2024-03-11T22:36:46.878559+0000 mgr.y (mgr.14601) 1063 : cluster 0 pgmap v1514: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:48.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[21434]: audit 2024-03-11T22:36:47.223053+0000 mon.c (mon.2) 733 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:36:48.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[21434]: audit 2024-03-11T22:36:47.225129+0000 mon.c (mon.2) 734 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:36:48.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:48 smithi049 bash[21434]: audit 2024-03-11T22:36:47.235506+0000 mon.a (mon.0) 3472 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:36:50.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:36:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:36:50.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:50 smithi187 bash[23415]: cluster 2024-03-11T22:36:48.880718+0000 mgr.y (mgr.14601) 1064 : cluster 0 pgmap v1515: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:50.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:50 smithi049 bash[28804]: cluster 2024-03-11T22:36:48.880718+0000 mgr.y (mgr.14601) 1064 : cluster 0 pgmap v1515: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:50.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:50 smithi049 bash[21434]: cluster 2024-03-11T22:36:48.880718+0000 mgr.y (mgr.14601) 1064 : cluster 0 pgmap v1515: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:51.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:51 smithi187 bash[23415]: audit 2024-03-11T22:36:49.901407+0000 mgr.y (mgr.14601) 1065 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:51.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:51 smithi049 bash[21434]: audit 2024-03-11T22:36:49.901407+0000 mgr.y (mgr.14601) 1065 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:51.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:51 smithi049 bash[28804]: audit 2024-03-11T22:36:49.901407+0000 mgr.y (mgr.14601) 1065 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:36:52.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:52 smithi187 bash[23415]: cluster 2024-03-11T22:36:50.881567+0000 mgr.y (mgr.14601) 1066 : cluster 0 pgmap v1516: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:52.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:52 smithi049 bash[21434]: cluster 2024-03-11T22:36:50.881567+0000 mgr.y (mgr.14601) 1066 : cluster 0 pgmap v1516: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:52.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:52 smithi049 bash[28804]: cluster 2024-03-11T22:36:50.881567+0000 mgr.y (mgr.14601) 1066 : cluster 0 pgmap v1516: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:54.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:54 smithi187 bash[23415]: cluster 2024-03-11T22:36:52.882398+0000 mgr.y (mgr.14601) 1067 : cluster 0 pgmap v1517: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:54 smithi049 bash[21434]: cluster 2024-03-11T22:36:52.882398+0000 mgr.y (mgr.14601) 1067 : cluster 0 pgmap v1517: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:54.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:54 smithi049 bash[28804]: cluster 2024-03-11T22:36:52.882398+0000 mgr.y (mgr.14601) 1067 : cluster 0 pgmap v1517: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:54.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:36:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:36:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:36:56.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:56 smithi187 bash[23415]: cluster 2024-03-11T22:36:54.884670+0000 mgr.y (mgr.14601) 1068 : cluster 0 pgmap v1518: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:56.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:56 smithi049 bash[21434]: cluster 2024-03-11T22:36:54.884670+0000 mgr.y (mgr.14601) 1068 : cluster 0 pgmap v1518: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:56.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:56 smithi049 bash[28804]: cluster 2024-03-11T22:36:54.884670+0000 mgr.y (mgr.14601) 1068 : cluster 0 pgmap v1518: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:36:58.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:58 smithi187 bash[23415]: cluster 2024-03-11T22:36:56.885544+0000 mgr.y (mgr.14601) 1069 : cluster 0 pgmap v1519: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:58.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:58 smithi049 bash[21434]: cluster 2024-03-11T22:36:56.885544+0000 mgr.y (mgr.14601) 1069 : cluster 0 pgmap v1519: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:58.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:58 smithi049 bash[28804]: cluster 2024-03-11T22:36:56.885544+0000 mgr.y (mgr.14601) 1069 : cluster 0 pgmap v1519: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:36:59.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:36:59 smithi187 bash[23415]: audit 2024-03-11T22:36:58.557173+0000 mon.c (mon.2) 735 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:59.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:36:59 smithi049 bash[21434]: audit 2024-03-11T22:36:58.557173+0000 mon.c (mon.2) 735 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:36:59.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:36:59 smithi049 bash[28804]: audit 2024-03-11T22:36:58.557173+0000 mon.c (mon.2) 735 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:00.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:36:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:37:00.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:00 smithi049 bash[28804]: cluster 2024-03-11T22:36:58.887690+0000 mgr.y (mgr.14601) 1070 : cluster 0 pgmap v1520: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:00.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:00 smithi049 bash[21434]: cluster 2024-03-11T22:36:58.887690+0000 mgr.y (mgr.14601) 1070 : cluster 0 pgmap v1520: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:00.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:00 smithi187 bash[23415]: cluster 2024-03-11T22:36:58.887690+0000 mgr.y (mgr.14601) 1070 : cluster 0 pgmap v1520: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:01.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:01 smithi049 bash[21434]: audit 2024-03-11T22:36:59.912770+0000 mgr.y (mgr.14601) 1071 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:01.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:01 smithi049 bash[28804]: audit 2024-03-11T22:36:59.912770+0000 mgr.y (mgr.14601) 1071 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:01.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:01 smithi187 bash[23415]: audit 2024-03-11T22:36:59.912770+0000 mgr.y (mgr.14601) 1071 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:02.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:02 smithi049 bash[21434]: cluster 2024-03-11T22:37:00.888529+0000 mgr.y (mgr.14601) 1072 : cluster 0 pgmap v1521: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:02.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:02 smithi049 bash[28804]: cluster 2024-03-11T22:37:00.888529+0000 mgr.y (mgr.14601) 1072 : cluster 0 pgmap v1521: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:02.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:02 smithi187 bash[23415]: cluster 2024-03-11T22:37:00.888529+0000 mgr.y (mgr.14601) 1072 : cluster 0 pgmap v1521: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:04 smithi049 bash[21434]: cluster 2024-03-11T22:37:02.889387+0000 mgr.y (mgr.14601) 1073 : cluster 0 pgmap v1522: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:04.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:37:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:37:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:37:04.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:04 smithi049 bash[28804]: cluster 2024-03-11T22:37:02.889387+0000 mgr.y (mgr.14601) 1073 : cluster 0 pgmap v1522: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:04.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:04 smithi187 bash[23415]: cluster 2024-03-11T22:37:02.889387+0000 mgr.y (mgr.14601) 1073 : cluster 0 pgmap v1522: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:06.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:06 smithi049 bash[21434]: cluster 2024-03-11T22:37:04.891621+0000 mgr.y (mgr.14601) 1074 : cluster 0 pgmap v1523: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:06.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:06 smithi049 bash[28804]: cluster 2024-03-11T22:37:04.891621+0000 mgr.y (mgr.14601) 1074 : cluster 0 pgmap v1523: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:06.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:06 smithi187 bash[23415]: cluster 2024-03-11T22:37:04.891621+0000 mgr.y (mgr.14601) 1074 : cluster 0 pgmap v1523: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:08.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:08 smithi049 bash[28804]: cluster 2024-03-11T22:37:06.892464+0000 mgr.y (mgr.14601) 1075 : cluster 0 pgmap v1524: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:08.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:08 smithi049 bash[21434]: cluster 2024-03-11T22:37:06.892464+0000 mgr.y (mgr.14601) 1075 : cluster 0 pgmap v1524: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:08.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:08 smithi187 bash[23415]: cluster 2024-03-11T22:37:06.892464+0000 mgr.y (mgr.14601) 1075 : cluster 0 pgmap v1524: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:10.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:37:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:37:10.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:10 smithi049 bash[21434]: cluster 2024-03-11T22:37:08.894631+0000 mgr.y (mgr.14601) 1076 : cluster 0 pgmap v1525: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:10.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:10 smithi049 bash[28804]: cluster 2024-03-11T22:37:08.894631+0000 mgr.y (mgr.14601) 1076 : cluster 0 pgmap v1525: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:10.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:10 smithi187 bash[23415]: cluster 2024-03-11T22:37:08.894631+0000 mgr.y (mgr.14601) 1076 : cluster 0 pgmap v1525: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:11.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:11 smithi187 bash[23415]: audit 2024-03-11T22:37:09.924195+0000 mgr.y (mgr.14601) 1077 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:11.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:11 smithi049 bash[21434]: audit 2024-03-11T22:37:09.924195+0000 mgr.y (mgr.14601) 1077 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:11.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:11 smithi049 bash[28804]: audit 2024-03-11T22:37:09.924195+0000 mgr.y (mgr.14601) 1077 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:12.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:12 smithi187 bash[23415]: cluster 2024-03-11T22:37:10.895446+0000 mgr.y (mgr.14601) 1078 : cluster 0 pgmap v1526: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:12.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:12 smithi049 bash[21434]: cluster 2024-03-11T22:37:10.895446+0000 mgr.y (mgr.14601) 1078 : cluster 0 pgmap v1526: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:12.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:12 smithi049 bash[28804]: cluster 2024-03-11T22:37:10.895446+0000 mgr.y (mgr.14601) 1078 : cluster 0 pgmap v1526: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:14 smithi049 bash[21434]: cluster 2024-03-11T22:37:12.896266+0000 mgr.y (mgr.14601) 1079 : cluster 0 pgmap v1527: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:14 smithi049 bash[21434]: audit 2024-03-11T22:37:13.591796+0000 mon.c (mon.2) 736 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:14.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:37:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:37:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:37:14.538 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:14 smithi049 bash[28804]: cluster 2024-03-11T22:37:12.896266+0000 mgr.y (mgr.14601) 1079 : cluster 0 pgmap v1527: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:14.538 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:14 smithi049 bash[28804]: audit 2024-03-11T22:37:13.591796+0000 mon.c (mon.2) 736 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:14.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:14 smithi187 bash[23415]: cluster 2024-03-11T22:37:12.896266+0000 mgr.y (mgr.14601) 1079 : cluster 0 pgmap v1527: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:14.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:14 smithi187 bash[23415]: audit 2024-03-11T22:37:13.591796+0000 mon.c (mon.2) 736 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:16.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:16 smithi187 bash[23415]: cluster 2024-03-11T22:37:14.898558+0000 mgr.y (mgr.14601) 1080 : cluster 0 pgmap v1528: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:16.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:16 smithi049 bash[28804]: cluster 2024-03-11T22:37:14.898558+0000 mgr.y (mgr.14601) 1080 : cluster 0 pgmap v1528: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:16.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:16 smithi049 bash[21434]: cluster 2024-03-11T22:37:14.898558+0000 mgr.y (mgr.14601) 1080 : cluster 0 pgmap v1528: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:17.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:17 smithi187 bash[23415]: cluster 2024-03-11T22:37:16.899383+0000 mgr.y (mgr.14601) 1081 : cluster 0 pgmap v1529: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:17.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:17 smithi049 bash[21434]: cluster 2024-03-11T22:37:16.899383+0000 mgr.y (mgr.14601) 1081 : cluster 0 pgmap v1529: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:17.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:17 smithi049 bash[28804]: cluster 2024-03-11T22:37:16.899383+0000 mgr.y (mgr.14601) 1081 : cluster 0 pgmap v1529: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:20.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:19 smithi187 bash[23415]: cluster 2024-03-11T22:37:18.901705+0000 mgr.y (mgr.14601) 1082 : cluster 0 pgmap v1530: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:20.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:37:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:37:20.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:19 smithi049 bash[28804]: cluster 2024-03-11T22:37:18.901705+0000 mgr.y (mgr.14601) 1082 : cluster 0 pgmap v1530: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:20.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:19 smithi049 bash[21434]: cluster 2024-03-11T22:37:18.901705+0000 mgr.y (mgr.14601) 1082 : cluster 0 pgmap v1530: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:21.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:20 smithi187 bash[23415]: audit 2024-03-11T22:37:19.935713+0000 mgr.y (mgr.14601) 1083 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:21.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:20 smithi049 bash[21434]: audit 2024-03-11T22:37:19.935713+0000 mgr.y (mgr.14601) 1083 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:21.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:20 smithi049 bash[28804]: audit 2024-03-11T22:37:19.935713+0000 mgr.y (mgr.14601) 1083 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:22.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:21 smithi187 bash[23415]: cluster 2024-03-11T22:37:20.902676+0000 mgr.y (mgr.14601) 1084 : cluster 0 pgmap v1531: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:22.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:21 smithi049 bash[21434]: cluster 2024-03-11T22:37:20.902676+0000 mgr.y (mgr.14601) 1084 : cluster 0 pgmap v1531: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:22.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:21 smithi049 bash[28804]: cluster 2024-03-11T22:37:20.902676+0000 mgr.y (mgr.14601) 1084 : cluster 0 pgmap v1531: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:24.235 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:23 smithi049 bash[28804]: cluster 2024-03-11T22:37:22.903648+0000 mgr.y (mgr.14601) 1085 : cluster 0 pgmap v1532: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:24.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:23 smithi049 bash[21434]: cluster 2024-03-11T22:37:22.903648+0000 mgr.y (mgr.14601) 1085 : cluster 0 pgmap v1532: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:24.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:23 smithi187 bash[23415]: cluster 2024-03-11T22:37:22.903648+0000 mgr.y (mgr.14601) 1085 : cluster 0 pgmap v1532: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:24.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:37:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:37:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:37:26.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:25 smithi187 bash[23415]: cluster 2024-03-11T22:37:24.906070+0000 mgr.y (mgr.14601) 1086 : cluster 0 pgmap v1533: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:26.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:25 smithi049 bash[21434]: cluster 2024-03-11T22:37:24.906070+0000 mgr.y (mgr.14601) 1086 : cluster 0 pgmap v1533: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:26.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:25 smithi049 bash[28804]: cluster 2024-03-11T22:37:24.906070+0000 mgr.y (mgr.14601) 1086 : cluster 0 pgmap v1533: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:28.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:27 smithi187 bash[23415]: cluster 2024-03-11T22:37:26.906938+0000 mgr.y (mgr.14601) 1087 : cluster 0 pgmap v1534: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:28.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:27 smithi049 bash[21434]: cluster 2024-03-11T22:37:26.906938+0000 mgr.y (mgr.14601) 1087 : cluster 0 pgmap v1534: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:28.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:27 smithi049 bash[28804]: cluster 2024-03-11T22:37:26.906938+0000 mgr.y (mgr.14601) 1087 : cluster 0 pgmap v1534: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:29.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:28 smithi187 bash[23415]: audit 2024-03-11T22:37:28.625860+0000 mon.c (mon.2) 737 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:29.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:28 smithi049 bash[21434]: audit 2024-03-11T22:37:28.625860+0000 mon.c (mon.2) 737 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:29.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:28 smithi049 bash[28804]: audit 2024-03-11T22:37:28.625860+0000 mon.c (mon.2) 737 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:30.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:29 smithi187 bash[23415]: cluster 2024-03-11T22:37:28.909080+0000 mgr.y (mgr.14601) 1088 : cluster 0 pgmap v1535: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:30.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:37:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:37:30.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:29 smithi049 bash[21434]: cluster 2024-03-11T22:37:28.909080+0000 mgr.y (mgr.14601) 1088 : cluster 0 pgmap v1535: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:30.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:29 smithi049 bash[28804]: cluster 2024-03-11T22:37:28.909080+0000 mgr.y (mgr.14601) 1088 : cluster 0 pgmap v1535: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:31.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:30 smithi049 bash[21434]: audit 2024-03-11T22:37:29.947134+0000 mgr.y (mgr.14601) 1089 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:31.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:30 smithi049 bash[28804]: audit 2024-03-11T22:37:29.947134+0000 mgr.y (mgr.14601) 1089 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:31.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:30 smithi187 bash[23415]: audit 2024-03-11T22:37:29.947134+0000 mgr.y (mgr.14601) 1089 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:32.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:32 smithi049 bash[21434]: cluster 2024-03-11T22:37:30.910137+0000 mgr.y (mgr.14601) 1090 : cluster 0 pgmap v1536: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:32.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:32 smithi049 bash[28804]: cluster 2024-03-11T22:37:30.910137+0000 mgr.y (mgr.14601) 1090 : cluster 0 pgmap v1536: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:32.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:32 smithi187 bash[23415]: cluster 2024-03-11T22:37:30.910137+0000 mgr.y (mgr.14601) 1090 : cluster 0 pgmap v1536: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:34.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:34 smithi049 bash[21434]: cluster 2024-03-11T22:37:32.910992+0000 mgr.y (mgr.14601) 1091 : cluster 0 pgmap v1537: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:34.287 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:37:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:37:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:37:34.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:34 smithi049 bash[28804]: cluster 2024-03-11T22:37:32.910992+0000 mgr.y (mgr.14601) 1091 : cluster 0 pgmap v1537: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:34.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:34 smithi187 bash[23415]: cluster 2024-03-11T22:37:32.910992+0000 mgr.y (mgr.14601) 1091 : cluster 0 pgmap v1537: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:36.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:36 smithi049 bash[21434]: cluster 2024-03-11T22:37:34.913778+0000 mgr.y (mgr.14601) 1092 : cluster 0 pgmap v1538: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:36.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:36 smithi049 bash[28804]: cluster 2024-03-11T22:37:34.913778+0000 mgr.y (mgr.14601) 1092 : cluster 0 pgmap v1538: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:36.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:36 smithi187 bash[23415]: cluster 2024-03-11T22:37:34.913778+0000 mgr.y (mgr.14601) 1092 : cluster 0 pgmap v1538: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:38.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:38 smithi049 bash[21434]: cluster 2024-03-11T22:37:36.914713+0000 mgr.y (mgr.14601) 1093 : cluster 0 pgmap v1539: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:38.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:38 smithi049 bash[28804]: cluster 2024-03-11T22:37:36.914713+0000 mgr.y (mgr.14601) 1093 : cluster 0 pgmap v1539: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:38.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:38 smithi187 bash[23415]: cluster 2024-03-11T22:37:36.914713+0000 mgr.y (mgr.14601) 1093 : cluster 0 pgmap v1539: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:40.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:40 smithi187 bash[23415]: cluster 2024-03-11T22:37:38.916905+0000 mgr.y (mgr.14601) 1094 : cluster 0 pgmap v1540: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:40.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:37:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:37:40.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:40 smithi049 bash[21434]: cluster 2024-03-11T22:37:38.916905+0000 mgr.y (mgr.14601) 1094 : cluster 0 pgmap v1540: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:40.286 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:40 smithi049 bash[28804]: cluster 2024-03-11T22:37:38.916905+0000 mgr.y (mgr.14601) 1094 : cluster 0 pgmap v1540: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:41.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:41 smithi187 bash[23415]: audit 2024-03-11T22:37:39.958354+0000 mgr.y (mgr.14601) 1095 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:41.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:41 smithi049 bash[21434]: audit 2024-03-11T22:37:39.958354+0000 mgr.y (mgr.14601) 1095 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:41.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:41 smithi049 bash[28804]: audit 2024-03-11T22:37:39.958354+0000 mgr.y (mgr.14601) 1095 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:42.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:42 smithi187 bash[23415]: cluster 2024-03-11T22:37:40.917714+0000 mgr.y (mgr.14601) 1096 : cluster 0 pgmap v1541: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:42.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:42 smithi049 bash[21434]: cluster 2024-03-11T22:37:40.917714+0000 mgr.y (mgr.14601) 1096 : cluster 0 pgmap v1541: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:42.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:42 smithi049 bash[28804]: cluster 2024-03-11T22:37:40.917714+0000 mgr.y (mgr.14601) 1096 : cluster 0 pgmap v1541: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:44.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:44 smithi187 bash[23415]: cluster 2024-03-11T22:37:42.918649+0000 mgr.y (mgr.14601) 1097 : cluster 0 pgmap v1542: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:44.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:44 smithi187 bash[23415]: audit 2024-03-11T22:37:43.659509+0000 mon.c (mon.2) 738 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:44.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:37:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:37:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:37:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:44 smithi049 bash[21434]: cluster 2024-03-11T22:37:42.918649+0000 mgr.y (mgr.14601) 1097 : cluster 0 pgmap v1542: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:44.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:44 smithi049 bash[21434]: audit 2024-03-11T22:37:43.659509+0000 mon.c (mon.2) 738 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:44 smithi049 bash[28804]: cluster 2024-03-11T22:37:42.918649+0000 mgr.y (mgr.14601) 1097 : cluster 0 pgmap v1542: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:44 smithi049 bash[28804]: audit 2024-03-11T22:37:43.659509+0000 mon.c (mon.2) 738 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:46.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:46 smithi187 bash[23415]: cluster 2024-03-11T22:37:44.920905+0000 mgr.y (mgr.14601) 1098 : cluster 0 pgmap v1543: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:46.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:46 smithi049 bash[21434]: cluster 2024-03-11T22:37:44.920905+0000 mgr.y (mgr.14601) 1098 : cluster 0 pgmap v1543: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:46.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:46 smithi049 bash[28804]: cluster 2024-03-11T22:37:44.920905+0000 mgr.y (mgr.14601) 1098 : cluster 0 pgmap v1543: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:48.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:48 smithi187 bash[23415]: cluster 2024-03-11T22:37:46.921719+0000 mgr.y (mgr.14601) 1099 : cluster 0 pgmap v1544: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:48.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:48 smithi187 bash[23415]: audit 2024-03-11T22:37:47.331309+0000 mon.c (mon.2) 739 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:37:48.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:48 smithi049 bash[28804]: cluster 2024-03-11T22:37:46.921719+0000 mgr.y (mgr.14601) 1099 : cluster 0 pgmap v1544: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:48.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:48 smithi049 bash[28804]: audit 2024-03-11T22:37:47.331309+0000 mon.c (mon.2) 739 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:37:48.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:48 smithi049 bash[21434]: cluster 2024-03-11T22:37:46.921719+0000 mgr.y (mgr.14601) 1099 : cluster 0 pgmap v1544: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:48.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:48 smithi049 bash[21434]: audit 2024-03-11T22:37:47.331309+0000 mon.c (mon.2) 739 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:37:50.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:50 smithi187 bash[23415]: cluster 2024-03-11T22:37:48.923857+0000 mgr.y (mgr.14601) 1100 : cluster 0 pgmap v1545: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:50.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:37:49 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:37:50.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:50 smithi049 bash[21434]: cluster 2024-03-11T22:37:48.923857+0000 mgr.y (mgr.14601) 1100 : cluster 0 pgmap v1545: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:50.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:50 smithi049 bash[28804]: cluster 2024-03-11T22:37:48.923857+0000 mgr.y (mgr.14601) 1100 : cluster 0 pgmap v1545: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:51.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:51 smithi187 bash[23415]: audit 2024-03-11T22:37:49.961477+0000 mgr.y (mgr.14601) 1101 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:51.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:51 smithi049 bash[21434]: audit 2024-03-11T22:37:49.961477+0000 mgr.y (mgr.14601) 1101 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:51.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:51 smithi049 bash[28804]: audit 2024-03-11T22:37:49.961477+0000 mgr.y (mgr.14601) 1101 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:37:52.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:52 smithi187 bash[23415]: cluster 2024-03-11T22:37:50.924681+0000 mgr.y (mgr.14601) 1102 : cluster 0 pgmap v1546: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:52.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:52 smithi049 bash[21434]: cluster 2024-03-11T22:37:50.924681+0000 mgr.y (mgr.14601) 1102 : cluster 0 pgmap v1546: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:52.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:52 smithi049 bash[28804]: cluster 2024-03-11T22:37:50.924681+0000 mgr.y (mgr.14601) 1102 : cluster 0 pgmap v1546: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:54.414 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:54 smithi187 bash[23415]: cluster 2024-03-11T22:37:52.925531+0000 mgr.y (mgr.14601) 1103 : cluster 0 pgmap v1547: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:54.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:37:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:37:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:37:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:54 smithi049 bash[21434]: cluster 2024-03-11T22:37:52.925531+0000 mgr.y (mgr.14601) 1103 : cluster 0 pgmap v1547: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:54.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:54 smithi049 bash[28804]: cluster 2024-03-11T22:37:52.925531+0000 mgr.y (mgr.14601) 1103 : cluster 0 pgmap v1547: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:56.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:56 smithi187 bash[23415]: cluster 2024-03-11T22:37:54.927810+0000 mgr.y (mgr.14601) 1104 : cluster 0 pgmap v1548: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:56.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:56 smithi049 bash[21434]: cluster 2024-03-11T22:37:54.927810+0000 mgr.y (mgr.14601) 1104 : cluster 0 pgmap v1548: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:56.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:56 smithi049 bash[28804]: cluster 2024-03-11T22:37:54.927810+0000 mgr.y (mgr.14601) 1104 : cluster 0 pgmap v1548: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:37:58.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:58 smithi187 bash[23415]: cluster 2024-03-11T22:37:56.928569+0000 mgr.y (mgr.14601) 1105 : cluster 0 pgmap v1549: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:58 smithi187 bash[23415]: audit 2024-03-11T22:37:57.911607+0000 mon.a (mon.0) 3473 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:58 smithi187 bash[23415]: audit 2024-03-11T22:37:57.928061+0000 mon.a (mon.0) 3474 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:58 smithi187 bash[23415]: audit 2024-03-11T22:37:57.932486+0000 mon.c (mon.2) 740 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:37:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:58 smithi187 bash[23415]: audit 2024-03-11T22:37:57.934455+0000 mon.c (mon.2) 741 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:37:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:58 smithi187 bash[23415]: audit 2024-03-11T22:37:57.945596+0000 mon.a (mon.0) 3475 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[21434]: cluster 2024-03-11T22:37:56.928569+0000 mgr.y (mgr.14601) 1105 : cluster 0 pgmap v1549: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[21434]: audit 2024-03-11T22:37:57.911607+0000 mon.a (mon.0) 3473 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[21434]: audit 2024-03-11T22:37:57.928061+0000 mon.a (mon.0) 3474 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[21434]: audit 2024-03-11T22:37:57.932486+0000 mon.c (mon.2) 740 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[21434]: audit 2024-03-11T22:37:57.934455+0000 mon.c (mon.2) 741 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[21434]: audit 2024-03-11T22:37:57.945596+0000 mon.a (mon.0) 3475 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[28804]: cluster 2024-03-11T22:37:56.928569+0000 mgr.y (mgr.14601) 1105 : cluster 0 pgmap v1549: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[28804]: audit 2024-03-11T22:37:57.911607+0000 mon.a (mon.0) 3473 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[28804]: audit 2024-03-11T22:37:57.928061+0000 mon.a (mon.0) 3474 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[28804]: audit 2024-03-11T22:37:57.932486+0000 mon.c (mon.2) 740 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[28804]: audit 2024-03-11T22:37:57.934455+0000 mon.c (mon.2) 741 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:37:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:58 smithi049 bash[28804]: audit 2024-03-11T22:37:57.945596+0000 mon.a (mon.0) 3475 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:37:59.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:37:59 smithi187 bash[23415]: audit 2024-03-11T22:37:58.693332+0000 mon.c (mon.2) 742 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:59.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:37:59 smithi049 bash[21434]: audit 2024-03-11T22:37:58.693332+0000 mon.c (mon.2) 742 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:37:59.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:37:59 smithi049 bash[28804]: audit 2024-03-11T22:37:58.693332+0000 mon.c (mon.2) 742 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:00.252 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:00 smithi187 bash[23415]: cluster 2024-03-11T22:37:58.930707+0000 mgr.y (mgr.14601) 1106 : cluster 0 pgmap v1550: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:00.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:37:59 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:38:00.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:00 smithi049 bash[28804]: cluster 2024-03-11T22:37:58.930707+0000 mgr.y (mgr.14601) 1106 : cluster 0 pgmap v1550: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:00.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:00 smithi049 bash[21434]: cluster 2024-03-11T22:37:58.930707+0000 mgr.y (mgr.14601) 1106 : cluster 0 pgmap v1550: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:01.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:01 smithi187 bash[23415]: audit 2024-03-11T22:37:59.972839+0000 mgr.y (mgr.14601) 1107 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:01.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:01 smithi049 bash[21434]: audit 2024-03-11T22:37:59.972839+0000 mgr.y (mgr.14601) 1107 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:01.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:01 smithi049 bash[28804]: audit 2024-03-11T22:37:59.972839+0000 mgr.y (mgr.14601) 1107 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:02.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:02 smithi187 bash[23415]: cluster 2024-03-11T22:38:00.931508+0000 mgr.y (mgr.14601) 1108 : cluster 0 pgmap v1551: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:02.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:02 smithi049 bash[28804]: cluster 2024-03-11T22:38:00.931508+0000 mgr.y (mgr.14601) 1108 : cluster 0 pgmap v1551: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:02.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:02 smithi049 bash[21434]: cluster 2024-03-11T22:38:00.931508+0000 mgr.y (mgr.14601) 1108 : cluster 0 pgmap v1551: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:04.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:04 smithi187 bash[23415]: cluster 2024-03-11T22:38:02.932305+0000 mgr.y (mgr.14601) 1109 : cluster 0 pgmap v1552: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:04 smithi049 bash[21434]: cluster 2024-03-11T22:38:02.932305+0000 mgr.y (mgr.14601) 1109 : cluster 0 pgmap v1552: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:04.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:38:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:38:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:38:04.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:04 smithi049 bash[28804]: cluster 2024-03-11T22:38:02.932305+0000 mgr.y (mgr.14601) 1109 : cluster 0 pgmap v1552: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:06.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:06 smithi187 bash[23415]: cluster 2024-03-11T22:38:04.934631+0000 mgr.y (mgr.14601) 1110 : cluster 0 pgmap v1553: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:06.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:06 smithi049 bash[21434]: cluster 2024-03-11T22:38:04.934631+0000 mgr.y (mgr.14601) 1110 : cluster 0 pgmap v1553: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:06.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:06 smithi049 bash[28804]: cluster 2024-03-11T22:38:04.934631+0000 mgr.y (mgr.14601) 1110 : cluster 0 pgmap v1553: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:08.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:08 smithi187 bash[23415]: cluster 2024-03-11T22:38:06.935457+0000 mgr.y (mgr.14601) 1111 : cluster 0 pgmap v1554: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:08.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:08 smithi049 bash[21434]: cluster 2024-03-11T22:38:06.935457+0000 mgr.y (mgr.14601) 1111 : cluster 0 pgmap v1554: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:08.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:08 smithi049 bash[28804]: cluster 2024-03-11T22:38:06.935457+0000 mgr.y (mgr.14601) 1111 : cluster 0 pgmap v1554: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:10.231 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:38:09 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:38:10.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:10 smithi187 bash[23415]: cluster 2024-03-11T22:38:08.937643+0000 mgr.y (mgr.14601) 1112 : cluster 0 pgmap v1555: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:10.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:10 smithi049 bash[21434]: cluster 2024-03-11T22:38:08.937643+0000 mgr.y (mgr.14601) 1112 : cluster 0 pgmap v1555: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:10.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:10 smithi049 bash[28804]: cluster 2024-03-11T22:38:08.937643+0000 mgr.y (mgr.14601) 1112 : cluster 0 pgmap v1555: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:11.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:11 smithi187 bash[23415]: audit 2024-03-11T22:38:09.974187+0000 mgr.y (mgr.14601) 1113 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:11.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:11 smithi049 bash[21434]: audit 2024-03-11T22:38:09.974187+0000 mgr.y (mgr.14601) 1113 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:11.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:11 smithi049 bash[28804]: audit 2024-03-11T22:38:09.974187+0000 mgr.y (mgr.14601) 1113 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:12.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:12 smithi187 bash[23415]: cluster 2024-03-11T22:38:10.938395+0000 mgr.y (mgr.14601) 1114 : cluster 0 pgmap v1556: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:12.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:12 smithi049 bash[21434]: cluster 2024-03-11T22:38:10.938395+0000 mgr.y (mgr.14601) 1114 : cluster 0 pgmap v1556: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:12.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:12 smithi049 bash[28804]: cluster 2024-03-11T22:38:10.938395+0000 mgr.y (mgr.14601) 1114 : cluster 0 pgmap v1556: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:14.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:14 smithi187 bash[23415]: cluster 2024-03-11T22:38:12.939204+0000 mgr.y (mgr.14601) 1115 : cluster 0 pgmap v1557: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:14.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:14 smithi187 bash[23415]: audit 2024-03-11T22:38:13.727327+0000 mon.c (mon.2) 743 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:14.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:38:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:38:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:38:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:14 smithi049 bash[21434]: cluster 2024-03-11T22:38:12.939204+0000 mgr.y (mgr.14601) 1115 : cluster 0 pgmap v1557: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:14 smithi049 bash[21434]: audit 2024-03-11T22:38:13.727327+0000 mon.c (mon.2) 743 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:14 smithi049 bash[28804]: cluster 2024-03-11T22:38:12.939204+0000 mgr.y (mgr.14601) 1115 : cluster 0 pgmap v1557: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:14 smithi049 bash[28804]: audit 2024-03-11T22:38:13.727327+0000 mon.c (mon.2) 743 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:16.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:16 smithi187 bash[23415]: cluster 2024-03-11T22:38:14.941466+0000 mgr.y (mgr.14601) 1116 : cluster 0 pgmap v1558: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:16.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:16 smithi049 bash[28804]: cluster 2024-03-11T22:38:14.941466+0000 mgr.y (mgr.14601) 1116 : cluster 0 pgmap v1558: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:16.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:16 smithi049 bash[21434]: cluster 2024-03-11T22:38:14.941466+0000 mgr.y (mgr.14601) 1116 : cluster 0 pgmap v1558: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:18.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:18 smithi049 bash[21434]: cluster 2024-03-11T22:38:16.942282+0000 mgr.y (mgr.14601) 1117 : cluster 0 pgmap v1559: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:18.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:18 smithi049 bash[28804]: cluster 2024-03-11T22:38:16.942282+0000 mgr.y (mgr.14601) 1117 : cluster 0 pgmap v1559: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:18.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:18 smithi187 bash[23415]: cluster 2024-03-11T22:38:16.942282+0000 mgr.y (mgr.14601) 1117 : cluster 0 pgmap v1559: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:20.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:38:19 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:38:20.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:20 smithi049 bash[21434]: cluster 2024-03-11T22:38:18.944471+0000 mgr.y (mgr.14601) 1118 : cluster 0 pgmap v1560: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:20.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:20 smithi049 bash[28804]: cluster 2024-03-11T22:38:18.944471+0000 mgr.y (mgr.14601) 1118 : cluster 0 pgmap v1560: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:20.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:20 smithi187 bash[23415]: cluster 2024-03-11T22:38:18.944471+0000 mgr.y (mgr.14601) 1118 : cluster 0 pgmap v1560: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:21.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:21 smithi049 bash[21434]: audit 2024-03-11T22:38:19.985652+0000 mgr.y (mgr.14601) 1119 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:21.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:21 smithi049 bash[28804]: audit 2024-03-11T22:38:19.985652+0000 mgr.y (mgr.14601) 1119 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:21.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:21 smithi187 bash[23415]: audit 2024-03-11T22:38:19.985652+0000 mgr.y (mgr.14601) 1119 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:22.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:22 smithi049 bash[21434]: cluster 2024-03-11T22:38:20.945278+0000 mgr.y (mgr.14601) 1120 : cluster 0 pgmap v1561: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:22.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:22 smithi049 bash[28804]: cluster 2024-03-11T22:38:20.945278+0000 mgr.y (mgr.14601) 1120 : cluster 0 pgmap v1561: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:22.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:22 smithi187 bash[23415]: cluster 2024-03-11T22:38:20.945278+0000 mgr.y (mgr.14601) 1120 : cluster 0 pgmap v1561: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:24 smithi049 bash[21434]: cluster 2024-03-11T22:38:22.946021+0000 mgr.y (mgr.14601) 1121 : cluster 0 pgmap v1562: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:24 smithi049 bash[28804]: cluster 2024-03-11T22:38:22.946021+0000 mgr.y (mgr.14601) 1121 : cluster 0 pgmap v1562: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:24.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:38:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:38:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:38:24.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:24 smithi187 bash[23415]: cluster 2024-03-11T22:38:22.946021+0000 mgr.y (mgr.14601) 1121 : cluster 0 pgmap v1562: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:26.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:26 smithi049 bash[28804]: cluster 2024-03-11T22:38:24.948276+0000 mgr.y (mgr.14601) 1122 : cluster 0 pgmap v1563: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-11T22:38:26.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:26 smithi049 bash[21434]: cluster 2024-03-11T22:38:24.948276+0000 mgr.y (mgr.14601) 1122 : cluster 0 pgmap v1563: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-11T22:38:26.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:26 smithi187 bash[23415]: cluster 2024-03-11T22:38:24.948276+0000 mgr.y (mgr.14601) 1122 : cluster 0 pgmap v1563: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-11T22:38:28.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:28 smithi049 bash[21434]: cluster 2024-03-11T22:38:26.949117+0000 mgr.y (mgr.14601) 1123 : cluster 0 pgmap v1564: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:38:28.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:28 smithi049 bash[28804]: cluster 2024-03-11T22:38:26.949117+0000 mgr.y (mgr.14601) 1123 : cluster 0 pgmap v1564: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:38:28.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:28 smithi187 bash[23415]: cluster 2024-03-11T22:38:26.949117+0000 mgr.y (mgr.14601) 1123 : cluster 0 pgmap v1564: 228 pgs: 228 active+clean; 582 KiB data, 756 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-11T22:38:29.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:29 smithi187 bash[23415]: audit 2024-03-11T22:38:28.760991+0000 mon.c (mon.2) 744 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:29.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:29 smithi049 bash[21434]: audit 2024-03-11T22:38:28.760991+0000 mon.c (mon.2) 744 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:29.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:29 smithi049 bash[28804]: audit 2024-03-11T22:38:28.760991+0000 mon.c (mon.2) 744 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:30.252 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:38:29 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:38:30.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:30 smithi187 bash[23415]: cluster 2024-03-11T22:38:28.951215+0000 mgr.y (mgr.14601) 1124 : cluster 0 pgmap v1565: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:30.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:30 smithi049 bash[21434]: cluster 2024-03-11T22:38:28.951215+0000 mgr.y (mgr.14601) 1124 : cluster 0 pgmap v1565: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:30.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:30 smithi049 bash[28804]: cluster 2024-03-11T22:38:28.951215+0000 mgr.y (mgr.14601) 1124 : cluster 0 pgmap v1565: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:31.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:31 smithi187 bash[23415]: audit 2024-03-11T22:38:29.989500+0000 mgr.y (mgr.14601) 1125 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:31.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:31 smithi049 bash[21434]: audit 2024-03-11T22:38:29.989500+0000 mgr.y (mgr.14601) 1125 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:31.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:31 smithi049 bash[28804]: audit 2024-03-11T22:38:29.989500+0000 mgr.y (mgr.14601) 1125 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:32.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:32 smithi187 bash[23415]: cluster 2024-03-11T22:38:30.952041+0000 mgr.y (mgr.14601) 1126 : cluster 0 pgmap v1566: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:32.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:32 smithi049 bash[21434]: cluster 2024-03-11T22:38:30.952041+0000 mgr.y (mgr.14601) 1126 : cluster 0 pgmap v1566: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:32.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:32 smithi049 bash[28804]: cluster 2024-03-11T22:38:30.952041+0000 mgr.y (mgr.14601) 1126 : cluster 0 pgmap v1566: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:34 smithi049 bash[21434]: cluster 2024-03-11T22:38:32.952885+0000 mgr.y (mgr.14601) 1127 : cluster 0 pgmap v1567: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:34.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:38:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:38:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:38:34.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:34 smithi049 bash[28804]: cluster 2024-03-11T22:38:32.952885+0000 mgr.y (mgr.14601) 1127 : cluster 0 pgmap v1567: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:34.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:34 smithi187 bash[23415]: cluster 2024-03-11T22:38:32.952885+0000 mgr.y (mgr.14601) 1127 : cluster 0 pgmap v1567: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:36.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:36 smithi187 bash[23415]: cluster 2024-03-11T22:38:34.955161+0000 mgr.y (mgr.14601) 1128 : cluster 0 pgmap v1568: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:36.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:36 smithi049 bash[28804]: cluster 2024-03-11T22:38:34.955161+0000 mgr.y (mgr.14601) 1128 : cluster 0 pgmap v1568: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:36.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:36 smithi049 bash[21434]: cluster 2024-03-11T22:38:34.955161+0000 mgr.y (mgr.14601) 1128 : cluster 0 pgmap v1568: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-11T22:38:38.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:38 smithi187 bash[23415]: cluster 2024-03-11T22:38:36.955993+0000 mgr.y (mgr.14601) 1129 : cluster 0 pgmap v1569: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-03-11T22:38:38.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:38 smithi049 bash[28804]: cluster 2024-03-11T22:38:36.955993+0000 mgr.y (mgr.14601) 1129 : cluster 0 pgmap v1569: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-03-11T22:38:38.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:38 smithi049 bash[21434]: cluster 2024-03-11T22:38:36.955993+0000 mgr.y (mgr.14601) 1129 : cluster 0 pgmap v1569: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-03-11T22:38:40.319 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:38:39 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:38:40.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:40 smithi187 bash[23415]: cluster 2024-03-11T22:38:38.958169+0000 mgr.y (mgr.14601) 1130 : cluster 0 pgmap v1570: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-03-11T22:38:40.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:40 smithi049 bash[21434]: cluster 2024-03-11T22:38:38.958169+0000 mgr.y (mgr.14601) 1130 : cluster 0 pgmap v1570: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-03-11T22:38:40.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:40 smithi049 bash[28804]: cluster 2024-03-11T22:38:38.958169+0000 mgr.y (mgr.14601) 1130 : cluster 0 pgmap v1570: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-03-11T22:38:41.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:41 smithi187 bash[23415]: audit 2024-03-11T22:38:39.997487+0000 mgr.y (mgr.14601) 1131 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:41.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:41 smithi049 bash[21434]: audit 2024-03-11T22:38:39.997487+0000 mgr.y (mgr.14601) 1131 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:41.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:41 smithi049 bash[28804]: audit 2024-03-11T22:38:39.997487+0000 mgr.y (mgr.14601) 1131 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:42.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:42 smithi187 bash[23415]: cluster 2024-03-11T22:38:40.959006+0000 mgr.y (mgr.14601) 1132 : cluster 0 pgmap v1571: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:42.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:42 smithi049 bash[28804]: cluster 2024-03-11T22:38:40.959006+0000 mgr.y (mgr.14601) 1132 : cluster 0 pgmap v1571: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:42.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:42 smithi049 bash[21434]: cluster 2024-03-11T22:38:40.959006+0000 mgr.y (mgr.14601) 1132 : cluster 0 pgmap v1571: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:43.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:43 smithi187 bash[23415]: cluster 2024-03-11T22:38:42.959817+0000 mgr.y (mgr.14601) 1133 : cluster 0 pgmap v1572: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:43.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:43 smithi049 bash[21434]: cluster 2024-03-11T22:38:42.959817+0000 mgr.y (mgr.14601) 1133 : cluster 0 pgmap v1572: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:43.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:43 smithi049 bash[28804]: cluster 2024-03-11T22:38:42.959817+0000 mgr.y (mgr.14601) 1133 : cluster 0 pgmap v1572: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:44 smithi049 bash[21434]: audit 2024-03-11T22:38:43.794554+0000 mon.c (mon.2) 745 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:44.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:38:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:38:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:38:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:44 smithi049 bash[28804]: audit 2024-03-11T22:38:43.794554+0000 mon.c (mon.2) 745 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:44.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:44 smithi187 bash[23415]: audit 2024-03-11T22:38:43.794554+0000 mon.c (mon.2) 745 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:45.752 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:45 smithi187 bash[23415]: cluster 2024-03-11T22:38:44.962087+0000 mgr.y (mgr.14601) 1134 : cluster 0 pgmap v1573: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:45.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:45 smithi049 bash[21434]: cluster 2024-03-11T22:38:44.962087+0000 mgr.y (mgr.14601) 1134 : cluster 0 pgmap v1573: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:45.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:45 smithi049 bash[28804]: cluster 2024-03-11T22:38:44.962087+0000 mgr.y (mgr.14601) 1134 : cluster 0 pgmap v1573: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:48.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:48 smithi049 bash[21434]: cluster 2024-03-11T22:38:46.962918+0000 mgr.y (mgr.14601) 1135 : cluster 0 pgmap v1574: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:48.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:48 smithi049 bash[28804]: cluster 2024-03-11T22:38:46.962918+0000 mgr.y (mgr.14601) 1135 : cluster 0 pgmap v1574: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:48.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:48 smithi187 bash[23415]: cluster 2024-03-11T22:38:46.962918+0000 mgr.y (mgr.14601) 1135 : cluster 0 pgmap v1574: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:50.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:50 smithi049 bash[21434]: cluster 2024-03-11T22:38:48.965121+0000 mgr.y (mgr.14601) 1136 : cluster 0 pgmap v1575: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:50.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:50 smithi049 bash[28804]: cluster 2024-03-11T22:38:48.965121+0000 mgr.y (mgr.14601) 1136 : cluster 0 pgmap v1575: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:50.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:50 smithi187 bash[23415]: cluster 2024-03-11T22:38:48.965121+0000 mgr.y (mgr.14601) 1136 : cluster 0 pgmap v1575: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:50.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:38:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:38:51.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:51 smithi187 bash[23415]: audit 2024-03-11T22:38:50.005590+0000 mgr.y (mgr.14601) 1137 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:51.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:51 smithi049 bash[28804]: audit 2024-03-11T22:38:50.005590+0000 mgr.y (mgr.14601) 1137 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:51.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:51 smithi049 bash[21434]: audit 2024-03-11T22:38:50.005590+0000 mgr.y (mgr.14601) 1137 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:38:52.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:52 smithi187 bash[23415]: cluster 2024-03-11T22:38:50.965891+0000 mgr.y (mgr.14601) 1138 : cluster 0 pgmap v1576: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:52.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:52 smithi049 bash[21434]: cluster 2024-03-11T22:38:50.965891+0000 mgr.y (mgr.14601) 1138 : cluster 0 pgmap v1576: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:52.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:52 smithi049 bash[28804]: cluster 2024-03-11T22:38:50.965891+0000 mgr.y (mgr.14601) 1138 : cluster 0 pgmap v1576: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:54.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:54 smithi187 bash[23415]: cluster 2024-03-11T22:38:52.966731+0000 mgr.y (mgr.14601) 1139 : cluster 0 pgmap v1577: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:54 smithi049 bash[21434]: cluster 2024-03-11T22:38:52.966731+0000 mgr.y (mgr.14601) 1139 : cluster 0 pgmap v1577: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:54.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:54 smithi049 bash[28804]: cluster 2024-03-11T22:38:52.966731+0000 mgr.y (mgr.14601) 1139 : cluster 0 pgmap v1577: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:54.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:38:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:38:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:38:56.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:56 smithi187 bash[23415]: cluster 2024-03-11T22:38:54.969023+0000 mgr.y (mgr.14601) 1140 : cluster 0 pgmap v1578: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:56.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:56 smithi049 bash[21434]: cluster 2024-03-11T22:38:54.969023+0000 mgr.y (mgr.14601) 1140 : cluster 0 pgmap v1578: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:56.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:56 smithi049 bash[28804]: cluster 2024-03-11T22:38:54.969023+0000 mgr.y (mgr.14601) 1140 : cluster 0 pgmap v1578: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:38:58.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:58 smithi187 bash[23415]: cluster 2024-03-11T22:38:56.969889+0000 mgr.y (mgr.14601) 1141 : cluster 0 pgmap v1579: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:58 smithi187 bash[23415]: audit 2024-03-11T22:38:58.039645+0000 mon.c (mon.2) 746 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:38:58.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:58 smithi049 bash[21434]: cluster 2024-03-11T22:38:56.969889+0000 mgr.y (mgr.14601) 1141 : cluster 0 pgmap v1579: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:58.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:58 smithi049 bash[21434]: audit 2024-03-11T22:38:58.039645+0000 mon.c (mon.2) 746 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:38:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:58 smithi049 bash[28804]: cluster 2024-03-11T22:38:56.969889+0000 mgr.y (mgr.14601) 1141 : cluster 0 pgmap v1579: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:38:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:58 smithi049 bash[28804]: audit 2024-03-11T22:38:58.039645+0000 mon.c (mon.2) 746 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:38:59.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:59 smithi187 bash[23415]: audit 2024-03-11T22:38:58.777955+0000 mon.c (mon.2) 747 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:38:59.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:59 smithi187 bash[23415]: audit 2024-03-11T22:38:58.779557+0000 mon.c (mon.2) 748 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:38:59.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:59 smithi187 bash[23415]: audit 2024-03-11T22:38:58.789886+0000 mon.a (mon.0) 3476 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:38:59.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:38:59 smithi187 bash[23415]: audit 2024-03-11T22:38:58.828350+0000 mon.c (mon.2) 749 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:59.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[21434]: audit 2024-03-11T22:38:58.777955+0000 mon.c (mon.2) 747 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:38:59.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[21434]: audit 2024-03-11T22:38:58.779557+0000 mon.c (mon.2) 748 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:38:59.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[21434]: audit 2024-03-11T22:38:58.789886+0000 mon.a (mon.0) 3476 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:38:59.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[21434]: audit 2024-03-11T22:38:58.828350+0000 mon.c (mon.2) 749 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:38:59.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[28804]: audit 2024-03-11T22:38:58.777955+0000 mon.c (mon.2) 747 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:38:59.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[28804]: audit 2024-03-11T22:38:58.779557+0000 mon.c (mon.2) 748 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:38:59.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[28804]: audit 2024-03-11T22:38:58.789886+0000 mon.a (mon.0) 3476 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:38:59.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:38:59 smithi049 bash[28804]: audit 2024-03-11T22:38:58.828350+0000 mon.c (mon.2) 749 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:00 smithi187 bash[23415]: cluster 2024-03-11T22:38:58.972134+0000 mgr.y (mgr.14601) 1142 : cluster 0 pgmap v1580: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:00.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:39:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:39:00.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:00 smithi049 bash[21434]: cluster 2024-03-11T22:38:58.972134+0000 mgr.y (mgr.14601) 1142 : cluster 0 pgmap v1580: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:00.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:00 smithi049 bash[28804]: cluster 2024-03-11T22:38:58.972134+0000 mgr.y (mgr.14601) 1142 : cluster 0 pgmap v1580: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:01.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:01 smithi187 bash[23415]: audit 2024-03-11T22:39:00.013624+0000 mgr.y (mgr.14601) 1143 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:01.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:01 smithi049 bash[28804]: audit 2024-03-11T22:39:00.013624+0000 mgr.y (mgr.14601) 1143 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:01.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:01 smithi049 bash[21434]: audit 2024-03-11T22:39:00.013624+0000 mgr.y (mgr.14601) 1143 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:02.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:02 smithi187 bash[23415]: cluster 2024-03-11T22:39:00.972914+0000 mgr.y (mgr.14601) 1144 : cluster 0 pgmap v1581: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:02.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:02 smithi049 bash[21434]: cluster 2024-03-11T22:39:00.972914+0000 mgr.y (mgr.14601) 1144 : cluster 0 pgmap v1581: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:02.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:02 smithi049 bash[28804]: cluster 2024-03-11T22:39:00.972914+0000 mgr.y (mgr.14601) 1144 : cluster 0 pgmap v1581: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:04.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:04 smithi187 bash[23415]: cluster 2024-03-11T22:39:02.973727+0000 mgr.y (mgr.14601) 1145 : cluster 0 pgmap v1582: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:04 smithi049 bash[21434]: cluster 2024-03-11T22:39:02.973727+0000 mgr.y (mgr.14601) 1145 : cluster 0 pgmap v1582: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:04.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:39:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:39:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:39:04.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:04 smithi049 bash[28804]: cluster 2024-03-11T22:39:02.973727+0000 mgr.y (mgr.14601) 1145 : cluster 0 pgmap v1582: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:06.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:06 smithi187 bash[23415]: cluster 2024-03-11T22:39:04.975972+0000 mgr.y (mgr.14601) 1146 : cluster 0 pgmap v1583: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:06.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:06 smithi049 bash[21434]: cluster 2024-03-11T22:39:04.975972+0000 mgr.y (mgr.14601) 1146 : cluster 0 pgmap v1583: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:06.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:06 smithi049 bash[28804]: cluster 2024-03-11T22:39:04.975972+0000 mgr.y (mgr.14601) 1146 : cluster 0 pgmap v1583: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:08.502 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:08 smithi187 bash[23415]: cluster 2024-03-11T22:39:06.976816+0000 mgr.y (mgr.14601) 1147 : cluster 0 pgmap v1584: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:08.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:08 smithi049 bash[21434]: cluster 2024-03-11T22:39:06.976816+0000 mgr.y (mgr.14601) 1147 : cluster 0 pgmap v1584: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:08.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:08 smithi049 bash[28804]: cluster 2024-03-11T22:39:06.976816+0000 mgr.y (mgr.14601) 1147 : cluster 0 pgmap v1584: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:10.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:10 smithi187 bash[23415]: cluster 2024-03-11T22:39:08.979102+0000 mgr.y (mgr.14601) 1148 : cluster 0 pgmap v1585: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:10.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:39:10 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:39:10.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:10 smithi049 bash[21434]: cluster 2024-03-11T22:39:08.979102+0000 mgr.y (mgr.14601) 1148 : cluster 0 pgmap v1585: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:10.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:10 smithi049 bash[28804]: cluster 2024-03-11T22:39:08.979102+0000 mgr.y (mgr.14601) 1148 : cluster 0 pgmap v1585: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:11.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:11 smithi187 bash[23415]: audit 2024-03-11T22:39:10.025031+0000 mgr.y (mgr.14601) 1149 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:11.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:11 smithi049 bash[28804]: audit 2024-03-11T22:39:10.025031+0000 mgr.y (mgr.14601) 1149 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:11.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:11 smithi049 bash[21434]: audit 2024-03-11T22:39:10.025031+0000 mgr.y (mgr.14601) 1149 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:12.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:12 smithi187 bash[23415]: cluster 2024-03-11T22:39:10.979952+0000 mgr.y (mgr.14601) 1150 : cluster 0 pgmap v1586: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:12.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:12 smithi049 bash[21434]: cluster 2024-03-11T22:39:10.979952+0000 mgr.y (mgr.14601) 1150 : cluster 0 pgmap v1586: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:12.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:12 smithi049 bash[28804]: cluster 2024-03-11T22:39:10.979952+0000 mgr.y (mgr.14601) 1150 : cluster 0 pgmap v1586: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:14.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:14 smithi187 bash[23415]: cluster 2024-03-11T22:39:12.980723+0000 mgr.y (mgr.14601) 1151 : cluster 0 pgmap v1587: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:14.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:14 smithi187 bash[23415]: audit 2024-03-11T22:39:13.865482+0000 mon.c (mon.2) 750 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:14.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:39:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:39:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:39:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:14 smithi049 bash[28804]: cluster 2024-03-11T22:39:12.980723+0000 mgr.y (mgr.14601) 1151 : cluster 0 pgmap v1587: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:14 smithi049 bash[28804]: audit 2024-03-11T22:39:13.865482+0000 mon.c (mon.2) 750 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:14 smithi049 bash[21434]: cluster 2024-03-11T22:39:12.980723+0000 mgr.y (mgr.14601) 1151 : cluster 0 pgmap v1587: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:14 smithi049 bash[21434]: audit 2024-03-11T22:39:13.865482+0000 mon.c (mon.2) 750 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:16.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:16 smithi187 bash[23415]: cluster 2024-03-11T22:39:14.982955+0000 mgr.y (mgr.14601) 1152 : cluster 0 pgmap v1588: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:16.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:16 smithi049 bash[21434]: cluster 2024-03-11T22:39:14.982955+0000 mgr.y (mgr.14601) 1152 : cluster 0 pgmap v1588: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:16.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:16 smithi049 bash[28804]: cluster 2024-03-11T22:39:14.982955+0000 mgr.y (mgr.14601) 1152 : cluster 0 pgmap v1588: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:18.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:18 smithi187 bash[23415]: cluster 2024-03-11T22:39:16.983786+0000 mgr.y (mgr.14601) 1153 : cluster 0 pgmap v1589: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:18.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:18 smithi049 bash[21434]: cluster 2024-03-11T22:39:16.983786+0000 mgr.y (mgr.14601) 1153 : cluster 0 pgmap v1589: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:18.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:18 smithi049 bash[28804]: cluster 2024-03-11T22:39:16.983786+0000 mgr.y (mgr.14601) 1153 : cluster 0 pgmap v1589: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:20.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:20 smithi187 bash[23415]: cluster 2024-03-11T22:39:18.985998+0000 mgr.y (mgr.14601) 1154 : cluster 0 pgmap v1590: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:20.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:39:20 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:39:20.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:20 smithi049 bash[28804]: cluster 2024-03-11T22:39:18.985998+0000 mgr.y (mgr.14601) 1154 : cluster 0 pgmap v1590: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:20.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:20 smithi049 bash[21434]: cluster 2024-03-11T22:39:18.985998+0000 mgr.y (mgr.14601) 1154 : cluster 0 pgmap v1590: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:21.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:21 smithi187 bash[23415]: audit 2024-03-11T22:39:20.036352+0000 mgr.y (mgr.14601) 1155 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:21.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:21 smithi049 bash[28804]: audit 2024-03-11T22:39:20.036352+0000 mgr.y (mgr.14601) 1155 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:21.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:21 smithi049 bash[21434]: audit 2024-03-11T22:39:20.036352+0000 mgr.y (mgr.14601) 1155 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:22.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:22 smithi187 bash[23415]: cluster 2024-03-11T22:39:20.986881+0000 mgr.y (mgr.14601) 1156 : cluster 0 pgmap v1591: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:22.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:22 smithi049 bash[21434]: cluster 2024-03-11T22:39:20.986881+0000 mgr.y (mgr.14601) 1156 : cluster 0 pgmap v1591: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:22.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:22 smithi049 bash[28804]: cluster 2024-03-11T22:39:20.986881+0000 mgr.y (mgr.14601) 1156 : cluster 0 pgmap v1591: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:24.505 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:24 smithi187 bash[23415]: cluster 2024-03-11T22:39:22.987763+0000 mgr.y (mgr.14601) 1157 : cluster 0 pgmap v1592: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:24.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:39:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:39:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:39:24.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:24 smithi049 bash[28804]: cluster 2024-03-11T22:39:22.987763+0000 mgr.y (mgr.14601) 1157 : cluster 0 pgmap v1592: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:24.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:24 smithi049 bash[21434]: cluster 2024-03-11T22:39:22.987763+0000 mgr.y (mgr.14601) 1157 : cluster 0 pgmap v1592: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:26.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:26 smithi187 bash[23415]: cluster 2024-03-11T22:39:24.990089+0000 mgr.y (mgr.14601) 1158 : cluster 0 pgmap v1593: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:26.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:26 smithi049 bash[21434]: cluster 2024-03-11T22:39:24.990089+0000 mgr.y (mgr.14601) 1158 : cluster 0 pgmap v1593: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:26.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:26 smithi049 bash[28804]: cluster 2024-03-11T22:39:24.990089+0000 mgr.y (mgr.14601) 1158 : cluster 0 pgmap v1593: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:28.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:28 smithi187 bash[23415]: cluster 2024-03-11T22:39:26.990946+0000 mgr.y (mgr.14601) 1159 : cluster 0 pgmap v1594: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:28.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:28 smithi049 bash[21434]: cluster 2024-03-11T22:39:26.990946+0000 mgr.y (mgr.14601) 1159 : cluster 0 pgmap v1594: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:28.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:28 smithi049 bash[28804]: cluster 2024-03-11T22:39:26.990946+0000 mgr.y (mgr.14601) 1159 : cluster 0 pgmap v1594: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:29.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:29 smithi187 bash[23415]: audit 2024-03-11T22:39:28.899628+0000 mon.c (mon.2) 751 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:29.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:29 smithi049 bash[21434]: audit 2024-03-11T22:39:28.899628+0000 mon.c (mon.2) 751 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:29.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:29 smithi049 bash[28804]: audit 2024-03-11T22:39:28.899628+0000 mon.c (mon.2) 751 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:30.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:30 smithi187 bash[23415]: cluster 2024-03-11T22:39:28.993224+0000 mgr.y (mgr.14601) 1160 : cluster 0 pgmap v1595: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:30.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:39:30 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:39:30.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:30 smithi049 bash[21434]: cluster 2024-03-11T22:39:28.993224+0000 mgr.y (mgr.14601) 1160 : cluster 0 pgmap v1595: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:30.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:30 smithi049 bash[28804]: cluster 2024-03-11T22:39:28.993224+0000 mgr.y (mgr.14601) 1160 : cluster 0 pgmap v1595: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:31.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:31 smithi187 bash[23415]: audit 2024-03-11T22:39:30.047905+0000 mgr.y (mgr.14601) 1161 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:31.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:31 smithi049 bash[21434]: audit 2024-03-11T22:39:30.047905+0000 mgr.y (mgr.14601) 1161 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:31.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:31 smithi049 bash[28804]: audit 2024-03-11T22:39:30.047905+0000 mgr.y (mgr.14601) 1161 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:32.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:32 smithi187 bash[23415]: cluster 2024-03-11T22:39:30.994179+0000 mgr.y (mgr.14601) 1162 : cluster 0 pgmap v1596: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:32.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:32 smithi049 bash[21434]: cluster 2024-03-11T22:39:30.994179+0000 mgr.y (mgr.14601) 1162 : cluster 0 pgmap v1596: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:32.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:32 smithi049 bash[28804]: cluster 2024-03-11T22:39:30.994179+0000 mgr.y (mgr.14601) 1162 : cluster 0 pgmap v1596: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:34.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:34 smithi187 bash[23415]: cluster 2024-03-11T22:39:32.995022+0000 mgr.y (mgr.14601) 1163 : cluster 0 pgmap v1597: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:34 smithi049 bash[21434]: cluster 2024-03-11T22:39:32.995022+0000 mgr.y (mgr.14601) 1163 : cluster 0 pgmap v1597: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:34.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:34 smithi049 bash[28804]: cluster 2024-03-11T22:39:32.995022+0000 mgr.y (mgr.14601) 1163 : cluster 0 pgmap v1597: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:34.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:39:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:39:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:39:36.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:36 smithi187 bash[23415]: cluster 2024-03-11T22:39:34.997319+0000 mgr.y (mgr.14601) 1164 : cluster 0 pgmap v1598: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:36.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:36 smithi049 bash[21434]: cluster 2024-03-11T22:39:34.997319+0000 mgr.y (mgr.14601) 1164 : cluster 0 pgmap v1598: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:36.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:36 smithi049 bash[28804]: cluster 2024-03-11T22:39:34.997319+0000 mgr.y (mgr.14601) 1164 : cluster 0 pgmap v1598: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:38.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:38 smithi187 bash[23415]: cluster 2024-03-11T22:39:36.998192+0000 mgr.y (mgr.14601) 1165 : cluster 0 pgmap v1599: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:38.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:38 smithi049 bash[21434]: cluster 2024-03-11T22:39:36.998192+0000 mgr.y (mgr.14601) 1165 : cluster 0 pgmap v1599: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:38.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:38 smithi049 bash[28804]: cluster 2024-03-11T22:39:36.998192+0000 mgr.y (mgr.14601) 1165 : cluster 0 pgmap v1599: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:40.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:40 smithi187 bash[23415]: cluster 2024-03-11T22:39:39.000546+0000 mgr.y (mgr.14601) 1166 : cluster 0 pgmap v1600: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:40.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:39:40 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:39:40.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:40 smithi049 bash[21434]: cluster 2024-03-11T22:39:39.000546+0000 mgr.y (mgr.14601) 1166 : cluster 0 pgmap v1600: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:40.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:40 smithi049 bash[28804]: cluster 2024-03-11T22:39:39.000546+0000 mgr.y (mgr.14601) 1166 : cluster 0 pgmap v1600: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:41.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:41 smithi187 bash[23415]: audit 2024-03-11T22:39:40.059346+0000 mgr.y (mgr.14601) 1167 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:41.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:41 smithi049 bash[21434]: audit 2024-03-11T22:39:40.059346+0000 mgr.y (mgr.14601) 1167 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:41.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:41 smithi049 bash[28804]: audit 2024-03-11T22:39:40.059346+0000 mgr.y (mgr.14601) 1167 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:42.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:42 smithi187 bash[23415]: cluster 2024-03-11T22:39:41.001588+0000 mgr.y (mgr.14601) 1168 : cluster 0 pgmap v1601: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:42.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:42 smithi049 bash[28804]: cluster 2024-03-11T22:39:41.001588+0000 mgr.y (mgr.14601) 1168 : cluster 0 pgmap v1601: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:42.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:42 smithi049 bash[21434]: cluster 2024-03-11T22:39:41.001588+0000 mgr.y (mgr.14601) 1168 : cluster 0 pgmap v1601: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:44 smithi049 bash[21434]: cluster 2024-03-11T22:39:43.002430+0000 mgr.y (mgr.14601) 1169 : cluster 0 pgmap v1602: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:44.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:44 smithi049 bash[21434]: audit 2024-03-11T22:39:43.934413+0000 mon.c (mon.2) 752 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:44.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:39:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:39:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:39:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:44 smithi049 bash[28804]: cluster 2024-03-11T22:39:43.002430+0000 mgr.y (mgr.14601) 1169 : cluster 0 pgmap v1602: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:44 smithi049 bash[28804]: audit 2024-03-11T22:39:43.934413+0000 mon.c (mon.2) 752 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:44.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:44 smithi187 bash[23415]: cluster 2024-03-11T22:39:43.002430+0000 mgr.y (mgr.14601) 1169 : cluster 0 pgmap v1602: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:44.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:44 smithi187 bash[23415]: audit 2024-03-11T22:39:43.934413+0000 mon.c (mon.2) 752 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:46.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:46 smithi049 bash[21434]: cluster 2024-03-11T22:39:45.004725+0000 mgr.y (mgr.14601) 1170 : cluster 0 pgmap v1603: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:46.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:46 smithi049 bash[28804]: cluster 2024-03-11T22:39:45.004725+0000 mgr.y (mgr.14601) 1170 : cluster 0 pgmap v1603: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:46.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:46 smithi187 bash[23415]: cluster 2024-03-11T22:39:45.004725+0000 mgr.y (mgr.14601) 1170 : cluster 0 pgmap v1603: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:48.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:48 smithi049 bash[21434]: cluster 2024-03-11T22:39:47.005614+0000 mgr.y (mgr.14601) 1171 : cluster 0 pgmap v1604: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:48.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:48 smithi049 bash[28804]: cluster 2024-03-11T22:39:47.005614+0000 mgr.y (mgr.14601) 1171 : cluster 0 pgmap v1604: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:48.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:48 smithi187 bash[23415]: cluster 2024-03-11T22:39:47.005614+0000 mgr.y (mgr.14601) 1171 : cluster 0 pgmap v1604: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:50.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:50 smithi187 bash[23415]: cluster 2024-03-11T22:39:49.007897+0000 mgr.y (mgr.14601) 1172 : cluster 0 pgmap v1605: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:50.504 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:39:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:39:50.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:50 smithi049 bash[21434]: cluster 2024-03-11T22:39:49.007897+0000 mgr.y (mgr.14601) 1172 : cluster 0 pgmap v1605: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:50.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:50 smithi049 bash[28804]: cluster 2024-03-11T22:39:49.007897+0000 mgr.y (mgr.14601) 1172 : cluster 0 pgmap v1605: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:51.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:51 smithi049 bash[28804]: audit 2024-03-11T22:39:50.069864+0000 mgr.y (mgr.14601) 1173 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:51.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:51 smithi049 bash[21434]: audit 2024-03-11T22:39:50.069864+0000 mgr.y (mgr.14601) 1173 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:51.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:51 smithi187 bash[23415]: audit 2024-03-11T22:39:50.069864+0000 mgr.y (mgr.14601) 1173 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:39:52.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:52 smithi049 bash[28804]: cluster 2024-03-11T22:39:51.008754+0000 mgr.y (mgr.14601) 1174 : cluster 0 pgmap v1606: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:52.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:52 smithi049 bash[21434]: cluster 2024-03-11T22:39:51.008754+0000 mgr.y (mgr.14601) 1174 : cluster 0 pgmap v1606: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:52.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:52 smithi187 bash[23415]: cluster 2024-03-11T22:39:51.008754+0000 mgr.y (mgr.14601) 1174 : cluster 0 pgmap v1606: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:54.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:39:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:39:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:39:54.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:54 smithi049 bash[28804]: cluster 2024-03-11T22:39:53.009601+0000 mgr.y (mgr.14601) 1175 : cluster 0 pgmap v1607: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:54.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:54 smithi049 bash[21434]: cluster 2024-03-11T22:39:53.009601+0000 mgr.y (mgr.14601) 1175 : cluster 0 pgmap v1607: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:54.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:54 smithi187 bash[23415]: cluster 2024-03-11T22:39:53.009601+0000 mgr.y (mgr.14601) 1175 : cluster 0 pgmap v1607: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:56.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:56 smithi187 bash[23415]: cluster 2024-03-11T22:39:55.011794+0000 mgr.y (mgr.14601) 1176 : cluster 0 pgmap v1608: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:56.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:56 smithi049 bash[28804]: cluster 2024-03-11T22:39:55.011794+0000 mgr.y (mgr.14601) 1176 : cluster 0 pgmap v1608: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:56.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:56 smithi049 bash[21434]: cluster 2024-03-11T22:39:55.011794+0000 mgr.y (mgr.14601) 1176 : cluster 0 pgmap v1608: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:39:58.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:58 smithi187 bash[23415]: cluster 2024-03-11T22:39:57.012586+0000 mgr.y (mgr.14601) 1177 : cluster 0 pgmap v1609: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:58.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:58 smithi049 bash[28804]: cluster 2024-03-11T22:39:57.012586+0000 mgr.y (mgr.14601) 1177 : cluster 0 pgmap v1609: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:58.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:58 smithi049 bash[21434]: cluster 2024-03-11T22:39:57.012586+0000 mgr.y (mgr.14601) 1177 : cluster 0 pgmap v1609: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:39:59.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:59 smithi187 bash[23415]: audit 2024-03-11T22:39:58.895003+0000 mon.c (mon.2) 753 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:39:59.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:39:59 smithi187 bash[23415]: audit 2024-03-11T22:39:58.968806+0000 mon.c (mon.2) 754 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:59.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:59 smithi049 bash[28804]: audit 2024-03-11T22:39:58.895003+0000 mon.c (mon.2) 753 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:39:59.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:39:59 smithi049 bash[28804]: audit 2024-03-11T22:39:58.968806+0000 mon.c (mon.2) 754 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:39:59.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:59 smithi049 bash[21434]: audit 2024-03-11T22:39:58.895003+0000 mon.c (mon.2) 753 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:39:59.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:39:59 smithi049 bash[21434]: audit 2024-03-11T22:39:58.968806+0000 mon.c (mon.2) 754 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:00.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:40:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: cluster 2024-03-11T22:39:59.014828+0000 mgr.y (mgr.14601) 1178 : cluster 0 pgmap v1610: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: cluster 2024-03-11T22:40:00.000138+0000 mon.a (mon.0) 3477 : cluster 3 overall HEALTH_WARN 3 pool(s) do not have an application enabled 2024-03-11T22:40:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: audit 2024-03-11T22:40:00.050156+0000 mon.a (mon.0) 3478 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: audit 2024-03-11T22:40:00.061810+0000 mon.a (mon.0) 3479 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: audit 2024-03-11T22:40:00.101210+0000 mon.a (mon.0) 3480 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: audit 2024-03-11T22:40:00.112299+0000 mon.a (mon.0) 3481 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: audit 2024-03-11T22:40:00.114771+0000 mon.c (mon.2) 755 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:40:00.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: audit 2024-03-11T22:40:00.115966+0000 mon.c (mon.2) 756 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:40:00.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:00 smithi187 bash[23415]: audit 2024-03-11T22:40:00.124513+0000 mon.a (mon.0) 3482 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: cluster 2024-03-11T22:39:59.014828+0000 mgr.y (mgr.14601) 1178 : cluster 0 pgmap v1610: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: cluster 2024-03-11T22:40:00.000138+0000 mon.a (mon.0) 3477 : cluster 3 overall HEALTH_WARN 3 pool(s) do not have an application enabled 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: audit 2024-03-11T22:40:00.050156+0000 mon.a (mon.0) 3478 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: audit 2024-03-11T22:40:00.061810+0000 mon.a (mon.0) 3479 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: audit 2024-03-11T22:40:00.101210+0000 mon.a (mon.0) 3480 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: audit 2024-03-11T22:40:00.112299+0000 mon.a (mon.0) 3481 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: audit 2024-03-11T22:40:00.114771+0000 mon.c (mon.2) 755 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: audit 2024-03-11T22:40:00.115966+0000 mon.c (mon.2) 756 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[21434]: audit 2024-03-11T22:40:00.124513+0000 mon.a (mon.0) 3482 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: cluster 2024-03-11T22:39:59.014828+0000 mgr.y (mgr.14601) 1178 : cluster 0 pgmap v1610: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:00.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: cluster 2024-03-11T22:40:00.000138+0000 mon.a (mon.0) 3477 : cluster 3 overall HEALTH_WARN 3 pool(s) do not have an application enabled 2024-03-11T22:40:00.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: audit 2024-03-11T22:40:00.050156+0000 mon.a (mon.0) 3478 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: audit 2024-03-11T22:40:00.061810+0000 mon.a (mon.0) 3479 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: audit 2024-03-11T22:40:00.101210+0000 mon.a (mon.0) 3480 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: audit 2024-03-11T22:40:00.112299+0000 mon.a (mon.0) 3481 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:00.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: audit 2024-03-11T22:40:00.114771+0000 mon.c (mon.2) 755 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:40:00.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: audit 2024-03-11T22:40:00.115966+0000 mon.c (mon.2) 756 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:40:00.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:00 smithi049 bash[28804]: audit 2024-03-11T22:40:00.124513+0000 mon.a (mon.0) 3482 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:40:01.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:01 smithi187 bash[23415]: audit 2024-03-11T22:40:00.077513+0000 mgr.y (mgr.14601) 1179 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:01.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:01 smithi049 bash[21434]: audit 2024-03-11T22:40:00.077513+0000 mgr.y (mgr.14601) 1179 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:01.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:01 smithi049 bash[28804]: audit 2024-03-11T22:40:00.077513+0000 mgr.y (mgr.14601) 1179 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:02 smithi187 bash[23415]: cluster 2024-03-11T22:40:01.015671+0000 mgr.y (mgr.14601) 1180 : cluster 0 pgmap v1611: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:02.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:02 smithi049 bash[21434]: cluster 2024-03-11T22:40:01.015671+0000 mgr.y (mgr.14601) 1180 : cluster 0 pgmap v1611: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:02.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:02 smithi049 bash[28804]: cluster 2024-03-11T22:40:01.015671+0000 mgr.y (mgr.14601) 1180 : cluster 0 pgmap v1611: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:04 smithi049 bash[21434]: cluster 2024-03-11T22:40:03.016501+0000 mgr.y (mgr.14601) 1181 : cluster 0 pgmap v1612: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:04.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:04 smithi049 bash[28804]: cluster 2024-03-11T22:40:03.016501+0000 mgr.y (mgr.14601) 1181 : cluster 0 pgmap v1612: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:04.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:40:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:40:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:40:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:04 smithi187 bash[23415]: cluster 2024-03-11T22:40:03.016501+0000 mgr.y (mgr.14601) 1181 : cluster 0 pgmap v1612: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:06.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:06 smithi187 bash[23415]: cluster 2024-03-11T22:40:05.018825+0000 mgr.y (mgr.14601) 1182 : cluster 0 pgmap v1613: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:06.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:06 smithi049 bash[21434]: cluster 2024-03-11T22:40:05.018825+0000 mgr.y (mgr.14601) 1182 : cluster 0 pgmap v1613: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:06.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:06 smithi049 bash[28804]: cluster 2024-03-11T22:40:05.018825+0000 mgr.y (mgr.14601) 1182 : cluster 0 pgmap v1613: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:08.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:08 smithi187 bash[23415]: cluster 2024-03-11T22:40:07.019697+0000 mgr.y (mgr.14601) 1183 : cluster 0 pgmap v1614: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:08.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:08 smithi049 bash[21434]: cluster 2024-03-11T22:40:07.019697+0000 mgr.y (mgr.14601) 1183 : cluster 0 pgmap v1614: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:08.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:08 smithi049 bash[28804]: cluster 2024-03-11T22:40:07.019697+0000 mgr.y (mgr.14601) 1183 : cluster 0 pgmap v1614: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:10.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:10 smithi187 bash[23415]: cluster 2024-03-11T22:40:09.021952+0000 mgr.y (mgr.14601) 1184 : cluster 0 pgmap v1615: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:10.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:40:10 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:40:10.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:10 smithi049 bash[21434]: cluster 2024-03-11T22:40:09.021952+0000 mgr.y (mgr.14601) 1184 : cluster 0 pgmap v1615: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:10.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:10 smithi049 bash[28804]: cluster 2024-03-11T22:40:09.021952+0000 mgr.y (mgr.14601) 1184 : cluster 0 pgmap v1615: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:11.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:11 smithi187 bash[23415]: audit 2024-03-11T22:40:10.086291+0000 mgr.y (mgr.14601) 1185 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:11.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:11 smithi049 bash[21434]: audit 2024-03-11T22:40:10.086291+0000 mgr.y (mgr.14601) 1185 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:11.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:11 smithi049 bash[28804]: audit 2024-03-11T22:40:10.086291+0000 mgr.y (mgr.14601) 1185 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:12.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:12 smithi187 bash[23415]: cluster 2024-03-11T22:40:11.022804+0000 mgr.y (mgr.14601) 1186 : cluster 0 pgmap v1616: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:12.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:12 smithi049 bash[21434]: cluster 2024-03-11T22:40:11.022804+0000 mgr.y (mgr.14601) 1186 : cluster 0 pgmap v1616: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:12.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:12 smithi049 bash[28804]: cluster 2024-03-11T22:40:11.022804+0000 mgr.y (mgr.14601) 1186 : cluster 0 pgmap v1616: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:14.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:40:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:40:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:40:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:14 smithi049 bash[21434]: cluster 2024-03-11T22:40:13.023654+0000 mgr.y (mgr.14601) 1187 : cluster 0 pgmap v1617: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:14 smithi049 bash[21434]: audit 2024-03-11T22:40:13.996946+0000 mon.c (mon.2) 757 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:14 smithi049 bash[28804]: cluster 2024-03-11T22:40:13.023654+0000 mgr.y (mgr.14601) 1187 : cluster 0 pgmap v1617: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:14 smithi049 bash[28804]: audit 2024-03-11T22:40:13.996946+0000 mon.c (mon.2) 757 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:14 smithi187 bash[23415]: cluster 2024-03-11T22:40:13.023654+0000 mgr.y (mgr.14601) 1187 : cluster 0 pgmap v1617: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:14 smithi187 bash[23415]: audit 2024-03-11T22:40:13.996946+0000 mon.c (mon.2) 757 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:16.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:16 smithi187 bash[23415]: cluster 2024-03-11T22:40:15.025946+0000 mgr.y (mgr.14601) 1188 : cluster 0 pgmap v1618: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:16.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:16 smithi049 bash[21434]: cluster 2024-03-11T22:40:15.025946+0000 mgr.y (mgr.14601) 1188 : cluster 0 pgmap v1618: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:16.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:16 smithi049 bash[28804]: cluster 2024-03-11T22:40:15.025946+0000 mgr.y (mgr.14601) 1188 : cluster 0 pgmap v1618: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:17.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:17 smithi187 bash[23415]: cluster 2024-03-11T22:40:17.026826+0000 mgr.y (mgr.14601) 1189 : cluster 0 pgmap v1619: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:17.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:17 smithi049 bash[21434]: cluster 2024-03-11T22:40:17.026826+0000 mgr.y (mgr.14601) 1189 : cluster 0 pgmap v1619: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:17.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:17 smithi049 bash[28804]: cluster 2024-03-11T22:40:17.026826+0000 mgr.y (mgr.14601) 1189 : cluster 0 pgmap v1619: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:20.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:20 smithi187 bash[23415]: cluster 2024-03-11T22:40:19.029123+0000 mgr.y (mgr.14601) 1190 : cluster 0 pgmap v1620: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:20.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:40:20 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:40:20.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:20 smithi049 bash[28804]: cluster 2024-03-11T22:40:19.029123+0000 mgr.y (mgr.14601) 1190 : cluster 0 pgmap v1620: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:20.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:20 smithi049 bash[21434]: cluster 2024-03-11T22:40:19.029123+0000 mgr.y (mgr.14601) 1190 : cluster 0 pgmap v1620: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:21.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:21 smithi187 bash[23415]: audit 2024-03-11T22:40:20.093911+0000 mgr.y (mgr.14601) 1191 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:21.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:21 smithi049 bash[28804]: audit 2024-03-11T22:40:20.093911+0000 mgr.y (mgr.14601) 1191 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:21.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:21 smithi049 bash[21434]: audit 2024-03-11T22:40:20.093911+0000 mgr.y (mgr.14601) 1191 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:22.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:22 smithi187 bash[23415]: cluster 2024-03-11T22:40:21.029917+0000 mgr.y (mgr.14601) 1192 : cluster 0 pgmap v1621: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:22.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:22 smithi049 bash[28804]: cluster 2024-03-11T22:40:21.029917+0000 mgr.y (mgr.14601) 1192 : cluster 0 pgmap v1621: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:22.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:22 smithi049 bash[21434]: cluster 2024-03-11T22:40:21.029917+0000 mgr.y (mgr.14601) 1192 : cluster 0 pgmap v1621: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:24.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:24 smithi187 bash[23415]: cluster 2024-03-11T22:40:23.030813+0000 mgr.y (mgr.14601) 1193 : cluster 0 pgmap v1622: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:24.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:24 smithi049 bash[28804]: cluster 2024-03-11T22:40:23.030813+0000 mgr.y (mgr.14601) 1193 : cluster 0 pgmap v1622: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:24 smithi049 bash[21434]: cluster 2024-03-11T22:40:23.030813+0000 mgr.y (mgr.14601) 1193 : cluster 0 pgmap v1622: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:24.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:40:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:40:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:40:26.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:26 smithi187 bash[23415]: cluster 2024-03-11T22:40:25.033127+0000 mgr.y (mgr.14601) 1194 : cluster 0 pgmap v1623: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:26.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:26 smithi049 bash[28804]: cluster 2024-03-11T22:40:25.033127+0000 mgr.y (mgr.14601) 1194 : cluster 0 pgmap v1623: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:26.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:26 smithi049 bash[21434]: cluster 2024-03-11T22:40:25.033127+0000 mgr.y (mgr.14601) 1194 : cluster 0 pgmap v1623: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:28.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:28 smithi187 bash[23415]: cluster 2024-03-11T22:40:27.033928+0000 mgr.y (mgr.14601) 1195 : cluster 0 pgmap v1624: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:28.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:28 smithi049 bash[21434]: cluster 2024-03-11T22:40:27.033928+0000 mgr.y (mgr.14601) 1195 : cluster 0 pgmap v1624: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:28.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:28 smithi049 bash[28804]: cluster 2024-03-11T22:40:27.033928+0000 mgr.y (mgr.14601) 1195 : cluster 0 pgmap v1624: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:29.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:29 smithi187 bash[23415]: audit 2024-03-11T22:40:29.031695+0000 mon.c (mon.2) 758 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:29.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:29 smithi049 bash[21434]: audit 2024-03-11T22:40:29.031695+0000 mon.c (mon.2) 758 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:29.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:29 smithi049 bash[28804]: audit 2024-03-11T22:40:29.031695+0000 mon.c (mon.2) 758 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:30.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:30 smithi187 bash[23415]: cluster 2024-03-11T22:40:29.036087+0000 mgr.y (mgr.14601) 1196 : cluster 0 pgmap v1625: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:30.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:40:30 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:40:30.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:30 smithi049 bash[21434]: cluster 2024-03-11T22:40:29.036087+0000 mgr.y (mgr.14601) 1196 : cluster 0 pgmap v1625: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:30.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:30 smithi049 bash[28804]: cluster 2024-03-11T22:40:29.036087+0000 mgr.y (mgr.14601) 1196 : cluster 0 pgmap v1625: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:31.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:31 smithi187 bash[23415]: audit 2024-03-11T22:40:30.105203+0000 mgr.y (mgr.14601) 1197 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:31.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:31 smithi049 bash[21434]: audit 2024-03-11T22:40:30.105203+0000 mgr.y (mgr.14601) 1197 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:31.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:31 smithi049 bash[28804]: audit 2024-03-11T22:40:30.105203+0000 mgr.y (mgr.14601) 1197 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:32.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:32 smithi187 bash[23415]: cluster 2024-03-11T22:40:31.037580+0000 mgr.y (mgr.14601) 1198 : cluster 0 pgmap v1626: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:32.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:32 smithi049 bash[21434]: cluster 2024-03-11T22:40:31.037580+0000 mgr.y (mgr.14601) 1198 : cluster 0 pgmap v1626: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:32.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:32 smithi049 bash[28804]: cluster 2024-03-11T22:40:31.037580+0000 mgr.y (mgr.14601) 1198 : cluster 0 pgmap v1626: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:34.003 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:40:33 smithi187 bash[50671]: logger=cleanup t=2024-03-11T22:40:33.674817845Z level=info msg="Completed cleanup jobs" duration=59.746916ms 2024-03-11T22:40:34.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:34 smithi187 bash[23415]: cluster 2024-03-11T22:40:33.038419+0000 mgr.y (mgr.14601) 1199 : cluster 0 pgmap v1627: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:34.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:34 smithi049 bash[28804]: cluster 2024-03-11T22:40:33.038419+0000 mgr.y (mgr.14601) 1199 : cluster 0 pgmap v1627: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:34 smithi049 bash[21434]: cluster 2024-03-11T22:40:33.038419+0000 mgr.y (mgr.14601) 1199 : cluster 0 pgmap v1627: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:34.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:40:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:40:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:40:36.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:36 smithi187 bash[23415]: cluster 2024-03-11T22:40:35.040674+0000 mgr.y (mgr.14601) 1200 : cluster 0 pgmap v1628: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:36.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:36 smithi049 bash[21434]: cluster 2024-03-11T22:40:35.040674+0000 mgr.y (mgr.14601) 1200 : cluster 0 pgmap v1628: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:36.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:36 smithi049 bash[28804]: cluster 2024-03-11T22:40:35.040674+0000 mgr.y (mgr.14601) 1200 : cluster 0 pgmap v1628: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:38.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:38 smithi187 bash[23415]: cluster 2024-03-11T22:40:37.041488+0000 mgr.y (mgr.14601) 1201 : cluster 0 pgmap v1629: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:38.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:38 smithi049 bash[21434]: cluster 2024-03-11T22:40:37.041488+0000 mgr.y (mgr.14601) 1201 : cluster 0 pgmap v1629: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:38.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:38 smithi049 bash[28804]: cluster 2024-03-11T22:40:37.041488+0000 mgr.y (mgr.14601) 1201 : cluster 0 pgmap v1629: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:40.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:40 smithi187 bash[23415]: cluster 2024-03-11T22:40:39.043620+0000 mgr.y (mgr.14601) 1202 : cluster 0 pgmap v1630: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:40.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:40:40 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:40:40.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:40 smithi049 bash[28804]: cluster 2024-03-11T22:40:39.043620+0000 mgr.y (mgr.14601) 1202 : cluster 0 pgmap v1630: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:40.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:40 smithi049 bash[21434]: cluster 2024-03-11T22:40:39.043620+0000 mgr.y (mgr.14601) 1202 : cluster 0 pgmap v1630: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:41.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:41 smithi187 bash[23415]: audit 2024-03-11T22:40:40.116432+0000 mgr.y (mgr.14601) 1203 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:41.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:41 smithi049 bash[21434]: audit 2024-03-11T22:40:40.116432+0000 mgr.y (mgr.14601) 1203 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:41.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:41 smithi049 bash[28804]: audit 2024-03-11T22:40:40.116432+0000 mgr.y (mgr.14601) 1203 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:42.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:42 smithi187 bash[23415]: cluster 2024-03-11T22:40:41.044455+0000 mgr.y (mgr.14601) 1204 : cluster 0 pgmap v1631: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:42.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:42 smithi049 bash[28804]: cluster 2024-03-11T22:40:41.044455+0000 mgr.y (mgr.14601) 1204 : cluster 0 pgmap v1631: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:42.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:42 smithi049 bash[21434]: cluster 2024-03-11T22:40:41.044455+0000 mgr.y (mgr.14601) 1204 : cluster 0 pgmap v1631: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:44.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:44 smithi187 bash[23415]: cluster 2024-03-11T22:40:43.045288+0000 mgr.y (mgr.14601) 1205 : cluster 0 pgmap v1632: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:44.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:44 smithi187 bash[23415]: audit 2024-03-11T22:40:44.067197+0000 mon.c (mon.2) 759 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:44.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:40:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:40:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:40:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:44 smithi049 bash[21434]: cluster 2024-03-11T22:40:43.045288+0000 mgr.y (mgr.14601) 1205 : cluster 0 pgmap v1632: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:44 smithi049 bash[21434]: audit 2024-03-11T22:40:44.067197+0000 mon.c (mon.2) 759 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:44 smithi049 bash[28804]: cluster 2024-03-11T22:40:43.045288+0000 mgr.y (mgr.14601) 1205 : cluster 0 pgmap v1632: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:44 smithi049 bash[28804]: audit 2024-03-11T22:40:44.067197+0000 mon.c (mon.2) 759 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:46.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:46 smithi187 bash[23415]: cluster 2024-03-11T22:40:45.047527+0000 mgr.y (mgr.14601) 1206 : cluster 0 pgmap v1633: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:46.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:46 smithi049 bash[21434]: cluster 2024-03-11T22:40:45.047527+0000 mgr.y (mgr.14601) 1206 : cluster 0 pgmap v1633: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:46.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:46 smithi049 bash[28804]: cluster 2024-03-11T22:40:45.047527+0000 mgr.y (mgr.14601) 1206 : cluster 0 pgmap v1633: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:48.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:48 smithi187 bash[23415]: cluster 2024-03-11T22:40:47.048350+0000 mgr.y (mgr.14601) 1207 : cluster 0 pgmap v1634: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:48.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:48 smithi049 bash[21434]: cluster 2024-03-11T22:40:47.048350+0000 mgr.y (mgr.14601) 1207 : cluster 0 pgmap v1634: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:48.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:48 smithi049 bash[28804]: cluster 2024-03-11T22:40:47.048350+0000 mgr.y (mgr.14601) 1207 : cluster 0 pgmap v1634: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:50.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:50 smithi187 bash[23415]: cluster 2024-03-11T22:40:49.050537+0000 mgr.y (mgr.14601) 1208 : cluster 0 pgmap v1635: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:50.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:40:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:40:50.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:50 smithi049 bash[21434]: cluster 2024-03-11T22:40:49.050537+0000 mgr.y (mgr.14601) 1208 : cluster 0 pgmap v1635: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:50.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:50 smithi049 bash[28804]: cluster 2024-03-11T22:40:49.050537+0000 mgr.y (mgr.14601) 1208 : cluster 0 pgmap v1635: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:51.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:51 smithi187 bash[23415]: audit 2024-03-11T22:40:50.127849+0000 mgr.y (mgr.14601) 1209 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:51.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:51 smithi049 bash[21434]: audit 2024-03-11T22:40:50.127849+0000 mgr.y (mgr.14601) 1209 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:51.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:51 smithi049 bash[28804]: audit 2024-03-11T22:40:50.127849+0000 mgr.y (mgr.14601) 1209 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:40:52.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:52 smithi187 bash[23415]: cluster 2024-03-11T22:40:51.051344+0000 mgr.y (mgr.14601) 1210 : cluster 0 pgmap v1636: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:52.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:52 smithi049 bash[21434]: cluster 2024-03-11T22:40:51.051344+0000 mgr.y (mgr.14601) 1210 : cluster 0 pgmap v1636: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:52.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:52 smithi049 bash[28804]: cluster 2024-03-11T22:40:51.051344+0000 mgr.y (mgr.14601) 1210 : cluster 0 pgmap v1636: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:54.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:54 smithi187 bash[23415]: cluster 2024-03-11T22:40:53.052171+0000 mgr.y (mgr.14601) 1211 : cluster 0 pgmap v1637: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:54 smithi049 bash[21434]: cluster 2024-03-11T22:40:53.052171+0000 mgr.y (mgr.14601) 1211 : cluster 0 pgmap v1637: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:54.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:54 smithi049 bash[28804]: cluster 2024-03-11T22:40:53.052171+0000 mgr.y (mgr.14601) 1211 : cluster 0 pgmap v1637: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:54.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:40:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:40:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:40:56.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:56 smithi187 bash[23415]: cluster 2024-03-11T22:40:55.054541+0000 mgr.y (mgr.14601) 1212 : cluster 0 pgmap v1638: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:56.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:56 smithi049 bash[21434]: cluster 2024-03-11T22:40:55.054541+0000 mgr.y (mgr.14601) 1212 : cluster 0 pgmap v1638: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:56.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:56 smithi049 bash[28804]: cluster 2024-03-11T22:40:55.054541+0000 mgr.y (mgr.14601) 1212 : cluster 0 pgmap v1638: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:40:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:58 smithi187 bash[23415]: cluster 2024-03-11T22:40:57.055434+0000 mgr.y (mgr.14601) 1213 : cluster 0 pgmap v1639: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:58.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:58 smithi049 bash[21434]: cluster 2024-03-11T22:40:57.055434+0000 mgr.y (mgr.14601) 1213 : cluster 0 pgmap v1639: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:58.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:58 smithi049 bash[28804]: cluster 2024-03-11T22:40:57.055434+0000 mgr.y (mgr.14601) 1213 : cluster 0 pgmap v1639: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:40:59.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:40:59 smithi187 bash[23415]: audit 2024-03-11T22:40:59.101844+0000 mon.c (mon.2) 760 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:59.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:40:59 smithi049 bash[21434]: audit 2024-03-11T22:40:59.101844+0000 mon.c (mon.2) 760 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:40:59.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:40:59 smithi049 bash[28804]: audit 2024-03-11T22:40:59.101844+0000 mon.c (mon.2) 760 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:00.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:41:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:41:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:00 smithi187 bash[23415]: cluster 2024-03-11T22:40:59.057711+0000 mgr.y (mgr.14601) 1214 : cluster 0 pgmap v1640: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:00.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:00 smithi187 bash[23415]: audit 2024-03-11T22:41:00.212418+0000 mon.c (mon.2) 761 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:41:00.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:00 smithi049 bash[21434]: cluster 2024-03-11T22:40:59.057711+0000 mgr.y (mgr.14601) 1214 : cluster 0 pgmap v1640: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:00.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:00 smithi049 bash[21434]: audit 2024-03-11T22:41:00.212418+0000 mon.c (mon.2) 761 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:41:00.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:00 smithi049 bash[28804]: cluster 2024-03-11T22:40:59.057711+0000 mgr.y (mgr.14601) 1214 : cluster 0 pgmap v1640: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:00.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:00 smithi049 bash[28804]: audit 2024-03-11T22:41:00.212418+0000 mon.c (mon.2) 761 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:41:01.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:01 smithi187 bash[23415]: audit 2024-03-11T22:41:00.139214+0000 mgr.y (mgr.14601) 1215 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:01.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:01 smithi187 bash[23415]: audit 2024-03-11T22:41:00.789607+0000 mon.a (mon.0) 3483 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:01.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:01 smithi187 bash[23415]: audit 2024-03-11T22:41:00.803683+0000 mon.a (mon.0) 3484 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:01.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:01 smithi049 bash[21434]: audit 2024-03-11T22:41:00.139214+0000 mgr.y (mgr.14601) 1215 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:01.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:01 smithi049 bash[21434]: audit 2024-03-11T22:41:00.789607+0000 mon.a (mon.0) 3483 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:01.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:01 smithi049 bash[21434]: audit 2024-03-11T22:41:00.803683+0000 mon.a (mon.0) 3484 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:01.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:01 smithi049 bash[28804]: audit 2024-03-11T22:41:00.139214+0000 mgr.y (mgr.14601) 1215 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:01.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:01 smithi049 bash[28804]: audit 2024-03-11T22:41:00.789607+0000 mon.a (mon.0) 3483 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:01.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:01 smithi049 bash[28804]: audit 2024-03-11T22:41:00.803683+0000 mon.a (mon.0) 3484 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:02.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:02 smithi187 bash[23415]: cluster 2024-03-11T22:41:01.058529+0000 mgr.y (mgr.14601) 1216 : cluster 0 pgmap v1641: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:02.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:02 smithi187 bash[23415]: audit 2024-03-11T22:41:01.497063+0000 mon.c (mon.2) 762 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:41:02.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:02 smithi187 bash[23415]: audit 2024-03-11T22:41:01.499001+0000 mon.c (mon.2) 763 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:41:02.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:02 smithi187 bash[23415]: audit 2024-03-11T22:41:01.510240+0000 mon.a (mon.0) 3485 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:02.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[21434]: cluster 2024-03-11T22:41:01.058529+0000 mgr.y (mgr.14601) 1216 : cluster 0 pgmap v1641: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:02.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[21434]: audit 2024-03-11T22:41:01.497063+0000 mon.c (mon.2) 762 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:41:02.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[21434]: audit 2024-03-11T22:41:01.499001+0000 mon.c (mon.2) 763 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:41:02.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[21434]: audit 2024-03-11T22:41:01.510240+0000 mon.a (mon.0) 3485 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:02.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[28804]: cluster 2024-03-11T22:41:01.058529+0000 mgr.y (mgr.14601) 1216 : cluster 0 pgmap v1641: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:02.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[28804]: audit 2024-03-11T22:41:01.497063+0000 mon.c (mon.2) 762 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:41:02.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[28804]: audit 2024-03-11T22:41:01.499001+0000 mon.c (mon.2) 763 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:41:02.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:02 smithi049 bash[28804]: audit 2024-03-11T22:41:01.510240+0000 mon.a (mon.0) 3485 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:41:04.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:04 smithi187 bash[23415]: cluster 2024-03-11T22:41:03.059359+0000 mgr.y (mgr.14601) 1217 : cluster 0 pgmap v1642: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:04 smithi049 bash[21434]: cluster 2024-03-11T22:41:03.059359+0000 mgr.y (mgr.14601) 1217 : cluster 0 pgmap v1642: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:04 smithi049 bash[28804]: cluster 2024-03-11T22:41:03.059359+0000 mgr.y (mgr.14601) 1217 : cluster 0 pgmap v1642: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:04.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:41:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:41:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:41:06.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:06 smithi187 bash[23415]: cluster 2024-03-11T22:41:05.061661+0000 mgr.y (mgr.14601) 1218 : cluster 0 pgmap v1643: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:06.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:06 smithi049 bash[21434]: cluster 2024-03-11T22:41:05.061661+0000 mgr.y (mgr.14601) 1218 : cluster 0 pgmap v1643: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:06.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:06 smithi049 bash[28804]: cluster 2024-03-11T22:41:05.061661+0000 mgr.y (mgr.14601) 1218 : cluster 0 pgmap v1643: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:08.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:08 smithi187 bash[23415]: cluster 2024-03-11T22:41:07.062462+0000 mgr.y (mgr.14601) 1219 : cluster 0 pgmap v1644: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:08.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:08 smithi049 bash[21434]: cluster 2024-03-11T22:41:07.062462+0000 mgr.y (mgr.14601) 1219 : cluster 0 pgmap v1644: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:08.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:08 smithi049 bash[28804]: cluster 2024-03-11T22:41:07.062462+0000 mgr.y (mgr.14601) 1219 : cluster 0 pgmap v1644: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:10.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:10 smithi187 bash[23415]: cluster 2024-03-11T22:41:09.064728+0000 mgr.y (mgr.14601) 1220 : cluster 0 pgmap v1645: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:10.504 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:41:10 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:41:10.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:10 smithi049 bash[21434]: cluster 2024-03-11T22:41:09.064728+0000 mgr.y (mgr.14601) 1220 : cluster 0 pgmap v1645: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:10.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:10 smithi049 bash[28804]: cluster 2024-03-11T22:41:09.064728+0000 mgr.y (mgr.14601) 1220 : cluster 0 pgmap v1645: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:11.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:11 smithi049 bash[21434]: audit 2024-03-11T22:41:10.150649+0000 mgr.y (mgr.14601) 1221 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:11.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:11 smithi049 bash[28804]: audit 2024-03-11T22:41:10.150649+0000 mgr.y (mgr.14601) 1221 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:11.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:11 smithi187 bash[23415]: audit 2024-03-11T22:41:10.150649+0000 mgr.y (mgr.14601) 1221 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:12.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:12 smithi049 bash[21434]: cluster 2024-03-11T22:41:11.065584+0000 mgr.y (mgr.14601) 1222 : cluster 0 pgmap v1646: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:12.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:12 smithi049 bash[28804]: cluster 2024-03-11T22:41:11.065584+0000 mgr.y (mgr.14601) 1222 : cluster 0 pgmap v1646: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:12.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:12 smithi187 bash[23415]: cluster 2024-03-11T22:41:11.065584+0000 mgr.y (mgr.14601) 1222 : cluster 0 pgmap v1646: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:14.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:41:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:41:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:41:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:14 smithi049 bash[21434]: cluster 2024-03-11T22:41:13.066392+0000 mgr.y (mgr.14601) 1223 : cluster 0 pgmap v1647: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:14 smithi049 bash[21434]: audit 2024-03-11T22:41:14.135598+0000 mon.c (mon.2) 764 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:14 smithi049 bash[28804]: cluster 2024-03-11T22:41:13.066392+0000 mgr.y (mgr.14601) 1223 : cluster 0 pgmap v1647: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:14 smithi049 bash[28804]: audit 2024-03-11T22:41:14.135598+0000 mon.c (mon.2) 764 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:14 smithi187 bash[23415]: cluster 2024-03-11T22:41:13.066392+0000 mgr.y (mgr.14601) 1223 : cluster 0 pgmap v1647: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:14 smithi187 bash[23415]: audit 2024-03-11T22:41:14.135598+0000 mon.c (mon.2) 764 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:16.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:16 smithi049 bash[21434]: cluster 2024-03-11T22:41:15.068662+0000 mgr.y (mgr.14601) 1224 : cluster 0 pgmap v1648: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:16.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:16 smithi049 bash[28804]: cluster 2024-03-11T22:41:15.068662+0000 mgr.y (mgr.14601) 1224 : cluster 0 pgmap v1648: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:16.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:16 smithi187 bash[23415]: cluster 2024-03-11T22:41:15.068662+0000 mgr.y (mgr.14601) 1224 : cluster 0 pgmap v1648: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:18.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:18 smithi049 bash[21434]: cluster 2024-03-11T22:41:17.069512+0000 mgr.y (mgr.14601) 1225 : cluster 0 pgmap v1649: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:18.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:18 smithi049 bash[28804]: cluster 2024-03-11T22:41:17.069512+0000 mgr.y (mgr.14601) 1225 : cluster 0 pgmap v1649: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:18.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:18 smithi187 bash[23415]: cluster 2024-03-11T22:41:17.069512+0000 mgr.y (mgr.14601) 1225 : cluster 0 pgmap v1649: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:20.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:20 smithi187 bash[23415]: cluster 2024-03-11T22:41:19.071730+0000 mgr.y (mgr.14601) 1226 : cluster 0 pgmap v1650: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:20.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:41:20 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:41:20.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:20 smithi049 bash[21434]: cluster 2024-03-11T22:41:19.071730+0000 mgr.y (mgr.14601) 1226 : cluster 0 pgmap v1650: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:20.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:20 smithi049 bash[28804]: cluster 2024-03-11T22:41:19.071730+0000 mgr.y (mgr.14601) 1226 : cluster 0 pgmap v1650: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:21.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:21 smithi049 bash[21434]: audit 2024-03-11T22:41:20.162089+0000 mgr.y (mgr.14601) 1227 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:21.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:21 smithi049 bash[28804]: audit 2024-03-11T22:41:20.162089+0000 mgr.y (mgr.14601) 1227 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:21.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:21 smithi187 bash[23415]: audit 2024-03-11T22:41:20.162089+0000 mgr.y (mgr.14601) 1227 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:22.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:22 smithi049 bash[21434]: cluster 2024-03-11T22:41:21.072595+0000 mgr.y (mgr.14601) 1228 : cluster 0 pgmap v1651: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:22.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:22 smithi049 bash[28804]: cluster 2024-03-11T22:41:21.072595+0000 mgr.y (mgr.14601) 1228 : cluster 0 pgmap v1651: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:22.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:22 smithi187 bash[23415]: cluster 2024-03-11T22:41:21.072595+0000 mgr.y (mgr.14601) 1228 : cluster 0 pgmap v1651: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:24 smithi049 bash[21434]: cluster 2024-03-11T22:41:23.073479+0000 mgr.y (mgr.14601) 1229 : cluster 0 pgmap v1652: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:24.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:41:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:41:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:41:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:24 smithi049 bash[28804]: cluster 2024-03-11T22:41:23.073479+0000 mgr.y (mgr.14601) 1229 : cluster 0 pgmap v1652: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:24.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:24 smithi187 bash[23415]: cluster 2024-03-11T22:41:23.073479+0000 mgr.y (mgr.14601) 1229 : cluster 0 pgmap v1652: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:26.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:26 smithi187 bash[23415]: cluster 2024-03-11T22:41:25.075774+0000 mgr.y (mgr.14601) 1230 : cluster 0 pgmap v1653: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:26.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:26 smithi049 bash[21434]: cluster 2024-03-11T22:41:25.075774+0000 mgr.y (mgr.14601) 1230 : cluster 0 pgmap v1653: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:26 smithi049 bash[28804]: cluster 2024-03-11T22:41:25.075774+0000 mgr.y (mgr.14601) 1230 : cluster 0 pgmap v1653: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:28.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:28 smithi187 bash[23415]: cluster 2024-03-11T22:41:27.076609+0000 mgr.y (mgr.14601) 1231 : cluster 0 pgmap v1654: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:28.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:28 smithi049 bash[21434]: cluster 2024-03-11T22:41:27.076609+0000 mgr.y (mgr.14601) 1231 : cluster 0 pgmap v1654: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:28.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:28 smithi049 bash[28804]: cluster 2024-03-11T22:41:27.076609+0000 mgr.y (mgr.14601) 1231 : cluster 0 pgmap v1654: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:29.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:29 smithi187 bash[23415]: audit 2024-03-11T22:41:29.169391+0000 mon.c (mon.2) 765 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:29.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:29 smithi049 bash[21434]: audit 2024-03-11T22:41:29.169391+0000 mon.c (mon.2) 765 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:29.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:29 smithi049 bash[28804]: audit 2024-03-11T22:41:29.169391+0000 mon.c (mon.2) 765 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:30.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:30 smithi187 bash[23415]: cluster 2024-03-11T22:41:29.078854+0000 mgr.y (mgr.14601) 1232 : cluster 0 pgmap v1655: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:30.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:41:30 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:41:30.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:30 smithi049 bash[21434]: cluster 2024-03-11T22:41:29.078854+0000 mgr.y (mgr.14601) 1232 : cluster 0 pgmap v1655: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:30 smithi049 bash[28804]: cluster 2024-03-11T22:41:29.078854+0000 mgr.y (mgr.14601) 1232 : cluster 0 pgmap v1655: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:31.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:31 smithi187 bash[23415]: audit 2024-03-11T22:41:30.169872+0000 mgr.y (mgr.14601) 1233 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:31.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:31 smithi049 bash[28804]: audit 2024-03-11T22:41:30.169872+0000 mgr.y (mgr.14601) 1233 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:31.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:31 smithi049 bash[21434]: audit 2024-03-11T22:41:30.169872+0000 mgr.y (mgr.14601) 1233 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:32.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:32 smithi187 bash[23415]: cluster 2024-03-11T22:41:31.079687+0000 mgr.y (mgr.14601) 1234 : cluster 0 pgmap v1656: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:32.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:32 smithi049 bash[21434]: cluster 2024-03-11T22:41:31.079687+0000 mgr.y (mgr.14601) 1234 : cluster 0 pgmap v1656: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:32.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:32 smithi049 bash[28804]: cluster 2024-03-11T22:41:31.079687+0000 mgr.y (mgr.14601) 1234 : cluster 0 pgmap v1656: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:34 smithi049 bash[21434]: cluster 2024-03-11T22:41:33.080646+0000 mgr.y (mgr.14601) 1235 : cluster 0 pgmap v1657: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:34.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:34 smithi049 bash[28804]: cluster 2024-03-11T22:41:33.080646+0000 mgr.y (mgr.14601) 1235 : cluster 0 pgmap v1657: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:34.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:41:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:41:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:41:34.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:34 smithi187 bash[23415]: cluster 2024-03-11T22:41:33.080646+0000 mgr.y (mgr.14601) 1235 : cluster 0 pgmap v1657: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:36.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:36 smithi187 bash[23415]: cluster 2024-03-11T22:41:35.082960+0000 mgr.y (mgr.14601) 1236 : cluster 0 pgmap v1658: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:36.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:36 smithi049 bash[21434]: cluster 2024-03-11T22:41:35.082960+0000 mgr.y (mgr.14601) 1236 : cluster 0 pgmap v1658: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:36.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:36 smithi049 bash[28804]: cluster 2024-03-11T22:41:35.082960+0000 mgr.y (mgr.14601) 1236 : cluster 0 pgmap v1658: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:38.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:38 smithi187 bash[23415]: cluster 2024-03-11T22:41:37.083928+0000 mgr.y (mgr.14601) 1237 : cluster 0 pgmap v1659: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:38.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:38 smithi049 bash[21434]: cluster 2024-03-11T22:41:37.083928+0000 mgr.y (mgr.14601) 1237 : cluster 0 pgmap v1659: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:38.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:38 smithi049 bash[28804]: cluster 2024-03-11T22:41:37.083928+0000 mgr.y (mgr.14601) 1237 : cluster 0 pgmap v1659: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:40.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:40 smithi187 bash[23415]: cluster 2024-03-11T22:41:39.086330+0000 mgr.y (mgr.14601) 1238 : cluster 0 pgmap v1660: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:40.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:41:40 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:41:40.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:40 smithi049 bash[21434]: cluster 2024-03-11T22:41:39.086330+0000 mgr.y (mgr.14601) 1238 : cluster 0 pgmap v1660: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:40.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:40 smithi049 bash[28804]: cluster 2024-03-11T22:41:39.086330+0000 mgr.y (mgr.14601) 1238 : cluster 0 pgmap v1660: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:41.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:41 smithi187 bash[23415]: audit 2024-03-11T22:41:40.175373+0000 mgr.y (mgr.14601) 1239 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:41.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:41 smithi049 bash[21434]: audit 2024-03-11T22:41:40.175373+0000 mgr.y (mgr.14601) 1239 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:41.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:41 smithi049 bash[28804]: audit 2024-03-11T22:41:40.175373+0000 mgr.y (mgr.14601) 1239 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:42.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:42 smithi187 bash[23415]: cluster 2024-03-11T22:41:41.087307+0000 mgr.y (mgr.14601) 1240 : cluster 0 pgmap v1661: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:42.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:42 smithi049 bash[21434]: cluster 2024-03-11T22:41:41.087307+0000 mgr.y (mgr.14601) 1240 : cluster 0 pgmap v1661: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:42.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:42 smithi049 bash[28804]: cluster 2024-03-11T22:41:41.087307+0000 mgr.y (mgr.14601) 1240 : cluster 0 pgmap v1661: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:44.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:41:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:41:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:41:44.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:44 smithi049 bash[21434]: cluster 2024-03-11T22:41:43.088122+0000 mgr.y (mgr.14601) 1241 : cluster 0 pgmap v1662: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:44.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:44 smithi049 bash[21434]: audit 2024-03-11T22:41:44.204056+0000 mon.c (mon.2) 766 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:44 smithi049 bash[28804]: cluster 2024-03-11T22:41:43.088122+0000 mgr.y (mgr.14601) 1241 : cluster 0 pgmap v1662: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:44 smithi049 bash[28804]: audit 2024-03-11T22:41:44.204056+0000 mon.c (mon.2) 766 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:44.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:44 smithi187 bash[23415]: cluster 2024-03-11T22:41:43.088122+0000 mgr.y (mgr.14601) 1241 : cluster 0 pgmap v1662: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:44.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:44 smithi187 bash[23415]: audit 2024-03-11T22:41:44.204056+0000 mon.c (mon.2) 766 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:41:46.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:46 smithi187 bash[23415]: cluster 2024-03-11T22:41:45.090492+0000 mgr.y (mgr.14601) 1242 : cluster 0 pgmap v1663: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:46.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:46 smithi049 bash[21434]: cluster 2024-03-11T22:41:45.090492+0000 mgr.y (mgr.14601) 1242 : cluster 0 pgmap v1663: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:46.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:46 smithi049 bash[28804]: cluster 2024-03-11T22:41:45.090492+0000 mgr.y (mgr.14601) 1242 : cluster 0 pgmap v1663: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:47.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:47 smithi187 bash[23415]: cluster 2024-03-11T22:41:47.091331+0000 mgr.y (mgr.14601) 1243 : cluster 0 pgmap v1664: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:47.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:47 smithi049 bash[21434]: cluster 2024-03-11T22:41:47.091331+0000 mgr.y (mgr.14601) 1243 : cluster 0 pgmap v1664: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:47.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:47 smithi049 bash[28804]: cluster 2024-03-11T22:41:47.091331+0000 mgr.y (mgr.14601) 1243 : cluster 0 pgmap v1664: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:50.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:41:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:41:50.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:50 smithi187 bash[23415]: cluster 2024-03-11T22:41:49.093581+0000 mgr.y (mgr.14601) 1244 : cluster 0 pgmap v1665: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:50.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:50 smithi049 bash[21434]: cluster 2024-03-11T22:41:49.093581+0000 mgr.y (mgr.14601) 1244 : cluster 0 pgmap v1665: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:50.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:50 smithi049 bash[28804]: cluster 2024-03-11T22:41:49.093581+0000 mgr.y (mgr.14601) 1244 : cluster 0 pgmap v1665: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:51.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:51 smithi187 bash[23415]: audit 2024-03-11T22:41:50.178147+0000 mgr.y (mgr.14601) 1245 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:51.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:51 smithi049 bash[21434]: audit 2024-03-11T22:41:50.178147+0000 mgr.y (mgr.14601) 1245 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:51.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:51 smithi049 bash[28804]: audit 2024-03-11T22:41:50.178147+0000 mgr.y (mgr.14601) 1245 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:41:52.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:52 smithi187 bash[23415]: cluster 2024-03-11T22:41:51.094372+0000 mgr.y (mgr.14601) 1246 : cluster 0 pgmap v1666: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:52.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:52 smithi049 bash[21434]: cluster 2024-03-11T22:41:51.094372+0000 mgr.y (mgr.14601) 1246 : cluster 0 pgmap v1666: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:52.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:52 smithi049 bash[28804]: cluster 2024-03-11T22:41:51.094372+0000 mgr.y (mgr.14601) 1246 : cluster 0 pgmap v1666: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:54.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:54 smithi187 bash[23415]: cluster 2024-03-11T22:41:53.095178+0000 mgr.y (mgr.14601) 1247 : cluster 0 pgmap v1667: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:54.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:54 smithi049 bash[28804]: cluster 2024-03-11T22:41:53.095178+0000 mgr.y (mgr.14601) 1247 : cluster 0 pgmap v1667: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:54.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:54 smithi049 bash[21434]: cluster 2024-03-11T22:41:53.095178+0000 mgr.y (mgr.14601) 1247 : cluster 0 pgmap v1667: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:54.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:41:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:41:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:41:56.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:56 smithi187 bash[23415]: cluster 2024-03-11T22:41:55.097489+0000 mgr.y (mgr.14601) 1248 : cluster 0 pgmap v1668: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:56.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:56 smithi049 bash[21434]: cluster 2024-03-11T22:41:55.097489+0000 mgr.y (mgr.14601) 1248 : cluster 0 pgmap v1668: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:56.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:56 smithi049 bash[28804]: cluster 2024-03-11T22:41:55.097489+0000 mgr.y (mgr.14601) 1248 : cluster 0 pgmap v1668: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:41:58.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:41:58 smithi187 bash[23415]: cluster 2024-03-11T22:41:57.098371+0000 mgr.y (mgr.14601) 1249 : cluster 0 pgmap v1669: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:58.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:41:58 smithi049 bash[28804]: cluster 2024-03-11T22:41:57.098371+0000 mgr.y (mgr.14601) 1249 : cluster 0 pgmap v1669: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:41:58.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:41:58 smithi049 bash[21434]: cluster 2024-03-11T22:41:57.098371+0000 mgr.y (mgr.14601) 1249 : cluster 0 pgmap v1669: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:00.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:42:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:42:00.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:00 smithi187 bash[23415]: cluster 2024-03-11T22:41:59.100628+0000 mgr.y (mgr.14601) 1250 : cluster 0 pgmap v1670: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:00.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:00 smithi187 bash[23415]: audit 2024-03-11T22:41:59.240712+0000 mon.c (mon.2) 767 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:00.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:00 smithi049 bash[21434]: cluster 2024-03-11T22:41:59.100628+0000 mgr.y (mgr.14601) 1250 : cluster 0 pgmap v1670: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:00.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:00 smithi049 bash[21434]: audit 2024-03-11T22:41:59.240712+0000 mon.c (mon.2) 767 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:00.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:00 smithi049 bash[28804]: cluster 2024-03-11T22:41:59.100628+0000 mgr.y (mgr.14601) 1250 : cluster 0 pgmap v1670: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:00.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:00 smithi049 bash[28804]: audit 2024-03-11T22:41:59.240712+0000 mon.c (mon.2) 767 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:01.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:01 smithi187 bash[23415]: audit 2024-03-11T22:42:00.185997+0000 mgr.y (mgr.14601) 1251 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:01.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:01 smithi049 bash[28804]: audit 2024-03-11T22:42:00.185997+0000 mgr.y (mgr.14601) 1251 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:01.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:01 smithi049 bash[21434]: audit 2024-03-11T22:42:00.185997+0000 mgr.y (mgr.14601) 1251 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:02 smithi187 bash[23415]: cluster 2024-03-11T22:42:01.101456+0000 mgr.y (mgr.14601) 1252 : cluster 0 pgmap v1671: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:02 smithi187 bash[23415]: audit 2024-03-11T22:42:01.602997+0000 mon.c (mon.2) 768 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:42:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:02 smithi187 bash[23415]: audit 2024-03-11T22:42:02.130427+0000 mon.a (mon.0) 3486 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:02 smithi187 bash[23415]: audit 2024-03-11T22:42:02.138262+0000 mon.a (mon.0) 3487 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:02.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[21434]: cluster 2024-03-11T22:42:01.101456+0000 mgr.y (mgr.14601) 1252 : cluster 0 pgmap v1671: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:02.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[21434]: audit 2024-03-11T22:42:01.602997+0000 mon.c (mon.2) 768 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:42:02.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[21434]: audit 2024-03-11T22:42:02.130427+0000 mon.a (mon.0) 3486 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:02.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[21434]: audit 2024-03-11T22:42:02.138262+0000 mon.a (mon.0) 3487 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:02.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[28804]: cluster 2024-03-11T22:42:01.101456+0000 mgr.y (mgr.14601) 1252 : cluster 0 pgmap v1671: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:02.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[28804]: audit 2024-03-11T22:42:01.602997+0000 mon.c (mon.2) 768 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:42:02.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[28804]: audit 2024-03-11T22:42:02.130427+0000 mon.a (mon.0) 3486 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:02.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:02 smithi049 bash[28804]: audit 2024-03-11T22:42:02.138262+0000 mon.a (mon.0) 3487 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:04 smithi049 bash[21434]: cluster 2024-03-11T22:42:03.102275+0000 mgr.y (mgr.14601) 1253 : cluster 0 pgmap v1672: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:04.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:42:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:42:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:42:04.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:04 smithi049 bash[28804]: cluster 2024-03-11T22:42:03.102275+0000 mgr.y (mgr.14601) 1253 : cluster 0 pgmap v1672: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:04 smithi187 bash[23415]: cluster 2024-03-11T22:42:03.102275+0000 mgr.y (mgr.14601) 1253 : cluster 0 pgmap v1672: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:06.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:06 smithi187 bash[23415]: cluster 2024-03-11T22:42:05.104496+0000 mgr.y (mgr.14601) 1254 : cluster 0 pgmap v1673: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:06.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:06 smithi049 bash[21434]: cluster 2024-03-11T22:42:05.104496+0000 mgr.y (mgr.14601) 1254 : cluster 0 pgmap v1673: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:06.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:06 smithi049 bash[28804]: cluster 2024-03-11T22:42:05.104496+0000 mgr.y (mgr.14601) 1254 : cluster 0 pgmap v1673: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:08.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:08 smithi187 bash[23415]: cluster 2024-03-11T22:42:07.104987+0000 mgr.y (mgr.14601) 1255 : cluster 0 pgmap v1674: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:08.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:08 smithi187 bash[23415]: audit 2024-03-11T22:42:07.295907+0000 mon.a (mon.0) 3488 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:08 smithi187 bash[23415]: audit 2024-03-11T22:42:07.314294+0000 mon.a (mon.0) 3489 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:08 smithi187 bash[23415]: audit 2024-03-11T22:42:08.191709+0000 mon.a (mon.0) 3490 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:08 smithi187 bash[23415]: audit 2024-03-11T22:42:08.208116+0000 mon.a (mon.0) 3491 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[21434]: cluster 2024-03-11T22:42:07.104987+0000 mgr.y (mgr.14601) 1255 : cluster 0 pgmap v1674: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[21434]: audit 2024-03-11T22:42:07.295907+0000 mon.a (mon.0) 3488 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[21434]: audit 2024-03-11T22:42:07.314294+0000 mon.a (mon.0) 3489 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[21434]: audit 2024-03-11T22:42:08.191709+0000 mon.a (mon.0) 3490 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[21434]: audit 2024-03-11T22:42:08.208116+0000 mon.a (mon.0) 3491 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[28804]: cluster 2024-03-11T22:42:07.104987+0000 mgr.y (mgr.14601) 1255 : cluster 0 pgmap v1674: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[28804]: audit 2024-03-11T22:42:07.295907+0000 mon.a (mon.0) 3488 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[28804]: audit 2024-03-11T22:42:07.314294+0000 mon.a (mon.0) 3489 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[28804]: audit 2024-03-11T22:42:08.191709+0000 mon.a (mon.0) 3490 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:08 smithi049 bash[28804]: audit 2024-03-11T22:42:08.208116+0000 mon.a (mon.0) 3491 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:09.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:09 smithi187 bash[23415]: audit 2024-03-11T22:42:08.887212+0000 mon.c (mon.2) 769 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:42:09.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:09 smithi187 bash[23415]: audit 2024-03-11T22:42:08.889001+0000 mon.c (mon.2) 770 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:42:09.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:09 smithi187 bash[23415]: audit 2024-03-11T22:42:08.900548+0000 mon.a (mon.0) 3492 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:09.789 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:09 smithi049 bash[28804]: audit 2024-03-11T22:42:08.887212+0000 mon.c (mon.2) 769 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:42:09.790 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:09 smithi049 bash[28804]: audit 2024-03-11T22:42:08.889001+0000 mon.c (mon.2) 770 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:42:09.790 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:09 smithi049 bash[28804]: audit 2024-03-11T22:42:08.900548+0000 mon.a (mon.0) 3492 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:09.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:09 smithi049 bash[21434]: audit 2024-03-11T22:42:08.887212+0000 mon.c (mon.2) 769 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:42:09.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:09 smithi049 bash[21434]: audit 2024-03-11T22:42:08.889001+0000 mon.c (mon.2) 770 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:42:09.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:09 smithi049 bash[21434]: audit 2024-03-11T22:42:08.900548+0000 mon.a (mon.0) 3492 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:42:10.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:42:10 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:42:10.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:10 smithi187 bash[23415]: cluster 2024-03-11T22:42:09.107151+0000 mgr.y (mgr.14601) 1256 : cluster 0 pgmap v1675: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:10.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:10 smithi049 bash[28804]: cluster 2024-03-11T22:42:09.107151+0000 mgr.y (mgr.14601) 1256 : cluster 0 pgmap v1675: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:10.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:10 smithi049 bash[21434]: cluster 2024-03-11T22:42:09.107151+0000 mgr.y (mgr.14601) 1256 : cluster 0 pgmap v1675: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:11.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:11 smithi187 bash[23415]: audit 2024-03-11T22:42:10.197316+0000 mgr.y (mgr.14601) 1257 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:11.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:11 smithi049 bash[28804]: audit 2024-03-11T22:42:10.197316+0000 mgr.y (mgr.14601) 1257 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:11.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:11 smithi049 bash[21434]: audit 2024-03-11T22:42:10.197316+0000 mgr.y (mgr.14601) 1257 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:12.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:12 smithi187 bash[23415]: cluster 2024-03-11T22:42:11.107989+0000 mgr.y (mgr.14601) 1258 : cluster 0 pgmap v1676: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:12.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:12 smithi049 bash[21434]: cluster 2024-03-11T22:42:11.107989+0000 mgr.y (mgr.14601) 1258 : cluster 0 pgmap v1676: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:12.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:12 smithi049 bash[28804]: cluster 2024-03-11T22:42:11.107989+0000 mgr.y (mgr.14601) 1258 : cluster 0 pgmap v1676: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:14.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:42:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:42:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:42:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:14 smithi049 bash[28804]: cluster 2024-03-11T22:42:13.108817+0000 mgr.y (mgr.14601) 1259 : cluster 0 pgmap v1677: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:14 smithi049 bash[28804]: audit 2024-03-11T22:42:14.273536+0000 mon.c (mon.2) 771 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:14 smithi049 bash[21434]: cluster 2024-03-11T22:42:13.108817+0000 mgr.y (mgr.14601) 1259 : cluster 0 pgmap v1677: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:14 smithi049 bash[21434]: audit 2024-03-11T22:42:14.273536+0000 mon.c (mon.2) 771 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:14 smithi187 bash[23415]: cluster 2024-03-11T22:42:13.108817+0000 mgr.y (mgr.14601) 1259 : cluster 0 pgmap v1677: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:14 smithi187 bash[23415]: audit 2024-03-11T22:42:14.273536+0000 mon.c (mon.2) 771 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:16.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:16 smithi187 bash[23415]: cluster 2024-03-11T22:42:15.111071+0000 mgr.y (mgr.14601) 1260 : cluster 0 pgmap v1678: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:16.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:16 smithi049 bash[28804]: cluster 2024-03-11T22:42:15.111071+0000 mgr.y (mgr.14601) 1260 : cluster 0 pgmap v1678: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:16.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:16 smithi049 bash[21434]: cluster 2024-03-11T22:42:15.111071+0000 mgr.y (mgr.14601) 1260 : cluster 0 pgmap v1678: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:18.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:18 smithi187 bash[23415]: cluster 2024-03-11T22:42:17.111931+0000 mgr.y (mgr.14601) 1261 : cluster 0 pgmap v1679: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:18.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:18 smithi049 bash[21434]: cluster 2024-03-11T22:42:17.111931+0000 mgr.y (mgr.14601) 1261 : cluster 0 pgmap v1679: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:18.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:18 smithi049 bash[28804]: cluster 2024-03-11T22:42:17.111931+0000 mgr.y (mgr.14601) 1261 : cluster 0 pgmap v1679: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:20.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:20 smithi187 bash[23415]: cluster 2024-03-11T22:42:19.114169+0000 mgr.y (mgr.14601) 1262 : cluster 0 pgmap v1680: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:20.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:42:20 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:42:20.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:20 smithi049 bash[21434]: cluster 2024-03-11T22:42:19.114169+0000 mgr.y (mgr.14601) 1262 : cluster 0 pgmap v1680: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:20.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:20 smithi049 bash[28804]: cluster 2024-03-11T22:42:19.114169+0000 mgr.y (mgr.14601) 1262 : cluster 0 pgmap v1680: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:21.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:21 smithi187 bash[23415]: audit 2024-03-11T22:42:20.208264+0000 mgr.y (mgr.14601) 1263 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:21.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:21 smithi049 bash[21434]: audit 2024-03-11T22:42:20.208264+0000 mgr.y (mgr.14601) 1263 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:21.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:21 smithi049 bash[28804]: audit 2024-03-11T22:42:20.208264+0000 mgr.y (mgr.14601) 1263 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:22.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:22 smithi187 bash[23415]: cluster 2024-03-11T22:42:21.114963+0000 mgr.y (mgr.14601) 1264 : cluster 0 pgmap v1681: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:22.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:22 smithi049 bash[21434]: cluster 2024-03-11T22:42:21.114963+0000 mgr.y (mgr.14601) 1264 : cluster 0 pgmap v1681: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:22.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:22 smithi049 bash[28804]: cluster 2024-03-11T22:42:21.114963+0000 mgr.y (mgr.14601) 1264 : cluster 0 pgmap v1681: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:24 smithi049 bash[21434]: cluster 2024-03-11T22:42:23.115784+0000 mgr.y (mgr.14601) 1265 : cluster 0 pgmap v1682: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:24.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:42:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:42:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:42:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:24 smithi049 bash[28804]: cluster 2024-03-11T22:42:23.115784+0000 mgr.y (mgr.14601) 1265 : cluster 0 pgmap v1682: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:24.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:24 smithi187 bash[23415]: cluster 2024-03-11T22:42:23.115784+0000 mgr.y (mgr.14601) 1265 : cluster 0 pgmap v1682: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:26.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:26 smithi187 bash[23415]: cluster 2024-03-11T22:42:25.118076+0000 mgr.y (mgr.14601) 1266 : cluster 0 pgmap v1683: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:26.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:26 smithi049 bash[21434]: cluster 2024-03-11T22:42:25.118076+0000 mgr.y (mgr.14601) 1266 : cluster 0 pgmap v1683: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:26 smithi049 bash[28804]: cluster 2024-03-11T22:42:25.118076+0000 mgr.y (mgr.14601) 1266 : cluster 0 pgmap v1683: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:28.755 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:28 smithi187 bash[23415]: cluster 2024-03-11T22:42:27.118951+0000 mgr.y (mgr.14601) 1267 : cluster 0 pgmap v1684: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:28.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:28 smithi049 bash[21434]: cluster 2024-03-11T22:42:27.118951+0000 mgr.y (mgr.14601) 1267 : cluster 0 pgmap v1684: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:28.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:28 smithi049 bash[28804]: cluster 2024-03-11T22:42:27.118951+0000 mgr.y (mgr.14601) 1267 : cluster 0 pgmap v1684: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:29.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:29 smithi187 bash[23415]: audit 2024-03-11T22:42:29.307515+0000 mon.c (mon.2) 772 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:29.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:29 smithi049 bash[21434]: audit 2024-03-11T22:42:29.307515+0000 mon.c (mon.2) 772 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:29.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:29 smithi049 bash[28804]: audit 2024-03-11T22:42:29.307515+0000 mon.c (mon.2) 772 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:30.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:30 smithi187 bash[23415]: cluster 2024-03-11T22:42:29.121253+0000 mgr.y (mgr.14601) 1268 : cluster 0 pgmap v1685: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:30.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:42:30 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:42:30.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:30 smithi049 bash[21434]: cluster 2024-03-11T22:42:29.121253+0000 mgr.y (mgr.14601) 1268 : cluster 0 pgmap v1685: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:30 smithi049 bash[28804]: cluster 2024-03-11T22:42:29.121253+0000 mgr.y (mgr.14601) 1268 : cluster 0 pgmap v1685: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:31.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:31 smithi187 bash[23415]: audit 2024-03-11T22:42:30.214202+0000 mgr.y (mgr.14601) 1269 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:31.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:31 smithi049 bash[21434]: audit 2024-03-11T22:42:30.214202+0000 mgr.y (mgr.14601) 1269 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:31.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:31 smithi049 bash[28804]: audit 2024-03-11T22:42:30.214202+0000 mgr.y (mgr.14601) 1269 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:32.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:32 smithi187 bash[23415]: cluster 2024-03-11T22:42:31.122004+0000 mgr.y (mgr.14601) 1270 : cluster 0 pgmap v1686: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:32.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:32 smithi049 bash[21434]: cluster 2024-03-11T22:42:31.122004+0000 mgr.y (mgr.14601) 1270 : cluster 0 pgmap v1686: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:32.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:32 smithi049 bash[28804]: cluster 2024-03-11T22:42:31.122004+0000 mgr.y (mgr.14601) 1270 : cluster 0 pgmap v1686: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:33.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:33 smithi187 bash[23415]: cluster 2024-03-11T22:42:33.122824+0000 mgr.y (mgr.14601) 1271 : cluster 0 pgmap v1687: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:33.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:33 smithi049 bash[21434]: cluster 2024-03-11T22:42:33.122824+0000 mgr.y (mgr.14601) 1271 : cluster 0 pgmap v1687: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:33.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:33 smithi049 bash[28804]: cluster 2024-03-11T22:42:33.122824+0000 mgr.y (mgr.14601) 1271 : cluster 0 pgmap v1687: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:34.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:42:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:42:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:42:36.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:36 smithi187 bash[23415]: cluster 2024-03-11T22:42:35.125083+0000 mgr.y (mgr.14601) 1272 : cluster 0 pgmap v1688: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:36.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:36 smithi049 bash[21434]: cluster 2024-03-11T22:42:35.125083+0000 mgr.y (mgr.14601) 1272 : cluster 0 pgmap v1688: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:36.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:36 smithi049 bash[28804]: cluster 2024-03-11T22:42:35.125083+0000 mgr.y (mgr.14601) 1272 : cluster 0 pgmap v1688: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:38.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:38 smithi187 bash[23415]: cluster 2024-03-11T22:42:37.125885+0000 mgr.y (mgr.14601) 1273 : cluster 0 pgmap v1689: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:38.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:38 smithi049 bash[21434]: cluster 2024-03-11T22:42:37.125885+0000 mgr.y (mgr.14601) 1273 : cluster 0 pgmap v1689: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:38.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:38 smithi049 bash[28804]: cluster 2024-03-11T22:42:37.125885+0000 mgr.y (mgr.14601) 1273 : cluster 0 pgmap v1689: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:40.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:40 smithi187 bash[23415]: cluster 2024-03-11T22:42:39.128179+0000 mgr.y (mgr.14601) 1274 : cluster 0 pgmap v1690: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:40.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:42:40 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:42:40.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:40 smithi049 bash[21434]: cluster 2024-03-11T22:42:39.128179+0000 mgr.y (mgr.14601) 1274 : cluster 0 pgmap v1690: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:40.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:40 smithi049 bash[28804]: cluster 2024-03-11T22:42:39.128179+0000 mgr.y (mgr.14601) 1274 : cluster 0 pgmap v1690: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:41.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:41 smithi187 bash[23415]: audit 2024-03-11T22:42:40.225719+0000 mgr.y (mgr.14601) 1275 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:41.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:41 smithi049 bash[21434]: audit 2024-03-11T22:42:40.225719+0000 mgr.y (mgr.14601) 1275 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:41.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:41 smithi049 bash[28804]: audit 2024-03-11T22:42:40.225719+0000 mgr.y (mgr.14601) 1275 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:42.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:42 smithi187 bash[23415]: cluster 2024-03-11T22:42:41.129018+0000 mgr.y (mgr.14601) 1276 : cluster 0 pgmap v1691: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:42.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:42 smithi049 bash[21434]: cluster 2024-03-11T22:42:41.129018+0000 mgr.y (mgr.14601) 1276 : cluster 0 pgmap v1691: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:42.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:42 smithi049 bash[28804]: cluster 2024-03-11T22:42:41.129018+0000 mgr.y (mgr.14601) 1276 : cluster 0 pgmap v1691: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:44.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:44 smithi187 bash[23415]: cluster 2024-03-11T22:42:43.129829+0000 mgr.y (mgr.14601) 1277 : cluster 0 pgmap v1692: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:44 smithi049 bash[21434]: cluster 2024-03-11T22:42:43.129829+0000 mgr.y (mgr.14601) 1277 : cluster 0 pgmap v1692: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:44.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:42:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:42:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:42:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:44 smithi049 bash[28804]: cluster 2024-03-11T22:42:43.129829+0000 mgr.y (mgr.14601) 1277 : cluster 0 pgmap v1692: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:45.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:45 smithi187 bash[23415]: audit 2024-03-11T22:42:44.341305+0000 mon.c (mon.2) 773 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:45.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:45 smithi049 bash[21434]: audit 2024-03-11T22:42:44.341305+0000 mon.c (mon.2) 773 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:45.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:45 smithi049 bash[28804]: audit 2024-03-11T22:42:44.341305+0000 mon.c (mon.2) 773 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:46.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:46 smithi187 bash[23415]: cluster 2024-03-11T22:42:45.132293+0000 mgr.y (mgr.14601) 1278 : cluster 0 pgmap v1693: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:46.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:46 smithi049 bash[21434]: cluster 2024-03-11T22:42:45.132293+0000 mgr.y (mgr.14601) 1278 : cluster 0 pgmap v1693: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:46.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:46 smithi049 bash[28804]: cluster 2024-03-11T22:42:45.132293+0000 mgr.y (mgr.14601) 1278 : cluster 0 pgmap v1693: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:48.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:48 smithi187 bash[23415]: cluster 2024-03-11T22:42:47.133151+0000 mgr.y (mgr.14601) 1279 : cluster 0 pgmap v1694: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:48.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:48 smithi049 bash[21434]: cluster 2024-03-11T22:42:47.133151+0000 mgr.y (mgr.14601) 1279 : cluster 0 pgmap v1694: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:48.539 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:48 smithi049 bash[28804]: cluster 2024-03-11T22:42:47.133151+0000 mgr.y (mgr.14601) 1279 : cluster 0 pgmap v1694: 228 pgs: 228 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:49.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:49 smithi049 bash[21434]: cluster 2024-03-11T22:42:48.226542+0000 mon.a (mon.0) 3493 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-03-11T22:42:49.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:49 smithi049 bash[28804]: cluster 2024-03-11T22:42:48.226542+0000 mon.a (mon.0) 3493 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-03-11T22:42:49.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:49 smithi187 bash[23415]: cluster 2024-03-11T22:42:48.226542+0000 mon.a (mon.0) 3493 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-03-11T22:42:50.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:50 smithi187 bash[23415]: cluster 2024-03-11T22:42:49.135364+0000 mgr.y (mgr.14601) 1280 : cluster 0 pgmap v1696: 196 pgs: 196 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:42:50.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:50 smithi187 bash[23415]: cluster 2024-03-11T22:42:49.234111+0000 mon.a (mon.0) 3494 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:42:50.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:50 smithi187 bash[23415]: cluster 2024-03-11T22:42:49.257321+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-03-11T22:42:50.504 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:42:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:42:50.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:50 smithi049 bash[21434]: cluster 2024-03-11T22:42:49.135364+0000 mgr.y (mgr.14601) 1280 : cluster 0 pgmap v1696: 196 pgs: 196 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:42:50.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:50 smithi049 bash[21434]: cluster 2024-03-11T22:42:49.234111+0000 mon.a (mon.0) 3494 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:42:50.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:50 smithi049 bash[21434]: cluster 2024-03-11T22:42:49.257321+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-03-11T22:42:50.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:50 smithi049 bash[28804]: cluster 2024-03-11T22:42:49.135364+0000 mgr.y (mgr.14601) 1280 : cluster 0 pgmap v1696: 196 pgs: 196 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:42:50.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:50 smithi049 bash[28804]: cluster 2024-03-11T22:42:49.234111+0000 mon.a (mon.0) 3494 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:42:50.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:50 smithi049 bash[28804]: cluster 2024-03-11T22:42:49.257321+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-03-11T22:42:51.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:51 smithi187 bash[23415]: audit 2024-03-11T22:42:50.237157+0000 mgr.y (mgr.14601) 1281 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:51.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:51 smithi187 bash[23415]: cluster 2024-03-11T22:42:50.267813+0000 mon.a (mon.0) 3496 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-03-11T22:42:51.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:51 smithi049 bash[21434]: audit 2024-03-11T22:42:50.237157+0000 mgr.y (mgr.14601) 1281 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:51.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:51 smithi049 bash[21434]: cluster 2024-03-11T22:42:50.267813+0000 mon.a (mon.0) 3496 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-03-11T22:42:51.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:51 smithi049 bash[28804]: audit 2024-03-11T22:42:50.237157+0000 mgr.y (mgr.14601) 1281 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:42:51.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:51 smithi049 bash[28804]: cluster 2024-03-11T22:42:50.267813+0000 mon.a (mon.0) 3496 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-03-11T22:42:52.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:52 smithi187 bash[23415]: cluster 2024-03-11T22:42:51.136189+0000 mgr.y (mgr.14601) 1282 : cluster 0 pgmap v1699: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:52.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:52 smithi187 bash[23415]: cluster 2024-03-11T22:42:51.271401+0000 mon.a (mon.0) 3497 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-03-11T22:42:52.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:52 smithi049 bash[21434]: cluster 2024-03-11T22:42:51.136189+0000 mgr.y (mgr.14601) 1282 : cluster 0 pgmap v1699: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:52.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:52 smithi049 bash[21434]: cluster 2024-03-11T22:42:51.271401+0000 mon.a (mon.0) 3497 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-03-11T22:42:52.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:52 smithi049 bash[28804]: cluster 2024-03-11T22:42:51.136189+0000 mgr.y (mgr.14601) 1282 : cluster 0 pgmap v1699: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:42:52.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:52 smithi049 bash[28804]: cluster 2024-03-11T22:42:51.271401+0000 mon.a (mon.0) 3497 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-03-11T22:42:53.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:53 smithi187 bash[23415]: cluster 2024-03-11T22:42:52.322728+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-03-11T22:42:53.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:53 smithi049 bash[21434]: cluster 2024-03-11T22:42:52.322728+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-03-11T22:42:53.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:53 smithi049 bash[28804]: cluster 2024-03-11T22:42:52.322728+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-03-11T22:42:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:54 smithi049 bash[21434]: cluster 2024-03-11T22:42:53.137157+0000 mgr.y (mgr.14601) 1283 : cluster 0 pgmap v1702: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:42:54.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:54 smithi049 bash[21434]: cluster 2024-03-11T22:42:53.337660+0000 mon.a (mon.0) 3499 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-03-11T22:42:54.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:42:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:42:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:42:54.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:54 smithi049 bash[28804]: cluster 2024-03-11T22:42:53.137157+0000 mgr.y (mgr.14601) 1283 : cluster 0 pgmap v1702: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:42:54.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:54 smithi049 bash[28804]: cluster 2024-03-11T22:42:53.337660+0000 mon.a (mon.0) 3499 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-03-11T22:42:54.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:54 smithi187 bash[23415]: cluster 2024-03-11T22:42:53.137157+0000 mgr.y (mgr.14601) 1283 : cluster 0 pgmap v1702: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 748 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:42:54.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:54 smithi187 bash[23415]: cluster 2024-03-11T22:42:53.337660+0000 mon.a (mon.0) 3499 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-03-11T22:42:55.380 INFO:tasks.workunit.client.0.smithi049.stdout: list: Running main() from gmock_main.cc 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [----------] Global test environment set-up. 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [----------] 3 tests from NeoradosList 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [ OK ] NeoradosList.ListObjects (1815712 ms) 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [ OK ] NeoradosList.ListObjectsNS (3043 ms) 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [ OK ] NeoradosList.ListObjectsMany (4091 ms) 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [----------] 3 tests from NeoradosList (1822846 ms total) 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [----------] Global test environment tear-down 2024-03-11T22:42:55.381 INFO:tasks.workunit.client.0.smithi049.stdout: list: [==========] 3 tests from 1 test suite ran. (1822846 ms total) 2024-03-11T22:42:55.382 INFO:tasks.workunit.client.0.smithi049.stdout: list: [ PASSED ] 3 tests. 2024-03-11T22:42:55.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ for t in "${!pids[@]}" 2024-03-11T22:42:55.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=65045 2024-03-11T22:42:55.382 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 65045 2024-03-11T22:42:55.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:55 smithi187 bash[23415]: cluster 2024-03-11T22:42:54.341239+0000 mon.a (mon.0) 3500 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-03-11T22:42:55.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:55 smithi049 bash[28804]: cluster 2024-03-11T22:42:54.341239+0000 mon.a (mon.0) 3500 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-03-11T22:42:55.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:55 smithi049 bash[21434]: cluster 2024-03-11T22:42:54.341239+0000 mon.a (mon.0) 3500 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-03-11T22:42:56.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:56 smithi187 bash[23415]: cluster 2024-03-11T22:42:55.138165+0000 mgr.y (mgr.14601) 1284 : cluster 0 pgmap v1705: 228 pgs: 1 creating+activating, 32 creating+peering, 195 active+clean; 582 KiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:56.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:56 smithi187 bash[23415]: cluster 2024-03-11T22:42:55.347570+0000 mon.a (mon.0) 3501 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:42:56.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:56 smithi187 bash[23415]: cluster 2024-03-11T22:42:55.364265+0000 mon.a (mon.0) 3502 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-03-11T22:42:56.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:56 smithi049 bash[21434]: cluster 2024-03-11T22:42:55.138165+0000 mgr.y (mgr.14601) 1284 : cluster 0 pgmap v1705: 228 pgs: 1 creating+activating, 32 creating+peering, 195 active+clean; 582 KiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:56.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:56 smithi049 bash[21434]: cluster 2024-03-11T22:42:55.347570+0000 mon.a (mon.0) 3501 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:42:56.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:56 smithi049 bash[21434]: cluster 2024-03-11T22:42:55.364265+0000 mon.a (mon.0) 3502 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-03-11T22:42:56.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:56 smithi049 bash[28804]: cluster 2024-03-11T22:42:55.138165+0000 mgr.y (mgr.14601) 1284 : cluster 0 pgmap v1705: 228 pgs: 1 creating+activating, 32 creating+peering, 195 active+clean; 582 KiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:56.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:56 smithi049 bash[28804]: cluster 2024-03-11T22:42:55.347570+0000 mon.a (mon.0) 3501 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:42:56.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:56 smithi049 bash[28804]: cluster 2024-03-11T22:42:55.364265+0000 mon.a (mon.0) 3502 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-03-11T22:42:57.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:57 smithi187 bash[23415]: cluster 2024-03-11T22:42:56.369987+0000 mon.a (mon.0) 3503 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-03-11T22:42:57.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:57 smithi187 bash[23415]: cluster 2024-03-11T22:42:57.139003+0000 mgr.y (mgr.14601) 1285 : cluster 0 pgmap v1708: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:57.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:57 smithi187 bash[23415]: cluster 2024-03-11T22:42:57.370233+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-03-11T22:42:57.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:57 smithi049 bash[21434]: cluster 2024-03-11T22:42:56.369987+0000 mon.a (mon.0) 3503 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-03-11T22:42:57.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:57 smithi049 bash[21434]: cluster 2024-03-11T22:42:57.139003+0000 mgr.y (mgr.14601) 1285 : cluster 0 pgmap v1708: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:57.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:57 smithi049 bash[21434]: cluster 2024-03-11T22:42:57.370233+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-03-11T22:42:57.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:57 smithi049 bash[28804]: cluster 2024-03-11T22:42:56.369987+0000 mon.a (mon.0) 3503 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-03-11T22:42:57.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:57 smithi049 bash[28804]: cluster 2024-03-11T22:42:57.139003+0000 mgr.y (mgr.14601) 1285 : cluster 0 pgmap v1708: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:57.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:57 smithi049 bash[28804]: cluster 2024-03-11T22:42:57.370233+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-03-11T22:42:59.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:59 smithi187 bash[23415]: cluster 2024-03-11T22:42:58.400600+0000 mon.a (mon.0) 3505 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-03-11T22:42:59.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:59 smithi187 bash[23415]: cluster 2024-03-11T22:42:59.140580+0000 mgr.y (mgr.14601) 1286 : cluster 0 pgmap v1711: 164 pgs: 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:59.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:42:59 smithi187 bash[23415]: audit 2024-03-11T22:42:59.375263+0000 mon.c (mon.2) 774 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:59.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:59 smithi049 bash[21434]: cluster 2024-03-11T22:42:58.400600+0000 mon.a (mon.0) 3505 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-03-11T22:42:59.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:59 smithi049 bash[21434]: cluster 2024-03-11T22:42:59.140580+0000 mgr.y (mgr.14601) 1286 : cluster 0 pgmap v1711: 164 pgs: 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:59.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:42:59 smithi049 bash[21434]: audit 2024-03-11T22:42:59.375263+0000 mon.c (mon.2) 774 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:42:59.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:59 smithi049 bash[28804]: cluster 2024-03-11T22:42:58.400600+0000 mon.a (mon.0) 3505 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-03-11T22:42:59.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:59 smithi049 bash[28804]: cluster 2024-03-11T22:42:59.140580+0000 mgr.y (mgr.14601) 1286 : cluster 0 pgmap v1711: 164 pgs: 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:42:59.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:42:59 smithi049 bash[28804]: audit 2024-03-11T22:42:59.375263+0000 mon.c (mon.2) 774 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:00.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:43:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:43:00.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:00 smithi187 bash[23415]: cluster 2024-03-11T22:42:59.416153+0000 mon.a (mon.0) 3506 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-03-11T22:43:00.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:00 smithi187 bash[23415]: audit 2024-03-11T22:43:00.246317+0000 mgr.y (mgr.14601) 1287 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:00.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:00 smithi049 bash[28804]: cluster 2024-03-11T22:42:59.416153+0000 mon.a (mon.0) 3506 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-03-11T22:43:00.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:00 smithi049 bash[28804]: audit 2024-03-11T22:43:00.246317+0000 mgr.y (mgr.14601) 1287 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:00 smithi049 bash[21434]: cluster 2024-03-11T22:42:59.416153+0000 mon.a (mon.0) 3506 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-03-11T22:43:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:00 smithi049 bash[21434]: audit 2024-03-11T22:43:00.246317+0000 mgr.y (mgr.14601) 1287 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:01.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:01 smithi187 bash[23415]: cluster 2024-03-11T22:43:00.416644+0000 mon.a (mon.0) 3507 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-03-11T22:43:01.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:01 smithi187 bash[23415]: cluster 2024-03-11T22:43:01.141409+0000 mgr.y (mgr.14601) 1288 : cluster 0 pgmap v1714: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:01.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:01 smithi187 bash[23415]: cluster 2024-03-11T22:43:01.302916+0000 mon.a (mon.0) 3508 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:01.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:01 smithi049 bash[28804]: cluster 2024-03-11T22:43:00.416644+0000 mon.a (mon.0) 3507 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-03-11T22:43:01.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:01 smithi049 bash[28804]: cluster 2024-03-11T22:43:01.141409+0000 mgr.y (mgr.14601) 1288 : cluster 0 pgmap v1714: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:01.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:01 smithi049 bash[28804]: cluster 2024-03-11T22:43:01.302916+0000 mon.a (mon.0) 3508 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:01.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:01 smithi049 bash[21434]: cluster 2024-03-11T22:43:00.416644+0000 mon.a (mon.0) 3507 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-03-11T22:43:01.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:01 smithi049 bash[21434]: cluster 2024-03-11T22:43:01.141409+0000 mgr.y (mgr.14601) 1288 : cluster 0 pgmap v1714: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:01.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:01 smithi049 bash[21434]: cluster 2024-03-11T22:43:01.302916+0000 mon.a (mon.0) 3508 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:02.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:02 smithi187 bash[23415]: cluster 2024-03-11T22:43:01.445870+0000 mon.a (mon.0) 3509 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-03-11T22:43:02.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:02 smithi049 bash[21434]: cluster 2024-03-11T22:43:01.445870+0000 mon.a (mon.0) 3509 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-03-11T22:43:02.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:02 smithi049 bash[28804]: cluster 2024-03-11T22:43:01.445870+0000 mon.a (mon.0) 3509 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-03-11T22:43:03.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:03 smithi187 bash[23415]: cluster 2024-03-11T22:43:02.455677+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-03-11T22:43:03.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:03 smithi187 bash[23415]: cluster 2024-03-11T22:43:03.142151+0000 mgr.y (mgr.14601) 1289 : cluster 0 pgmap v1717: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:43:03.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:03 smithi049 bash[21434]: cluster 2024-03-11T22:43:02.455677+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-03-11T22:43:03.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:03 smithi049 bash[21434]: cluster 2024-03-11T22:43:03.142151+0000 mgr.y (mgr.14601) 1289 : cluster 0 pgmap v1717: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:43:03.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:03 smithi049 bash[28804]: cluster 2024-03-11T22:43:02.455677+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-03-11T22:43:03.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:03 smithi049 bash[28804]: cluster 2024-03-11T22:43:03.142151+0000 mgr.y (mgr.14601) 1289 : cluster 0 pgmap v1717: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 785 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:43:04.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:43:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:43:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:43:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:04 smithi049 bash[28804]: cluster 2024-03-11T22:43:03.469642+0000 mon.a (mon.0) 3511 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-03-11T22:43:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:04 smithi049 bash[21434]: cluster 2024-03-11T22:43:03.469642+0000 mon.a (mon.0) 3511 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-03-11T22:43:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:04 smithi187 bash[23415]: cluster 2024-03-11T22:43:03.469642+0000 mon.a (mon.0) 3511 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-03-11T22:43:05.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:05 smithi187 bash[23415]: cluster 2024-03-11T22:43:04.469745+0000 mon.a (mon.0) 3512 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-03-11T22:43:05.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:05 smithi187 bash[23415]: cluster 2024-03-11T22:43:05.142899+0000 mgr.y (mgr.14601) 1290 : cluster 0 pgmap v1720: 164 pgs: 164 active+clean; 582 KiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:05 smithi049 bash[21434]: cluster 2024-03-11T22:43:04.469745+0000 mon.a (mon.0) 3512 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-03-11T22:43:05.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:05 smithi049 bash[21434]: cluster 2024-03-11T22:43:05.142899+0000 mgr.y (mgr.14601) 1290 : cluster 0 pgmap v1720: 164 pgs: 164 active+clean; 582 KiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:05.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:05 smithi049 bash[28804]: cluster 2024-03-11T22:43:04.469745+0000 mon.a (mon.0) 3512 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-03-11T22:43:05.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:05 smithi049 bash[28804]: cluster 2024-03-11T22:43:05.142899+0000 mgr.y (mgr.14601) 1290 : cluster 0 pgmap v1720: 164 pgs: 164 active+clean; 582 KiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:06.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:06 smithi187 bash[23415]: cluster 2024-03-11T22:43:05.494289+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-03-11T22:43:06.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:06 smithi049 bash[21434]: cluster 2024-03-11T22:43:05.494289+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-03-11T22:43:06.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:06 smithi049 bash[28804]: cluster 2024-03-11T22:43:05.494289+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-03-11T22:43:07.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:07 smithi049 bash[21434]: cluster 2024-03-11T22:43:06.501476+0000 mon.a (mon.0) 3514 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-03-11T22:43:07.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:07 smithi049 bash[21434]: cluster 2024-03-11T22:43:07.143744+0000 mgr.y (mgr.14601) 1291 : cluster 0 pgmap v1723: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:07.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:07 smithi049 bash[28804]: cluster 2024-03-11T22:43:06.501476+0000 mon.a (mon.0) 3514 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-03-11T22:43:07.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:07 smithi049 bash[28804]: cluster 2024-03-11T22:43:07.143744+0000 mgr.y (mgr.14601) 1291 : cluster 0 pgmap v1723: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:08.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:07 smithi187 bash[23415]: cluster 2024-03-11T22:43:06.501476+0000 mon.a (mon.0) 3514 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-03-11T22:43:08.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:07 smithi187 bash[23415]: cluster 2024-03-11T22:43:07.143744+0000 mgr.y (mgr.14601) 1291 : cluster 0 pgmap v1723: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 793 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:08.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:08 smithi049 bash[21434]: cluster 2024-03-11T22:43:07.494512+0000 mon.a (mon.0) 3515 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:08.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:08 smithi049 bash[21434]: cluster 2024-03-11T22:43:07.511120+0000 mon.a (mon.0) 3516 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-03-11T22:43:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:08 smithi049 bash[28804]: cluster 2024-03-11T22:43:07.494512+0000 mon.a (mon.0) 3515 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:08 smithi049 bash[28804]: cluster 2024-03-11T22:43:07.511120+0000 mon.a (mon.0) 3516 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-03-11T22:43:09.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:08 smithi187 bash[23415]: cluster 2024-03-11T22:43:07.494512+0000 mon.a (mon.0) 3515 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:09.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:08 smithi187 bash[23415]: cluster 2024-03-11T22:43:07.511120+0000 mon.a (mon.0) 3516 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: Running main() from gmock_main.cc 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [----------] Global test environment set-up. 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (1816652 ms) 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3066 ms) 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3042 ms) 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3037 ms) 2024-03-11T22:43:09.533 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (3043 ms) 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3025 ms) 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (5049 ms) 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (1836914 ms total) 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [----------] Global test environment tear-down 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (1836914 ms total) 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stdout: write_operations: [ PASSED ] 7 tests. 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stderr:+ exit 0 2024-03-11T22:43:09.534 INFO:tasks.workunit.client.0.smithi049.stderr:+ cleanup 2024-03-11T22:43:09.535 INFO:tasks.workunit.client.0.smithi049.stderr:+ pkill -P 64044 2024-03-11T22:43:09.548 INFO:tasks.workunit.client.0.smithi049.stderr:+ true 2024-03-11T22:43:09.549 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-11T22:43:09.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-11T22:43:09.560 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-03-11T22:43:09.562 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-03-11T22:43:09.562 DEBUG:teuthology.orchestra.run.smithi049:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fbcdfe674e56d1ea7a0810744e5915bb07961be5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-03-11T22:43:09.608 INFO:tasks.workunit.client.0.smithi049.stderr:+ uuidgen 2024-03-11T22:43:09.609 INFO:tasks.workunit.client.0.smithi049.stderr:+ p=e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:43:09.609 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool create e465fdb5-455f-4dac-9dcc-834a5c09fa37 12 2024-03-11T22:43:09.725 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- 172.21.15.49:0/1878969535 >> v1:172.21.15.49:6790/0 conn(0x7ff794109e90 legacy=0x7ff79410c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:09.726 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- 172.21.15.49:0/1878969535 shutdown_connections 2024-03-11T22:43:09.726 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- 172.21.15.49:0/1878969535 >> 172.21.15.49:0/1878969535 conn(0x7ff7940fcab0 msgr2=0x7ff7940feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:09.726 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- 172.21.15.49:0/1878969535 shutdown_connections 2024-03-11T22:43:09.726 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- 172.21.15.49:0/1878969535 wait complete. 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 Processor -- start 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- start start 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff7941a80b0 con 0x7ff79410da00 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff7941a92b0 con 0x7ff794109e90 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.714+0000 7ff799639640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff7941aa4b0 con 0x7ff794101200 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff7937fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff79410da00 0x7ff7941a6870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51382/0 (socket says 172.21.15.49:51382) 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff792ffd640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7ff794101200 0x7ff7941062d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:41284/0 (socket says 172.21.15.49:41284) 2024-03-11T22:43:09.727 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff7937fe640 1 -- 172.21.15.49:0/1190236228 learned_addr learned my addr 172.21.15.49:0/1190236228 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:43:09.728 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954932848 0 0) 0x7ff7941a80b0 con 0x7ff79410da00 2024-03-11T22:43:09.728 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77c003530 con 0x7ff79410da00 2024-03-11T22:43:09.728 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3233087064 0 0) 0x7ff77c003530 con 0x7ff79410da00 2024-03-11T22:43:09.728 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff7941a80b0 con 0x7ff79410da00 2024-03-11T22:43:09.728 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ff78c001be0 con 0x7ff79410da00 2024-03-11T22:43:09.730 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3965637602 0 0) 0x7ff7941a80b0 con 0x7ff79410da00 2024-03-11T22:43:09.730 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 >> v1:172.21.15.49:6790/0 conn(0x7ff794101200 legacy=0x7ff7941062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:09.730 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 >> v1:172.21.15.187:6789/0 conn(0x7ff794109e90 legacy=0x7ff7941a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:09.730 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7941ab6b0 con 0x7ff79410da00 2024-03-11T22:43:09.731 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7941a82a0 con 0x7ff79410da00 2024-03-11T22:43:09.731 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.718+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7941a8720 con 0x7ff79410da00 2024-03-11T22:43:09.731 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.722+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7ff78c003e30 con 0x7ff79410da00 2024-03-11T22:43:09.731 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.722+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7ff78c005f50 con 0x7ff79410da00 2024-03-11T22:43:09.731 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.722+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff780005090 con 0x7ff79410da00 2024-03-11T22:43:09.732 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.722+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7ff78c01c4a0 con 0x7ff79410da00 2024-03-11T22:43:09.733 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.722+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(781..781 src has 260..781) v4 ==== 7443+0+0 (unknown 2939778150 0 0) 0x7ff78c088bd0 con 0x7ff79410da00 2024-03-11T22:43:09.740 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.730+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ff78c0559e0 con 0x7ff79410da00 2024-03-11T22:43:09.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:09 smithi049 bash[21434]: audit 2024-03-11T22:43:08.986660+0000 mon.c (mon.2) 775 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:43:09.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:09 smithi049 bash[21434]: cluster 2024-03-11T22:43:09.145442+0000 mgr.y (mgr.14601) 1292 : cluster 0 pgmap v1725: 196 pgs: 196 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 437 B/s wr, 2 op/s 2024-03-11T22:43:09.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:09 smithi049 bash[28804]: audit 2024-03-11T22:43:08.986660+0000 mon.c (mon.2) 775 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:43:09.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:09 smithi049 bash[28804]: cluster 2024-03-11T22:43:09.145442+0000 mgr.y (mgr.14601) 1292 : cluster 0 pgmap v1725: 196 pgs: 196 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 437 B/s wr, 2 op/s 2024-03-11T22:43:09.922 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:09.910+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12} v 0) v1 -- 0x7ff7800058c0 con 0x7ff79410da00 2024-03-11T22:43:10.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:09 smithi187 bash[23415]: audit 2024-03-11T22:43:08.986660+0000 mon.c (mon.2) 775 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:43:10.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:09 smithi187 bash[23415]: cluster 2024-03-11T22:43:09.145442+0000 mgr.y (mgr.14601) 1292 : cluster 0 pgmap v1725: 196 pgs: 196 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 437 B/s wr, 2 op/s 2024-03-11T22:43:10.520 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:43:10 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:43:10.731 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.722+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]=0 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' created v782) v1 ==== 176+0+0 (unknown 2901708014 0 0) 0x7ff78c053fe0 con 0x7ff79410da00 2024-03-11T22:43:10.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[21434]: cluster 2024-03-11T22:43:09.514791+0000 mon.a (mon.0) 3517 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[21434]: audit 2024-03-11T22:43:09.716416+0000 mon.c (mon.2) 776 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[21434]: audit 2024-03-11T22:43:09.717695+0000 mon.c (mon.2) 777 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[21434]: audit 2024-03-11T22:43:09.724049+0000 mon.a (mon.0) 3518 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[21434]: audit 2024-03-11T22:43:09.916727+0000 mon.a (mon.0) 3519 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]: dispatch 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[21434]: audit 2024-03-11T22:43:10.250342+0000 mgr.y (mgr.14601) 1293 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[28804]: cluster 2024-03-11T22:43:09.514791+0000 mon.a (mon.0) 3517 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[28804]: audit 2024-03-11T22:43:09.716416+0000 mon.c (mon.2) 776 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[28804]: audit 2024-03-11T22:43:09.717695+0000 mon.c (mon.2) 777 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:43:10.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[28804]: audit 2024-03-11T22:43:09.724049+0000 mon.a (mon.0) 3518 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:43:10.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[28804]: audit 2024-03-11T22:43:09.916727+0000 mon.a (mon.0) 3519 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]: dispatch 2024-03-11T22:43:10.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:10 smithi049 bash[28804]: audit 2024-03-11T22:43:10.250342+0000 mgr.y (mgr.14601) 1293 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:10.847 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12} v 0) v1 -- 0x7ff7800053f0 con 0x7ff79410da00 2024-03-11T22:43:10.847 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff77bfff640 1 -- 172.21.15.49:0/1190236228 <== mon.0 v1:172.21.15.49:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]=0 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' already exists v782) v1 ==== 183+0+0 (unknown 3401351489 0 0) 0x7ff7800053f0 con 0x7ff79410da00 2024-03-11T22:43:10.848 INFO:tasks.workunit.client.0.smithi049.stderr:pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' already exists 2024-03-11T22:43:10.850 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 >> v1:172.21.15.49:6800/915645872 conn(0x7ff77c06e2c0 legacy=0x7ff77c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:10.850 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 >> v1:172.21.15.49:6789/0 conn(0x7ff79410da00 legacy=0x7ff7941a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:10.850 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 shutdown_connections 2024-03-11T22:43:10.850 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 >> 172.21.15.49:0/1190236228 conn(0x7ff7940fcab0 msgr2=0x7ff794109420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:10.850 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 shutdown_connections 2024-03-11T22:43:10.850 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.838+0000 7ff799639640 1 -- 172.21.15.49:0/1190236228 wait complete. 2024-03-11T22:43:10.866 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota e465fdb5-455f-4dac-9dcc-834a5c09fa37 max_objects 10 2024-03-11T22:43:10.990 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.978+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/2021546760 >> v1:172.21.15.49:6790/0 conn(0x7f2b380fff40 legacy=0x7f2b38100320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:10.991 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.978+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/2021546760 shutdown_connections 2024-03-11T22:43:10.991 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.978+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/2021546760 >> 172.21.15.49:0/2021546760 conn(0x7f2b380fb9a0 msgr2=0x7f2b380fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:10.991 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.978+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/2021546760 shutdown_connections 2024-03-11T22:43:10.991 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.978+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/2021546760 wait complete. 2024-03-11T22:43:10.991 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 Processor -- start 2024-03-11T22:43:10.991 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 -- start start 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2b381ac440 con 0x7f2b38105d40 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2b381ad640 con 0x7f2b380fff40 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2b381ae840 con 0x7f2b38114250 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b36d9d640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f2b38114250 0x7f2b381aab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:41312/0 (socket says 172.21.15.49:41312) 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2ffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2b38105d40 0x7f2b381a7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51400/0 (socket says 172.21.15.49:51400) 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b36d9d640 1 -- 172.21.15.49:0/1262818487 learned_addr learned my addr 172.21.15.49:0/1262818487 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989560502 0 0) 0x7f2b381ae840 con 0x7f2b38114250 2024-03-11T22:43:10.993 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b24003530 con 0x7f2b38114250 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522619700 0 0) 0x7f2b381ac440 con 0x7f2b38105d40 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b381ae840 con 0x7f2b38105d40 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1552985244 0 0) 0x7f2b24003530 con 0x7f2b38114250 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b381ac440 con 0x7f2b38114250 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2b30001c60 con 0x7f2b38114250 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3501129353 0 0) 0x7f2b381ae840 con 0x7f2b38105d40 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b24003530 con 0x7f2b38105d40 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913135506 0 0) 0x7f2b381ad640 con 0x7f2b380fff40 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b381ae840 con 0x7f2b380fff40 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2b20001840 con 0x7f2b38105d40 2024-03-11T22:43:10.994 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4233295988 0 0) 0x7f2b381ac440 con 0x7f2b38114250 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 >> v1:172.21.15.187:6789/0 conn(0x7f2b380fff40 legacy=0x7f2b381139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 >> v1:172.21.15.49:6789/0 conn(0x7f2b38105d40 legacy=0x7f2b381a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b381afa40 con 0x7f2b38114250 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b381ac630 con 0x7f2b38114250 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b381acab0 con 0x7f2b38114250 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f2b30003e30 con 0x7f2b38114250 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2b30006010 con 0x7f2b38114250 2024-03-11T22:43:10.995 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b18005090 con 0x7f2b38114250 2024-03-11T22:43:10.996 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f2b300039a0 con 0x7f2b38114250 2024-03-11T22:43:10.996 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.982+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(782..782 src has 260..782) v4 ==== 7818+0+0 (unknown 942868795 0 0) 0x7f2b30088c50 con 0x7f2b38114250 2024-03-11T22:43:10.999 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:10.990+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2b30055b80 con 0x7f2b38114250 2024-03-11T22:43:11.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:10 smithi187 bash[23415]: cluster 2024-03-11T22:43:09.514791+0000 mon.a (mon.0) 3517 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-03-11T22:43:11.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:10 smithi187 bash[23415]: audit 2024-03-11T22:43:09.716416+0000 mon.c (mon.2) 776 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:43:11.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:10 smithi187 bash[23415]: audit 2024-03-11T22:43:09.717695+0000 mon.c (mon.2) 777 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:43:11.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:10 smithi187 bash[23415]: audit 2024-03-11T22:43:09.724049+0000 mon.a (mon.0) 3518 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:43:11.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:10 smithi187 bash[23415]: audit 2024-03-11T22:43:09.916727+0000 mon.a (mon.0) 3519 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]: dispatch 2024-03-11T22:43:11.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:10 smithi187 bash[23415]: audit 2024-03-11T22:43:10.250342+0000 mgr.y (mgr.14601) 1293 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:11.172 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:11.162+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f2b18005340 con 0x7f2b38114250 2024-03-11T22:43:11.751 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:11.742+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v783) v1 ==== 223+0+0 (unknown 976514690 0 0) 0x7f2b30053ef0 con 0x7f2b38114250 2024-03-11T22:43:11.866 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:11.854+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f2b180010a0 con 0x7f2b38114250 2024-03-11T22:43:12.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:11 smithi187 bash[23415]: audit 2024-03-11T22:43:10.725451+0000 mon.a (mon.0) 3520 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]': finished 2024-03-11T22:43:12.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:11 smithi187 bash[23415]: cluster 2024-03-11T22:43:10.732257+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-03-11T22:43:12.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:11 smithi187 bash[23415]: audit 2024-03-11T22:43:10.841683+0000 mon.a (mon.0) 3522 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]: dispatch 2024-03-11T22:43:12.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:11 smithi187 bash[23415]: cluster 2024-03-11T22:43:11.146135+0000 mgr.y (mgr.14601) 1294 : cluster 0 pgmap v1728: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:43:12.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:11 smithi187 bash[23415]: audit 2024-03-11T22:43:11.166904+0000 mon.c (mon.2) 778 : audit 1 from='client.? v1:172.21.15.49:0/1262818487' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:12.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:11 smithi187 bash[23415]: audit 2024-03-11T22:43:11.167353+0000 mon.a (mon.0) 3523 : audit 1 from='client.47159 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:12.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[28804]: audit 2024-03-11T22:43:10.725451+0000 mon.a (mon.0) 3520 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]': finished 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[28804]: cluster 2024-03-11T22:43:10.732257+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[28804]: audit 2024-03-11T22:43:10.841683+0000 mon.a (mon.0) 3522 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]: dispatch 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[28804]: cluster 2024-03-11T22:43:11.146135+0000 mgr.y (mgr.14601) 1294 : cluster 0 pgmap v1728: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[28804]: audit 2024-03-11T22:43:11.166904+0000 mon.c (mon.2) 778 : audit 1 from='client.? v1:172.21.15.49:0/1262818487' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[28804]: audit 2024-03-11T22:43:11.167353+0000 mon.a (mon.0) 3523 : audit 1 from='client.47159 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[21434]: audit 2024-03-11T22:43:10.725451+0000 mon.a (mon.0) 3520 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]': finished 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[21434]: cluster 2024-03-11T22:43:10.732257+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[21434]: audit 2024-03-11T22:43:10.841683+0000 mon.a (mon.0) 3522 : audit 1 from='client.? v1:172.21.15.49:0/1190236228' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pg_num": 12}]: dispatch 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[21434]: cluster 2024-03-11T22:43:11.146135+0000 mgr.y (mgr.14601) 1294 : cluster 0 pgmap v1728: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[21434]: audit 2024-03-11T22:43:11.166904+0000 mon.c (mon.2) 778 : audit 1 from='client.? v1:172.21.15.49:0/1262818487' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:12.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:11 smithi049 bash[21434]: audit 2024-03-11T22:43:11.167353+0000 mon.a (mon.0) 3523 : audit 1 from='client.47159 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:12.752 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.742+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/1262818487 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v784) v1 ==== 223+0+0 (unknown 52308101 0 0) 0x7f2b30055710 con 0x7f2b38114250 2024-03-11T22:43:12.752 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_objects = 10 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:43:12.757 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.746+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 >> v1:172.21.15.49:6800/915645872 conn(0x7f2b2406e5d0 legacy=0x7f2b24070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:12.757 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.746+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 >> v1:172.21.15.49:6790/0 conn(0x7f2b38114250 legacy=0x7f2b381aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:12.757 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.746+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 shutdown_connections 2024-03-11T22:43:12.757 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.746+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 >> 172.21.15.49:0/1262818487 conn(0x7f2b380fb9a0 msgr2=0x7f2b380fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:12.757 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.746+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 shutdown_connections 2024-03-11T22:43:12.757 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.746+0000 7f2b3cbd1640 1 -- 172.21.15.49:0/1262818487 wait complete. 2024-03-11T22:43:12.778 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool application enable e465fdb5-455f-4dac-9dcc-834a5c09fa37 rados 2024-03-11T22:43:12.899 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- 172.21.15.49:0/3553412290 >> v1:172.21.15.49:6789/0 conn(0x7f294410fbc0 legacy=0x7f2944112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:12.900 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- 172.21.15.49:0/3553412290 shutdown_connections 2024-03-11T22:43:12.900 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- 172.21.15.49:0/3553412290 >> 172.21.15.49:0/3553412290 conn(0x7f2944076370 msgr2=0x7f29440fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:12.900 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- 172.21.15.49:0/3553412290 shutdown_connections 2024-03-11T22:43:12.900 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- 172.21.15.49:0/3553412290 wait complete. 2024-03-11T22:43:12.902 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 Processor -- start 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- start start 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f29441a8060 con 0x7f2944101eb0 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f29441a9220 con 0x7f294410fbc0 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f29441aa420 con 0x7f2944102290 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f294259c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2944101eb0 0x7f294410f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51420/0 (socket says 172.21.15.49:51420) 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f294259c640 1 -- 172.21.15.49:0/4172906512 learned_addr learned my addr 172.21.15.49:0/4172906512 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721318127 0 0) 0x7f29441a8060 con 0x7f2944101eb0 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292c003770 con 0x7f2944101eb0 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539952544 0 0) 0x7f29441aa420 con 0x7f2944102290 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29441a8060 con 0x7f2944102290 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1959681933 0 0) 0x7f292c003770 con 0x7f2944101eb0 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29441aa420 con 0x7f2944101eb0 2024-03-11T22:43:12.903 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2938001940 con 0x7f2944101eb0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3923176189 0 0) 0x7f29441a8060 con 0x7f2944102290 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f292c003770 con 0x7f2944102290 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2934001830 con 0x7f2944102290 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929894195 0 0) 0x7f29441a9220 con 0x7f294410fbc0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29441a8060 con 0x7f294410fbc0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2900020342 0 0) 0x7f29441aa420 con 0x7f2944101eb0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 >> v1:172.21.15.49:6790/0 conn(0x7f2944102290 legacy=0x7f29441a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 >> v1:172.21.15.187:6789/0 conn(0x7f294410fbc0 legacy=0x7f29441a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29441ab620 con 0x7f2944101eb0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29441aa610 con 0x7f2944101eb0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f29441aab10 con 0x7f2944101eb0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f2938001c90 con 0x7f2944101eb0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.890+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f2938005c20 con 0x7f2944101eb0 2024-03-11T22:43:12.904 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.894+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2924005090 con 0x7f2944101eb0 2024-03-11T22:43:12.905 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.894+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f2938003910 con 0x7f2944101eb0 2024-03-11T22:43:12.905 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.894+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(784..784 src has 260..784) v4 ==== 7818+0+0 (unknown 3762235934 0 0) 0x7f2938088800 con 0x7f2944101eb0 2024-03-11T22:43:12.909 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:12.898+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2938055810 con 0x7f2944101eb0 2024-03-11T22:43:13.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[28804]: audit 2024-03-11T22:43:11.734933+0000 mon.a (mon.0) 3524 : audit 1 from='client.47159 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:43:13.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[28804]: cluster 2024-03-11T22:43:11.744512+0000 mon.a (mon.0) 3525 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-03-11T22:43:13.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[28804]: audit 2024-03-11T22:43:11.860784+0000 mon.c (mon.2) 779 : audit 1 from='client.? v1:172.21.15.49:0/1262818487' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:13.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[28804]: audit 2024-03-11T22:43:11.861435+0000 mon.a (mon.0) 3526 : audit 1 from='client.47159 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:13.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[21434]: audit 2024-03-11T22:43:11.734933+0000 mon.a (mon.0) 3524 : audit 1 from='client.47159 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:43:13.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[21434]: cluster 2024-03-11T22:43:11.744512+0000 mon.a (mon.0) 3525 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-03-11T22:43:13.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[21434]: audit 2024-03-11T22:43:11.860784+0000 mon.c (mon.2) 779 : audit 1 from='client.? v1:172.21.15.49:0/1262818487' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:13.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:12 smithi049 bash[21434]: audit 2024-03-11T22:43:11.861435+0000 mon.a (mon.0) 3526 : audit 1 from='client.47159 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:13.086 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:13.074+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"} v 0) v1 -- 0x7f2924005340 con 0x7f2944101eb0 2024-03-11T22:43:13.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:12 smithi187 bash[23415]: audit 2024-03-11T22:43:11.734933+0000 mon.a (mon.0) 3524 : audit 1 from='client.47159 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:43:13.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:12 smithi187 bash[23415]: cluster 2024-03-11T22:43:11.744512+0000 mon.a (mon.0) 3525 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-03-11T22:43:13.254 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:12 smithi187 bash[23415]: audit 2024-03-11T22:43:11.860784+0000 mon.c (mon.2) 779 : audit 1 from='client.? v1:172.21.15.49:0/1262818487' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:13.254 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:12 smithi187 bash[23415]: audit 2024-03-11T22:43:11.861435+0000 mon.a (mon.0) 3526 : audit 1 from='client.47159 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:43:13.765 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:13.754+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]=0 enabled application 'rados' on pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' v785) v1 ==== 213+0+0 (unknown 2031548696 0 0) 0x7f2938053b80 con 0x7f2944101eb0 2024-03-11T22:43:13.872 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:13.862+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"} v 0) v1 -- 0x7f29240010a0 con 0x7f2944101eb0 2024-03-11T22:43:14.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[28804]: audit 2024-03-11T22:43:12.738002+0000 mon.a (mon.0) 3527 : audit 1 from='client.47159 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:43:14.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[28804]: cluster 2024-03-11T22:43:12.744444+0000 mon.a (mon.0) 3528 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-03-11T22:43:14.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[28804]: audit 2024-03-11T22:43:13.081333+0000 mon.a (mon.0) 3529 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]: dispatch 2024-03-11T22:43:14.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[28804]: cluster 2024-03-11T22:43:13.147028+0000 mgr.y (mgr.14601) 1295 : cluster 0 pgmap v1731: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:43:14.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[21434]: audit 2024-03-11T22:43:12.738002+0000 mon.a (mon.0) 3527 : audit 1 from='client.47159 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:43:14.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[21434]: cluster 2024-03-11T22:43:12.744444+0000 mon.a (mon.0) 3528 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-03-11T22:43:14.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[21434]: audit 2024-03-11T22:43:13.081333+0000 mon.a (mon.0) 3529 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]: dispatch 2024-03-11T22:43:14.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:13 smithi049 bash[21434]: cluster 2024-03-11T22:43:13.147028+0000 mgr.y (mgr.14601) 1295 : cluster 0 pgmap v1731: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:43:14.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:13 smithi187 bash[23415]: audit 2024-03-11T22:43:12.738002+0000 mon.a (mon.0) 3527 : audit 1 from='client.47159 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:43:14.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:13 smithi187 bash[23415]: cluster 2024-03-11T22:43:12.744444+0000 mon.a (mon.0) 3528 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-03-11T22:43:14.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:13 smithi187 bash[23415]: audit 2024-03-11T22:43:13.081333+0000 mon.a (mon.0) 3529 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]: dispatch 2024-03-11T22:43:14.254 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:13 smithi187 bash[23415]: cluster 2024-03-11T22:43:13.147028+0000 mgr.y (mgr.14601) 1295 : cluster 0 pgmap v1731: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 783 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:43:14.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:43:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:43:14.767 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:14.758+0000 7f29337fe640 1 -- 172.21.15.49:0/4172906512 <== mon.0 v1:172.21.15.49:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]=0 enabled application 'rados' on pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' v786) v1 ==== 213+0+0 (unknown 930406962 0 0) 0x7f29380553a0 con 0x7f2944101eb0 2024-03-11T22:43:14.768 INFO:tasks.workunit.client.0.smithi049.stderr:enabled application 'rados' on pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' 2024-03-11T22:43:14.772 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:14.762+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 >> v1:172.21.15.49:6800/915645872 conn(0x7f292c06e710 legacy=0x7f292c070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:14.772 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:14.762+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 >> v1:172.21.15.49:6789/0 conn(0x7f2944101eb0 legacy=0x7f294410f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:14.775 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:14.766+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 shutdown_connections 2024-03-11T22:43:14.775 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:14.766+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 >> 172.21.15.49:0/4172906512 conn(0x7f2944076370 msgr2=0x7f2944111ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:14.775 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:14.766+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 shutdown_connections 2024-03-11T22:43:14.775 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:14.766+0000 7f2948a08640 1 -- 172.21.15.49:0/4172906512 wait complete. 2024-03-11T22:43:14.795 INFO:tasks.workunit.client.0.smithi049.stderr:+ seq 1 10 2024-03-11T22:43:14.813 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj1 /etc/passwd 2024-03-11T22:43:14.857 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj2 /etc/passwd 2024-03-11T22:43:14.895 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj3 /etc/passwd 2024-03-11T22:43:14.931 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj4 /etc/passwd 2024-03-11T22:43:14.966 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj5 /etc/passwd 2024-03-11T22:43:15.000 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj6 /etc/passwd 2024-03-11T22:43:15.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[21434]: audit 2024-03-11T22:43:13.758777+0000 mon.a (mon.0) 3530 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]': finished 2024-03-11T22:43:15.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[21434]: cluster 2024-03-11T22:43:13.765917+0000 mon.a (mon.0) 3531 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-03-11T22:43:15.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[21434]: audit 2024-03-11T22:43:13.867422+0000 mon.a (mon.0) 3532 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]: dispatch 2024-03-11T22:43:15.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[21434]: audit 2024-03-11T22:43:14.413632+0000 mon.c (mon.2) 780 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:15.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[28804]: audit 2024-03-11T22:43:13.758777+0000 mon.a (mon.0) 3530 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]': finished 2024-03-11T22:43:15.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[28804]: cluster 2024-03-11T22:43:13.765917+0000 mon.a (mon.0) 3531 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-03-11T22:43:15.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[28804]: audit 2024-03-11T22:43:13.867422+0000 mon.a (mon.0) 3532 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]: dispatch 2024-03-11T22:43:15.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:14 smithi049 bash[28804]: audit 2024-03-11T22:43:14.413632+0000 mon.c (mon.2) 780 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:15.037 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj7 /etc/passwd 2024-03-11T22:43:15.071 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj8 /etc/passwd 2024-03-11T22:43:15.106 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj9 /etc/passwd 2024-03-11T22:43:15.140 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put obj10 /etc/passwd 2024-03-11T22:43:15.175 INFO:tasks.workunit.client.0.smithi049.stderr:+ sleep 30 2024-03-11T22:43:15.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:14 smithi187 bash[23415]: audit 2024-03-11T22:43:13.758777+0000 mon.a (mon.0) 3530 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]': finished 2024-03-11T22:43:15.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:14 smithi187 bash[23415]: cluster 2024-03-11T22:43:13.765917+0000 mon.a (mon.0) 3531 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-03-11T22:43:15.254 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:14 smithi187 bash[23415]: audit 2024-03-11T22:43:13.867422+0000 mon.a (mon.0) 3532 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]: dispatch 2024-03-11T22:43:15.254 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:14 smithi187 bash[23415]: audit 2024-03-11T22:43:14.413632+0000 mon.c (mon.2) 780 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:16.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:15 smithi187 bash[23415]: audit 2024-03-11T22:43:14.761503+0000 mon.a (mon.0) 3533 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]': finished 2024-03-11T22:43:16.254 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:15 smithi187 bash[23415]: cluster 2024-03-11T22:43:14.767711+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-03-11T22:43:16.254 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:15 smithi187 bash[23415]: cluster 2024-03-11T22:43:15.147471+0000 mgr.y (mgr.14601) 1296 : cluster 0 pgmap v1734: 176 pgs: 176 active+clean; 582 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:16.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:15 smithi049 bash[21434]: audit 2024-03-11T22:43:14.761503+0000 mon.a (mon.0) 3533 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]': finished 2024-03-11T22:43:16.287 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:15 smithi049 bash[21434]: cluster 2024-03-11T22:43:14.767711+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-03-11T22:43:16.287 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:15 smithi049 bash[21434]: cluster 2024-03-11T22:43:15.147471+0000 mgr.y (mgr.14601) 1296 : cluster 0 pgmap v1734: 176 pgs: 176 active+clean; 582 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:16.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:15 smithi049 bash[28804]: audit 2024-03-11T22:43:14.761503+0000 mon.a (mon.0) 3533 : audit 1 from='client.? v1:172.21.15.49:0/4172906512' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "app": "rados"}]': finished 2024-03-11T22:43:16.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:15 smithi049 bash[28804]: cluster 2024-03-11T22:43:14.767711+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-03-11T22:43:16.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:15 smithi049 bash[28804]: cluster 2024-03-11T22:43:15.147471+0000 mgr.y (mgr.14601) 1296 : cluster 0 pgmap v1734: 176 pgs: 176 active+clean; 582 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:17.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:16 smithi187 bash[23415]: cluster 2024-03-11T22:43:15.771802+0000 mon.a (mon.0) 3535 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:17.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:16 smithi049 bash[21434]: cluster 2024-03-11T22:43:15.771802+0000 mon.a (mon.0) 3535 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:17.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:16 smithi049 bash[28804]: cluster 2024-03-11T22:43:15.771802+0000 mon.a (mon.0) 3535 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:43:18.253 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:17 smithi187 bash[23415]: cluster 2024-03-11T22:43:17.148328+0000 mgr.y (mgr.14601) 1297 : cluster 0 pgmap v1735: 176 pgs: 176 active+clean; 582 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 757 B/s rd, 0 op/s 2024-03-11T22:43:18.286 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:17 smithi049 bash[21434]: cluster 2024-03-11T22:43:17.148328+0000 mgr.y (mgr.14601) 1297 : cluster 0 pgmap v1735: 176 pgs: 176 active+clean; 582 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 757 B/s rd, 0 op/s 2024-03-11T22:43:18.287 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:17 smithi049 bash[28804]: cluster 2024-03-11T22:43:17.148328+0000 mgr.y (mgr.14601) 1297 : cluster 0 pgmap v1735: 176 pgs: 176 active+clean; 582 KiB data, 809 MiB used, 714 GiB / 715 GiB avail; 757 B/s rd, 0 op/s 2024-03-11T22:43:20.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:20 smithi187 bash[23415]: cluster 2024-03-11T22:43:19.150340+0000 mgr.y (mgr.14601) 1298 : cluster 0 pgmap v1736: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-03-11T22:43:20.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:43:20 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:43:20.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:20 smithi049 bash[21434]: cluster 2024-03-11T22:43:19.150340+0000 mgr.y (mgr.14601) 1298 : cluster 0 pgmap v1736: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-03-11T22:43:20.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:20 smithi049 bash[28804]: cluster 2024-03-11T22:43:19.150340+0000 mgr.y (mgr.14601) 1298 : cluster 0 pgmap v1736: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-03-11T22:43:21.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:21 smithi187 bash[23415]: audit 2024-03-11T22:43:20.260911+0000 mgr.y (mgr.14601) 1299 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:21.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:21 smithi049 bash[21434]: audit 2024-03-11T22:43:20.260911+0000 mgr.y (mgr.14601) 1299 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:21.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:21 smithi049 bash[28804]: audit 2024-03-11T22:43:20.260911+0000 mgr.y (mgr.14601) 1299 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:22.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:22 smithi187 bash[23415]: cluster 2024-03-11T22:43:21.151207+0000 mgr.y (mgr.14601) 1300 : cluster 0 pgmap v1737: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-03-11T22:43:22.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:22 smithi187 bash[23415]: cluster 2024-03-11T22:43:21.309083+0000 mon.a (mon.0) 3536 : cluster 3 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' is full (reached quota's max_objects: 10) 2024-03-11T22:43:22.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:22 smithi187 bash[23415]: cluster 2024-03-11T22:43:21.309620+0000 mon.a (mon.0) 3537 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:43:22.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:22 smithi187 bash[23415]: cluster 2024-03-11T22:43:21.319144+0000 mon.a (mon.0) 3538 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-03-11T22:43:22.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[21434]: cluster 2024-03-11T22:43:21.151207+0000 mgr.y (mgr.14601) 1300 : cluster 0 pgmap v1737: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-03-11T22:43:22.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[21434]: cluster 2024-03-11T22:43:21.309083+0000 mon.a (mon.0) 3536 : cluster 3 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' is full (reached quota's max_objects: 10) 2024-03-11T22:43:22.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[21434]: cluster 2024-03-11T22:43:21.309620+0000 mon.a (mon.0) 3537 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:43:22.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[21434]: cluster 2024-03-11T22:43:21.319144+0000 mon.a (mon.0) 3538 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-03-11T22:43:22.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[28804]: cluster 2024-03-11T22:43:21.151207+0000 mgr.y (mgr.14601) 1300 : cluster 0 pgmap v1737: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-03-11T22:43:22.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[28804]: cluster 2024-03-11T22:43:21.309083+0000 mon.a (mon.0) 3536 : cluster 3 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' is full (reached quota's max_objects: 10) 2024-03-11T22:43:22.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[28804]: cluster 2024-03-11T22:43:21.309620+0000 mon.a (mon.0) 3537 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:43:22.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:22 smithi049 bash[28804]: cluster 2024-03-11T22:43:21.319144+0000 mon.a (mon.0) 3538 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-03-11T22:43:24.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:24 smithi187 bash[23415]: cluster 2024-03-11T22:43:23.152020+0000 mgr.y (mgr.14601) 1301 : cluster 0 pgmap v1739: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 610 B/s rd, 14 KiB/s wr, 1 op/s 2024-03-11T22:43:24.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:43:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:43:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:43:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:24 smithi049 bash[28804]: cluster 2024-03-11T22:43:23.152020+0000 mgr.y (mgr.14601) 1301 : cluster 0 pgmap v1739: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 610 B/s rd, 14 KiB/s wr, 1 op/s 2024-03-11T22:43:24.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:24 smithi049 bash[21434]: cluster 2024-03-11T22:43:23.152020+0000 mgr.y (mgr.14601) 1301 : cluster 0 pgmap v1739: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 610 B/s rd, 14 KiB/s wr, 1 op/s 2024-03-11T22:43:26.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:26 smithi187 bash[23415]: cluster 2024-03-11T22:43:25.153944+0000 mgr.y (mgr.14601) 1302 : cluster 0 pgmap v1740: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:43:26.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:26 smithi049 bash[21434]: cluster 2024-03-11T22:43:25.153944+0000 mgr.y (mgr.14601) 1302 : cluster 0 pgmap v1740: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:43:26.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:26 smithi049 bash[28804]: cluster 2024-03-11T22:43:25.153944+0000 mgr.y (mgr.14601) 1302 : cluster 0 pgmap v1740: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:43:28.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:28 smithi187 bash[23415]: cluster 2024-03-11T22:43:27.154747+0000 mgr.y (mgr.14601) 1303 : cluster 0 pgmap v1741: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:43:28.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:28 smithi049 bash[28804]: cluster 2024-03-11T22:43:27.154747+0000 mgr.y (mgr.14601) 1303 : cluster 0 pgmap v1741: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:43:28.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:28 smithi049 bash[21434]: cluster 2024-03-11T22:43:27.154747+0000 mgr.y (mgr.14601) 1303 : cluster 0 pgmap v1741: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:43:30.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:43:30 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:43:30.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:30 smithi187 bash[23415]: cluster 2024-03-11T22:43:29.156594+0000 mgr.y (mgr.14601) 1304 : cluster 0 pgmap v1742: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:30.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:30 smithi187 bash[23415]: audit 2024-03-11T22:43:29.455449+0000 mon.a (mon.0) 3539 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:43:30.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:30 smithi187 bash[23415]: audit 2024-03-11T22:43:29.458399+0000 mon.c (mon.2) 781 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:30.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:30 smithi049 bash[21434]: cluster 2024-03-11T22:43:29.156594+0000 mgr.y (mgr.14601) 1304 : cluster 0 pgmap v1742: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:30.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:30 smithi049 bash[21434]: audit 2024-03-11T22:43:29.455449+0000 mon.a (mon.0) 3539 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:43:30.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:30 smithi049 bash[21434]: audit 2024-03-11T22:43:29.458399+0000 mon.c (mon.2) 781 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:30.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:30 smithi049 bash[28804]: cluster 2024-03-11T22:43:29.156594+0000 mgr.y (mgr.14601) 1304 : cluster 0 pgmap v1742: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:30.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:30 smithi049 bash[28804]: audit 2024-03-11T22:43:29.455449+0000 mon.a (mon.0) 3539 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:43:30.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:30 smithi049 bash[28804]: audit 2024-03-11T22:43:29.458399+0000 mon.c (mon.2) 781 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:31.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:31 smithi187 bash[23415]: audit 2024-03-11T22:43:30.272213+0000 mgr.y (mgr.14601) 1305 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:31.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:31 smithi049 bash[28804]: audit 2024-03-11T22:43:30.272213+0000 mgr.y (mgr.14601) 1305 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:31.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:31 smithi049 bash[21434]: audit 2024-03-11T22:43:30.272213+0000 mgr.y (mgr.14601) 1305 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:32.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:32 smithi187 bash[23415]: cluster 2024-03-11T22:43:31.157418+0000 mgr.y (mgr.14601) 1306 : cluster 0 pgmap v1743: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:32.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:32 smithi049 bash[21434]: cluster 2024-03-11T22:43:31.157418+0000 mgr.y (mgr.14601) 1306 : cluster 0 pgmap v1743: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:32.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:32 smithi049 bash[28804]: cluster 2024-03-11T22:43:31.157418+0000 mgr.y (mgr.14601) 1306 : cluster 0 pgmap v1743: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:43:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:34 smithi049 bash[21434]: cluster 2024-03-11T22:43:33.158187+0000 mgr.y (mgr.14601) 1307 : cluster 0 pgmap v1744: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 864 B/s rd, 0 op/s 2024-03-11T22:43:34.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:34 smithi049 bash[28804]: cluster 2024-03-11T22:43:33.158187+0000 mgr.y (mgr.14601) 1307 : cluster 0 pgmap v1744: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 864 B/s rd, 0 op/s 2024-03-11T22:43:34.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:43:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:43:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:43:34.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:34 smithi187 bash[23415]: cluster 2024-03-11T22:43:33.158187+0000 mgr.y (mgr.14601) 1307 : cluster 0 pgmap v1744: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 864 B/s rd, 0 op/s 2024-03-11T22:43:36.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:36 smithi049 bash[21434]: cluster 2024-03-11T22:43:35.160114+0000 mgr.y (mgr.14601) 1308 : cluster 0 pgmap v1745: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:36.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:36 smithi049 bash[28804]: cluster 2024-03-11T22:43:35.160114+0000 mgr.y (mgr.14601) 1308 : cluster 0 pgmap v1745: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:36.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:36 smithi187 bash[23415]: cluster 2024-03-11T22:43:35.160114+0000 mgr.y (mgr.14601) 1308 : cluster 0 pgmap v1745: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:38.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:38 smithi049 bash[21434]: cluster 2024-03-11T22:43:37.160883+0000 mgr.y (mgr.14601) 1309 : cluster 0 pgmap v1746: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:38.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:38 smithi049 bash[28804]: cluster 2024-03-11T22:43:37.160883+0000 mgr.y (mgr.14601) 1309 : cluster 0 pgmap v1746: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:38.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:38 smithi187 bash[23415]: cluster 2024-03-11T22:43:37.160883+0000 mgr.y (mgr.14601) 1309 : cluster 0 pgmap v1746: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:40.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:40 smithi049 bash[21434]: cluster 2024-03-11T22:43:39.162751+0000 mgr.y (mgr.14601) 1310 : cluster 0 pgmap v1747: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:40.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:40 smithi049 bash[28804]: cluster 2024-03-11T22:43:39.162751+0000 mgr.y (mgr.14601) 1310 : cluster 0 pgmap v1747: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:40.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:43:40 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:43:40.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:40 smithi187 bash[23415]: cluster 2024-03-11T22:43:39.162751+0000 mgr.y (mgr.14601) 1310 : cluster 0 pgmap v1747: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:41.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:41 smithi049 bash[21434]: audit 2024-03-11T22:43:40.283631+0000 mgr.y (mgr.14601) 1311 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:41.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:41 smithi049 bash[28804]: audit 2024-03-11T22:43:40.283631+0000 mgr.y (mgr.14601) 1311 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:41.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:41 smithi187 bash[23415]: audit 2024-03-11T22:43:40.283631+0000 mgr.y (mgr.14601) 1311 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:42.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:42 smithi049 bash[21434]: cluster 2024-03-11T22:43:41.163540+0000 mgr.y (mgr.14601) 1312 : cluster 0 pgmap v1748: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:42.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:42 smithi049 bash[28804]: cluster 2024-03-11T22:43:41.163540+0000 mgr.y (mgr.14601) 1312 : cluster 0 pgmap v1748: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:42.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:42 smithi187 bash[23415]: cluster 2024-03-11T22:43:41.163540+0000 mgr.y (mgr.14601) 1312 : cluster 0 pgmap v1748: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:44 smithi049 bash[21434]: cluster 2024-03-11T22:43:43.164329+0000 mgr.y (mgr.14601) 1313 : cluster 0 pgmap v1749: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:44 smithi049 bash[28804]: cluster 2024-03-11T22:43:43.164329+0000 mgr.y (mgr.14601) 1313 : cluster 0 pgmap v1749: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:44.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:43:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:43:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:43:44.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:44 smithi187 bash[23415]: cluster 2024-03-11T22:43:43.164329+0000 mgr.y (mgr.14601) 1313 : cluster 0 pgmap v1749: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:43:45.177 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=135851 2024-03-11T22:43:45.177 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota e465fdb5-455f-4dac-9dcc-834a5c09fa37 max_objects 100 2024-03-11T22:43:45.177 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put onemore /etc/passwd 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2440813269 >> v1:172.21.15.49:6790/0 conn(0x7f5cd0109e70 legacy=0x7f5cd010c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2440813269 shutdown_connections 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2440813269 >> 172.21.15.49:0/2440813269 conn(0x7f5cd00fca50 msgr2=0x7f5cd00fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2440813269 shutdown_connections 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2440813269 wait complete. 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 Processor -- start 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- start start 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5cd0106830 con 0x7f5cd010d9e0 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5cd0106a20 con 0x7f5cd0109e70 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5cd01a84a0 con 0x7f5cd01011e0 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd5180640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f5cd01011e0 0x7f5cd0103760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:36300/0 (socket says 172.21.15.49:36300) 2024-03-11T22:43:45.310 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd5180640 1 -- 172.21.15.49:0/2639254752 learned_addr learned my addr 172.21.15.49:0/2639254752 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd5981640 1 --1- 172.21.15.49:0/2639254752 >> v1:172.21.15.49:6789/0 conn(0x7f5cd010d9e0 0x7f5cd01a4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47194/0 (socket says 172.21.15.49:47194) 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228670974 0 0) 0x7f5cd0106830 con 0x7f5cd010d9e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cbc003170 con 0x7f5cd010d9e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129608383 0 0) 0x7f5cd01a84a0 con 0x7f5cd01011e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd0106830 con 0x7f5cd01011e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4029525948 0 0) 0x7f5cbc003170 con 0x7f5cd010d9e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5cd01a84a0 con 0x7f5cd010d9e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f5cc8001bc0 con 0x7f5cd010d9e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2597155248 0 0) 0x7f5cd0106830 con 0x7f5cd01011e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5cbc003170 con 0x7f5cd01011e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f5ccc001860 con 0x7f5cd01011e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032056197 0 0) 0x7f5cd0106a20 con 0x7f5cd0109e70 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd0106830 con 0x7f5cd0109e70 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3780306654 0 0) 0x7f5cd01a84a0 con 0x7f5cd010d9e0 2024-03-11T22:43:45.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 >> v1:172.21.15.49:6790/0 conn(0x7f5cd01011e0 legacy=0x7f5cd0103760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:45.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 >> v1:172.21.15.187:6789/0 conn(0x7f5cd0109e70 legacy=0x7f5cd0103e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:45.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd01a9640 con 0x7f5cd010d9e0 2024-03-11T22:43:45.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd01a8690 con 0x7f5cd010d9e0 2024-03-11T22:43:45.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd01a8b10 con 0x7f5cd010d9e0 2024-03-11T22:43:45.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f5cc8003e30 con 0x7f5cd010d9e0 2024-03-11T22:43:45.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f5cc8005f30 con 0x7f5cd010d9e0 2024-03-11T22:43:45.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.297+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb4005090 con 0x7f5cd010d9e0 2024-03-11T22:43:45.313 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.301+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f5cc8003980 con 0x7f5cd010d9e0 2024-03-11T22:43:45.313 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.301+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(787..787 src has 260..787) v4 ==== 7831+0+0 (unknown 1903936007 0 0) 0x7f5cc8088cf0 con 0x7f5cd010d9e0 2024-03-11T22:43:45.313 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.301+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=788}) v3 -- 0x7f5cd01a84a0 con 0x7f5cd010d9e0 2024-03-11T22:43:45.317 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.305+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f5cc8055c10 con 0x7f5cd010d9e0 2024-03-11T22:43:45.490 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:45.477+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7f5cb4005340 con 0x7f5cd010d9e0 2024-03-11T22:43:45.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:45 smithi187 bash[23415]: audit 2024-03-11T22:43:44.493192+0000 mon.c (mon.2) 782 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:45.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:45 smithi049 bash[21434]: audit 2024-03-11T22:43:44.493192+0000 mon.c (mon.2) 782 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:45.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:45 smithi049 bash[28804]: audit 2024-03-11T22:43:44.493192+0000 mon.c (mon.2) 782 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:43:46.299 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:46.289+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v788) v1 ==== 225+0+0 (unknown 2718813485 0 0) 0x7f5cc8053f80 con 0x7f5cd010d9e0 2024-03-11T22:43:46.300 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:46.289+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 11 ==== osd_map(788..788 src has 260..788) v4 ==== 628+0+0 (unknown 3650984825 0 0) 0x7f5cc8056540 con 0x7f5cd010d9e0 2024-03-11T22:43:46.300 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:46.289+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=789}) v3 -- 0x7f5cbc003170 con 0x7f5cd010d9e0 2024-03-11T22:43:46.325 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:46.313+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 12 ==== osd_map(789..789 src has 260..789) v4 ==== 628+0+0 (unknown 2943891902 0 0) 0x7f5cc8059f90 con 0x7f5cd010d9e0 2024-03-11T22:43:46.325 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:46.313+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=790}) v3 -- 0x7f5cd0106a20 con 0x7f5cd010d9e0 2024-03-11T22:43:46.424 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:46.413+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7f5cb40010a0 con 0x7f5cd010d9e0 2024-03-11T22:43:46.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:46 smithi187 bash[23415]: cluster 2024-03-11T22:43:45.166199+0000 mgr.y (mgr.14601) 1314 : cluster 0 pgmap v1750: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:46.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:46 smithi187 bash[23415]: audit 2024-03-11T22:43:45.484883+0000 mon.a (mon.0) 3540 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]: dispatch 2024-03-11T22:43:46.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:46 smithi049 bash[21434]: cluster 2024-03-11T22:43:45.166199+0000 mgr.y (mgr.14601) 1314 : cluster 0 pgmap v1750: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:46.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:46 smithi049 bash[21434]: audit 2024-03-11T22:43:45.484883+0000 mon.a (mon.0) 3540 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]: dispatch 2024-03-11T22:43:46.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:46 smithi049 bash[28804]: cluster 2024-03-11T22:43:45.166199+0000 mgr.y (mgr.14601) 1314 : cluster 0 pgmap v1750: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:43:46.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:46 smithi049 bash[28804]: audit 2024-03-11T22:43:45.484883+0000 mon.a (mon.0) 3540 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]: dispatch 2024-03-11T22:43:47.335 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.325+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v790) v1 ==== 225+0+0 (unknown 4090213853 0 0) 0x7f5cc80557a0 con 0x7f5cd010d9e0 2024-03-11T22:43:47.335 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_objects = 100 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:43:47.336 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.325+0000 7f5cc67fc640 1 -- 172.21.15.49:0/2639254752 <== mon.0 v1:172.21.15.49:6789/0 14 ==== osd_map(790..790 src has 260..790) v4 ==== 628+0+0 (unknown 4288155067 0 0) 0x7f5cc805e5e0 con 0x7f5cd010d9e0 2024-03-11T22:43:47.339 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.329+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 >> v1:172.21.15.49:6800/915645872 conn(0x7f5cbc06e590 legacy=0x7f5cbc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:47.339 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.329+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 >> v1:172.21.15.49:6789/0 conn(0x7f5cd010d9e0 legacy=0x7f5cd01a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:47.339 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.329+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 shutdown_connections 2024-03-11T22:43:47.339 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.329+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 >> 172.21.15.49:0/2639254752 conn(0x7f5cd00fca50 msgr2=0x7f5cd010de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:47.340 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.329+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 shutdown_connections 2024-03-11T22:43:47.340 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.329+0000 7f5cd73e4640 1 -- 172.21.15.49:0/2639254752 wait complete. 2024-03-11T22:43:47.362 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 135851 2024-03-11T22:43:47.363 INFO:tasks.workunit.client.0.smithi049.stderr:+ [ 0 -ne 0 ] 2024-03-11T22:43:47.363 INFO:tasks.workunit.client.0.smithi049.stderr:+ true 2024-03-11T22:43:47.363 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put twomore /etc/passwd 2024-03-11T22:43:47.404 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota e465fdb5-455f-4dac-9dcc-834a5c09fa37 max_bytes 100 2024-03-11T22:43:47.523 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.509+0000 7f8724d10640 1 -- 172.21.15.49:0/3151544255 >> v1:172.21.15.49:6789/0 conn(0x7f8720110410 legacy=0x7f8720112800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:47.523 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.509+0000 7f8724d10640 1 -- 172.21.15.49:0/3151544255 shutdown_connections 2024-03-11T22:43:47.523 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.509+0000 7f8724d10640 1 -- 172.21.15.49:0/3151544255 >> 172.21.15.49:0/3151544255 conn(0x7f8720076da0 msgr2=0x7f87200791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:47.523 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- 172.21.15.49:0/3151544255 shutdown_connections 2024-03-11T22:43:47.523 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- 172.21.15.49:0/3151544255 wait complete. 2024-03-11T22:43:47.523 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 Processor -- start 2024-03-11T22:43:47.523 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- start start 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f87201ac370 con 0x7f872010d660 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f87201ad570 con 0x7f8720110410 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f87201ae770 con 0x7f8720114010 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f871e59c640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f872010d660 0x7f872010c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47252/0 (socket says 172.21.15.49:47252) 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f871e59c640 1 -- 172.21.15.49:0/1931709678 learned_addr learned my addr 172.21.15.49:0/1931709678 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194946920 0 0) 0x7f87201ac370 con 0x7f872010d660 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8708003530 con 0x7f872010d660 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073237446 0 0) 0x7f87201ae770 con 0x7f8720114010 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87201ac370 con 0x7f8720114010 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3310377158 0 0) 0x7f8708003530 con 0x7f872010d660 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f87201ae770 con 0x7f872010d660 2024-03-11T22:43:47.526 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8710001c40 con 0x7f872010d660 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 549925672 0 0) 0x7f87201ac370 con 0x7f8720114010 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8708003530 con 0x7f8720114010 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153690240 0 0) 0x7f87201ad570 con 0x7f8720110410 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87201ac370 con 0x7f8720110410 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8718001a00 con 0x7f8720114010 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 7100397 0 0) 0x7f87201ae770 con 0x7f872010d660 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 >> v1:172.21.15.49:6790/0 conn(0x7f8720114010 legacy=0x7f87201aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 >> v1:172.21.15.187:6789/0 conn(0x7f8720110410 legacy=0x7f87201a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87201af970 con 0x7f872010d660 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87201ae960 con 0x7f872010d660 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f87201aede0 con 0x7f872010d660 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f8710003e30 con 0x7f872010d660 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8710005ec0 con 0x7f872010d660 2024-03-11T22:43:47.527 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8700005090 con 0x7f872010d660 2024-03-11T22:43:47.528 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.513+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f8710003980 con 0x7f872010d660 2024-03-11T22:43:47.528 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.517+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 8 ==== osd_map(790..790 src has 260..790) v4 ==== 7831+0+0 (unknown 2374186798 0 0) 0x7f8710088c80 con 0x7f872010d660 2024-03-11T22:43:47.531 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.521+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8710055ba0 con 0x7f872010d660 2024-03-11T22:43:47.702 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:47.689+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f8700005340 con 0x7f872010d660 2024-03-11T22:43:47.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:47 smithi187 bash[23415]: audit 2024-03-11T22:43:46.293168+0000 mon.a (mon.0) 3541 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]': finished 2024-03-11T22:43:47.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:47 smithi187 bash[23415]: cluster 2024-03-11T22:43:46.300006+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-03-11T22:43:47.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:47 smithi187 bash[23415]: cluster 2024-03-11T22:43:46.316049+0000 mon.a (mon.0) 3543 : cluster 1 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' no longer out of quota; removing NO_QUOTA flag 2024-03-11T22:43:47.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:47 smithi187 bash[23415]: cluster 2024-03-11T22:43:46.316555+0000 mon.a (mon.0) 3544 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:43:47.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:47 smithi187 bash[23415]: cluster 2024-03-11T22:43:46.327047+0000 mon.a (mon.0) 3545 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-03-11T22:43:47.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:47 smithi187 bash[23415]: audit 2024-03-11T22:43:46.418667+0000 mon.a (mon.0) 3546 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]: dispatch 2024-03-11T22:43:47.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[21434]: audit 2024-03-11T22:43:46.293168+0000 mon.a (mon.0) 3541 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]': finished 2024-03-11T22:43:47.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[21434]: cluster 2024-03-11T22:43:46.300006+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-03-11T22:43:47.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[21434]: cluster 2024-03-11T22:43:46.316049+0000 mon.a (mon.0) 3543 : cluster 1 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' no longer out of quota; removing NO_QUOTA flag 2024-03-11T22:43:47.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[21434]: cluster 2024-03-11T22:43:46.316555+0000 mon.a (mon.0) 3544 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:43:47.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[21434]: cluster 2024-03-11T22:43:46.327047+0000 mon.a (mon.0) 3545 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-03-11T22:43:47.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[21434]: audit 2024-03-11T22:43:46.418667+0000 mon.a (mon.0) 3546 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]: dispatch 2024-03-11T22:43:47.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[28804]: audit 2024-03-11T22:43:46.293168+0000 mon.a (mon.0) 3541 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]': finished 2024-03-11T22:43:47.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[28804]: cluster 2024-03-11T22:43:46.300006+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-03-11T22:43:47.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[28804]: cluster 2024-03-11T22:43:46.316049+0000 mon.a (mon.0) 3543 : cluster 1 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' no longer out of quota; removing NO_QUOTA flag 2024-03-11T22:43:47.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[28804]: cluster 2024-03-11T22:43:46.316555+0000 mon.a (mon.0) 3544 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:43:47.789 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[28804]: cluster 2024-03-11T22:43:46.327047+0000 mon.a (mon.0) 3545 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-03-11T22:43:47.789 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:47 smithi049 bash[28804]: audit 2024-03-11T22:43:46.418667+0000 mon.a (mon.0) 3546 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]: dispatch 2024-03-11T22:43:48.337 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:48.325+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v791) v1 ==== 221+0+0 (unknown 275548871 0 0) 0x7f8710053f10 con 0x7f872010d660 2024-03-11T22:43:48.451 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:48.441+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 --> v1:172.21.15.49:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f8700000c50 con 0x7f872010d660 2024-03-11T22:43:48.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:48 smithi187 bash[23415]: cluster 2024-03-11T22:43:47.167089+0000 mgr.y (mgr.14601) 1315 : cluster 0 pgmap v1753: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:43:48.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:48 smithi187 bash[23415]: audit 2024-03-11T22:43:47.329065+0000 mon.a (mon.0) 3547 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]': finished 2024-03-11T22:43:48.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:48 smithi187 bash[23415]: cluster 2024-03-11T22:43:47.337620+0000 mon.a (mon.0) 3548 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-03-11T22:43:48.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:48 smithi187 bash[23415]: audit 2024-03-11T22:43:47.696713+0000 mon.a (mon.0) 3549 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-11T22:43:48.790 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[28804]: cluster 2024-03-11T22:43:47.167089+0000 mgr.y (mgr.14601) 1315 : cluster 0 pgmap v1753: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:43:48.790 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[28804]: audit 2024-03-11T22:43:47.329065+0000 mon.a (mon.0) 3547 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]': finished 2024-03-11T22:43:48.790 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[28804]: cluster 2024-03-11T22:43:47.337620+0000 mon.a (mon.0) 3548 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-03-11T22:43:48.790 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[28804]: audit 2024-03-11T22:43:47.696713+0000 mon.a (mon.0) 3549 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-11T22:43:48.790 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[21434]: cluster 2024-03-11T22:43:47.167089+0000 mgr.y (mgr.14601) 1315 : cluster 0 pgmap v1753: 176 pgs: 176 active+clean; 699 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:43:48.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[21434]: audit 2024-03-11T22:43:47.329065+0000 mon.a (mon.0) 3547 : audit 1 from='client.? v1:172.21.15.49:0/2639254752' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "100"}]': finished 2024-03-11T22:43:48.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[21434]: cluster 2024-03-11T22:43:47.337620+0000 mon.a (mon.0) 3548 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-03-11T22:43:48.791 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:48 smithi049 bash[21434]: audit 2024-03-11T22:43:47.696713+0000 mon.a (mon.0) 3549 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-11T22:43:49.351 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:49.337+0000 7f870f7fe640 1 -- 172.21.15.49:0/1931709678 <== mon.0 v1:172.21.15.49:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v792) v1 ==== 221+0+0 (unknown 2329768127 0 0) 0x7f8710055730 con 0x7f872010d660 2024-03-11T22:43:49.351 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_bytes = 100 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:43:49.359 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:49.345+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 >> v1:172.21.15.49:6800/915645872 conn(0x7f870806e5d0 legacy=0x7f8708070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:49.359 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:49.345+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 >> v1:172.21.15.49:6789/0 conn(0x7f872010d660 legacy=0x7f872010c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:43:49.359 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:49.345+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 shutdown_connections 2024-03-11T22:43:49.359 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:49.345+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 >> 172.21.15.49:0/1931709678 conn(0x7f8720076da0 msgr2=0x7f8720117510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:43:49.359 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:49.345+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 shutdown_connections 2024-03-11T22:43:49.360 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:43:49.345+0000 7f8724d10640 1 -- 172.21.15.49:0/1931709678 wait complete. 2024-03-11T22:43:49.377 INFO:tasks.workunit.client.0.smithi049.stderr:+ sleep 30 2024-03-11T22:43:49.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:49 smithi187 bash[23415]: audit 2024-03-11T22:43:48.331693+0000 mon.a (mon.0) 3550 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]': finished 2024-03-11T22:43:49.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:49 smithi187 bash[23415]: cluster 2024-03-11T22:43:48.336580+0000 mon.a (mon.0) 3551 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-03-11T22:43:49.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:49 smithi187 bash[23415]: audit 2024-03-11T22:43:48.445968+0000 mon.a (mon.0) 3552 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-11T22:43:49.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:49 smithi049 bash[21434]: audit 2024-03-11T22:43:48.331693+0000 mon.a (mon.0) 3550 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]': finished 2024-03-11T22:43:49.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:49 smithi049 bash[21434]: cluster 2024-03-11T22:43:48.336580+0000 mon.a (mon.0) 3551 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-03-11T22:43:49.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:49 smithi049 bash[21434]: audit 2024-03-11T22:43:48.445968+0000 mon.a (mon.0) 3552 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-11T22:43:49.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:49 smithi049 bash[28804]: audit 2024-03-11T22:43:48.331693+0000 mon.a (mon.0) 3550 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]': finished 2024-03-11T22:43:49.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:49 smithi049 bash[28804]: cluster 2024-03-11T22:43:48.336580+0000 mon.a (mon.0) 3551 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-03-11T22:43:49.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:49 smithi049 bash[28804]: audit 2024-03-11T22:43:48.445968+0000 mon.a (mon.0) 3552 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-11T22:43:50.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:43:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:43:50.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:50 smithi187 bash[23415]: cluster 2024-03-11T22:43:49.169009+0000 mgr.y (mgr.14601) 1316 : cluster 0 pgmap v1756: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-11T22:43:50.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:50 smithi187 bash[23415]: audit 2024-03-11T22:43:49.344599+0000 mon.a (mon.0) 3553 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]': finished 2024-03-11T22:43:50.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:50 smithi187 bash[23415]: cluster 2024-03-11T22:43:49.350259+0000 mon.a (mon.0) 3554 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-03-11T22:43:50.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:50 smithi049 bash[28804]: cluster 2024-03-11T22:43:49.169009+0000 mgr.y (mgr.14601) 1316 : cluster 0 pgmap v1756: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-11T22:43:50.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:50 smithi049 bash[28804]: audit 2024-03-11T22:43:49.344599+0000 mon.a (mon.0) 3553 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]': finished 2024-03-11T22:43:50.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:50 smithi049 bash[28804]: cluster 2024-03-11T22:43:49.350259+0000 mon.a (mon.0) 3554 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-03-11T22:43:50.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:50 smithi049 bash[21434]: cluster 2024-03-11T22:43:49.169009+0000 mgr.y (mgr.14601) 1316 : cluster 0 pgmap v1756: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-11T22:43:50.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:50 smithi049 bash[21434]: audit 2024-03-11T22:43:49.344599+0000 mon.a (mon.0) 3553 : audit 1 from='client.? v1:172.21.15.49:0/1931709678' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "100"}]': finished 2024-03-11T22:43:50.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:50 smithi049 bash[21434]: cluster 2024-03-11T22:43:49.350259+0000 mon.a (mon.0) 3554 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-03-11T22:43:51.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:51 smithi187 bash[23415]: audit 2024-03-11T22:43:50.294452+0000 mgr.y (mgr.14601) 1317 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:51.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:51 smithi187 bash[23415]: cluster 2024-03-11T22:43:51.318908+0000 mon.a (mon.0) 3555 : cluster 3 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' is full (reached quota's max_bytes: 100 B) 2024-03-11T22:43:51.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:51 smithi187 bash[23415]: cluster 2024-03-11T22:43:51.319532+0000 mon.a (mon.0) 3556 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:43:51.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:51 smithi187 bash[23415]: cluster 2024-03-11T22:43:51.328384+0000 mon.a (mon.0) 3557 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-03-11T22:43:51.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[28804]: audit 2024-03-11T22:43:50.294452+0000 mgr.y (mgr.14601) 1317 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:51.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[28804]: cluster 2024-03-11T22:43:51.318908+0000 mon.a (mon.0) 3555 : cluster 3 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' is full (reached quota's max_bytes: 100 B) 2024-03-11T22:43:51.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[28804]: cluster 2024-03-11T22:43:51.319532+0000 mon.a (mon.0) 3556 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:43:51.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[28804]: cluster 2024-03-11T22:43:51.328384+0000 mon.a (mon.0) 3557 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-03-11T22:43:51.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[21434]: audit 2024-03-11T22:43:50.294452+0000 mgr.y (mgr.14601) 1317 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:43:51.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[21434]: cluster 2024-03-11T22:43:51.318908+0000 mon.a (mon.0) 3555 : cluster 3 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' is full (reached quota's max_bytes: 100 B) 2024-03-11T22:43:51.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[21434]: cluster 2024-03-11T22:43:51.319532+0000 mon.a (mon.0) 3556 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:43:51.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:51 smithi049 bash[21434]: cluster 2024-03-11T22:43:51.328384+0000 mon.a (mon.0) 3557 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-03-11T22:43:52.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:52 smithi187 bash[23415]: cluster 2024-03-11T22:43:51.169776+0000 mgr.y (mgr.14601) 1318 : cluster 0 pgmap v1758: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.9 KiB/s wr, 1 op/s 2024-03-11T22:43:52.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:52 smithi049 bash[21434]: cluster 2024-03-11T22:43:51.169776+0000 mgr.y (mgr.14601) 1318 : cluster 0 pgmap v1758: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.9 KiB/s wr, 1 op/s 2024-03-11T22:43:52.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:52 smithi049 bash[28804]: cluster 2024-03-11T22:43:51.169776+0000 mgr.y (mgr.14601) 1318 : cluster 0 pgmap v1758: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.9 KiB/s wr, 1 op/s 2024-03-11T22:43:54.560 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:43:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:43:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:43:54.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:54 smithi187 bash[23415]: cluster 2024-03-11T22:43:53.170690+0000 mgr.y (mgr.14601) 1319 : cluster 0 pgmap v1760: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 877 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-03-11T22:43:55.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:54 smithi049 bash[21434]: cluster 2024-03-11T22:43:53.170690+0000 mgr.y (mgr.14601) 1319 : cluster 0 pgmap v1760: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 877 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-03-11T22:43:55.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:54 smithi049 bash[28804]: cluster 2024-03-11T22:43:53.170690+0000 mgr.y (mgr.14601) 1319 : cluster 0 pgmap v1760: 176 pgs: 176 active+clean; 722 KiB data, 810 MiB used, 714 GiB / 715 GiB avail; 877 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-03-11T22:43:56.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:56 smithi187 bash[23415]: cluster 2024-03-11T22:43:55.172719+0000 mgr.y (mgr.14601) 1320 : cluster 0 pgmap v1761: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 1 op/s 2024-03-11T22:43:56.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:56 smithi049 bash[21434]: cluster 2024-03-11T22:43:55.172719+0000 mgr.y (mgr.14601) 1320 : cluster 0 pgmap v1761: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 1 op/s 2024-03-11T22:43:56.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:56 smithi049 bash[28804]: cluster 2024-03-11T22:43:55.172719+0000 mgr.y (mgr.14601) 1320 : cluster 0 pgmap v1761: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 1 op/s 2024-03-11T22:43:58.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:43:58 smithi187 bash[23415]: cluster 2024-03-11T22:43:57.173580+0000 mgr.y (mgr.14601) 1321 : cluster 0 pgmap v1762: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:43:58.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:43:58 smithi049 bash[21434]: cluster 2024-03-11T22:43:57.173580+0000 mgr.y (mgr.14601) 1321 : cluster 0 pgmap v1762: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:43:58.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:43:58 smithi049 bash[28804]: cluster 2024-03-11T22:43:57.173580+0000 mgr.y (mgr.14601) 1321 : cluster 0 pgmap v1762: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-11T22:44:00.754 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:44:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:44:00.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:00 smithi187 bash[23415]: cluster 2024-03-11T22:43:59.175431+0000 mgr.y (mgr.14601) 1322 : cluster 0 pgmap v1763: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-11T22:44:00.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:00 smithi187 bash[23415]: audit 2024-03-11T22:43:59.526549+0000 mon.c (mon.2) 783 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:00.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:00 smithi049 bash[21434]: cluster 2024-03-11T22:43:59.175431+0000 mgr.y (mgr.14601) 1322 : cluster 0 pgmap v1763: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-11T22:44:00.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:00 smithi049 bash[21434]: audit 2024-03-11T22:43:59.526549+0000 mon.c (mon.2) 783 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:00.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:00 smithi049 bash[28804]: cluster 2024-03-11T22:43:59.175431+0000 mgr.y (mgr.14601) 1322 : cluster 0 pgmap v1763: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-11T22:44:00.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:00 smithi049 bash[28804]: audit 2024-03-11T22:43:59.526549+0000 mon.c (mon.2) 783 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:01.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:01 smithi187 bash[23415]: audit 2024-03-11T22:44:00.302402+0000 mgr.y (mgr.14601) 1323 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:01.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:01 smithi187 bash[23415]: cluster 2024-03-11T22:44:01.176244+0000 mgr.y (mgr.14601) 1324 : cluster 0 pgmap v1764: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:44:01.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:01 smithi049 bash[21434]: audit 2024-03-11T22:44:00.302402+0000 mgr.y (mgr.14601) 1323 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:01.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:01 smithi049 bash[21434]: cluster 2024-03-11T22:44:01.176244+0000 mgr.y (mgr.14601) 1324 : cluster 0 pgmap v1764: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:44:01.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:01 smithi049 bash[28804]: audit 2024-03-11T22:44:00.302402+0000 mgr.y (mgr.14601) 1323 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:01.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:01 smithi049 bash[28804]: cluster 2024-03-11T22:44:01.176244+0000 mgr.y (mgr.14601) 1324 : cluster 0 pgmap v1764: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:44:04.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:04 smithi187 bash[23415]: cluster 2024-03-11T22:44:03.177058+0000 mgr.y (mgr.14601) 1325 : cluster 0 pgmap v1765: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-11T22:44:04.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:44:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:44:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:44:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:04 smithi049 bash[21434]: cluster 2024-03-11T22:44:03.177058+0000 mgr.y (mgr.14601) 1325 : cluster 0 pgmap v1765: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-11T22:44:04.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:04 smithi049 bash[28804]: cluster 2024-03-11T22:44:03.177058+0000 mgr.y (mgr.14601) 1325 : cluster 0 pgmap v1765: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-11T22:44:06.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:06 smithi187 bash[23415]: cluster 2024-03-11T22:44:05.178910+0000 mgr.y (mgr.14601) 1326 : cluster 0 pgmap v1766: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:06.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:06 smithi049 bash[28804]: cluster 2024-03-11T22:44:05.178910+0000 mgr.y (mgr.14601) 1326 : cluster 0 pgmap v1766: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:06.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:06 smithi049 bash[21434]: cluster 2024-03-11T22:44:05.178910+0000 mgr.y (mgr.14601) 1326 : cluster 0 pgmap v1766: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:08.503 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:08 smithi187 bash[23415]: cluster 2024-03-11T22:44:07.179719+0000 mgr.y (mgr.14601) 1327 : cluster 0 pgmap v1767: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:08.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:08 smithi049 bash[28804]: cluster 2024-03-11T22:44:07.179719+0000 mgr.y (mgr.14601) 1327 : cluster 0 pgmap v1767: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:08.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:08 smithi049 bash[21434]: cluster 2024-03-11T22:44:07.179719+0000 mgr.y (mgr.14601) 1327 : cluster 0 pgmap v1767: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:10.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:44:10 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:44:10.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:10 smithi187 bash[23415]: cluster 2024-03-11T22:44:09.181580+0000 mgr.y (mgr.14601) 1328 : cluster 0 pgmap v1768: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:10.504 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:10 smithi187 bash[23415]: audit 2024-03-11T22:44:09.784171+0000 mon.c (mon.2) 784 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:44:10.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:10 smithi049 bash[28804]: cluster 2024-03-11T22:44:09.181580+0000 mgr.y (mgr.14601) 1328 : cluster 0 pgmap v1768: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:10.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:10 smithi049 bash[28804]: audit 2024-03-11T22:44:09.784171+0000 mon.c (mon.2) 784 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:44:10.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:10 smithi049 bash[21434]: cluster 2024-03-11T22:44:09.181580+0000 mgr.y (mgr.14601) 1328 : cluster 0 pgmap v1768: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:10.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:10 smithi049 bash[21434]: audit 2024-03-11T22:44:09.784171+0000 mon.c (mon.2) 784 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:44:11.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[21434]: audit 2024-03-11T22:44:10.310336+0000 mgr.y (mgr.14601) 1329 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:11.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[21434]: audit 2024-03-11T22:44:10.517195+0000 mon.c (mon.2) 785 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:44:11.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[21434]: audit 2024-03-11T22:44:10.518886+0000 mon.c (mon.2) 786 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:44:11.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[21434]: audit 2024-03-11T22:44:10.529077+0000 mon.a (mon.0) 3558 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:44:11.539 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[28804]: audit 2024-03-11T22:44:10.310336+0000 mgr.y (mgr.14601) 1329 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:11.539 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[28804]: audit 2024-03-11T22:44:10.517195+0000 mon.c (mon.2) 785 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:44:11.539 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[28804]: audit 2024-03-11T22:44:10.518886+0000 mon.c (mon.2) 786 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:44:11.539 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:11 smithi049 bash[28804]: audit 2024-03-11T22:44:10.529077+0000 mon.a (mon.0) 3558 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:44:11.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:11 smithi187 bash[23415]: audit 2024-03-11T22:44:10.310336+0000 mgr.y (mgr.14601) 1329 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:11 smithi187 bash[23415]: audit 2024-03-11T22:44:10.517195+0000 mon.c (mon.2) 785 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:44:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:11 smithi187 bash[23415]: audit 2024-03-11T22:44:10.518886+0000 mon.c (mon.2) 786 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:44:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:11 smithi187 bash[23415]: audit 2024-03-11T22:44:10.529077+0000 mon.a (mon.0) 3558 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:44:12.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:12 smithi049 bash[21434]: cluster 2024-03-11T22:44:11.182360+0000 mgr.y (mgr.14601) 1330 : cluster 0 pgmap v1769: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:12.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:12 smithi049 bash[28804]: cluster 2024-03-11T22:44:11.182360+0000 mgr.y (mgr.14601) 1330 : cluster 0 pgmap v1769: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:12.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:12 smithi187 bash[23415]: cluster 2024-03-11T22:44:11.182360+0000 mgr.y (mgr.14601) 1330 : cluster 0 pgmap v1769: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:14.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:14 smithi049 bash[21434]: cluster 2024-03-11T22:44:13.183170+0000 mgr.y (mgr.14601) 1331 : cluster 0 pgmap v1770: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:14.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:14 smithi049 bash[28804]: cluster 2024-03-11T22:44:13.183170+0000 mgr.y (mgr.14601) 1331 : cluster 0 pgmap v1770: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:14.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:44:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:44:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:44:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:14 smithi187 bash[23415]: cluster 2024-03-11T22:44:13.183170+0000 mgr.y (mgr.14601) 1331 : cluster 0 pgmap v1770: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:15.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:15 smithi049 bash[21434]: audit 2024-03-11T22:44:14.559603+0000 mon.c (mon.2) 787 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:15.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:15 smithi049 bash[28804]: audit 2024-03-11T22:44:14.559603+0000 mon.c (mon.2) 787 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:15.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:15 smithi187 bash[23415]: audit 2024-03-11T22:44:14.559603+0000 mon.c (mon.2) 787 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:16.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:16 smithi049 bash[21434]: cluster 2024-03-11T22:44:15.185023+0000 mgr.y (mgr.14601) 1332 : cluster 0 pgmap v1771: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:16.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:16 smithi049 bash[28804]: cluster 2024-03-11T22:44:15.185023+0000 mgr.y (mgr.14601) 1332 : cluster 0 pgmap v1771: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:16.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:16 smithi187 bash[23415]: cluster 2024-03-11T22:44:15.185023+0000 mgr.y (mgr.14601) 1332 : cluster 0 pgmap v1771: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:18.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:18 smithi049 bash[21434]: cluster 2024-03-11T22:44:17.185782+0000 mgr.y (mgr.14601) 1333 : cluster 0 pgmap v1772: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:18.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:18 smithi049 bash[28804]: cluster 2024-03-11T22:44:17.185782+0000 mgr.y (mgr.14601) 1333 : cluster 0 pgmap v1772: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:18.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:18 smithi187 bash[23415]: cluster 2024-03-11T22:44:17.185782+0000 mgr.y (mgr.14601) 1333 : cluster 0 pgmap v1772: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:19.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ pid=135953 2024-03-11T22:44:19.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota e465fdb5-455f-4dac-9dcc-834a5c09fa37 max_bytes 0 2024-03-11T22:44:19.379 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put two /etc/passwd 2024-03-11T22:44:19.512 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- 172.21.15.49:0/2289762064 >> v1:172.21.15.49:6789/0 conn(0x7f4590114010 legacy=0x7f45901164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:19.513 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- 172.21.15.49:0/2289762064 shutdown_connections 2024-03-11T22:44:19.513 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- 172.21.15.49:0/2289762064 >> 172.21.15.49:0/2289762064 conn(0x7f4590076da0 msgr2=0x7f45900791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:19.513 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- 172.21.15.49:0/2289762064 shutdown_connections 2024-03-11T22:44:19.513 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- 172.21.15.49:0/2289762064 wait complete. 2024-03-11T22:44:19.513 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 Processor -- start 2024-03-11T22:44:19.513 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- start start 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f45901a3280 con 0x7f459010d660 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f45901ad3b0 con 0x7f4590114010 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f45901ae5b0 con 0x7f4590110410 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4595985640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f459010d660 0x7f45901a2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55408/0 (socket says 172.21.15.49:55408) 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4595985640 1 -- 172.21.15.49:0/1208241026 learned_addr learned my addr 172.21.15.49:0/1208241026 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958599928 0 0) 0x7f45901ae5b0 con 0x7f4590110410 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f457c001ff0 con 0x7f4590110410 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169177148 0 0) 0x7f45901a3280 con 0x7f459010d660 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45901ae5b0 con 0x7f459010d660 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2659558102 0 0) 0x7f457c001ff0 con 0x7f4590110410 2024-03-11T22:44:19.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f45901a3280 con 0x7f4590110410 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4580001a00 con 0x7f4590110410 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4112031150 0 0) 0x7f45901ae5b0 con 0x7f459010d660 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f457c001ff0 con 0x7f459010d660 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f458c001990 con 0x7f459010d660 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012296961 0 0) 0x7f45901ad3b0 con 0x7f4590114010 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45901ae5b0 con 0x7f4590114010 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 855467888 0 0) 0x7f45901a3280 con 0x7f4590110410 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 >> v1:172.21.15.187:6789/0 conn(0x7f4590114010 legacy=0x7f45901aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 >> v1:172.21.15.49:6789/0 conn(0x7f459010d660 legacy=0x7f45901a2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45901af7b0 con 0x7f4590110410 2024-03-11T22:44:19.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45901ac400 con 0x7f4590110410 2024-03-11T22:44:19.518 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f45901ac880 con 0x7f4590110410 2024-03-11T22:44:19.518 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f4580003a90 con 0x7f4590110410 2024-03-11T22:44:19.518 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.501+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4580004a00 con 0x7f4590110410 2024-03-11T22:44:19.518 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.505+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4574005090 con 0x7f4590110410 2024-03-11T22:44:19.518 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.505+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f4580003600 con 0x7f4590110410 2024-03-11T22:44:19.518 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.505+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(793..793 src has 260..793) v4 ==== 7831+0+0 (unknown 2372296356 0 0) 0x7f4580087720 con 0x7f4590110410 2024-03-11T22:44:19.519 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.505+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=794}) v3 -- 0x7f45901a3280 con 0x7f4590110410 2024-03-11T22:44:19.521 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.509+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f4580054640 con 0x7f4590110410 2024-03-11T22:44:19.704 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:19.693+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f4574005340 con 0x7f4590110410 2024-03-11T22:44:20.281 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:20.269+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 10 ==== osd_map(794..794 src has 260..794) v4 ==== 628+0+0 (unknown 3048773 0 0) 0x7f4580054f70 con 0x7f4590110410 2024-03-11T22:44:20.281 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:20.269+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=795}) v3 -- 0x7f45901ad3b0 con 0x7f4590110410 2024-03-11T22:44:20.291 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:20.281+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v794) v1 ==== 217+0+0 (unknown 21854149 0 0) 0x7f45800529b0 con 0x7f4590110410 2024-03-11T22:44:20.400 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:20.389+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f4574000c50 con 0x7f4590110410 2024-03-11T22:44:20.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:44:20 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:44:20.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:20 smithi187 bash[23415]: cluster 2024-03-11T22:44:19.187558+0000 mgr.y (mgr.14601) 1334 : cluster 0 pgmap v1773: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:20.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:20 smithi187 bash[23415]: audit 2024-03-11T22:44:19.699373+0000 mon.c (mon.2) 788 : audit 1 from='client.? v1:172.21.15.49:0/1208241026' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:20.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:20 smithi187 bash[23415]: audit 2024-03-11T22:44:19.699842+0000 mon.a (mon.0) 3559 : audit 1 from='client.47300 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:20.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:20 smithi049 bash[28804]: cluster 2024-03-11T22:44:19.187558+0000 mgr.y (mgr.14601) 1334 : cluster 0 pgmap v1773: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:20.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:20 smithi049 bash[28804]: audit 2024-03-11T22:44:19.699373+0000 mon.c (mon.2) 788 : audit 1 from='client.? v1:172.21.15.49:0/1208241026' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:20.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:20 smithi049 bash[28804]: audit 2024-03-11T22:44:19.699842+0000 mon.a (mon.0) 3559 : audit 1 from='client.47300 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:20.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:20 smithi049 bash[21434]: cluster 2024-03-11T22:44:19.187558+0000 mgr.y (mgr.14601) 1334 : cluster 0 pgmap v1773: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:20.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:20 smithi049 bash[21434]: audit 2024-03-11T22:44:19.699373+0000 mon.c (mon.2) 788 : audit 1 from='client.? v1:172.21.15.49:0/1208241026' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:20.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:20 smithi049 bash[21434]: audit 2024-03-11T22:44:19.699842+0000 mon.a (mon.0) 3559 : audit 1 from='client.47300 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:21.299 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.289+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 12 ==== osd_map(795..795 src has 260..795) v4 ==== 628+0+0 (unknown 1714563577 0 0) 0x7f45800589c0 con 0x7f4590110410 2024-03-11T22:44:21.300 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.289+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=796}) v3 -- 0x7f457c07b7e0 con 0x7f4590110410 2024-03-11T22:44:21.307 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.297+0000 7f4586ffd640 1 -- 172.21.15.49:0/1208241026 <== mon.2 v1:172.21.15.49:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v795) v1 ==== 217+0+0 (unknown 3491133963 0 0) 0x7f45800541d0 con 0x7f4590110410 2024-03-11T22:44:21.307 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_bytes = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:44:21.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.301+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 >> v1:172.21.15.49:6800/915645872 conn(0x7f457c06e630 legacy=0x7f457c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:21.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.301+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 >> v1:172.21.15.49:6790/0 conn(0x7f4590110410 legacy=0x7f45901a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:21.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.301+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 shutdown_connections 2024-03-11T22:44:21.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.301+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 >> 172.21.15.49:0/1208241026 conn(0x7f4590076da0 msgr2=0x7f4590114460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:21.311 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.301+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 shutdown_connections 2024-03-11T22:44:21.312 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.301+0000 7f4597be9640 1 -- 172.21.15.49:0/1208241026 wait complete. 2024-03-11T22:44:21.333 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota e465fdb5-455f-4dac-9dcc-834a5c09fa37 max_objects 0 2024-03-11T22:44:21.460 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/1278489292 >> v1:172.21.15.49:6789/0 conn(0x7fba3c109f60 legacy=0x7fba3c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:21.460 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/1278489292 shutdown_connections 2024-03-11T22:44:21.460 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/1278489292 >> 172.21.15.49:0/1278489292 conn(0x7fba3c0fb9a0 msgr2=0x7fba3c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:21.460 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/1278489292 shutdown_connections 2024-03-11T22:44:21.461 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/1278489292 wait complete. 2024-03-11T22:44:21.461 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 Processor -- start 2024-03-11T22:44:21.461 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- start start 2024-03-11T22:44:21.463 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fba3c1a8020 con 0x7fba3c10da70 2024-03-11T22:44:21.463 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fba3c1a9220 con 0x7fba3c109f60 2024-03-11T22:44:21.463 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fba3c1aa420 con 0x7fba3c102150 2024-03-11T22:44:21.463 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba40d0b640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fba3c102150 0x7fba3c109670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:41454/0 (socket says 172.21.15.49:41454) 2024-03-11T22:44:21.463 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba40d0b640 1 -- 172.21.15.49:0/247653532 learned_addr learned my addr 172.21.15.49:0/247653532 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477743485 0 0) 0x7fba3c1aa420 con 0x7fba3c102150 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2c001ff0 con 0x7fba3c102150 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668565292 0 0) 0x7fba3c1a8020 con 0x7fba3c10da70 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c1aa420 con 0x7fba3c10da70 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1018298584 0 0) 0x7fba2c001ff0 con 0x7fba3c102150 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba3c1a8020 con 0x7fba3c102150 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fba300018c0 con 0x7fba3c102150 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2185257122 0 0) 0x7fba3c1aa420 con 0x7fba3c10da70 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba2c001ff0 con 0x7fba3c10da70 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304789403 0 0) 0x7fba3c1a9220 con 0x7fba3c109f60 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c1aa420 con 0x7fba3c109f60 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fba34001400 con 0x7fba3c10da70 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1822078306 0 0) 0x7fba3c1a8020 con 0x7fba3c102150 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 >> v1:172.21.15.187:6789/0 conn(0x7fba3c109f60 legacy=0x7fba3c1a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:21.464 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 >> v1:172.21.15.49:6789/0 conn(0x7fba3c10da70 legacy=0x7fba3c1a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c1ab620 con 0x7fba3c102150 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c1aa610 con 0x7fba3c102150 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c1aaa90 con 0x7fba3c102150 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fba30003ab0 con 0x7fba3c102150 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.449+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fba30005c90 con 0x7fba3c102150 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.453+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba20005090 con 0x7fba3c102150 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.453+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fba30003600 con 0x7fba3c102150 2024-03-11T22:44:21.465 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.453+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(796..796 src has 260..796) v4 ==== 7831+0+0 (unknown 1906224013 0 0) 0x7fba30088830 con 0x7fba3c102150 2024-03-11T22:44:21.468 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.457+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fba30055750 con 0x7fba3c102150 2024-03-11T22:44:21.641 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:21.633+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7fba20005340 con 0x7fba3c102150 2024-03-11T22:44:21.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:21 smithi187 bash[23415]: audit 2024-03-11T22:44:20.272847+0000 mon.a (mon.0) 3560 : audit 1 from='client.47300 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:44:21.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:21 smithi187 bash[23415]: cluster 2024-03-11T22:44:20.281912+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-03-11T22:44:21.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:21 smithi187 bash[23415]: audit 2024-03-11T22:44:20.318330+0000 mgr.y (mgr.14601) 1335 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:21.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:21 smithi187 bash[23415]: audit 2024-03-11T22:44:20.395377+0000 mon.c (mon.2) 789 : audit 1 from='client.? v1:172.21.15.49:0/1208241026' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:21.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:21 smithi187 bash[23415]: audit 2024-03-11T22:44:20.395735+0000 mon.a (mon.0) 3562 : audit 1 from='client.47300 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:21.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[28804]: audit 2024-03-11T22:44:20.272847+0000 mon.a (mon.0) 3560 : audit 1 from='client.47300 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:44:21.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[28804]: cluster 2024-03-11T22:44:20.281912+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-03-11T22:44:21.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[28804]: audit 2024-03-11T22:44:20.318330+0000 mgr.y (mgr.14601) 1335 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:21.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[28804]: audit 2024-03-11T22:44:20.395377+0000 mon.c (mon.2) 789 : audit 1 from='client.? v1:172.21.15.49:0/1208241026' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:21.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[28804]: audit 2024-03-11T22:44:20.395735+0000 mon.a (mon.0) 3562 : audit 1 from='client.47300 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:21.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[21434]: audit 2024-03-11T22:44:20.272847+0000 mon.a (mon.0) 3560 : audit 1 from='client.47300 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:44:21.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[21434]: cluster 2024-03-11T22:44:20.281912+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-03-11T22:44:21.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[21434]: audit 2024-03-11T22:44:20.318330+0000 mgr.y (mgr.14601) 1335 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:21.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[21434]: audit 2024-03-11T22:44:20.395377+0000 mon.c (mon.2) 789 : audit 1 from='client.? v1:172.21.15.49:0/1208241026' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:21.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:21 smithi049 bash[21434]: audit 2024-03-11T22:44:20.395735+0000 mon.a (mon.0) 3562 : audit 1 from='client.47300 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:44:22.346 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:22.337+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v797) v1 ==== 221+0+0 (unknown 1730972630 0 0) 0x7fba30053ac0 con 0x7fba3c102150 2024-03-11T22:44:22.455 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:22.449+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7fba20000c50 con 0x7fba3c102150 2024-03-11T22:44:22.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: cluster 2024-03-11T22:44:21.188328+0000 mgr.y (mgr.14601) 1336 : cluster 0 pgmap v1775: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:44:22.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: audit 2024-03-11T22:44:21.292094+0000 mon.a (mon.0) 3563 : audit 1 from='client.47300 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:44:22.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: cluster 2024-03-11T22:44:21.300812+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-03-11T22:44:22.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: cluster 2024-03-11T22:44:21.326735+0000 mon.a (mon.0) 3565 : cluster 1 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' no longer out of quota; removing NO_QUOTA flag 2024-03-11T22:44:22.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: cluster 2024-03-11T22:44:21.327164+0000 mon.a (mon.0) 3566 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:44:22.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: cluster 2024-03-11T22:44:21.332615+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-03-11T22:44:22.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: audit 2024-03-11T22:44:21.635996+0000 mon.c (mon.2) 790 : audit 1 from='client.? v1:172.21.15.49:0/247653532' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:22.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:22 smithi187 bash[23415]: audit 2024-03-11T22:44:21.636609+0000 mon.a (mon.0) 3568 : audit 1 from='client.47306 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:22.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: cluster 2024-03-11T22:44:21.188328+0000 mgr.y (mgr.14601) 1336 : cluster 0 pgmap v1775: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: audit 2024-03-11T22:44:21.292094+0000 mon.a (mon.0) 3563 : audit 1 from='client.47300 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: cluster 2024-03-11T22:44:21.300812+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: cluster 2024-03-11T22:44:21.326735+0000 mon.a (mon.0) 3565 : cluster 1 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' no longer out of quota; removing NO_QUOTA flag 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: cluster 2024-03-11T22:44:21.327164+0000 mon.a (mon.0) 3566 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: cluster 2024-03-11T22:44:21.332615+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: audit 2024-03-11T22:44:21.635996+0000 mon.c (mon.2) 790 : audit 1 from='client.? v1:172.21.15.49:0/247653532' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[21434]: audit 2024-03-11T22:44:21.636609+0000 mon.a (mon.0) 3568 : audit 1 from='client.47306 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: cluster 2024-03-11T22:44:21.188328+0000 mgr.y (mgr.14601) 1336 : cluster 0 pgmap v1775: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: audit 2024-03-11T22:44:21.292094+0000 mon.a (mon.0) 3563 : audit 1 from='client.47300 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:44:22.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: cluster 2024-03-11T22:44:21.300812+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-03-11T22:44:22.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: cluster 2024-03-11T22:44:21.326735+0000 mon.a (mon.0) 3565 : cluster 1 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' no longer out of quota; removing NO_QUOTA flag 2024-03-11T22:44:22.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: cluster 2024-03-11T22:44:21.327164+0000 mon.a (mon.0) 3566 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-11T22:44:22.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: cluster 2024-03-11T22:44:21.332615+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-03-11T22:44:22.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: audit 2024-03-11T22:44:21.635996+0000 mon.c (mon.2) 790 : audit 1 from='client.? v1:172.21.15.49:0/247653532' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:22.788 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:22 smithi049 bash[28804]: audit 2024-03-11T22:44:21.636609+0000 mon.a (mon.0) 3568 : audit 1 from='client.47306 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:23.348 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.340+0000 7fba39ffb640 1 -- 172.21.15.49:0/247653532 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v798) v1 ==== 221+0+0 (unknown 3794898692 0 0) 0x7fba300552e0 con 0x7fba3c102150 2024-03-11T22:44:23.348 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_objects = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:44:23.352 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.344+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 >> v1:172.21.15.49:6800/915645872 conn(0x7fba2c06e730 legacy=0x7fba2c070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:23.352 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.344+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 >> v1:172.21.15.49:6790/0 conn(0x7fba3c102150 legacy=0x7fba3c109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:23.352 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.344+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 shutdown_connections 2024-03-11T22:44:23.352 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.344+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 >> 172.21.15.49:0/247653532 conn(0x7fba3c0fb9a0 msgr2=0x7fba3c10fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:23.353 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.344+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 shutdown_connections 2024-03-11T22:44:23.353 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.344+0000 7fba42f6f640 1 -- 172.21.15.49:0/247653532 wait complete. 2024-03-11T22:44:23.374 INFO:tasks.workunit.client.0.smithi049.stderr:+ wait 135953 2024-03-11T22:44:23.374 INFO:tasks.workunit.client.0.smithi049.stderr:+ [ 0 -ne 0 ] 2024-03-11T22:44:23.374 INFO:tasks.workunit.client.0.smithi049.stderr:+ true 2024-03-11T22:44:23.374 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put three /etc/passwd 2024-03-11T22:44:23.418 INFO:tasks.workunit.client.0.smithi049.stderr:+ uuidgen 2024-03-11T22:44:23.419 INFO:tasks.workunit.client.0.smithi049.stderr:+ pp=ec81b7d6-e152-48e9-a783-539150d4b909 2024-03-11T22:44:23.419 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool create ec81b7d6-e152-48e9-a783-539150d4b909 12 2024-03-11T22:44:23.534 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- 172.21.15.49:0/2515869907 >> v1:172.21.15.49:6789/0 conn(0x7f7430109fb0 legacy=0x7f743010c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:23.534 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- 172.21.15.49:0/2515869907 shutdown_connections 2024-03-11T22:44:23.534 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- 172.21.15.49:0/2515869907 >> 172.21.15.49:0/2515869907 conn(0x7f7430076b70 msgr2=0x7f74300fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:23.534 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- 172.21.15.49:0/2515869907 shutdown_connections 2024-03-11T22:44:23.534 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- 172.21.15.49:0/2515869907 wait complete. 2024-03-11T22:44:23.534 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 Processor -- start 2024-03-11T22:44:23.535 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- start start 2024-03-11T22:44:23.535 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f74301a5eb0 con 0x7f7430109fb0 2024-03-11T22:44:23.535 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f74301a70b0 con 0x7f74301021a0 2024-03-11T22:44:23.535 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.524+0000 7f7436861640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f74301a82b0 con 0x7f743010dac0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742f7fe640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7430109fb0 0x7f74301a0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55450/0 (socket says 172.21.15.49:55450) 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742f7fe640 1 -- 172.21.15.49:0/313299285 learned_addr learned my addr 172.21.15.49:0/313299285 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137172673 0 0) 0x7f74301a82b0 con 0x7f743010dac0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7418003530 con 0x7f743010dac0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230679777 0 0) 0x7f74301a5eb0 con 0x7f7430109fb0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74301a82b0 con 0x7f7430109fb0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1976954240 0 0) 0x7f7418003530 con 0x7f743010dac0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f74301a5eb0 con 0x7f743010dac0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f74200018e0 con 0x7f743010dac0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3913061855 0 0) 0x7f74301a82b0 con 0x7f7430109fb0 2024-03-11T22:44:23.537 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7418003530 con 0x7f7430109fb0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f7424003600 con 0x7f7430109fb0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996205468 0 0) 0x7f74301a70b0 con 0x7f74301021a0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74301a82b0 con 0x7f74301021a0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2522386870 0 0) 0x7f74301a5eb0 con 0x7f743010dac0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 >> v1:172.21.15.187:6789/0 conn(0x7f74301021a0 legacy=0x7f74301097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 >> v1:172.21.15.49:6789/0 conn(0x7f7430109fb0 legacy=0x7f74301a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74301a94b0 con 0x7f743010dac0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74301a84a0 con 0x7f743010dac0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f74301a8920 con 0x7f743010dac0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f7420003ab0 con 0x7f743010dac0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f7420004910 con 0x7f743010dac0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c005090 con 0x7f743010dac0 2024-03-11T22:44:23.538 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f7420003600 con 0x7f743010dac0 2024-03-11T22:44:23.539 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.528+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(798..798 src has 260..798) v4 ==== 7831+0+0 (unknown 3936374424 0 0) 0x7f7420087600 con 0x7f743010dac0 2024-03-11T22:44:23.542 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.532+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f74200544c0 con 0x7f743010dac0 2024-03-11T22:44:23.717 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:23.708+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12} v 0) v1 -- 0x7f741c0058c0 con 0x7f743010dac0 2024-03-11T22:44:23.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:23 smithi187 bash[23415]: audit 2024-03-11T22:44:22.331050+0000 mon.a (mon.0) 3569 : audit 1 from='client.47306 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:44:23.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:23 smithi187 bash[23415]: cluster 2024-03-11T22:44:22.338683+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-03-11T22:44:23.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:23 smithi187 bash[23415]: audit 2024-03-11T22:44:22.450008+0000 mon.c (mon.2) 791 : audit 1 from='client.? v1:172.21.15.49:0/247653532' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:23.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:23 smithi187 bash[23415]: audit 2024-03-11T22:44:22.450615+0000 mon.a (mon.0) 3571 : audit 1 from='client.47306 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:23.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[21434]: audit 2024-03-11T22:44:22.331050+0000 mon.a (mon.0) 3569 : audit 1 from='client.47306 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:44:23.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[21434]: cluster 2024-03-11T22:44:22.338683+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-03-11T22:44:23.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[21434]: audit 2024-03-11T22:44:22.450008+0000 mon.c (mon.2) 791 : audit 1 from='client.? v1:172.21.15.49:0/247653532' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:23.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[21434]: audit 2024-03-11T22:44:22.450615+0000 mon.a (mon.0) 3571 : audit 1 from='client.47306 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:23.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[28804]: audit 2024-03-11T22:44:22.331050+0000 mon.a (mon.0) 3569 : audit 1 from='client.47306 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:44:23.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[28804]: cluster 2024-03-11T22:44:22.338683+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-03-11T22:44:23.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[28804]: audit 2024-03-11T22:44:22.450008+0000 mon.c (mon.2) 791 : audit 1 from='client.? v1:172.21.15.49:0/247653532' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:23.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:23 smithi049 bash[28804]: audit 2024-03-11T22:44:22.450615+0000 mon.a (mon.0) 3571 : audit 1 from='client.47306 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:44:24.370 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.360+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]=0 pool 'ec81b7d6-e152-48e9-a783-539150d4b909' created v799) v1 ==== 176+0+0 (unknown 555115306 0 0) 0x7f7420052830 con 0x7f743010dac0 2024-03-11T22:44:24.483 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.476+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12} v 0) v1 -- 0x7f741c0053f0 con 0x7f743010dac0 2024-03-11T22:44:24.484 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.476+0000 7f742d7fa640 1 -- 172.21.15.49:0/313299285 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]=0 pool 'ec81b7d6-e152-48e9-a783-539150d4b909' already exists v799) v1 ==== 183+0+0 (unknown 559086383 0 0) 0x7f741c0053f0 con 0x7f743010dac0 2024-03-11T22:44:24.485 INFO:tasks.workunit.client.0.smithi049.stderr:pool 'ec81b7d6-e152-48e9-a783-539150d4b909' already exists 2024-03-11T22:44:24.487 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.480+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 >> v1:172.21.15.49:6800/915645872 conn(0x7f741806e5d0 legacy=0x7f7418070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:24.487 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.480+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 >> v1:172.21.15.49:6790/0 conn(0x7f743010dac0 legacy=0x7f74301a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:24.487 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.480+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 shutdown_connections 2024-03-11T22:44:24.487 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.480+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 >> 172.21.15.49:0/313299285 conn(0x7f7430076b70 msgr2=0x7f74300fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:24.487 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.480+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 shutdown_connections 2024-03-11T22:44:24.488 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.480+0000 7f7436861640 1 -- 172.21.15.49:0/313299285 wait complete. 2024-03-11T22:44:24.502 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool application enable ec81b7d6-e152-48e9-a783-539150d4b909 rados 2024-03-11T22:44:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[21434]: cluster 2024-03-11T22:44:23.189139+0000 mgr.y (mgr.14601) 1337 : cluster 0 pgmap v1779: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:44:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[21434]: audit 2024-03-11T22:44:23.333685+0000 mon.a (mon.0) 3572 : audit 1 from='client.47306 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:44:24.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[21434]: cluster 2024-03-11T22:44:23.340456+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[21434]: audit 2024-03-11T22:44:23.711872+0000 mon.c (mon.2) 792 : audit 1 from='client.? v1:172.21.15.49:0/313299285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[21434]: audit 2024-03-11T22:44:23.712569+0000 mon.a (mon.0) 3574 : audit 1 from='client.47321 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:44:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[28804]: cluster 2024-03-11T22:44:23.189139+0000 mgr.y (mgr.14601) 1337 : cluster 0 pgmap v1779: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[28804]: audit 2024-03-11T22:44:23.333685+0000 mon.a (mon.0) 3572 : audit 1 from='client.47306 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[28804]: cluster 2024-03-11T22:44:23.340456+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[28804]: audit 2024-03-11T22:44:23.711872+0000 mon.c (mon.2) 792 : audit 1 from='client.? v1:172.21.15.49:0/313299285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:24.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:24 smithi049 bash[28804]: audit 2024-03-11T22:44:23.712569+0000 mon.a (mon.0) 3574 : audit 1 from='client.47321 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:24.619 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/648678234 >> v1:172.21.15.49:6790/0 conn(0x7fb9b41033e0 legacy=0x7fb9b41037c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:24.619 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/648678234 shutdown_connections 2024-03-11T22:44:24.619 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/648678234 >> 172.21.15.49:0/648678234 conn(0x7fb9b40fec30 msgr2=0x7fb9b4101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:24.619 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/648678234 shutdown_connections 2024-03-11T22:44:24.620 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/648678234 wait complete. 2024-03-11T22:44:24.620 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 Processor -- start 2024-03-11T22:44:24.620 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- start start 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb9b41a8040 con 0x7fb9b410fbe0 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb9b41a9240 con 0x7fb9b41033e0 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb9b41aa440 con 0x7fb9b410c070 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b3fff640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7fb9b410c070 0x7fb9b41a2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:40282/0 (socket says 172.21.15.49:40282) 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b3fff640 1 -- 172.21.15.49:0/1006833164 learned_addr learned my addr 172.21.15.49:0/1006833164 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b96e4640 1 --1- 172.21.15.49:0/1006833164 >> v1:172.21.15.49:6789/0 conn(0x7fb9b410fbe0 0x7fb9b41a6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53842/0 (socket says 172.21.15.49:53842) 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122464604 0 0) 0x7fb9b41aa440 con 0x7fb9b410c070 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb99c003770 con 0x7fb9b410c070 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956447612 0 0) 0x7fb9b41a8040 con 0x7fb9b410fbe0 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b41aa440 con 0x7fb9b410fbe0 2024-03-11T22:44:24.622 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 648411557 0 0) 0x7fb99c003770 con 0x7fb9b410c070 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb9b41a8040 con 0x7fb9b410c070 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb9a80018e0 con 0x7fb9b410c070 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 229440202 0 0) 0x7fb9b41aa440 con 0x7fb9b410fbe0 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb99c003770 con 0x7fb9b410fbe0 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257836605 0 0) 0x7fb9b41a9240 con 0x7fb9b41033e0 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b41aa440 con 0x7fb9b41033e0 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb9ac0017c0 con 0x7fb9b410fbe0 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 973921930 0 0) 0x7fb9b41a8040 con 0x7fb9b410c070 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 >> v1:172.21.15.187:6789/0 conn(0x7fb9b41033e0 legacy=0x7fb9b4108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 >> v1:172.21.15.49:6789/0 conn(0x7fb9b410fbe0 legacy=0x7fb9b41a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b41ab640 con 0x7fb9b410c070 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b41a8230 con 0x7fb9b410c070 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b41a86b0 con 0x7fb9b410c070 2024-03-11T22:44:24.623 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fb9a8003ab0 con 0x7fb9b410c070 2024-03-11T22:44:24.624 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fb9a8005bf0 con 0x7fb9b410c070 2024-03-11T22:44:24.624 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a0005090 con 0x7fb9b410c070 2024-03-11T22:44:24.624 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.612+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fb9a8003620 con 0x7fb9b410c070 2024-03-11T22:44:24.624 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.616+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(799..799 src has 260..799) v4 ==== 8206+0+0 (unknown 4072549639 0 0) 0x7fb9a8088a80 con 0x7fb9b410c070 2024-03-11T22:44:24.627 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.620+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb9a80557c0 con 0x7fb9b410c070 2024-03-11T22:44:24.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:24 smithi187 bash[23415]: cluster 2024-03-11T22:44:23.189139+0000 mgr.y (mgr.14601) 1337 : cluster 0 pgmap v1779: 176 pgs: 176 active+clean; 722 KiB data, 811 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:44:24.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:24 smithi187 bash[23415]: audit 2024-03-11T22:44:23.333685+0000 mon.a (mon.0) 3572 : audit 1 from='client.47306 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:44:24.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:24 smithi187 bash[23415]: cluster 2024-03-11T22:44:23.340456+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-03-11T22:44:24.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:24 smithi187 bash[23415]: audit 2024-03-11T22:44:23.711872+0000 mon.c (mon.2) 792 : audit 1 from='client.? v1:172.21.15.49:0/313299285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:24.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:24 smithi187 bash[23415]: audit 2024-03-11T22:44:23.712569+0000 mon.a (mon.0) 3574 : audit 1 from='client.47321 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:24.800 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:24.792+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"} v 0) v1 -- 0x7fb9a0005340 con 0x7fb9b410c070 2024-03-11T22:44:25.375 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:25.368+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]=0 enabled application 'rados' on pool 'ec81b7d6-e152-48e9-a783-539150d4b909' v800) v1 ==== 213+0+0 (unknown 1698643582 0 0) 0x7fb9a8053b30 con 0x7fb9b410c070 2024-03-11T22:44:25.492 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:25.484+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"} v 0) v1 -- 0x7fb9a00010a0 con 0x7fb9b410c070 2024-03-11T22:44:25.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:25 smithi187 bash[23415]: audit 2024-03-11T22:44:24.355801+0000 mon.a (mon.0) 3575 : audit 1 from='client.47321 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]': finished 2024-03-11T22:44:25.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:25 smithi187 bash[23415]: cluster 2024-03-11T22:44:24.363257+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-03-11T22:44:25.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:25 smithi187 bash[23415]: audit 2024-03-11T22:44:24.478058+0000 mon.c (mon.2) 793 : audit 1 from='client.? v1:172.21.15.49:0/313299285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:25.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:25 smithi187 bash[23415]: audit 2024-03-11T22:44:24.478759+0000 mon.a (mon.0) 3577 : audit 1 from='client.47321 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:25.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:25 smithi187 bash[23415]: audit 2024-03-11T22:44:24.795192+0000 mon.c (mon.2) 794 : audit 1 from='client.? v1:172.21.15.49:0/1006833164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:25.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:25 smithi187 bash[23415]: audit 2024-03-11T22:44:24.795937+0000 mon.a (mon.0) 3578 : audit 1 from='client.47327 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:25.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[21434]: audit 2024-03-11T22:44:24.355801+0000 mon.a (mon.0) 3575 : audit 1 from='client.47321 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]': finished 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[21434]: cluster 2024-03-11T22:44:24.363257+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[21434]: audit 2024-03-11T22:44:24.478058+0000 mon.c (mon.2) 793 : audit 1 from='client.? v1:172.21.15.49:0/313299285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[21434]: audit 2024-03-11T22:44:24.478759+0000 mon.a (mon.0) 3577 : audit 1 from='client.47321 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[21434]: audit 2024-03-11T22:44:24.795192+0000 mon.c (mon.2) 794 : audit 1 from='client.? v1:172.21.15.49:0/1006833164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[21434]: audit 2024-03-11T22:44:24.795937+0000 mon.a (mon.0) 3578 : audit 1 from='client.47327 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[28804]: audit 2024-03-11T22:44:24.355801+0000 mon.a (mon.0) 3575 : audit 1 from='client.47321 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]': finished 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[28804]: cluster 2024-03-11T22:44:24.363257+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[28804]: audit 2024-03-11T22:44:24.478058+0000 mon.c (mon.2) 793 : audit 1 from='client.? v1:172.21.15.49:0/313299285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[28804]: audit 2024-03-11T22:44:24.478759+0000 mon.a (mon.0) 3577 : audit 1 from='client.47321 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pg_num": 12}]: dispatch 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[28804]: audit 2024-03-11T22:44:24.795192+0000 mon.c (mon.2) 794 : audit 1 from='client.? v1:172.21.15.49:0/1006833164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:25.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:25 smithi049 bash[28804]: audit 2024-03-11T22:44:24.795937+0000 mon.a (mon.0) 3578 : audit 1 from='client.47327 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:26.401 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.392+0000 7fb9b1ffb640 1 -- 172.21.15.49:0/1006833164 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]=0 enabled application 'rados' on pool 'ec81b7d6-e152-48e9-a783-539150d4b909' v801) v1 ==== 213+0+0 (unknown 1595852952 0 0) 0x7fb9a8055350 con 0x7fb9b410c070 2024-03-11T22:44:26.401 INFO:tasks.workunit.client.0.smithi049.stderr:enabled application 'rados' on pool 'ec81b7d6-e152-48e9-a783-539150d4b909' 2024-03-11T22:44:26.405 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.396+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 >> v1:172.21.15.49:6800/915645872 conn(0x7fb99c06e730 legacy=0x7fb99c070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:26.405 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.396+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 >> v1:172.21.15.49:6790/0 conn(0x7fb9b410c070 legacy=0x7fb9b41a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:26.405 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.396+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 shutdown_connections 2024-03-11T22:44:26.405 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.396+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 >> 172.21.15.49:0/1006833164 conn(0x7fb9b40fec30 msgr2=0x7fb9b4112830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:26.405 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.396+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 shutdown_connections 2024-03-11T22:44:26.405 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.396+0000 7fb9bb147640 1 -- 172.21.15.49:0/1006833164 wait complete. 2024-03-11T22:44:26.424 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota ec81b7d6-e152-48e9-a783-539150d4b909 max_objects 10 2024-03-11T22:44:26.549 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- 172.21.15.49:0/1410099258 >> v1:172.21.15.49:6789/0 conn(0x7fae00105690 legacy=0x7fae00105a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:26.549 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- 172.21.15.49:0/1410099258 shutdown_connections 2024-03-11T22:44:26.549 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- 172.21.15.49:0/1410099258 >> 172.21.15.49:0/1410099258 conn(0x7fae00076300 msgr2=0x7fae000fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:26.549 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- 172.21.15.49:0/1410099258 shutdown_connections 2024-03-11T22:44:26.549 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- 172.21.15.49:0/1410099258 wait complete. 2024-03-11T22:44:26.549 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 Processor -- start 2024-03-11T22:44:26.550 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- start start 2024-03-11T22:44:26.551 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fae001a5d00 con 0x7fae001084b0 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fae001a6f00 con 0x7fae00105690 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fae06d12640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fae001a8100 con 0x7fae0010c050 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfffff640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fae001084b0 0x7fae00103940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53866/0 (socket says 172.21.15.49:53866) 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfffff640 1 -- 172.21.15.49:0/1509398256 learned_addr learned my addr 172.21.15.49:0/1509398256 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950590507 0 0) 0x7fae001a8100 con 0x7fae0010c050 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fade8001ff0 con 0x7fae0010c050 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213433942 0 0) 0x7fae001a5d00 con 0x7fae001084b0 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae001a8100 con 0x7fae001084b0 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 884819244 0 0) 0x7fade8001ff0 con 0x7fae0010c050 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae001a5d00 con 0x7fae0010c050 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fadf8001800 con 0x7fae0010c050 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3394754697 0 0) 0x7fae001a8100 con 0x7fae001084b0 2024-03-11T22:44:26.552 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fade8001ff0 con 0x7fae001084b0 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fadf4001d00 con 0x7fae001084b0 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1107332282 0 0) 0x7fae001a5d00 con 0x7fae0010c050 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 >> v1:172.21.15.187:6789/0 conn(0x7fae00105690 legacy=0x7fae00103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 >> v1:172.21.15.49:6789/0 conn(0x7fae001084b0 legacy=0x7fae00103940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.540+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae001a9300 con 0x7fae0010c050 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.544+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae001a5ef0 con 0x7fae0010c050 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.544+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fae001a6370 con 0x7fae0010c050 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.544+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7fadf8003a90 con 0x7fae0010c050 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.544+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7fadf80049b0 con 0x7fae0010c050 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.544+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec005090 con 0x7fae0010c050 2024-03-11T22:44:26.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.544+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7fadf8003600 con 0x7fae0010c050 2024-03-11T22:44:26.554 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.544+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(801..801 src has 260..801) v4 ==== 8219+0+0 (unknown 548231694 0 0) 0x7fadf8087950 con 0x7fae0010c050 2024-03-11T22:44:26.557 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.548+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fadf80546a0 con 0x7fae0010c050 2024-03-11T22:44:26.730 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:26.720+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fadec005340 con 0x7fae0010c050 2024-03-11T22:44:26.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:26 smithi187 bash[23415]: cluster 2024-03-11T22:44:25.189894+0000 mgr.y (mgr.14601) 1338 : cluster 0 pgmap v1782: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 6.2 KiB/s wr, 1 op/s 2024-03-11T22:44:26.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:26 smithi187 bash[23415]: cluster 2024-03-11T22:44:25.356889+0000 mon.a (mon.0) 3579 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:44:26.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:26 smithi187 bash[23415]: audit 2024-03-11T22:44:25.358469+0000 mon.a (mon.0) 3580 : audit 1 from='client.47327 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]': finished 2024-03-11T22:44:26.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:26 smithi187 bash[23415]: cluster 2024-03-11T22:44:25.365670+0000 mon.a (mon.0) 3581 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-03-11T22:44:26.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:26 smithi187 bash[23415]: audit 2024-03-11T22:44:25.486651+0000 mon.c (mon.2) 795 : audit 1 from='client.? v1:172.21.15.49:0/1006833164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:26.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:26 smithi187 bash[23415]: audit 2024-03-11T22:44:25.487124+0000 mon.a (mon.0) 3582 : audit 1 from='client.47327 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:26.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[28804]: cluster 2024-03-11T22:44:25.189894+0000 mgr.y (mgr.14601) 1338 : cluster 0 pgmap v1782: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 6.2 KiB/s wr, 1 op/s 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[28804]: cluster 2024-03-11T22:44:25.356889+0000 mon.a (mon.0) 3579 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[28804]: audit 2024-03-11T22:44:25.358469+0000 mon.a (mon.0) 3580 : audit 1 from='client.47327 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]': finished 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[28804]: cluster 2024-03-11T22:44:25.365670+0000 mon.a (mon.0) 3581 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[28804]: audit 2024-03-11T22:44:25.486651+0000 mon.c (mon.2) 795 : audit 1 from='client.? v1:172.21.15.49:0/1006833164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[28804]: audit 2024-03-11T22:44:25.487124+0000 mon.a (mon.0) 3582 : audit 1 from='client.47327 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[21434]: cluster 2024-03-11T22:44:25.189894+0000 mgr.y (mgr.14601) 1338 : cluster 0 pgmap v1782: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 6.2 KiB/s wr, 1 op/s 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[21434]: cluster 2024-03-11T22:44:25.356889+0000 mon.a (mon.0) 3579 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:44:26.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[21434]: audit 2024-03-11T22:44:25.358469+0000 mon.a (mon.0) 3580 : audit 1 from='client.47327 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]': finished 2024-03-11T22:44:26.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[21434]: cluster 2024-03-11T22:44:25.365670+0000 mon.a (mon.0) 3581 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-03-11T22:44:26.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[21434]: audit 2024-03-11T22:44:25.486651+0000 mon.c (mon.2) 795 : audit 1 from='client.? v1:172.21.15.49:0/1006833164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:26.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:26 smithi049 bash[21434]: audit 2024-03-11T22:44:25.487124+0000 mon.a (mon.0) 3582 : audit 1 from='client.47327 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]: dispatch 2024-03-11T22:44:27.412 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:27.404+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool ec81b7d6-e152-48e9-a783-539150d4b909 v802) v1 ==== 223+0+0 (unknown 128274878 0 0) 0x7fadf8052a10 con 0x7fae0010c050 2024-03-11T22:44:27.516 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:27.508+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fadec0010a0 con 0x7fae0010c050 2024-03-11T22:44:27.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:27 smithi187 bash[23415]: audit 2024-03-11T22:44:26.385322+0000 mon.a (mon.0) 3583 : audit 1 from='client.47327 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]': finished 2024-03-11T22:44:27.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:27 smithi187 bash[23415]: cluster 2024-03-11T22:44:26.393016+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-03-11T22:44:27.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:27 smithi187 bash[23415]: audit 2024-03-11T22:44:26.724590+0000 mon.c (mon.2) 796 : audit 1 from='client.? v1:172.21.15.49:0/1509398256' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:27.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:27 smithi187 bash[23415]: audit 2024-03-11T22:44:26.725348+0000 mon.a (mon.0) 3585 : audit 1 from='client.47333 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:27.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[28804]: audit 2024-03-11T22:44:26.385322+0000 mon.a (mon.0) 3583 : audit 1 from='client.47327 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]': finished 2024-03-11T22:44:27.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[28804]: cluster 2024-03-11T22:44:26.393016+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-03-11T22:44:27.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[28804]: audit 2024-03-11T22:44:26.724590+0000 mon.c (mon.2) 796 : audit 1 from='client.? v1:172.21.15.49:0/1509398256' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:27.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[28804]: audit 2024-03-11T22:44:26.725348+0000 mon.a (mon.0) 3585 : audit 1 from='client.47333 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:27.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[21434]: audit 2024-03-11T22:44:26.385322+0000 mon.a (mon.0) 3583 : audit 1 from='client.47327 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "app": "rados"}]': finished 2024-03-11T22:44:27.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[21434]: cluster 2024-03-11T22:44:26.393016+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-03-11T22:44:27.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[21434]: audit 2024-03-11T22:44:26.724590+0000 mon.c (mon.2) 796 : audit 1 from='client.? v1:172.21.15.49:0/1509398256' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:27.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:27 smithi049 bash[21434]: audit 2024-03-11T22:44:26.725348+0000 mon.a (mon.0) 3585 : audit 1 from='client.47333 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:28.421 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:28.412+0000 7fadfdffb640 1 -- 172.21.15.49:0/1509398256 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool ec81b7d6-e152-48e9-a783-539150d4b909 v803) v1 ==== 223+0+0 (unknown 1323365582 0 0) 0x7fadf8054230 con 0x7fae0010c050 2024-03-11T22:44:28.421 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_objects = 10 for pool ec81b7d6-e152-48e9-a783-539150d4b909 2024-03-11T22:44:28.424 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:28.416+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 >> v1:172.21.15.49:6800/915645872 conn(0x7fade806e420 legacy=0x7fade80708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:28.424 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:28.416+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 >> v1:172.21.15.49:6790/0 conn(0x7fae0010c050 legacy=0x7fae001a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:44:28.425 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:28.416+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 shutdown_connections 2024-03-11T22:44:28.425 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:28.416+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 >> 172.21.15.49:0/1509398256 conn(0x7fae00076300 msgr2=0x7fae00107b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:44:28.425 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:28.416+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 shutdown_connections 2024-03-11T22:44:28.425 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:44:28.416+0000 7fae06d12640 1 -- 172.21.15.49:0/1509398256 wait complete. 2024-03-11T22:44:28.443 INFO:tasks.workunit.client.0.smithi049.stderr:+ sleep 30 2024-03-11T22:44:28.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:28 smithi187 bash[23415]: cluster 2024-03-11T22:44:27.190793+0000 mgr.y (mgr.14601) 1339 : cluster 0 pgmap v1785: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-11T22:44:28.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:28 smithi187 bash[23415]: audit 2024-03-11T22:44:27.396797+0000 mon.a (mon.0) 3586 : audit 1 from='client.47333 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:44:28.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:28 smithi187 bash[23415]: cluster 2024-03-11T22:44:27.406477+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-03-11T22:44:28.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:28 smithi187 bash[23415]: audit 2024-03-11T22:44:27.511428+0000 mon.c (mon.2) 797 : audit 1 from='client.? v1:172.21.15.49:0/1509398256' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:28.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:28 smithi187 bash[23415]: audit 2024-03-11T22:44:27.512226+0000 mon.a (mon.0) 3588 : audit 1 from='client.47333 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:28.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[28804]: cluster 2024-03-11T22:44:27.190793+0000 mgr.y (mgr.14601) 1339 : cluster 0 pgmap v1785: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-11T22:44:28.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[28804]: audit 2024-03-11T22:44:27.396797+0000 mon.a (mon.0) 3586 : audit 1 from='client.47333 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:44:28.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[28804]: cluster 2024-03-11T22:44:27.406477+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-03-11T22:44:28.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[28804]: audit 2024-03-11T22:44:27.511428+0000 mon.c (mon.2) 797 : audit 1 from='client.? v1:172.21.15.49:0/1509398256' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:28.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[28804]: audit 2024-03-11T22:44:27.512226+0000 mon.a (mon.0) 3588 : audit 1 from='client.47333 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:28.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[21434]: cluster 2024-03-11T22:44:27.190793+0000 mgr.y (mgr.14601) 1339 : cluster 0 pgmap v1785: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-11T22:44:28.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[21434]: audit 2024-03-11T22:44:27.396797+0000 mon.a (mon.0) 3586 : audit 1 from='client.47333 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:44:28.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[21434]: cluster 2024-03-11T22:44:27.406477+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-03-11T22:44:28.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[21434]: audit 2024-03-11T22:44:27.511428+0000 mon.c (mon.2) 797 : audit 1 from='client.? v1:172.21.15.49:0/1509398256' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:28.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:28 smithi049 bash[21434]: audit 2024-03-11T22:44:27.512226+0000 mon.a (mon.0) 3588 : audit 1 from='client.47333 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]: dispatch 2024-03-11T22:44:29.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:29 smithi187 bash[23415]: audit 2024-03-11T22:44:28.407601+0000 mon.a (mon.0) 3589 : audit 1 from='client.47333 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:44:29.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:29 smithi187 bash[23415]: cluster 2024-03-11T22:44:28.414277+0000 mon.a (mon.0) 3590 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-03-11T22:44:29.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:29 smithi187 bash[23415]: cluster 2024-03-11T22:44:29.192928+0000 mgr.y (mgr.14601) 1340 : cluster 0 pgmap v1788: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:29.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:29 smithi049 bash[21434]: audit 2024-03-11T22:44:28.407601+0000 mon.a (mon.0) 3589 : audit 1 from='client.47333 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:44:29.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:29 smithi049 bash[21434]: cluster 2024-03-11T22:44:28.414277+0000 mon.a (mon.0) 3590 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-03-11T22:44:29.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:29 smithi049 bash[21434]: cluster 2024-03-11T22:44:29.192928+0000 mgr.y (mgr.14601) 1340 : cluster 0 pgmap v1788: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:29.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:29 smithi049 bash[28804]: audit 2024-03-11T22:44:28.407601+0000 mon.a (mon.0) 3589 : audit 1 from='client.47333 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "field": "max_objects", "val": "10"}]': finished 2024-03-11T22:44:29.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:29 smithi049 bash[28804]: cluster 2024-03-11T22:44:28.414277+0000 mon.a (mon.0) 3590 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-03-11T22:44:29.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:29 smithi049 bash[28804]: cluster 2024-03-11T22:44:29.192928+0000 mgr.y (mgr.14601) 1340 : cluster 0 pgmap v1788: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:30.607 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:44:30 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:44:31.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:30 smithi187 bash[23415]: audit 2024-03-11T22:44:29.600044+0000 mon.a (mon.0) 3591 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:44:31.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:30 smithi187 bash[23415]: audit 2024-03-11T22:44:29.603066+0000 mon.c (mon.2) 798 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:31.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:30 smithi187 bash[23415]: audit 2024-03-11T22:44:30.329653+0000 mgr.y (mgr.14601) 1341 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:31.036 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:30 smithi049 bash[28804]: audit 2024-03-11T22:44:29.600044+0000 mon.a (mon.0) 3591 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:44:31.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:30 smithi049 bash[28804]: audit 2024-03-11T22:44:29.603066+0000 mon.c (mon.2) 798 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:31.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:30 smithi049 bash[28804]: audit 2024-03-11T22:44:30.329653+0000 mgr.y (mgr.14601) 1341 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:31.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:30 smithi049 bash[21434]: audit 2024-03-11T22:44:29.600044+0000 mon.a (mon.0) 3591 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:44:31.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:30 smithi049 bash[21434]: audit 2024-03-11T22:44:29.603066+0000 mon.c (mon.2) 798 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:31.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:30 smithi049 bash[21434]: audit 2024-03-11T22:44:30.329653+0000 mgr.y (mgr.14601) 1341 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:32.003 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:31 smithi187 bash[23415]: cluster 2024-03-11T22:44:31.193750+0000 mgr.y (mgr.14601) 1342 : cluster 0 pgmap v1789: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 877 B/s rd, 0 op/s 2024-03-11T22:44:32.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:31 smithi187 bash[23415]: cluster 2024-03-11T22:44:31.329747+0000 mon.a (mon.0) 3592 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:44:32.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:31 smithi049 bash[21434]: cluster 2024-03-11T22:44:31.193750+0000 mgr.y (mgr.14601) 1342 : cluster 0 pgmap v1789: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 877 B/s rd, 0 op/s 2024-03-11T22:44:32.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:31 smithi049 bash[21434]: cluster 2024-03-11T22:44:31.329747+0000 mon.a (mon.0) 3592 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:44:32.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:31 smithi049 bash[28804]: cluster 2024-03-11T22:44:31.193750+0000 mgr.y (mgr.14601) 1342 : cluster 0 pgmap v1789: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 877 B/s rd, 0 op/s 2024-03-11T22:44:32.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:31 smithi049 bash[28804]: cluster 2024-03-11T22:44:31.329747+0000 mon.a (mon.0) 3592 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-11T22:44:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:34 smithi049 bash[21434]: cluster 2024-03-11T22:44:33.194535+0000 mgr.y (mgr.14601) 1343 : cluster 0 pgmap v1790: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 752 B/s rd, 0 op/s 2024-03-11T22:44:34.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:34 smithi049 bash[28804]: cluster 2024-03-11T22:44:33.194535+0000 mgr.y (mgr.14601) 1343 : cluster 0 pgmap v1790: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 752 B/s rd, 0 op/s 2024-03-11T22:44:34.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:44:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:44:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:44:34.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:34 smithi187 bash[23415]: cluster 2024-03-11T22:44:33.194535+0000 mgr.y (mgr.14601) 1343 : cluster 0 pgmap v1790: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 752 B/s rd, 0 op/s 2024-03-11T22:44:36.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:36 smithi049 bash[21434]: cluster 2024-03-11T22:44:35.196506+0000 mgr.y (mgr.14601) 1344 : cluster 0 pgmap v1791: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:36.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:36 smithi049 bash[28804]: cluster 2024-03-11T22:44:35.196506+0000 mgr.y (mgr.14601) 1344 : cluster 0 pgmap v1791: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:36.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:36 smithi187 bash[23415]: cluster 2024-03-11T22:44:35.196506+0000 mgr.y (mgr.14601) 1344 : cluster 0 pgmap v1791: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:38.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:38 smithi049 bash[21434]: cluster 2024-03-11T22:44:37.197338+0000 mgr.y (mgr.14601) 1345 : cluster 0 pgmap v1792: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-11T22:44:38.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:38 smithi049 bash[28804]: cluster 2024-03-11T22:44:37.197338+0000 mgr.y (mgr.14601) 1345 : cluster 0 pgmap v1792: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-11T22:44:38.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:38 smithi187 bash[23415]: cluster 2024-03-11T22:44:37.197338+0000 mgr.y (mgr.14601) 1345 : cluster 0 pgmap v1792: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-11T22:44:40.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:40 smithi049 bash[21434]: cluster 2024-03-11T22:44:39.199259+0000 mgr.y (mgr.14601) 1346 : cluster 0 pgmap v1793: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:44:40.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:40 smithi049 bash[28804]: cluster 2024-03-11T22:44:39.199259+0000 mgr.y (mgr.14601) 1346 : cluster 0 pgmap v1793: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:44:40.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:40 smithi187 bash[23415]: cluster 2024-03-11T22:44:39.199259+0000 mgr.y (mgr.14601) 1346 : cluster 0 pgmap v1793: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-11T22:44:40.754 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:44:40 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:44:41.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:41 smithi049 bash[21434]: audit 2024-03-11T22:44:40.341019+0000 mgr.y (mgr.14601) 1347 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:41.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:41 smithi049 bash[28804]: audit 2024-03-11T22:44:40.341019+0000 mgr.y (mgr.14601) 1347 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:41.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:41 smithi187 bash[23415]: audit 2024-03-11T22:44:40.341019+0000 mgr.y (mgr.14601) 1347 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:42.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:42 smithi049 bash[21434]: cluster 2024-03-11T22:44:41.200187+0000 mgr.y (mgr.14601) 1348 : cluster 0 pgmap v1794: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:42.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:42 smithi049 bash[28804]: cluster 2024-03-11T22:44:41.200187+0000 mgr.y (mgr.14601) 1348 : cluster 0 pgmap v1794: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:42.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:42 smithi187 bash[23415]: cluster 2024-03-11T22:44:41.200187+0000 mgr.y (mgr.14601) 1348 : cluster 0 pgmap v1794: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:44.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:44 smithi049 bash[21434]: cluster 2024-03-11T22:44:43.201031+0000 mgr.y (mgr.14601) 1349 : cluster 0 pgmap v1795: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:44.538 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:44:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:44:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:44:44.538 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:44 smithi049 bash[28804]: cluster 2024-03-11T22:44:43.201031+0000 mgr.y (mgr.14601) 1349 : cluster 0 pgmap v1795: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:44.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:44 smithi187 bash[23415]: cluster 2024-03-11T22:44:43.201031+0000 mgr.y (mgr.14601) 1349 : cluster 0 pgmap v1795: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:45.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:45 smithi187 bash[23415]: audit 2024-03-11T22:44:44.636707+0000 mon.c (mon.2) 799 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:45.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:45 smithi049 bash[21434]: audit 2024-03-11T22:44:44.636707+0000 mon.c (mon.2) 799 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:45.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:45 smithi049 bash[28804]: audit 2024-03-11T22:44:44.636707+0000 mon.c (mon.2) 799 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:44:46.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:46 smithi187 bash[23415]: cluster 2024-03-11T22:44:45.203033+0000 mgr.y (mgr.14601) 1350 : cluster 0 pgmap v1796: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:46.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:46 smithi049 bash[21434]: cluster 2024-03-11T22:44:45.203033+0000 mgr.y (mgr.14601) 1350 : cluster 0 pgmap v1796: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:46.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:46 smithi049 bash[28804]: cluster 2024-03-11T22:44:45.203033+0000 mgr.y (mgr.14601) 1350 : cluster 0 pgmap v1796: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:48.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:48 smithi187 bash[23415]: cluster 2024-03-11T22:44:47.204018+0000 mgr.y (mgr.14601) 1351 : cluster 0 pgmap v1797: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:48.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:48 smithi049 bash[21434]: cluster 2024-03-11T22:44:47.204018+0000 mgr.y (mgr.14601) 1351 : cluster 0 pgmap v1797: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:48.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:48 smithi049 bash[28804]: cluster 2024-03-11T22:44:47.204018+0000 mgr.y (mgr.14601) 1351 : cluster 0 pgmap v1797: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:50.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:50 smithi187 bash[23415]: cluster 2024-03-11T22:44:49.206026+0000 mgr.y (mgr.14601) 1352 : cluster 0 pgmap v1798: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:50.754 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:44:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:44:50.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:50 smithi049 bash[21434]: cluster 2024-03-11T22:44:49.206026+0000 mgr.y (mgr.14601) 1352 : cluster 0 pgmap v1798: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:50.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:50 smithi049 bash[28804]: cluster 2024-03-11T22:44:49.206026+0000 mgr.y (mgr.14601) 1352 : cluster 0 pgmap v1798: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:51.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:51 smithi187 bash[23415]: audit 2024-03-11T22:44:50.352464+0000 mgr.y (mgr.14601) 1353 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:51.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:51 smithi049 bash[21434]: audit 2024-03-11T22:44:50.352464+0000 mgr.y (mgr.14601) 1353 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:51.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:51 smithi049 bash[28804]: audit 2024-03-11T22:44:50.352464+0000 mgr.y (mgr.14601) 1353 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:44:52.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:52 smithi187 bash[23415]: cluster 2024-03-11T22:44:51.206983+0000 mgr.y (mgr.14601) 1354 : cluster 0 pgmap v1799: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:52.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:52 smithi049 bash[28804]: cluster 2024-03-11T22:44:51.206983+0000 mgr.y (mgr.14601) 1354 : cluster 0 pgmap v1799: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:52.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:52 smithi049 bash[21434]: cluster 2024-03-11T22:44:51.206983+0000 mgr.y (mgr.14601) 1354 : cluster 0 pgmap v1799: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:54 smithi049 bash[21434]: cluster 2024-03-11T22:44:53.207919+0000 mgr.y (mgr.14601) 1355 : cluster 0 pgmap v1800: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:54.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:54 smithi049 bash[28804]: cluster 2024-03-11T22:44:53.207919+0000 mgr.y (mgr.14601) 1355 : cluster 0 pgmap v1800: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:54.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:44:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:44:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:44:54.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:54 smithi187 bash[23415]: cluster 2024-03-11T22:44:53.207919+0000 mgr.y (mgr.14601) 1355 : cluster 0 pgmap v1800: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:56.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:56 smithi187 bash[23415]: cluster 2024-03-11T22:44:55.210059+0000 mgr.y (mgr.14601) 1356 : cluster 0 pgmap v1801: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:56.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:56 smithi049 bash[21434]: cluster 2024-03-11T22:44:55.210059+0000 mgr.y (mgr.14601) 1356 : cluster 0 pgmap v1801: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:56.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:56 smithi049 bash[28804]: cluster 2024-03-11T22:44:55.210059+0000 mgr.y (mgr.14601) 1356 : cluster 0 pgmap v1801: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:44:58.444 INFO:tasks.workunit.client.0.smithi049.stderr:+ seq 1 10 2024-03-11T22:44:58.445 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj1 /etc/passwd 2024-03-11T22:44:58.491 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj2 /etc/passwd 2024-03-11T22:44:58.528 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj3 /etc/passwd 2024-03-11T22:44:58.564 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj4 /etc/passwd 2024-03-11T22:44:58.600 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj5 /etc/passwd 2024-03-11T22:44:58.635 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj6 /etc/passwd 2024-03-11T22:44:58.670 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj7 /etc/passwd 2024-03-11T22:44:58.704 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj8 /etc/passwd 2024-03-11T22:44:58.739 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj9 /etc/passwd 2024-03-11T22:44:58.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:44:58 smithi187 bash[23415]: cluster 2024-03-11T22:44:57.211021+0000 mgr.y (mgr.14601) 1357 : cluster 0 pgmap v1802: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:58.776 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p ec81b7d6-e152-48e9-a783-539150d4b909 put obj10 /etc/passwd 2024-03-11T22:44:58.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:44:58 smithi049 bash[21434]: cluster 2024-03-11T22:44:57.211021+0000 mgr.y (mgr.14601) 1357 : cluster 0 pgmap v1802: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:58.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:44:58 smithi049 bash[28804]: cluster 2024-03-11T22:44:57.211021+0000 mgr.y (mgr.14601) 1357 : cluster 0 pgmap v1802: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:44:58.811 INFO:tasks.workunit.client.0.smithi049.stderr:+ sleep 30 2024-03-11T22:45:00.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:45:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:45:00.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:00 smithi187 bash[23415]: cluster 2024-03-11T22:44:59.213126+0000 mgr.y (mgr.14601) 1358 : cluster 0 pgmap v1803: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:00.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:00 smithi187 bash[23415]: audit 2024-03-11T22:44:59.671282+0000 mon.c (mon.2) 800 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:00.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:00 smithi049 bash[21434]: cluster 2024-03-11T22:44:59.213126+0000 mgr.y (mgr.14601) 1358 : cluster 0 pgmap v1803: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:00.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:00 smithi049 bash[21434]: audit 2024-03-11T22:44:59.671282+0000 mon.c (mon.2) 800 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:00.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:00 smithi049 bash[28804]: cluster 2024-03-11T22:44:59.213126+0000 mgr.y (mgr.14601) 1358 : cluster 0 pgmap v1803: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:00.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:00 smithi049 bash[28804]: audit 2024-03-11T22:44:59.671282+0000 mon.c (mon.2) 800 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:01.715 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:01 smithi187 bash[23415]: audit 2024-03-11T22:45:00.362481+0000 mgr.y (mgr.14601) 1359 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:01.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:01 smithi049 bash[21434]: audit 2024-03-11T22:45:00.362481+0000 mgr.y (mgr.14601) 1359 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:01.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:01 smithi049 bash[28804]: audit 2024-03-11T22:45:00.362481+0000 mgr.y (mgr.14601) 1359 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:02 smithi187 bash[23415]: cluster 2024-03-11T22:45:01.213910+0000 mgr.y (mgr.14601) 1360 : cluster 0 pgmap v1804: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:02.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:02 smithi049 bash[21434]: cluster 2024-03-11T22:45:01.213910+0000 mgr.y (mgr.14601) 1360 : cluster 0 pgmap v1804: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:02.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:02 smithi049 bash[28804]: cluster 2024-03-11T22:45:01.213910+0000 mgr.y (mgr.14601) 1360 : cluster 0 pgmap v1804: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:04.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:04 smithi049 bash[21434]: cluster 2024-03-11T22:45:03.214731+0000 mgr.y (mgr.14601) 1361 : cluster 0 pgmap v1805: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:04.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:45:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:45:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:45:04.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:04 smithi049 bash[28804]: cluster 2024-03-11T22:45:03.214731+0000 mgr.y (mgr.14601) 1361 : cluster 0 pgmap v1805: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:04 smithi187 bash[23415]: cluster 2024-03-11T22:45:03.214731+0000 mgr.y (mgr.14601) 1361 : cluster 0 pgmap v1805: 188 pgs: 188 active+clean; 745 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:06.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:06 smithi187 bash[23415]: cluster 2024-03-11T22:45:05.216709+0000 mgr.y (mgr.14601) 1362 : cluster 0 pgmap v1806: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-11T22:45:06.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:06 smithi187 bash[23415]: cluster 2024-03-11T22:45:06.340491+0000 mon.a (mon.0) 3593 : cluster 3 pool 'ec81b7d6-e152-48e9-a783-539150d4b909' is full (reached quota's max_objects: 10) 2024-03-11T22:45:06.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:06 smithi187 bash[23415]: cluster 2024-03-11T22:45:06.340998+0000 mon.a (mon.0) 3594 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:45:06.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:06 smithi049 bash[21434]: cluster 2024-03-11T22:45:05.216709+0000 mgr.y (mgr.14601) 1362 : cluster 0 pgmap v1806: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-11T22:45:06.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:06 smithi049 bash[21434]: cluster 2024-03-11T22:45:06.340491+0000 mon.a (mon.0) 3593 : cluster 3 pool 'ec81b7d6-e152-48e9-a783-539150d4b909' is full (reached quota's max_objects: 10) 2024-03-11T22:45:06.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:06 smithi049 bash[21434]: cluster 2024-03-11T22:45:06.340998+0000 mon.a (mon.0) 3594 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:45:06.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:06 smithi049 bash[28804]: cluster 2024-03-11T22:45:05.216709+0000 mgr.y (mgr.14601) 1362 : cluster 0 pgmap v1806: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-11T22:45:06.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:06 smithi049 bash[28804]: cluster 2024-03-11T22:45:06.340491+0000 mon.a (mon.0) 3593 : cluster 3 pool 'ec81b7d6-e152-48e9-a783-539150d4b909' is full (reached quota's max_objects: 10) 2024-03-11T22:45:06.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:06 smithi049 bash[28804]: cluster 2024-03-11T22:45:06.340998+0000 mon.a (mon.0) 3594 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-11T22:45:07.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:07 smithi187 bash[23415]: cluster 2024-03-11T22:45:06.350768+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-03-11T22:45:07.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:07 smithi049 bash[21434]: cluster 2024-03-11T22:45:06.350768+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-03-11T22:45:07.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:07 smithi049 bash[28804]: cluster 2024-03-11T22:45:06.350768+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-03-11T22:45:08.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:08 smithi187 bash[23415]: cluster 2024-03-11T22:45:07.217504+0000 mgr.y (mgr.14601) 1363 : cluster 0 pgmap v1808: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:08.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:08 smithi049 bash[21434]: cluster 2024-03-11T22:45:07.217504+0000 mgr.y (mgr.14601) 1363 : cluster 0 pgmap v1808: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:08.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:08 smithi049 bash[28804]: cluster 2024-03-11T22:45:07.217504+0000 mgr.y (mgr.14601) 1363 : cluster 0 pgmap v1808: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:10.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:10 smithi187 bash[23415]: cluster 2024-03-11T22:45:09.219636+0000 mgr.y (mgr.14601) 1364 : cluster 0 pgmap v1809: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:10.754 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:45:10 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:45:10.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:10 smithi049 bash[21434]: cluster 2024-03-11T22:45:09.219636+0000 mgr.y (mgr.14601) 1364 : cluster 0 pgmap v1809: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:10.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:10 smithi049 bash[28804]: cluster 2024-03-11T22:45:09.219636+0000 mgr.y (mgr.14601) 1364 : cluster 0 pgmap v1809: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:11 smithi187 bash[23415]: audit 2024-03-11T22:45:10.373892+0000 mgr.y (mgr.14601) 1365 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:11 smithi187 bash[23415]: audit 2024-03-11T22:45:10.621793+0000 mon.c (mon.2) 801 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:45:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:11 smithi187 bash[23415]: audit 2024-03-11T22:45:11.349880+0000 mon.c (mon.2) 802 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:45:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:11 smithi187 bash[23415]: audit 2024-03-11T22:45:11.351687+0000 mon.c (mon.2) 803 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:45:11.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:11 smithi187 bash[23415]: audit 2024-03-11T22:45:11.361087+0000 mon.a (mon.0) 3596 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:45:11.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[21434]: audit 2024-03-11T22:45:10.373892+0000 mgr.y (mgr.14601) 1365 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[21434]: audit 2024-03-11T22:45:10.621793+0000 mon.c (mon.2) 801 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[21434]: audit 2024-03-11T22:45:11.349880+0000 mon.c (mon.2) 802 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[21434]: audit 2024-03-11T22:45:11.351687+0000 mon.c (mon.2) 803 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[21434]: audit 2024-03-11T22:45:11.361087+0000 mon.a (mon.0) 3596 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[28804]: audit 2024-03-11T22:45:10.373892+0000 mgr.y (mgr.14601) 1365 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[28804]: audit 2024-03-11T22:45:10.621793+0000 mon.c (mon.2) 801 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[28804]: audit 2024-03-11T22:45:11.349880+0000 mon.c (mon.2) 802 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[28804]: audit 2024-03-11T22:45:11.351687+0000 mon.c (mon.2) 803 : audit 1 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-11T22:45:11.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:11 smithi049 bash[28804]: audit 2024-03-11T22:45:11.361087+0000 mon.a (mon.0) 3596 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:45:12.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:12 smithi187 bash[23415]: cluster 2024-03-11T22:45:11.220234+0000 mgr.y (mgr.14601) 1366 : cluster 0 pgmap v1810: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:12.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:12 smithi049 bash[21434]: cluster 2024-03-11T22:45:11.220234+0000 mgr.y (mgr.14601) 1366 : cluster 0 pgmap v1810: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:12.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:12 smithi049 bash[28804]: cluster 2024-03-11T22:45:11.220234+0000 mgr.y (mgr.14601) 1366 : cluster 0 pgmap v1810: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:14.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:14 smithi049 bash[28804]: cluster 2024-03-11T22:45:13.221007+0000 mgr.y (mgr.14601) 1367 : cluster 0 pgmap v1811: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:14.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:14 smithi049 bash[21434]: cluster 2024-03-11T22:45:13.221007+0000 mgr.y (mgr.14601) 1367 : cluster 0 pgmap v1811: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:14.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:45:14 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:45:14] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:45:14.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:14 smithi187 bash[23415]: cluster 2024-03-11T22:45:13.221007+0000 mgr.y (mgr.14601) 1367 : cluster 0 pgmap v1811: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-11T22:45:16.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:15 smithi187 bash[23415]: audit 2024-03-11T22:45:14.711736+0000 mon.a (mon.0) 3597 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:45:16.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:15 smithi187 bash[23415]: audit 2024-03-11T22:45:14.714771+0000 mon.c (mon.2) 804 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:16.004 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:15 smithi187 bash[23415]: cluster 2024-03-11T22:45:15.222917+0000 mgr.y (mgr.14601) 1368 : cluster 0 pgmap v1812: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:45:16.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:15 smithi049 bash[21434]: audit 2024-03-11T22:45:14.711736+0000 mon.a (mon.0) 3597 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:45:16.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:15 smithi049 bash[21434]: audit 2024-03-11T22:45:14.714771+0000 mon.c (mon.2) 804 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:16.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:15 smithi049 bash[21434]: cluster 2024-03-11T22:45:15.222917+0000 mgr.y (mgr.14601) 1368 : cluster 0 pgmap v1812: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:45:16.037 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:15 smithi049 bash[28804]: audit 2024-03-11T22:45:14.711736+0000 mon.a (mon.0) 3597 : audit 1 from='mgr.14601 ' entity='mgr.y' 2024-03-11T22:45:16.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:15 smithi049 bash[28804]: audit 2024-03-11T22:45:14.714771+0000 mon.c (mon.2) 804 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:16.038 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:15 smithi049 bash[28804]: cluster 2024-03-11T22:45:15.222917+0000 mgr.y (mgr.14601) 1368 : cluster 0 pgmap v1812: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-11T22:45:18.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:18 smithi187 bash[23415]: cluster 2024-03-11T22:45:17.223698+0000 mgr.y (mgr.14601) 1369 : cluster 0 pgmap v1813: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 941 B/s rd, 0 op/s 2024-03-11T22:45:18.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:18 smithi049 bash[21434]: cluster 2024-03-11T22:45:17.223698+0000 mgr.y (mgr.14601) 1369 : cluster 0 pgmap v1813: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 941 B/s rd, 0 op/s 2024-03-11T22:45:18.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:18 smithi049 bash[28804]: cluster 2024-03-11T22:45:17.223698+0000 mgr.y (mgr.14601) 1369 : cluster 0 pgmap v1813: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 941 B/s rd, 0 op/s 2024-03-11T22:45:20.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:20 smithi187 bash[23415]: cluster 2024-03-11T22:45:19.225662+0000 mgr.y (mgr.14601) 1370 : cluster 0 pgmap v1814: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:20.754 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:45:20 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:45:20.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:20 smithi049 bash[21434]: cluster 2024-03-11T22:45:19.225662+0000 mgr.y (mgr.14601) 1370 : cluster 0 pgmap v1814: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:20.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:20 smithi049 bash[28804]: cluster 2024-03-11T22:45:19.225662+0000 mgr.y (mgr.14601) 1370 : cluster 0 pgmap v1814: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:21.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:21 smithi187 bash[23415]: audit 2024-03-11T22:45:20.385305+0000 mgr.y (mgr.14601) 1371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:21.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:21 smithi049 bash[21434]: audit 2024-03-11T22:45:20.385305+0000 mgr.y (mgr.14601) 1371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:21.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:21 smithi049 bash[28804]: audit 2024-03-11T22:45:20.385305+0000 mgr.y (mgr.14601) 1371 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:22.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:22 smithi187 bash[23415]: cluster 2024-03-11T22:45:21.226461+0000 mgr.y (mgr.14601) 1372 : cluster 0 pgmap v1815: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:22.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:22 smithi049 bash[21434]: cluster 2024-03-11T22:45:21.226461+0000 mgr.y (mgr.14601) 1372 : cluster 0 pgmap v1815: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:22.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:22 smithi049 bash[28804]: cluster 2024-03-11T22:45:21.226461+0000 mgr.y (mgr.14601) 1372 : cluster 0 pgmap v1815: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:24.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:24 smithi049 bash[21434]: cluster 2024-03-11T22:45:23.227299+0000 mgr.y (mgr.14601) 1373 : cluster 0 pgmap v1816: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:24.539 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:45:24 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:45:24] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:45:24.539 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:24 smithi049 bash[28804]: cluster 2024-03-11T22:45:23.227299+0000 mgr.y (mgr.14601) 1373 : cluster 0 pgmap v1816: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:24.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:24 smithi187 bash[23415]: cluster 2024-03-11T22:45:23.227299+0000 mgr.y (mgr.14601) 1373 : cluster 0 pgmap v1816: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:26.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:26 smithi187 bash[23415]: cluster 2024-03-11T22:45:25.229287+0000 mgr.y (mgr.14601) 1374 : cluster 0 pgmap v1817: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:26.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:26 smithi049 bash[21434]: cluster 2024-03-11T22:45:25.229287+0000 mgr.y (mgr.14601) 1374 : cluster 0 pgmap v1817: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:26.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:26 smithi049 bash[28804]: cluster 2024-03-11T22:45:25.229287+0000 mgr.y (mgr.14601) 1374 : cluster 0 pgmap v1817: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:28.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:28 smithi187 bash[23415]: cluster 2024-03-11T22:45:27.230072+0000 mgr.y (mgr.14601) 1375 : cluster 0 pgmap v1818: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:28.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:28 smithi049 bash[28804]: cluster 2024-03-11T22:45:27.230072+0000 mgr.y (mgr.14601) 1375 : cluster 0 pgmap v1818: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:28.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:28 smithi049 bash[21434]: cluster 2024-03-11T22:45:27.230072+0000 mgr.y (mgr.14601) 1375 : cluster 0 pgmap v1818: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:28.812 INFO:tasks.workunit.client.0.smithi049.stderr:+ rados -p e465fdb5-455f-4dac-9dcc-834a5c09fa37 put threemore /etc/passwd 2024-03-11T22:45:28.860 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota e465fdb5-455f-4dac-9dcc-834a5c09fa37 max_bytes 0 2024-03-11T22:45:28.980 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/4027150502 >> v1:172.21.15.49:6789/0 conn(0x7f415c10d660 legacy=0x7f415c10da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:28.980 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/4027150502 shutdown_connections 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/4027150502 >> 172.21.15.49:0/4027150502 conn(0x7f415c076da0 msgr2=0x7f415c0791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/4027150502 shutdown_connections 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/4027150502 wait complete. 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 Processor -- start 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- start start 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f415c1ac430 con 0x7f415c114010 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f415c1ad630 con 0x7f415c10d660 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f415c1ae830 con 0x7f415c110410 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f416085e640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f415c110410 0x7f415c1a7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:41196/0 (socket says 172.21.15.49:41196) 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f416085e640 1 -- 172.21.15.49:0/601169289 learned_addr learned my addr 172.21.15.49:0/601169289 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:45:28.981 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154523499 0 0) 0x7f415c1ae830 con 0x7f415c110410 2024-03-11T22:45:28.982 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4144003250 con 0x7f415c110410 2024-03-11T22:45:28.982 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126793812 0 0) 0x7f415c1ac430 con 0x7f415c114010 2024-03-11T22:45:28.982 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f415c1ae830 con 0x7f415c114010 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2746212899 0 0) 0x7f4144003250 con 0x7f415c110410 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f415c1ac430 con 0x7f415c110410 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3640804401 0 0) 0x7f415c1ae830 con 0x7f415c114010 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4144003250 con 0x7f415c114010 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4150001900 con 0x7f415c110410 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4154001080 con 0x7f415c114010 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959617312 0 0) 0x7f415c1ad630 con 0x7f415c10d660 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f415c1ae830 con 0x7f415c10d660 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2315183382 0 0) 0x7f415c1ac430 con 0x7f415c110410 2024-03-11T22:45:28.984 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 >> v1:172.21.15.187:6789/0 conn(0x7f415c10d660 legacy=0x7f415c10c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 >> v1:172.21.15.49:6789/0 conn(0x7f415c114010 legacy=0x7f415c1aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c1afa30 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c1ac620 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c1acaa0 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f4150003ab0 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f4150005c90 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.971+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148005090 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.975+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f4150003600 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.975+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(804..804 src has 260..804) v4 ==== 8219+0+0 (unknown 1800649424 0 0) 0x7f4150088a20 con 0x7f415c110410 2024-03-11T22:45:28.985 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.975+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=805}) v3 -- 0x7f415c1ac430 con 0x7f415c110410 2024-03-11T22:45:28.987 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:28.979+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f4150055770 con 0x7f415c110410 2024-03-11T22:45:29.162 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:29.151+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f4148005340 con 0x7f415c110410 2024-03-11T22:45:29.326 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:29.315+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 10 ==== osd_map(805..805 src has 260..805) v4 ==== 628+0+0 (unknown 909794181 0 0) 0x7f41500560a0 con 0x7f415c110410 2024-03-11T22:45:29.326 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:29.315+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=806}) v3 -- 0x7f4144003250 con 0x7f415c110410 2024-03-11T22:45:29.333 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:29.323+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v805) v1 ==== 217+0+0 (unknown 3543575036 0 0) 0x7f4150053ae0 con 0x7f415c110410 2024-03-11T22:45:29.456 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:29.447+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f4148000c50 con 0x7f415c110410 2024-03-11T22:45:29.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:29 smithi187 bash[23415]: audit 2024-03-11T22:45:29.156903+0000 mon.c (mon.2) 805 : audit 1 from='client.? v1:172.21.15.49:0/601169289' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:29.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:29 smithi187 bash[23415]: audit 2024-03-11T22:45:29.157604+0000 mon.a (mon.0) 3598 : audit 1 from='client.47438 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:29.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:29 smithi049 bash[28804]: audit 2024-03-11T22:45:29.156903+0000 mon.c (mon.2) 805 : audit 1 from='client.? v1:172.21.15.49:0/601169289' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:29.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:29 smithi049 bash[28804]: audit 2024-03-11T22:45:29.157604+0000 mon.a (mon.0) 3598 : audit 1 from='client.47438 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:29.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:29 smithi049 bash[21434]: audit 2024-03-11T22:45:29.156903+0000 mon.c (mon.2) 805 : audit 1 from='client.? v1:172.21.15.49:0/601169289' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:29.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:29 smithi049 bash[21434]: audit 2024-03-11T22:45:29.157604+0000 mon.a (mon.0) 3598 : audit 1 from='client.47438 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:30.328 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.319+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 12 ==== osd_map(806..806 src has 260..806) v4 ==== 628+0+0 (unknown 2054517247 0 0) 0x7f41500560a0 con 0x7f415c110410 2024-03-11T22:45:30.328 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.319+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=807}) v3 -- 0x7f415c1ad630 con 0x7f415c110410 2024-03-11T22:45:30.337 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.327+0000 7f415a7fc640 1 -- 172.21.15.49:0/601169289 <== mon.2 v1:172.21.15.49:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v806) v1 ==== 217+0+0 (unknown 2771896671 0 0) 0x7f4150055300 con 0x7f415c110410 2024-03-11T22:45:30.337 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_bytes = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:45:30.344 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.335+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 >> v1:172.21.15.49:6800/915645872 conn(0x7f414406e600 legacy=0x7f4144070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:30.345 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.335+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 >> v1:172.21.15.49:6790/0 conn(0x7f415c110410 legacy=0x7f415c1a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:30.345 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.335+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 shutdown_connections 2024-03-11T22:45:30.345 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.335+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 >> 172.21.15.49:0/601169289 conn(0x7f415c076da0 msgr2=0x7f415c117510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:45:30.346 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.339+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 shutdown_connections 2024-03-11T22:45:30.347 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.339+0000 7f41632c3640 1 -- 172.21.15.49:0/601169289 wait complete. 2024-03-11T22:45:30.367 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool set-quota e465fdb5-455f-4dac-9dcc-834a5c09fa37 max_objects 0 2024-03-11T22:45:30.492 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- 172.21.15.49:0/316709961 >> v1:172.21.15.49:6790/0 conn(0x7f8dd810fbe0 legacy=0x7f8dd8112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:30.492 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- 172.21.15.49:0/316709961 shutdown_connections 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- 172.21.15.49:0/316709961 >> 172.21.15.49:0/316709961 conn(0x7f8dd80fec30 msgr2=0x7f8dd8101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- 172.21.15.49:0/316709961 shutdown_connections 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- 172.21.15.49:0/316709961 wait complete. 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 Processor -- start 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- start start 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8dd81a7f80 con 0x7f8dd81033e0 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8dd81a9180 con 0x7f8dd810fbe0 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8dd81aa380 con 0x7f8dd810c070 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddc8e1640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8dd81033e0 0x7f8dd81085c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57462/0 (socket says 172.21.15.49:57462) 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddc8e1640 1 -- 172.21.15.49:0/3366670648 learned_addr learned my addr 172.21.15.49:0/3366670648 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:45:30.493 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd7fff640 1 --1- 172.21.15.49:0/3366670648 >> v1:172.21.15.49:6790/0 conn(0x7f8dd810c070 0x7f8dd81a2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:41212/0 (socket says 172.21.15.49:41212) 2024-03-11T22:45:30.495 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559895005 0 0) 0x7f8dd81aa380 con 0x7f8dd810c070 2024-03-11T22:45:30.495 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc0003170 con 0x7f8dd810c070 2024-03-11T22:45:30.495 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737541816 0 0) 0x7f8dd81a7f80 con 0x7f8dd81033e0 2024-03-11T22:45:30.495 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd81aa380 con 0x7f8dd81033e0 2024-03-11T22:45:30.495 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1900572410 0 0) 0x7f8dc0003170 con 0x7f8dd810c070 2024-03-11T22:45:30.495 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8dd81a7f80 con 0x7f8dd810c070 2024-03-11T22:45:30.495 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8dcc0018c0 con 0x7f8dd810c070 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2755726467 0 0) 0x7f8dd81aa380 con 0x7f8dd81033e0 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8dc0003170 con 0x7f8dd81033e0 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8dc8001b10 con 0x7f8dd81033e0 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886245112 0 0) 0x7f8dd81a9180 con 0x7f8dd810fbe0 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd81aa380 con 0x7f8dd810fbe0 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2885628766 0 0) 0x7f8dd81a7f80 con 0x7f8dd810c070 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 >> v1:172.21.15.187:6789/0 conn(0x7f8dd810fbe0 legacy=0x7f8dd81a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 >> v1:172.21.15.49:6789/0 conn(0x7f8dd81033e0 legacy=0x7f8dd81085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd81ab580 con 0x7f8dd810c070 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd81a8170 con 0x7f8dd810c070 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd81a85f0 con 0x7f8dd810c070 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f8dcc003ab0 con 0x7f8dd810c070 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.483+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f8dcc005b60 con 0x7f8dd810c070 2024-03-11T22:45:30.496 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.487+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc4005090 con 0x7f8dd810c070 2024-03-11T22:45:30.497 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.487+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f8dcc005cc0 con 0x7f8dd810c070 2024-03-11T22:45:30.497 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.487+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(806..806 src has 260..806) v4 ==== 8219+0+0 (unknown 290889273 0 0) 0x7f8dcc088910 con 0x7f8dd810c070 2024-03-11T22:45:30.497 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.487+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=807}) v3 -- 0x7f8dd81a7f80 con 0x7f8dd810c070 2024-03-11T22:45:30.500 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.491+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8dcc055520 con 0x7f8dd810c070 2024-03-11T22:45:30.674 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:30.663+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f8dc4005340 con 0x7f8dd810c070 2024-03-11T22:45:30.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:45:30 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:45:30.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:30 smithi187 bash[23415]: cluster 2024-03-11T22:45:29.232053+0000 mgr.y (mgr.14601) 1376 : cluster 0 pgmap v1819: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:30.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:30 smithi187 bash[23415]: audit 2024-03-11T22:45:29.317913+0000 mon.a (mon.0) 3599 : audit 1 from='client.47438 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:45:30.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:30 smithi187 bash[23415]: cluster 2024-03-11T22:45:29.325855+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-03-11T22:45:30.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:30 smithi187 bash[23415]: audit 2024-03-11T22:45:29.450843+0000 mon.c (mon.2) 806 : audit 1 from='client.? v1:172.21.15.49:0/601169289' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:30.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:30 smithi187 bash[23415]: audit 2024-03-11T22:45:29.451502+0000 mon.a (mon.0) 3601 : audit 1 from='client.47438 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:30.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:30 smithi187 bash[23415]: audit 2024-03-11T22:45:29.748558+0000 mon.c (mon.2) 807 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:30.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[21434]: cluster 2024-03-11T22:45:29.232053+0000 mgr.y (mgr.14601) 1376 : cluster 0 pgmap v1819: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:30.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[21434]: audit 2024-03-11T22:45:29.317913+0000 mon.a (mon.0) 3599 : audit 1 from='client.47438 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[21434]: cluster 2024-03-11T22:45:29.325855+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[21434]: audit 2024-03-11T22:45:29.450843+0000 mon.c (mon.2) 806 : audit 1 from='client.? v1:172.21.15.49:0/601169289' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[21434]: audit 2024-03-11T22:45:29.451502+0000 mon.a (mon.0) 3601 : audit 1 from='client.47438 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[21434]: audit 2024-03-11T22:45:29.748558+0000 mon.c (mon.2) 807 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[28804]: cluster 2024-03-11T22:45:29.232053+0000 mgr.y (mgr.14601) 1376 : cluster 0 pgmap v1819: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[28804]: audit 2024-03-11T22:45:29.317913+0000 mon.a (mon.0) 3599 : audit 1 from='client.47438 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[28804]: cluster 2024-03-11T22:45:29.325855+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[28804]: audit 2024-03-11T22:45:29.450843+0000 mon.c (mon.2) 806 : audit 1 from='client.? v1:172.21.15.49:0/601169289' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[28804]: audit 2024-03-11T22:45:29.451502+0000 mon.a (mon.0) 3601 : audit 1 from='client.47438 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-11T22:45:30.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:30 smithi049 bash[28804]: audit 2024-03-11T22:45:29.748558+0000 mon.c (mon.2) 807 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:31.350 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:31.339+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 10 ==== osd_map(807..807 src has 260..807) v4 ==== 628+0+0 (unknown 675331492 0 0) 0x7f8dcc05e030 con 0x7f8dd810c070 2024-03-11T22:45:31.350 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:31.339+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=808}) v3 -- 0x7f8dc0003170 con 0x7f8dd810c070 2024-03-11T22:45:31.356 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:31.347+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v807) v1 ==== 221+0+0 (unknown 166064257 0 0) 0x7f8dcc053b20 con 0x7f8dd810c070 2024-03-11T22:45:31.469 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:31.459+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f8dc4000bf0 con 0x7f8dd810c070 2024-03-11T22:45:31.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:31 smithi187 bash[23415]: audit 2024-03-11T22:45:30.320314+0000 mon.a (mon.0) 3602 : audit 1 from='client.47438 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:45:31.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:31 smithi187 bash[23415]: cluster 2024-03-11T22:45:30.328390+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-03-11T22:45:31.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:31 smithi187 bash[23415]: audit 2024-03-11T22:45:30.394463+0000 mgr.y (mgr.14601) 1377 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:31.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:31 smithi187 bash[23415]: audit 2024-03-11T22:45:30.668812+0000 mon.c (mon.2) 808 : audit 1 from='client.? v1:172.21.15.49:0/3366670648' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:31.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:31 smithi187 bash[23415]: audit 2024-03-11T22:45:30.669581+0000 mon.a (mon.0) 3604 : audit 1 from='client.47444 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:31.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[21434]: audit 2024-03-11T22:45:30.320314+0000 mon.a (mon.0) 3602 : audit 1 from='client.47438 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:45:31.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[21434]: cluster 2024-03-11T22:45:30.328390+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-03-11T22:45:31.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[21434]: audit 2024-03-11T22:45:30.394463+0000 mgr.y (mgr.14601) 1377 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:31.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[21434]: audit 2024-03-11T22:45:30.668812+0000 mon.c (mon.2) 808 : audit 1 from='client.? v1:172.21.15.49:0/3366670648' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:31.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[21434]: audit 2024-03-11T22:45:30.669581+0000 mon.a (mon.0) 3604 : audit 1 from='client.47444 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:31.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[28804]: audit 2024-03-11T22:45:30.320314+0000 mon.a (mon.0) 3602 : audit 1 from='client.47438 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_bytes", "val": "0"}]': finished 2024-03-11T22:45:31.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[28804]: cluster 2024-03-11T22:45:30.328390+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-03-11T22:45:31.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[28804]: audit 2024-03-11T22:45:30.394463+0000 mgr.y (mgr.14601) 1377 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:31.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[28804]: audit 2024-03-11T22:45:30.668812+0000 mon.c (mon.2) 808 : audit 1 from='client.? v1:172.21.15.49:0/3366670648' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:31.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:31 smithi049 bash[28804]: audit 2024-03-11T22:45:30.669581+0000 mon.a (mon.0) 3604 : audit 1 from='client.47444 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:32.379 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.371+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 12 ==== osd_map(808..808 src has 260..808) v4 ==== 628+0+0 (unknown 1290130264 0 0) 0x7f8dcc086530 con 0x7f8dd810c070 2024-03-11T22:45:32.379 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.371+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=809}) v3 -- 0x7f8dd81a9180 con 0x7f8dd810c070 2024-03-11T22:45:32.385 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.375+0000 7f8dd5ffb640 1 -- 172.21.15.49:0/3366670648 <== mon.2 v1:172.21.15.49:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 v808) v1 ==== 221+0+0 (unknown 2471758585 0 0) 0x7f8dcc055340 con 0x7f8dd810c070 2024-03-11T22:45:32.385 INFO:tasks.workunit.client.0.smithi049.stderr:set-quota max_objects = 0 for pool e465fdb5-455f-4dac-9dcc-834a5c09fa37 2024-03-11T22:45:32.389 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.379+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 >> v1:172.21.15.49:6800/915645872 conn(0x7f8dc006e830 legacy=0x7f8dc0070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:32.389 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.379+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 >> v1:172.21.15.49:6790/0 conn(0x7f8dd810c070 legacy=0x7f8dd81a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:45:32.390 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.379+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 shutdown_connections 2024-03-11T22:45:32.390 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.379+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 >> 172.21.15.49:0/3366670648 conn(0x7f8dd80fec30 msgr2=0x7f8dd81130e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:45:32.391 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.383+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 shutdown_connections 2024-03-11T22:45:32.391 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:45:32.383+0000 7f8ddeb45640 1 -- 172.21.15.49:0/3366670648 wait complete. 2024-03-11T22:45:32.410 INFO:tasks.workunit.client.0.smithi049.stderr:+ sleep 30 2024-03-11T22:45:32.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:32 smithi187 bash[23415]: cluster 2024-03-11T22:45:31.232870+0000 mgr.y (mgr.14601) 1378 : cluster 0 pgmap v1822: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:32.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:32 smithi187 bash[23415]: audit 2024-03-11T22:45:31.342112+0000 mon.a (mon.0) 3605 : audit 1 from='client.47444 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:45:32.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:32 smithi187 bash[23415]: cluster 2024-03-11T22:45:31.349348+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-03-11T22:45:32.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:32 smithi187 bash[23415]: audit 2024-03-11T22:45:31.463881+0000 mon.c (mon.2) 809 : audit 1 from='client.? v1:172.21.15.49:0/3366670648' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:32.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:32 smithi187 bash[23415]: audit 2024-03-11T22:45:31.464554+0000 mon.a (mon.0) 3607 : audit 1 from='client.47444 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:32.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[21434]: cluster 2024-03-11T22:45:31.232870+0000 mgr.y (mgr.14601) 1378 : cluster 0 pgmap v1822: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:32.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[21434]: audit 2024-03-11T22:45:31.342112+0000 mon.a (mon.0) 3605 : audit 1 from='client.47444 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:45:32.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[21434]: cluster 2024-03-11T22:45:31.349348+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-03-11T22:45:32.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[21434]: audit 2024-03-11T22:45:31.463881+0000 mon.c (mon.2) 809 : audit 1 from='client.? v1:172.21.15.49:0/3366670648' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:32.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[21434]: audit 2024-03-11T22:45:31.464554+0000 mon.a (mon.0) 3607 : audit 1 from='client.47444 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:32.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[28804]: cluster 2024-03-11T22:45:31.232870+0000 mgr.y (mgr.14601) 1378 : cluster 0 pgmap v1822: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:32.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[28804]: audit 2024-03-11T22:45:31.342112+0000 mon.a (mon.0) 3605 : audit 1 from='client.47444 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:45:32.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[28804]: cluster 2024-03-11T22:45:31.349348+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-03-11T22:45:32.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[28804]: audit 2024-03-11T22:45:31.463881+0000 mon.c (mon.2) 809 : audit 1 from='client.? v1:172.21.15.49:0/3366670648' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:32.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:32 smithi049 bash[28804]: audit 2024-03-11T22:45:31.464554+0000 mon.a (mon.0) 3607 : audit 1 from='client.47444 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]: dispatch 2024-03-11T22:45:33.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:33 smithi187 bash[23415]: audit 2024-03-11T22:45:32.370939+0000 mon.a (mon.0) 3608 : audit 1 from='client.47444 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:45:33.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:33 smithi187 bash[23415]: cluster 2024-03-11T22:45:32.378636+0000 mon.a (mon.0) 3609 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-03-11T22:45:33.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:33 smithi049 bash[21434]: audit 2024-03-11T22:45:32.370939+0000 mon.a (mon.0) 3608 : audit 1 from='client.47444 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:45:33.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:33 smithi049 bash[21434]: cluster 2024-03-11T22:45:32.378636+0000 mon.a (mon.0) 3609 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-03-11T22:45:33.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:33 smithi049 bash[28804]: audit 2024-03-11T22:45:32.370939+0000 mon.a (mon.0) 3608 : audit 1 from='client.47444 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "field": "max_objects", "val": "0"}]': finished 2024-03-11T22:45:33.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:33 smithi049 bash[28804]: cluster 2024-03-11T22:45:32.378636+0000 mon.a (mon.0) 3609 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-03-11T22:45:34.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:34 smithi049 bash[21434]: cluster 2024-03-11T22:45:33.233651+0000 mgr.y (mgr.14601) 1379 : cluster 0 pgmap v1825: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:45:34.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:45:34 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:45:34] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:45:34.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:34 smithi049 bash[28804]: cluster 2024-03-11T22:45:33.233651+0000 mgr.y (mgr.14601) 1379 : cluster 0 pgmap v1825: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:45:34.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:34 smithi187 bash[23415]: cluster 2024-03-11T22:45:33.233651+0000 mgr.y (mgr.14601) 1379 : cluster 0 pgmap v1825: 188 pgs: 188 active+clean; 862 KiB data, 820 MiB used, 714 GiB / 715 GiB avail 2024-03-11T22:45:36.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:36 smithi187 bash[23415]: cluster 2024-03-11T22:45:35.235612+0000 mgr.y (mgr.14601) 1380 : cluster 0 pgmap v1826: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-03-11T22:45:36.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:36 smithi049 bash[21434]: cluster 2024-03-11T22:45:35.235612+0000 mgr.y (mgr.14601) 1380 : cluster 0 pgmap v1826: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-03-11T22:45:36.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:36 smithi049 bash[28804]: cluster 2024-03-11T22:45:35.235612+0000 mgr.y (mgr.14601) 1380 : cluster 0 pgmap v1826: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 865 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-03-11T22:45:38.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:38 smithi187 bash[23415]: cluster 2024-03-11T22:45:37.236385+0000 mgr.y (mgr.14601) 1381 : cluster 0 pgmap v1827: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 740 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-03-11T22:45:38.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:38 smithi049 bash[21434]: cluster 2024-03-11T22:45:37.236385+0000 mgr.y (mgr.14601) 1381 : cluster 0 pgmap v1827: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 740 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-03-11T22:45:38.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:38 smithi049 bash[28804]: cluster 2024-03-11T22:45:37.236385+0000 mgr.y (mgr.14601) 1381 : cluster 0 pgmap v1827: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 740 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-03-11T22:45:40.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:40 smithi187 bash[23415]: cluster 2024-03-11T22:45:39.238323+0000 mgr.y (mgr.14601) 1382 : cluster 0 pgmap v1828: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-11T22:45:40.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:45:40 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:45:40.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:40 smithi049 bash[21434]: cluster 2024-03-11T22:45:39.238323+0000 mgr.y (mgr.14601) 1382 : cluster 0 pgmap v1828: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-11T22:45:40.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:40 smithi049 bash[28804]: cluster 2024-03-11T22:45:39.238323+0000 mgr.y (mgr.14601) 1382 : cluster 0 pgmap v1828: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-11T22:45:42.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:42 smithi187 bash[23415]: audit 2024-03-11T22:45:40.402460+0000 mgr.y (mgr.14601) 1383 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:42.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:42 smithi187 bash[23415]: cluster 2024-03-11T22:45:41.239128+0000 mgr.y (mgr.14601) 1384 : cluster 0 pgmap v1829: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 1 op/s 2024-03-11T22:45:42.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:42 smithi049 bash[28804]: audit 2024-03-11T22:45:40.402460+0000 mgr.y (mgr.14601) 1383 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:42.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:42 smithi049 bash[28804]: cluster 2024-03-11T22:45:41.239128+0000 mgr.y (mgr.14601) 1384 : cluster 0 pgmap v1829: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 1 op/s 2024-03-11T22:45:42.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:42 smithi049 bash[21434]: audit 2024-03-11T22:45:40.402460+0000 mgr.y (mgr.14601) 1383 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:42.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:42 smithi049 bash[21434]: cluster 2024-03-11T22:45:41.239128+0000 mgr.y (mgr.14601) 1384 : cluster 0 pgmap v1829: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 1 op/s 2024-03-11T22:45:44.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:44 smithi049 bash[21434]: cluster 2024-03-11T22:45:43.239940+0000 mgr.y (mgr.14601) 1385 : cluster 0 pgmap v1830: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 1.1 KiB/s wr, 1 op/s 2024-03-11T22:45:44.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:45:44 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:45:44] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:45:44.537 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:44 smithi049 bash[28804]: cluster 2024-03-11T22:45:43.239940+0000 mgr.y (mgr.14601) 1385 : cluster 0 pgmap v1830: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 1.1 KiB/s wr, 1 op/s 2024-03-11T22:45:44.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:44 smithi187 bash[23415]: cluster 2024-03-11T22:45:43.239940+0000 mgr.y (mgr.14601) 1385 : cluster 0 pgmap v1830: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 1.1 KiB/s wr, 1 op/s 2024-03-11T22:45:45.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:45 smithi187 bash[23415]: audit 2024-03-11T22:45:44.782232+0000 mon.c (mon.2) 810 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:45.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:45 smithi187 bash[23415]: cluster 2024-03-11T22:45:45.242060+0000 mgr.y (mgr.14601) 1386 : cluster 0 pgmap v1831: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 1 op/s 2024-03-11T22:45:45.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:45 smithi049 bash[28804]: audit 2024-03-11T22:45:44.782232+0000 mon.c (mon.2) 810 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:45.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:45 smithi049 bash[28804]: cluster 2024-03-11T22:45:45.242060+0000 mgr.y (mgr.14601) 1386 : cluster 0 pgmap v1831: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 1 op/s 2024-03-11T22:45:45.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:45 smithi049 bash[21434]: audit 2024-03-11T22:45:44.782232+0000 mon.c (mon.2) 810 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:45:45.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:45 smithi049 bash[21434]: cluster 2024-03-11T22:45:45.242060+0000 mgr.y (mgr.14601) 1386 : cluster 0 pgmap v1831: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 1 op/s 2024-03-11T22:45:48.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:48 smithi187 bash[23415]: cluster 2024-03-11T22:45:47.242899+0000 mgr.y (mgr.14601) 1387 : cluster 0 pgmap v1832: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:48.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:48 smithi049 bash[21434]: cluster 2024-03-11T22:45:47.242899+0000 mgr.y (mgr.14601) 1387 : cluster 0 pgmap v1832: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:48.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:48 smithi049 bash[28804]: cluster 2024-03-11T22:45:47.242899+0000 mgr.y (mgr.14601) 1387 : cluster 0 pgmap v1832: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:50.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:50 smithi187 bash[23415]: cluster 2024-03-11T22:45:49.244942+0000 mgr.y (mgr.14601) 1388 : cluster 0 pgmap v1833: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:50.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:45:50 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:45:50.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:50 smithi049 bash[21434]: cluster 2024-03-11T22:45:49.244942+0000 mgr.y (mgr.14601) 1388 : cluster 0 pgmap v1833: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:50.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:50 smithi049 bash[28804]: cluster 2024-03-11T22:45:49.244942+0000 mgr.y (mgr.14601) 1388 : cluster 0 pgmap v1833: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:52.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:52 smithi187 bash[23415]: audit 2024-03-11T22:45:50.409943+0000 mgr.y (mgr.14601) 1389 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:52.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:52 smithi187 bash[23415]: cluster 2024-03-11T22:45:51.245760+0000 mgr.y (mgr.14601) 1390 : cluster 0 pgmap v1834: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:52.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:52 smithi049 bash[28804]: audit 2024-03-11T22:45:50.409943+0000 mgr.y (mgr.14601) 1389 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:52.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:52 smithi049 bash[28804]: cluster 2024-03-11T22:45:51.245760+0000 mgr.y (mgr.14601) 1390 : cluster 0 pgmap v1834: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:52.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:52 smithi049 bash[21434]: audit 2024-03-11T22:45:50.409943+0000 mgr.y (mgr.14601) 1389 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:45:52.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:52 smithi049 bash[21434]: cluster 2024-03-11T22:45:51.245760+0000 mgr.y (mgr.14601) 1390 : cluster 0 pgmap v1834: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:54.536 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:54 smithi049 bash[21434]: cluster 2024-03-11T22:45:53.246553+0000 mgr.y (mgr.14601) 1391 : cluster 0 pgmap v1835: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:54.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:54 smithi049 bash[28804]: cluster 2024-03-11T22:45:53.246553+0000 mgr.y (mgr.14601) 1391 : cluster 0 pgmap v1835: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:54.537 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:45:54 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:45:54] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:45:54.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:54 smithi187 bash[23415]: cluster 2024-03-11T22:45:53.246553+0000 mgr.y (mgr.14601) 1391 : cluster 0 pgmap v1835: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:56.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:56 smithi187 bash[23415]: cluster 2024-03-11T22:45:55.248549+0000 mgr.y (mgr.14601) 1392 : cluster 0 pgmap v1836: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:56.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:56 smithi049 bash[21434]: cluster 2024-03-11T22:45:55.248549+0000 mgr.y (mgr.14601) 1392 : cluster 0 pgmap v1836: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:56.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:56 smithi049 bash[28804]: cluster 2024-03-11T22:45:55.248549+0000 mgr.y (mgr.14601) 1392 : cluster 0 pgmap v1836: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:45:58.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:45:58 smithi187 bash[23415]: cluster 2024-03-11T22:45:57.249344+0000 mgr.y (mgr.14601) 1393 : cluster 0 pgmap v1837: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:58.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:45:58 smithi049 bash[21434]: cluster 2024-03-11T22:45:57.249344+0000 mgr.y (mgr.14601) 1393 : cluster 0 pgmap v1837: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:45:58.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:45:58 smithi049 bash[28804]: cluster 2024-03-11T22:45:57.249344+0000 mgr.y (mgr.14601) 1393 : cluster 0 pgmap v1837: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:46:00.753 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:46:00 smithi187 bash[47695]: debug there is no tcmu-runner data available 2024-03-11T22:46:00.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:00 smithi187 bash[23415]: cluster 2024-03-11T22:45:59.251380+0000 mgr.y (mgr.14601) 1394 : cluster 0 pgmap v1838: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:46:00.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:00 smithi187 bash[23415]: audit 2024-03-11T22:45:59.815851+0000 mon.c (mon.2) 811 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:46:00.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:00 smithi049 bash[21434]: cluster 2024-03-11T22:45:59.251380+0000 mgr.y (mgr.14601) 1394 : cluster 0 pgmap v1838: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:46:00.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:00 smithi049 bash[21434]: audit 2024-03-11T22:45:59.815851+0000 mon.c (mon.2) 811 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:46:00.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:00 smithi049 bash[28804]: cluster 2024-03-11T22:45:59.251380+0000 mgr.y (mgr.14601) 1394 : cluster 0 pgmap v1838: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-11T22:46:00.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:00 smithi049 bash[28804]: audit 2024-03-11T22:45:59.815851+0000 mon.c (mon.2) 811 : audit 0 from='mgr.14601 v1:172.21.15.49:0/1872893059' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-11T22:46:02.411 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool delete e465fdb5-455f-4dac-9dcc-834a5c09fa37 e465fdb5-455f-4dac-9dcc-834a5c09fa37 --yes-i-really-really-mean-it 2024-03-11T22:46:02.543 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/4164658328 >> v1:172.21.15.49:6790/0 conn(0x7f90b010d9f0 legacy=0x7f90b010fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:02.543 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/4164658328 shutdown_connections 2024-03-11T22:46:02.543 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/4164658328 >> 172.21.15.49:0/4164658328 conn(0x7f90b00fcaa0 msgr2=0x7f90b00feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:46:02.543 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/4164658328 shutdown_connections 2024-03-11T22:46:02.543 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/4164658328 wait complete. 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 Processor -- start 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- start start 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f90b01a5f00 con 0x7f90b0109e80 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f90b01a7100 con 0x7f90b01011f0 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f90b01a8300 con 0x7f90b010d9f0 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b575f640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f90b010d9f0 0x7f90b01a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:59704/0 (socket says 172.21.15.49:59704) 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b575f640 1 -- 172.21.15.49:0/3684707842 learned_addr learned my addr 172.21.15.49:0/3684707842 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:46:02.544 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90affff640 1 --1- 172.21.15.49:0/3684707842 >> v1:172.21.15.49:6789/0 conn(0x7f90b0109e80 0x7f90b01a0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45590/0 (socket says 172.21.15.49:45590) 2024-03-11T22:46:02.546 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507757729 0 0) 0x7f90b01a8300 con 0x7f90b010d9f0 2024-03-11T22:46:02.546 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9094003530 con 0x7f90b010d9f0 2024-03-11T22:46:02.546 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912714935 0 0) 0x7f90b01a5f00 con 0x7f90b0109e80 2024-03-11T22:46:02.546 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b01a8300 con 0x7f90b0109e80 2024-03-11T22:46:02.546 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1820381401 0 0) 0x7f9094003530 con 0x7f90b010d9f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f90b01a5f00 con 0x7f90b010d9f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f90a8004740 con 0x7f90b010d9f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 387452719 0 0) 0x7f90b01a8300 con 0x7f90b0109e80 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9094003530 con 0x7f90b0109e80 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f909c001840 con 0x7f90b0109e80 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161409312 0 0) 0x7f90b01a7100 con 0x7f90b01011f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b01a8300 con 0x7f90b01011f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1070138428 0 0) 0x7f90b01a5f00 con 0x7f90b010d9f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 >> v1:172.21.15.187:6789/0 conn(0x7f90b01011f0 legacy=0x7f90b0106550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 >> v1:172.21.15.49:6789/0 conn(0x7f90b0109e80 legacy=0x7f90b01a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b01a9500 con 0x7f90b010d9f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b01a60f0 con 0x7f90b010d9f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b01a6570 con 0x7f90b010d9f0 2024-03-11T22:46:02.547 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f90a8001510 con 0x7f90b010d9f0 2024-03-11T22:46:02.548 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f90a8005350 con 0x7f90b010d9f0 2024-03-11T22:46:02.548 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9098005090 con 0x7f90b010d9f0 2024-03-11T22:46:02.548 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.534+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f90a8003af0 con 0x7f90b010d9f0 2024-03-11T22:46:02.548 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.538+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(808..808 src has 260..808) v4 ==== 8219+0+0 (unknown 1923159639 0 0) 0x7f90a8089220 con 0x7f90b010d9f0 2024-03-11T22:46:02.548 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.538+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=809}) v3 -- 0x7f90b01a5f00 con 0x7f90b010d9f0 2024-03-11T22:46:02.551 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.542+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f90a8055f70 con 0x7f90b010d9f0 2024-03-11T22:46:02.726 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:02.714+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9098005340 con 0x7f90b010d9f0 2024-03-11T22:46:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:02 smithi187 bash[23415]: audit 2024-03-11T22:46:00.418580+0000 mgr.y (mgr.14601) 1395 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:46:02.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:02 smithi187 bash[23415]: cluster 2024-03-11T22:46:01.252316+0000 mgr.y (mgr.14601) 1396 : cluster 0 pgmap v1839: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:46:02.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:02 smithi049 bash[21434]: audit 2024-03-11T22:46:00.418580+0000 mgr.y (mgr.14601) 1395 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:46:02.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:02 smithi049 bash[21434]: cluster 2024-03-11T22:46:01.252316+0000 mgr.y (mgr.14601) 1396 : cluster 0 pgmap v1839: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:46:02.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:02 smithi049 bash[28804]: audit 2024-03-11T22:46:00.418580+0000 mgr.y (mgr.14601) 1395 : audit 0 from='client.24490 v1:172.21.15.187:0/3839919588' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-11T22:46:02.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:02 smithi049 bash[28804]: cluster 2024-03-11T22:46:01.252316+0000 mgr.y (mgr.14601) 1396 : cluster 0 pgmap v1839: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:46:03.387 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.378+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 10 ==== osd_map(809..809 src has 260..809) v4 ==== 296+0+0 (unknown 1813726720 0 0) 0x7f90a8001e80 con 0x7f90b010d9f0 2024-03-11T22:46:03.387 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.378+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=810}) v3 -- 0x7f90b01a7100 con 0x7f90b010d9f0 2024-03-11T22:46:03.395 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.386+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]=0 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' removed v809) v1 ==== 248+0+0 (unknown 3573952906 0 0) 0x7f90a80542e0 con 0x7f90b010d9f0 2024-03-11T22:46:03.515 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.506+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9098001190 con 0x7f90b010d9f0 2024-03-11T22:46:03.517 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.506+0000 7f90adffb640 1 -- 172.21.15.49:0/3684707842 <== mon.2 v1:172.21.15.49:6790/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]=0 pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' does not exist v809) v1 ==== 255+0+0 (unknown 1963814968 0 0) 0x7f90a8055b00 con 0x7f90b010d9f0 2024-03-11T22:46:03.517 INFO:tasks.workunit.client.0.smithi049.stderr:pool 'e465fdb5-455f-4dac-9dcc-834a5c09fa37' does not exist 2024-03-11T22:46:03.519 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.510+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 >> v1:172.21.15.49:6800/915645872 conn(0x7f909406e530 legacy=0x7f90940709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:03.519 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.510+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 >> v1:172.21.15.49:6790/0 conn(0x7f90b010d9f0 legacy=0x7f90b01a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:03.520 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.510+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 shutdown_connections 2024-03-11T22:46:03.520 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.510+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 >> 172.21.15.49:0/3684707842 conn(0x7f90b00fcaa0 msgr2=0x7f90b0110660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:46:03.520 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.510+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 shutdown_connections 2024-03-11T22:46:03.520 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.510+0000 7f90b71c2640 1 -- 172.21.15.49:0/3684707842 wait complete. 2024-03-11T22:46:03.535 INFO:tasks.workunit.client.0.smithi049.stderr:+ ceph osd pool delete ec81b7d6-e152-48e9-a783-539150d4b909 ec81b7d6-e152-48e9-a783-539150d4b909 --yes-i-really-really-mean-it 2024-03-11T22:46:03.661 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- 172.21.15.49:0/248026106 >> v1:172.21.15.49:6790/0 conn(0x7f374410d9f0 legacy=0x7f374410fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- 172.21.15.49:0/248026106 shutdown_connections 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- 172.21.15.49:0/248026106 >> 172.21.15.49:0/248026106 conn(0x7f37440fcaa0 msgr2=0x7f37440feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- 172.21.15.49:0/248026106 shutdown_connections 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- 172.21.15.49:0/248026106 wait complete. 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 Processor -- start 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- start start 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f37441a5ea0 con 0x7f374410d9f0 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f37441a7060 con 0x7f37441011f0 2024-03-11T22:46:03.662 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f374b4ae640 1 -- --> v1:172.21.15.49:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f37441a8260 con 0x7f3744109e80 2024-03-11T22:46:03.663 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f3748a49640 1 --1- >> v1:172.21.15.49:6790/0 conn(0x7f3744109e80 0x7f37441a0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.49:6790/0 says I am v1:172.21.15.49:59722/0 (socket says 172.21.15.49:59722) 2024-03-11T22:46:03.663 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f3748a49640 1 -- 172.21.15.49:0/4234935423 learned_addr learned my addr 172.21.15.49:0/4234935423 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-03-11T22:46:03.663 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666463686 0 0) 0x7f37441a8260 con 0x7f3744109e80 2024-03-11T22:46:03.663 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3730003530 con 0x7f3744109e80 2024-03-11T22:46:03.663 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003250621 0 0) 0x7f37441a5ea0 con 0x7f374410d9f0 2024-03-11T22:46:03.663 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37441a8260 con 0x7f374410d9f0 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 506628861 0 0) 0x7f3730003530 con 0x7f3744109e80 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f37441a5ea0 con 0x7f3744109e80 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.650+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f3734001940 con 0x7f3744109e80 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3035354527 0 0) 0x7f37441a8260 con 0x7f374410d9f0 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3730003530 con 0x7f374410d9f0 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f373c004a70 con 0x7f374410d9f0 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200538904 0 0) 0x7f37441a7060 con 0x7f37441011f0 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37441a8260 con 0x7f37441011f0 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 629913394 0 0) 0x7f37441a5ea0 con 0x7f3744109e80 2024-03-11T22:46:03.665 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 >> v1:172.21.15.187:6789/0 conn(0x7f37441011f0 legacy=0x7f37441064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 >> v1:172.21.15.49:6789/0 conn(0x7f374410d9f0 legacy=0x7f37441a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37441a9460 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37441a6090 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f37441a6510 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 2865807718 0 0) 0x7f3734001cd0 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 4099328963 0 0) 0x7f3734005d20 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3728005090 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 7 ==== mgrmap(e 22) v1 ==== 91102+0+0 (unknown 1237327074 0 0) 0x7f3734004070 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 8 ==== osd_map(809..809 src has 260..809) v4 ==== 7831+0+0 (unknown 3661708769 0 0) 0x7f3734088a10 con 0x7f3744109e80 2024-03-11T22:46:03.666 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.654+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=810}) v3 -- 0x7f37441a5ea0 con 0x7f3744109e80 2024-03-11T22:46:03.668 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.658+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f37340558d0 con 0x7f3744109e80 2024-03-11T22:46:03.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:03 smithi187 bash[23415]: audit 2024-03-11T22:46:02.721168+0000 mon.c (mon.2) 812 : audit 1 from='client.? v1:172.21.15.49:0/3684707842' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:03.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:03 smithi187 bash[23415]: audit 2024-03-11T22:46:02.721961+0000 mon.a (mon.0) 3610 : audit 1 from='client.47450 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:03.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:03 smithi049 bash[28804]: audit 2024-03-11T22:46:02.721168+0000 mon.c (mon.2) 812 : audit 1 from='client.? v1:172.21.15.49:0/3684707842' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:03.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:03 smithi049 bash[28804]: audit 2024-03-11T22:46:02.721961+0000 mon.a (mon.0) 3610 : audit 1 from='client.47450 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:03.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:03 smithi049 bash[21434]: audit 2024-03-11T22:46:02.721168+0000 mon.c (mon.2) 812 : audit 1 from='client.? v1:172.21.15.49:0/3684707842' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:03.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:03 smithi049 bash[21434]: audit 2024-03-11T22:46:02.721961+0000 mon.a (mon.0) 3610 : audit 1 from='client.47450 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:03.840 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:03.830+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3728005340 con 0x7f3744109e80 2024-03-11T22:46:04.420 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.410+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 10 ==== osd_map(810..810 src has 260..810) v4 ==== 296+0+0 (unknown 840302120 0 0) 0x7f3734056200 con 0x7f3744109e80 2024-03-11T22:46:04.420 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.410+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_subscribe({osdmap=811}) v3 -- 0x7f37441a7060 con 0x7f3744109e80 2024-03-11T22:46:04.426 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.418+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]=0 pool 'ec81b7d6-e152-48e9-a783-539150d4b909' removed v810) v1 ==== 248+0+0 (unknown 669059700 0 0) 0x7f3734053c40 con 0x7f3744109e80 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21686]: ::ffff:172.21.15.187 - - [11/Mar/2024:22:46:04] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[28804]: cluster 2024-03-11T22:46:03.253248+0000 mgr.y (mgr.14601) 1397 : cluster 0 pgmap v1840: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[28804]: audit 2024-03-11T22:46:03.378908+0000 mon.a (mon.0) 3611 : audit 1 from='client.47450 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]': finished 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[28804]: cluster 2024-03-11T22:46:03.397367+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[28804]: audit 2024-03-11T22:46:03.510860+0000 mon.c (mon.2) 813 : audit 1 from='client.? v1:172.21.15.49:0/3684707842' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[28804]: audit 2024-03-11T22:46:03.511414+0000 mon.a (mon.0) 3613 : audit 1 from='client.47450 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[28804]: audit 2024-03-11T22:46:03.835511+0000 mon.c (mon.2) 814 : audit 1 from='client.? v1:172.21.15.49:0/4234935423' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.536 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[28804]: audit 2024-03-11T22:46:03.836069+0000 mon.a (mon.0) 3614 : audit 1 from='client.47456 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21434]: cluster 2024-03-11T22:46:03.253248+0000 mgr.y (mgr.14601) 1397 : cluster 0 pgmap v1840: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:46:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21434]: audit 2024-03-11T22:46:03.378908+0000 mon.a (mon.0) 3611 : audit 1 from='client.47450 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]': finished 2024-03-11T22:46:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21434]: cluster 2024-03-11T22:46:03.397367+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-03-11T22:46:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21434]: audit 2024-03-11T22:46:03.510860+0000 mon.c (mon.2) 813 : audit 1 from='client.? v1:172.21.15.49:0/3684707842' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21434]: audit 2024-03-11T22:46:03.511414+0000 mon.a (mon.0) 3613 : audit 1 from='client.47450 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21434]: audit 2024-03-11T22:46:03.835511+0000 mon.c (mon.2) 814 : audit 1 from='client.? v1:172.21.15.49:0/4234935423' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.537 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:04 smithi049 bash[21434]: audit 2024-03-11T22:46:03.836069+0000 mon.a (mon.0) 3614 : audit 1 from='client.47456 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.549 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.538+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 --> v1:172.21.15.49:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3728001150 con 0x7f3744109e80 2024-03-11T22:46:04.551 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.542+0000 7f373a7fc640 1 -- 172.21.15.49:0/4234935423 <== mon.2 v1:172.21.15.49:6790/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]=0 pool 'ec81b7d6-e152-48e9-a783-539150d4b909' does not exist v810) v1 ==== 255+0+0 (unknown 1614671084 0 0) 0x7f3734055460 con 0x7f3744109e80 2024-03-11T22:46:04.551 INFO:tasks.workunit.client.0.smithi049.stderr:pool 'ec81b7d6-e152-48e9-a783-539150d4b909' does not exist 2024-03-11T22:46:04.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.542+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 >> v1:172.21.15.49:6800/915645872 conn(0x7f373006e5d0 legacy=0x7f3730070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:04.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.542+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 >> v1:172.21.15.49:6790/0 conn(0x7f3744109e80 legacy=0x7f37441a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-11T22:46:04.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.542+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 shutdown_connections 2024-03-11T22:46:04.553 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.542+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 >> 172.21.15.49:0/4234935423 conn(0x7f37440fcaa0 msgr2=0x7f3744110660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-11T22:46:04.554 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.542+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 shutdown_connections 2024-03-11T22:46:04.554 INFO:tasks.workunit.client.0.smithi049.stderr:2024-03-11T22:46:04.542+0000 7f374b4ae640 1 -- 172.21.15.49:0/4234935423 wait complete. 2024-03-11T22:46:04.569 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2024-03-11T22:46:04.570 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2024-03-11T22:46:04.570 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-11T22:46:04.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-11T22:46:04.626 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-03-11T22:46:04.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-11T22:46:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:04 smithi187 bash[23415]: cluster 2024-03-11T22:46:03.253248+0000 mgr.y (mgr.14601) 1397 : cluster 0 pgmap v1840: 188 pgs: 188 active+clean; 874 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-11T22:46:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:04 smithi187 bash[23415]: audit 2024-03-11T22:46:03.378908+0000 mon.a (mon.0) 3611 : audit 1 from='client.47450 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]': finished 2024-03-11T22:46:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:04 smithi187 bash[23415]: cluster 2024-03-11T22:46:03.397367+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-03-11T22:46:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:04 smithi187 bash[23415]: audit 2024-03-11T22:46:03.510860+0000 mon.c (mon.2) 813 : audit 1 from='client.? v1:172.21.15.49:0/3684707842' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:04 smithi187 bash[23415]: audit 2024-03-11T22:46:03.511414+0000 mon.a (mon.0) 3613 : audit 1 from='client.47450 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "pool2": "e465fdb5-455f-4dac-9dcc-834a5c09fa37", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.753 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:04 smithi187 bash[23415]: audit 2024-03-11T22:46:03.835511+0000 mon.c (mon.2) 814 : audit 1 from='client.? v1:172.21.15.49:0/4234935423' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.754 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:04 smithi187 bash[23415]: audit 2024-03-11T22:46:03.836069+0000 mon.a (mon.0) 3614 : audit 1 from='client.47456 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "ec81b7d6-e152-48e9-a783-539150d4b909", "pool2": "ec81b7d6-e152-48e9-a783-539150d4b909", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-11T22:46:04.986 DEBUG:teuthology.parallel:result is None 2024-03-11T22:46:04.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-11T22:46:04.999 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-11T22:46:05.000 DEBUG:teuthology.orchestra.run.smithi049:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-11T22:46:05.057 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-11T22:46:05.057 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-11T22:46:05.067 INFO:tasks.cephadm:Teardown begin 2024-03-11T22:46:05.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-11T22:46:05.116 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-11T22:46:05.131 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-11T22:46:05.131 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-11T22:46:05.163 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-11T22:46:05.183 INFO:tasks.cephadm:Stopping all daemons... 2024-03-11T22:46:05.183 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-11T22:46:05.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a 2024-03-11T22:46:05.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:05 smithi049 systemd[1]: Stopping Ceph mon.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:05.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:05 smithi049 bash[21434]: debug 2024-03-11T22:46:05.354+0000 7ffa8b477700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-11T22:46:05.538 INFO:journalctl@ceph.mon.a.smithi049.stdout:Mar 11 22:46:05 smithi049 bash[21434]: debug 2024-03-11T22:46:05.354+0000 7ffa8b477700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-11T22:46:06.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.a.service' 2024-03-11T22:46:06.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:06.546 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-11T22:46:06.546 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-03-11T22:46:06.546 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.c 2024-03-11T22:46:06.786 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[21686]: [11/Mar/2024:22:46:06] ENGINE Bus STOPPING 2024-03-11T22:46:06.786 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[21686]: [11/Mar/2024:22:46:06] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-11T22:46:06.786 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[21686]: [11/Mar/2024:22:46:06] ENGINE Bus STOPPED 2024-03-11T22:46:06.786 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[21686]: [11/Mar/2024:22:46:06] ENGINE Bus STARTING 2024-03-11T22:46:06.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:06 smithi049 systemd[1]: Stopping Ceph mon.c for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:06.786 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[28804]: debug 2024-03-11T22:46:06.718+0000 7f3742e80700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-11T22:46:06.787 INFO:journalctl@ceph.mon.c.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[28804]: debug 2024-03-11T22:46:06.718+0000 7f3742e80700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-03-11T22:46:07.286 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[21686]: [11/Mar/2024:22:46:06] ENGINE Serving on http://:::9283 2024-03-11T22:46:07.286 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:06 smithi049 bash[21686]: [11/Mar/2024:22:46:06] ENGINE Bus STARTED 2024-03-11T22:46:07.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.c.service' 2024-03-11T22:46:07.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:07.638 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-03-11T22:46:07.638 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-03-11T22:46:07.638 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.b 2024-03-11T22:46:07.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:07 smithi187 systemd[1]: Stopping Ceph mon.b for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:07.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:07 smithi187 bash[23415]: debug 2024-03-11T22:46:07.833+0000 7fb5934c5700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-11T22:46:07.916 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:07 smithi187 bash[23415]: debug 2024-03-11T22:46:07.833+0000 7fb5934c5700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-03-11T22:46:08.890 INFO:journalctl@ceph.mon.b.smithi187.stdout:Mar 11 22:46:08 smithi187 bash[56009]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-mon-b 2024-03-11T22:46:08.903 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mon.b.service' 2024-03-11T22:46:08.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:08.935 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-03-11T22:46:08.935 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-11T22:46:08.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.y 2024-03-11T22:46:09.286 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:08 smithi049 systemd[1]: Stopping Ceph mgr.y for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:09.286 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:09 smithi049 bash[21686]: debug 2024-03-11T22:46:09.070+0000 7f560f312700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:46:09.286 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Mar 11 22:46:09 smithi049 bash[21686]: debug 2024-03-11T22:46:09.070+0000 7f560f312700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-11T22:46:09.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.y.service' 2024-03-11T22:46:09.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:09.972 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-11T22:46:09.972 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-11T22:46:09.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.x 2024-03-11T22:46:10.253 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:46:09 smithi187 systemd[1]: Stopping Ceph mgr.x for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:11.015 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.x.service' 2024-03-11T22:46:11.024 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:46:10 smithi187 bash[56118]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-mgr-x 2024-03-11T22:46:11.024 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:46:10 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-11T22:46:11.024 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:46:11 smithi187 bash[56181]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-mgr-x 2024-03-11T22:46:11.024 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:46:11 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-03-11T22:46:11.024 INFO:journalctl@ceph.mgr.x.smithi187.stdout:Mar 11 22:46:11 smithi187 systemd[1]: Stopped Ceph mgr.x for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:46:11.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:11.041 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-11T22:46:11.041 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-11T22:46:11.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.0 2024-03-11T22:46:11.536 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:46:11 smithi049 systemd[1]: Stopping Ceph osd.0 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:11.536 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:46:11 smithi049 bash[31830]: debug 2024-03-11T22:46:11.186+0000 7f9cdc363700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:46:11.536 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:46:11 smithi049 bash[31830]: debug 2024-03-11T22:46:11.186+0000 7f9cdc363700 -1 osd.0 810 *** Got signal Terminated *** 2024-03-11T22:46:11.536 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:46:11 smithi049 bash[31830]: debug 2024-03-11T22:46:11.186+0000 7f9cdc363700 -1 osd.0 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:46:17.785 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:46:17 smithi049 bash[136798]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-0 2024-03-11T22:46:17.786 INFO:journalctl@ceph.osd.0.smithi049.stdout:Mar 11 22:46:17 smithi049 bash[136862]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-0 2024-03-11T22:46:19.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.0.service' 2024-03-11T22:46:19.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:19.606 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-11T22:46:19.606 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-11T22:46:19.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.1 2024-03-11T22:46:20.036 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:46:19 smithi049 systemd[1]: Stopping Ceph osd.1 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:20.036 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:46:19 smithi049 bash[37586]: debug 2024-03-11T22:46:19.790+0000 7fee28d8a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:46:20.036 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:46:19 smithi049 bash[37586]: debug 2024-03-11T22:46:19.790+0000 7fee28d8a700 -1 osd.1 810 *** Got signal Terminated *** 2024-03-11T22:46:20.036 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:46:19 smithi049 bash[37586]: debug 2024-03-11T22:46:19.790+0000 7fee28d8a700 -1 osd.1 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:46:26.285 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:46:25 smithi049 bash[137000]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-1 2024-03-11T22:46:26.286 INFO:journalctl@ceph.osd.1.smithi049.stdout:Mar 11 22:46:26 smithi049 bash[137068]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-1 2024-03-11T22:46:27.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.1.service' 2024-03-11T22:46:27.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:27.766 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-11T22:46:27.767 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-11T22:46:27.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.2 2024-03-11T22:46:28.035 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:46:27 smithi049 systemd[1]: Stopping Ceph osd.2 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:28.036 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:46:27 smithi049 bash[43363]: debug 2024-03-11T22:46:27.949+0000 7feff8ba6700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:46:28.036 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:46:27 smithi049 bash[43363]: debug 2024-03-11T22:46:27.949+0000 7feff8ba6700 -1 osd.2 810 *** Got signal Terminated *** 2024-03-11T22:46:28.036 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:46:27 smithi049 bash[43363]: debug 2024-03-11T22:46:27.949+0000 7feff8ba6700 -1 osd.2 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:46:34.285 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:46:34 smithi049 bash[137203]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-2 2024-03-11T22:46:34.285 INFO:journalctl@ceph.osd.2.smithi049.stdout:Mar 11 22:46:34 smithi049 bash[137266]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-2 2024-03-11T22:46:35.972 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.2.service' 2024-03-11T22:46:36.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:36.000 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-11T22:46:36.000 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-11T22:46:36.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.3 2024-03-11T22:46:36.286 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:36 smithi049 systemd[1]: Stopping Ceph osd.3 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:36.286 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:36 smithi049 bash[49022]: debug 2024-03-11T22:46:36.185+0000 7f460d2d9700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:46:36.286 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:36 smithi049 bash[49022]: debug 2024-03-11T22:46:36.185+0000 7f460d2d9700 -1 osd.3 810 *** Got signal Terminated *** 2024-03-11T22:46:36.286 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:36 smithi049 bash[49022]: debug 2024-03-11T22:46:36.185+0000 7f460d2d9700 -1 osd.3 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:46:38.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:37 smithi187 bash[43126]: debug 2024-03-11T22:46:37.768+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:38.734 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:38 smithi187 bash[37702]: debug 2024-03-11T22:46:38.288+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:39.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:38 smithi187 bash[43126]: debug 2024-03-11T22:46:38.724+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:39.285 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:38 smithi049 bash[49022]: debug 2024-03-11T22:46:38.877+0000 7f46058c5700 -1 osd.3 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.726150+0000 front 2024-03-11T22:46:15.726338+0000 (oldest deadline 2024-03-11T22:46:38.626312+0000) 2024-03-11T22:46:39.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:39 smithi187 bash[37702]: debug 2024-03-11T22:46:39.324+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:39.503 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:39 smithi187 bash[32377]: debug 2024-03-11T22:46:39.080+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:40.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:39 smithi187 bash[43126]: debug 2024-03-11T22:46:39.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:40.003 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:39 smithi187 bash[26932]: debug 2024-03-11T22:46:39.508+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:40.285 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:39 smithi049 bash[49022]: debug 2024-03-11T22:46:39.901+0000 7f46058c5700 -1 osd.3 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.726150+0000 front 2024-03-11T22:46:15.726338+0000 (oldest deadline 2024-03-11T22:46:38.626312+0000) 2024-03-11T22:46:40.373 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:40 smithi187 bash[32377]: debug 2024-03-11T22:46:40.084+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:40.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:40 smithi187 bash[37702]: debug 2024-03-11T22:46:40.364+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:40.753 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:40 smithi187 bash[26932]: debug 2024-03-11T22:46:40.488+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:41.076 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:40 smithi187 bash[43126]: debug 2024-03-11T22:46:40.744+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:41.285 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:40 smithi049 bash[49022]: debug 2024-03-11T22:46:40.933+0000 7f46058c5700 -1 osd.3 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.726150+0000 front 2024-03-11T22:46:15.726338+0000 (oldest deadline 2024-03-11T22:46:38.626312+0000) 2024-03-11T22:46:41.357 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:41 smithi187 bash[32377]: debug 2024-03-11T22:46:41.068+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:41.752 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:41 smithi187 bash[26932]: debug 2024-03-11T22:46:41.448+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:41.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:41 smithi187 bash[37702]: debug 2024-03-11T22:46:41.348+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:42.033 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:41 smithi187 bash[43126]: debug 2024-03-11T22:46:41.768+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:42.387 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:42 smithi187 bash[32377]: debug 2024-03-11T22:46:42.024+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:42.752 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:42 smithi187 bash[26932]: debug 2024-03-11T22:46:42.464+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:42.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:42 smithi187 bash[37702]: debug 2024-03-11T22:46:42.380+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:42.785 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:42 smithi049 bash[137398]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-3 2024-03-11T22:46:42.785 INFO:journalctl@ceph.osd.3.smithi049.stdout:Mar 11 22:46:42 smithi049 bash[137461]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-3 2024-03-11T22:46:43.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:42 smithi187 bash[32377]: debug 2024-03-11T22:46:42.984+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:43.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:42 smithi187 bash[43126]: debug 2024-03-11T22:46:42.772+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:43.752 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:43 smithi187 bash[26932]: debug 2024-03-11T22:46:43.456+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:43.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:43 smithi187 bash[37702]: debug 2024-03-11T22:46:43.372+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:44.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.3.service' 2024-03-11T22:46:44.241 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:44.241 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-11T22:46:44.241 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-11T22:46:44.242 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.4 2024-03-11T22:46:44.252 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:43 smithi187 bash[43126]: debug 2024-03-11T22:46:43.768+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:44.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:43 smithi187 bash[32377]: debug 2024-03-11T22:46:43.988+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:44.510 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:44 smithi187 systemd[1]: Stopping Ceph osd.4 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:44.511 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:44 smithi187 bash[37702]: debug 2024-03-11T22:46:44.352+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:44.674 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:44 smithi187 bash[26932]: debug 2024-03-11T22:46:44.500+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:45.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:44 smithi187 bash[43126]: debug 2024-03-11T22:46:44.792+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:45.003 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:44 smithi187 bash[26932]: debug 2024-03-11T22:46:44.664+0000 7f6b83014700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:46:45.003 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:44 smithi187 bash[26932]: debug 2024-03-11T22:46:44.664+0000 7f6b83014700 -1 osd.4 810 *** Got signal Terminated *** 2024-03-11T22:46:45.003 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:44 smithi187 bash[26932]: debug 2024-03-11T22:46:44.664+0000 7f6b83014700 -1 osd.4 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:46:45.382 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:45 smithi187 bash[32377]: debug 2024-03-11T22:46:44.996+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:45.752 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:45 smithi187 bash[26932]: debug 2024-03-11T22:46:45.532+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:45.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:45 smithi187 bash[37702]: debug 2024-03-11T22:46:45.372+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:46.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:45 smithi187 bash[32377]: debug 2024-03-11T22:46:45.960+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:46.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:45 smithi187 bash[43126]: debug 2024-03-11T22:46:45.780+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:46.749 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:46 smithi187 bash[26932]: debug 2024-03-11T22:46:46.488+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:46.749 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:46 smithi187 bash[37702]: debug 2024-03-11T22:46:46.340+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:47.002 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:46 smithi187 bash[32377]: debug 2024-03-11T22:46:46.936+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:47.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:46 smithi187 bash[43126]: debug 2024-03-11T22:46:46.740+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:47.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:46 smithi187 bash[43126]: debug 2024-03-11T22:46:46.740+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:47.752 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[26932]: debug 2024-03-11T22:46:47.464+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:47.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[37702]: debug 2024-03-11T22:46:47.332+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:48.253 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[32377]: debug 2024-03-11T22:46:47.944+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:48.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[43126]: debug 2024-03-11T22:46:47.788+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:48.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[43126]: debug 2024-03-11T22:46:47.788+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:48.253 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[51422]: ts=2024-03-11T22:46:47.859Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.49:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.49:8765: connect: connection refused" 2024-03-11T22:46:48.253 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[51422]: ts=2024-03-11T22:46:47.864Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.49:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.49:8765: connect: connection refused" 2024-03-11T22:46:48.253 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[51422]: ts=2024-03-11T22:46:47.868Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.49:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.49:8765: connect: connection refused" 2024-03-11T22:46:48.254 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:46:47 smithi187 bash[51422]: ts=2024-03-11T22:46:47.868Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.49:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.49:8765: connect: connection refused" 2024-03-11T22:46:48.752 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:48 smithi187 bash[37702]: debug 2024-03-11T22:46:48.320+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:48.753 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:48 smithi187 bash[26932]: debug 2024-03-11T22:46:48.488+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:48.753 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:48 smithi187 bash[26932]: debug 2024-03-11T22:46:48.488+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:22.219200+0000 front 2024-03-11T22:46:22.218872+0000 (oldest deadline 2024-03-11T22:46:48.118611+0000) 2024-03-11T22:46:49.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:48 smithi187 bash[32377]: debug 2024-03-11T22:46:48.940+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:49.253 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:48 smithi187 bash[32377]: debug 2024-03-11T22:46:48.940+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:49.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:48 smithi187 bash[43126]: debug 2024-03-11T22:46:48.764+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:49.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:48 smithi187 bash[43126]: debug 2024-03-11T22:46:48.764+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:49.753 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[26932]: debug 2024-03-11T22:46:49.504+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.817075+0000 front 2024-03-11T22:46:15.817583+0000 (oldest deadline 2024-03-11T22:46:38.717074+0000) 2024-03-11T22:46:49.753 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[26932]: debug 2024-03-11T22:46:49.504+0000 7f6b7f608700 -1 osd.4 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:22.219200+0000 front 2024-03-11T22:46:22.218872+0000 (oldest deadline 2024-03-11T22:46:48.118611+0000) 2024-03-11T22:46:49.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[37702]: debug 2024-03-11T22:46:49.280+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:49.753 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[37702]: debug 2024-03-11T22:46:49.280+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:50.136 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[32377]: debug 2024-03-11T22:46:49.904+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:50.137 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[32377]: debug 2024-03-11T22:46:49.904+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:50.137 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[43126]: debug 2024-03-11T22:46:49.768+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:50.137 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:49 smithi187 bash[43126]: debug 2024-03-11T22:46:49.768+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:50.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[37702]: debug 2024-03-11T22:46:50.240+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:50.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[37702]: debug 2024-03-11T22:46:50.240+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:51.002 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[56225]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-4 2024-03-11T22:46:51.003 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[32377]: debug 2024-03-11T22:46:50.952+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:51.003 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[32377]: debug 2024-03-11T22:46:50.952+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:51.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[43126]: debug 2024-03-11T22:46:50.792+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:51.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[43126]: debug 2024-03-11T22:46:50.792+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:51.502 INFO:journalctl@ceph.osd.4.smithi187.stdout:Mar 11 22:46:50 smithi187 bash[56292]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-4 2024-03-11T22:46:51.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:51 smithi187 bash[37702]: debug 2024-03-11T22:46:51.204+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:51.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:51 smithi187 bash[37702]: debug 2024-03-11T22:46:51.204+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:52.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:51 smithi187 bash[32377]: debug 2024-03-11T22:46:51.936+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:52.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:51 smithi187 bash[32377]: debug 2024-03-11T22:46:51.936+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:52.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:51 smithi187 bash[43126]: debug 2024-03-11T22:46:51.800+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:52.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:51 smithi187 bash[43126]: debug 2024-03-11T22:46:51.800+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:52.674 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:52 smithi187 bash[37702]: debug 2024-03-11T22:46:52.248+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:52.674 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:52 smithi187 bash[37702]: debug 2024-03-11T22:46:52.248+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:52.983 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:52 smithi187 bash[43126]: debug 2024-03-11T22:46:52.788+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:52.983 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:52 smithi187 bash[43126]: debug 2024-03-11T22:46:52.788+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:53.145 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.4.service' 2024-03-11T22:46:53.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:46:53.216 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-11T22:46:53.216 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-11T22:46:53.216 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.5 2024-03-11T22:46:53.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:52 smithi187 bash[32377]: debug 2024-03-11T22:46:52.972+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:53.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:52 smithi187 bash[32377]: debug 2024-03-11T22:46:52.972+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:53.397 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:53 smithi187 systemd[1]: Stopping Ceph osd.5 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:46:53.397 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[37702]: debug 2024-03-11T22:46:53.248+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:53.398 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[37702]: debug 2024-03-11T22:46:53.248+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:53.752 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[32377]: debug 2024-03-11T22:46:53.388+0000 7f0e9a8f8700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:46:53.752 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[32377]: debug 2024-03-11T22:46:53.388+0000 7f0e9a8f8700 -1 osd.5 810 *** Got signal Terminated *** 2024-03-11T22:46:53.753 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[32377]: debug 2024-03-11T22:46:53.388+0000 7f0e9a8f8700 -1 osd.5 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:46:54.251 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[43126]: debug 2024-03-11T22:46:53.744+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:54.251 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[43126]: debug 2024-03-11T22:46:53.744+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:54.251 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[32377]: debug 2024-03-11T22:46:53.980+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:54.251 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:53 smithi187 bash[32377]: debug 2024-03-11T22:46:53.980+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:54.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:54 smithi187 bash[37702]: debug 2024-03-11T22:46:54.244+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:54.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:54 smithi187 bash[37702]: debug 2024-03-11T22:46:54.244+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:55.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:54 smithi187 bash[43126]: debug 2024-03-11T22:46:54.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:55.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:54 smithi187 bash[43126]: debug 2024-03-11T22:46:54.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:55.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[37702]: debug 2024-03-11T22:46:55.244+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:55.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[37702]: debug 2024-03-11T22:46:55.244+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:55.503 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[32377]: debug 2024-03-11T22:46:55.008+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:55.503 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[32377]: debug 2024-03-11T22:46:55.008+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:55.503 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[32377]: debug 2024-03-11T22:46:55.008+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:28.696793+0000 front 2024-03-11T22:46:28.697047+0000 (oldest deadline 2024-03-11T22:46:54.596663+0000) 2024-03-11T22:46:55.969 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[43126]: debug 2024-03-11T22:46:55.708+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:55.969 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[43126]: debug 2024-03-11T22:46:55.708+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:56.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[32377]: debug 2024-03-11T22:46:55.960+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:56.253 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[32377]: debug 2024-03-11T22:46:55.960+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:56.253 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:55 smithi187 bash[32377]: debug 2024-03-11T22:46:55.960+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:28.696793+0000 front 2024-03-11T22:46:28.697047+0000 (oldest deadline 2024-03-11T22:46:54.596663+0000) 2024-03-11T22:46:56.676 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:56 smithi187 bash[37702]: debug 2024-03-11T22:46:56.244+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:56.676 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:56 smithi187 bash[37702]: debug 2024-03-11T22:46:56.244+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:56.928 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:56 smithi187 bash[43126]: debug 2024-03-11T22:46:56.668+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:56.928 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:56 smithi187 bash[43126]: debug 2024-03-11T22:46:56.668+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:57.252 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:56 smithi187 bash[32377]: debug 2024-03-11T22:46:56.920+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:57.253 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:56 smithi187 bash[32377]: debug 2024-03-11T22:46:56.920+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:57.253 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:56 smithi187 bash[32377]: debug 2024-03-11T22:46:56.920+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:28.696793+0000 front 2024-03-11T22:46:28.697047+0000 (oldest deadline 2024-03-11T22:46:54.596663+0000) 2024-03-11T22:46:57.711 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[37702]: debug 2024-03-11T22:46:57.256+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:57.711 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[37702]: debug 2024-03-11T22:46:57.256+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:58.002 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[32377]: debug 2024-03-11T22:46:57.900+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:15.492362+0000 front 2024-03-11T22:46:15.492574+0000 (oldest deadline 2024-03-11T22:46:38.992199+0000) 2024-03-11T22:46:58.003 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[32377]: debug 2024-03-11T22:46:57.900+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:24.695522+0000 front 2024-03-11T22:46:24.695150+0000 (oldest deadline 2024-03-11T22:46:48.695912+0000) 2024-03-11T22:46:58.003 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[32377]: debug 2024-03-11T22:46:57.900+0000 7f0e96eec700 -1 osd.5 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:28.696793+0000 front 2024-03-11T22:46:28.697047+0000 (oldest deadline 2024-03-11T22:46:54.596663+0000) 2024-03-11T22:46:58.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[43126]: debug 2024-03-11T22:46:57.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:58.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[43126]: debug 2024-03-11T22:46:57.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:58.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:57 smithi187 bash[43126]: debug 2024-03-11T22:46:57.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:46:58.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:58 smithi187 bash[37702]: debug 2024-03-11T22:46:58.236+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:58.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:58 smithi187 bash[37702]: debug 2024-03-11T22:46:58.236+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:59.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:58 smithi187 bash[43126]: debug 2024-03-11T22:46:58.712+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:46:59.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:58 smithi187 bash[43126]: debug 2024-03-11T22:46:58.712+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:46:59.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:58 smithi187 bash[43126]: debug 2024-03-11T22:46:58.712+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:46:59.410 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[37702]: debug 2024-03-11T22:46:59.196+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:46:59.410 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[37702]: debug 2024-03-11T22:46:59.196+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:46:59.745 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[56428]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-5 2024-03-11T22:46:59.745 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[37702]: debug 2024-03-11T22:46:59.196+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:00.002 INFO:journalctl@ceph.osd.5.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[56491]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-5 2024-03-11T22:47:00.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[43126]: debug 2024-03-11T22:46:59.736+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:00.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[43126]: debug 2024-03-11T22:46:59.736+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:00.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:46:59 smithi187 bash[43126]: debug 2024-03-11T22:46:59.736+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:00.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:00 smithi187 bash[37702]: debug 2024-03-11T22:47:00.232+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:47:00.502 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:00 smithi187 bash[37702]: debug 2024-03-11T22:47:00.232+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:47:00.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:00 smithi187 bash[37702]: debug 2024-03-11T22:47:00.232+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:01.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:00 smithi187 bash[43126]: debug 2024-03-11T22:47:00.732+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:01.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:00 smithi187 bash[43126]: debug 2024-03-11T22:47:00.732+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:01.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:00 smithi187 bash[43126]: debug 2024-03-11T22:47:00.732+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:01.415 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:01 smithi187 bash[37702]: debug 2024-03-11T22:47:01.272+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:47:01.415 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:01 smithi187 bash[37702]: debug 2024-03-11T22:47:01.272+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:47:01.415 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:01 smithi187 bash[37702]: debug 2024-03-11T22:47:01.272+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:01.903 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.5.service' 2024-03-11T22:47:01.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:47:01.931 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-11T22:47:01.931 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-11T22:47:01.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.6 2024-03-11T22:47:02.088 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:01 smithi187 systemd[1]: Stopping Ceph osd.6 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:02.088 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:01 smithi187 bash[43126]: debug 2024-03-11T22:47:01.776+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:02.088 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:01 smithi187 bash[43126]: debug 2024-03-11T22:47:01.776+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:02.088 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:01 smithi187 bash[43126]: debug 2024-03-11T22:47:01.776+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:02.252 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[37702]: debug 2024-03-11T22:47:02.080+0000 7fb225638700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:47:02.252 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[37702]: debug 2024-03-11T22:47:02.080+0000 7fb225638700 -1 osd.6 810 *** Got signal Terminated *** 2024-03-11T22:47:02.253 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[37702]: debug 2024-03-11T22:47:02.080+0000 7fb225638700 -1 osd.6 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:47:02.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[37702]: debug 2024-03-11T22:47:02.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:47:02.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[37702]: debug 2024-03-11T22:47:02.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:47:02.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[37702]: debug 2024-03-11T22:47:02.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:02.503 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[37702]: debug 2024-03-11T22:47:02.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:38.919284+0000 front 2024-03-11T22:46:38.919454+0000 (oldest deadline 2024-03-11T22:47:01.819136+0000) 2024-03-11T22:47:03.252 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[43126]: debug 2024-03-11T22:47:02.748+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:03.252 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[43126]: debug 2024-03-11T22:47:02.748+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:03.253 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:02 smithi187 bash[43126]: debug 2024-03-11T22:47:02.748+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:03.714 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[37702]: debug 2024-03-11T22:47:03.272+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:47:03.714 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[37702]: debug 2024-03-11T22:47:03.272+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:47:03.714 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[37702]: debug 2024-03-11T22:47:03.272+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:03.714 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[37702]: debug 2024-03-11T22:47:03.272+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:38.919284+0000 front 2024-03-11T22:46:38.919454+0000 (oldest deadline 2024-03-11T22:47:01.819136+0000) 2024-03-11T22:47:04.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[43126]: debug 2024-03-11T22:47:03.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:04.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[43126]: debug 2024-03-11T22:47:03.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:04.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[43126]: debug 2024-03-11T22:47:03.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:04.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:03 smithi187 bash[43126]: debug 2024-03-11T22:47:03.704+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:04.688 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[37702]: debug 2024-03-11T22:47:04.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:47:04.689 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[37702]: debug 2024-03-11T22:47:04.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:47:04.689 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[37702]: debug 2024-03-11T22:47:04.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:04.689 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[37702]: debug 2024-03-11T22:47:04.308+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:38.919284+0000 front 2024-03-11T22:46:38.919454+0000 (oldest deadline 2024-03-11T22:47:01.819136+0000) 2024-03-11T22:47:05.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[43126]: debug 2024-03-11T22:47:04.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:05.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[43126]: debug 2024-03-11T22:47:04.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:05.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[43126]: debug 2024-03-11T22:47:04.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:05.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:04 smithi187 bash[43126]: debug 2024-03-11T22:47:04.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:05.698 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[37702]: debug 2024-03-11T22:47:05.260+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:47:05.698 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[37702]: debug 2024-03-11T22:47:05.260+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:47:05.698 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[37702]: debug 2024-03-11T22:47:05.260+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:05.698 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[37702]: debug 2024-03-11T22:47:05.260+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:38.919284+0000 front 2024-03-11T22:46:38.919454+0000 (oldest deadline 2024-03-11T22:47:01.819136+0000) 2024-03-11T22:47:06.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[43126]: debug 2024-03-11T22:47:05.692+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:06.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[43126]: debug 2024-03-11T22:47:05.692+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:06.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[43126]: debug 2024-03-11T22:47:05.692+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:06.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:05 smithi187 bash[43126]: debug 2024-03-11T22:47:05.692+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:06.651 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[37702]: debug 2024-03-11T22:47:06.280+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:13.512813+0000 front 2024-03-11T22:46:13.512662+0000 (oldest deadline 2024-03-11T22:46:37.612388+0000) 2024-03-11T22:47:06.651 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[37702]: debug 2024-03-11T22:47:06.280+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.716858+0000 front 2024-03-11T22:46:23.716879+0000 (oldest deadline 2024-03-11T22:46:49.016461+0000) 2024-03-11T22:47:06.651 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[37702]: debug 2024-03-11T22:47:06.280+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:31.918125+0000 front 2024-03-11T22:46:31.917962+0000 (oldest deadline 2024-03-11T22:46:58.918407+0000) 2024-03-11T22:47:06.651 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[37702]: debug 2024-03-11T22:47:06.280+0000 7fb221c2c700 -1 osd.6 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:38.919284+0000 front 2024-03-11T22:46:38.919454+0000 (oldest deadline 2024-03-11T22:47:01.819136+0000) 2024-03-11T22:47:07.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[43126]: debug 2024-03-11T22:47:06.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:07.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[43126]: debug 2024-03-11T22:47:06.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:07.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[43126]: debug 2024-03-11T22:47:06.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:07.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:06 smithi187 bash[43126]: debug 2024-03-11T22:47:06.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:08.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:07 smithi187 bash[43126]: debug 2024-03-11T22:47:07.668+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:08.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:07 smithi187 bash[43126]: debug 2024-03-11T22:47:07.668+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:08.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:07 smithi187 bash[43126]: debug 2024-03-11T22:47:07.668+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:08.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:07 smithi187 bash[43126]: debug 2024-03-11T22:47:07.668+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:08.396 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:08 smithi187 bash[56627]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-6 2024-03-11T22:47:08.396 INFO:journalctl@ceph.osd.6.smithi187.stdout:Mar 11 22:47:08 smithi187 bash[56689]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-6 2024-03-11T22:47:09.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:08 smithi187 bash[43126]: debug 2024-03-11T22:47:08.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:09.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:08 smithi187 bash[43126]: debug 2024-03-11T22:47:08.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:09.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:08 smithi187 bash[43126]: debug 2024-03-11T22:47:08.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:09.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:08 smithi187 bash[43126]: debug 2024-03-11T22:47:08.644+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:09.996 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:09 smithi187 bash[43126]: debug 2024-03-11T22:47:09.652+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:09.996 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:09 smithi187 bash[43126]: debug 2024-03-11T22:47:09.652+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:09.996 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:09 smithi187 bash[43126]: debug 2024-03-11T22:47:09.652+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:09.996 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:09 smithi187 bash[43126]: debug 2024-03-11T22:47:09.652+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:10.468 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.6.service' 2024-03-11T22:47:10.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:47:10.497 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-11T22:47:10.497 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-11T22:47:10.497 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.7 2024-03-11T22:47:10.752 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 systemd[1]: Stopping Ceph osd.7 for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:10.752 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 bash[43126]: debug 2024-03-11T22:47:10.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:10.752 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 bash[43126]: debug 2024-03-11T22:47:10.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:10.752 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 bash[43126]: debug 2024-03-11T22:47:10.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:10.752 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 bash[43126]: debug 2024-03-11T22:47:10.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:10.753 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 bash[43126]: debug 2024-03-11T22:47:10.672+0000 7f37725ad700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:47:10.753 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 bash[43126]: debug 2024-03-11T22:47:10.672+0000 7f37725ad700 -1 osd.7 810 *** Got signal Terminated *** 2024-03-11T22:47:10.753 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:10 smithi187 bash[43126]: debug 2024-03-11T22:47:10.672+0000 7f37725ad700 -1 osd.7 810 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-11T22:47:12.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:11 smithi187 bash[43126]: debug 2024-03-11T22:47:11.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:12.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:11 smithi187 bash[43126]: debug 2024-03-11T22:47:11.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:12.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:11 smithi187 bash[43126]: debug 2024-03-11T22:47:11.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:12.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:11 smithi187 bash[43126]: debug 2024-03-11T22:47:11.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:12.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:11 smithi187 bash[43126]: debug 2024-03-11T22:47:11.680+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.187:6802 osd.4 since back 2024-03-11T22:46:49.576057+0000 front 2024-03-11T22:46:49.576256+0000 (oldest deadline 2024-03-11T22:47:10.675834+0000) 2024-03-11T22:47:13.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:12 smithi187 bash[43126]: debug 2024-03-11T22:47:12.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:13.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:12 smithi187 bash[43126]: debug 2024-03-11T22:47:12.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:13.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:12 smithi187 bash[43126]: debug 2024-03-11T22:47:12.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:13.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:12 smithi187 bash[43126]: debug 2024-03-11T22:47:12.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:13.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:12 smithi187 bash[43126]: debug 2024-03-11T22:47:12.660+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.187:6802 osd.4 since back 2024-03-11T22:46:49.576057+0000 front 2024-03-11T22:46:49.576256+0000 (oldest deadline 2024-03-11T22:47:10.675834+0000) 2024-03-11T22:47:14.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:13 smithi187 bash[43126]: debug 2024-03-11T22:47:13.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:14.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:13 smithi187 bash[43126]: debug 2024-03-11T22:47:13.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:14.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:13 smithi187 bash[43126]: debug 2024-03-11T22:47:13.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:14.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:13 smithi187 bash[43126]: debug 2024-03-11T22:47:13.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:14.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:13 smithi187 bash[43126]: debug 2024-03-11T22:47:13.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.187:6802 osd.4 since back 2024-03-11T22:46:49.576057+0000 front 2024-03-11T22:46:49.576256+0000 (oldest deadline 2024-03-11T22:47:10.675834+0000) 2024-03-11T22:47:15.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:14 smithi187 bash[43126]: debug 2024-03-11T22:47:14.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:15.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:14 smithi187 bash[43126]: debug 2024-03-11T22:47:14.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:15.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:14 smithi187 bash[43126]: debug 2024-03-11T22:47:14.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:15.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:14 smithi187 bash[43126]: debug 2024-03-11T22:47:14.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:15.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:14 smithi187 bash[43126]: debug 2024-03-11T22:47:14.612+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.187:6802 osd.4 since back 2024-03-11T22:46:49.576057+0000 front 2024-03-11T22:46:49.576256+0000 (oldest deadline 2024-03-11T22:47:10.675834+0000) 2024-03-11T22:47:16.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:15 smithi187 bash[43126]: debug 2024-03-11T22:47:15.604+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6803 osd.0 since back 2024-03-11T22:46:11.668719+0000 front 2024-03-11T22:46:11.668241+0000 (oldest deadline 2024-03-11T22:46:37.568149+0000) 2024-03-11T22:47:16.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:15 smithi187 bash[43126]: debug 2024-03-11T22:47:15.604+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6807 osd.1 since back 2024-03-11T22:46:23.469811+0000 front 2024-03-11T22:46:23.469857+0000 (oldest deadline 2024-03-11T22:46:46.369762+0000) 2024-03-11T22:47:16.002 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:15 smithi187 bash[43126]: debug 2024-03-11T22:47:15.604+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6811 osd.2 since back 2024-03-11T22:46:32.172382+0000 front 2024-03-11T22:46:32.171984+0000 (oldest deadline 2024-03-11T22:46:57.472007+0000) 2024-03-11T22:47:16.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:15 smithi187 bash[43126]: debug 2024-03-11T22:47:15.604+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.49:6815 osd.3 since back 2024-03-11T22:46:37.472932+0000 front 2024-03-11T22:46:37.472814+0000 (oldest deadline 2024-03-11T22:47:02.772659+0000) 2024-03-11T22:47:16.003 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:15 smithi187 bash[43126]: debug 2024-03-11T22:47:15.604+0000 7f376ab99700 -1 osd.7 810 heartbeat_check: no reply from 172.21.15.187:6802 osd.4 since back 2024-03-11T22:46:49.576057+0000 front 2024-03-11T22:46:49.576256+0000 (oldest deadline 2024-03-11T22:47:10.675834+0000) 2024-03-11T22:47:17.252 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:16 smithi187 bash[56823]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-7 2024-03-11T22:47:17.252 INFO:journalctl@ceph.osd.7.smithi187.stdout:Mar 11 22:47:17 smithi187 bash[56887]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-osd-7 2024-03-11T22:47:18.892 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@osd.7.service' 2024-03-11T22:47:18.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:47:18.920 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-11T22:47:18.920 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-03-11T22:47:18.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@rgw.foo.a 2024-03-11T22:47:19.285 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:47:18 smithi049 systemd[1]: Stopping Ceph rgw.foo.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:19.285 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:47:19 smithi049 bash[53037]: debug 2024-03-11T22:47:19.064+0000 7fae57bdb700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-11T22:47:19.285 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:47:19 smithi049 bash[53037]: debug 2024-03-11T22:47:19.064+0000 7fae6644bac0 -1 shutting down 2024-03-11T22:47:29.785 INFO:journalctl@ceph.rgw.foo.a.smithi049.stdout:Mar 11 22:47:29 smithi049 bash[137594]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-rgw-foo-a 2024-03-11T22:47:29.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@rgw.foo.a.service' 2024-03-11T22:47:29.825 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:47:29.825 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-03-11T22:47:29.825 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-03-11T22:47:29.825 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-377df5b0-dff2-11ee-95c8-87774f69a715@prometheus.a 2024-03-11T22:47:30.184 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 systemd[1]: Stopping Ceph prometheus.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:30.184 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.963Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.964Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.965Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.965Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-11T22:47:30.185 INFO:journalctl@ceph.prometheus.a.smithi187.stdout:Mar 11 22:47:29 smithi187 bash[51422]: ts=2024-03-11T22:47:29.965Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-11T22:47:30.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-377df5b0-dff2-11ee-95c8-87774f69a715@prometheus.a.service' 2024-03-11T22:47:30.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-11T22:47:30.696 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-03-11T22:47:30.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm rm-cluster --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 --force --keep-logs 2024-03-11T22:47:30.865 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:47:35.705 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:35 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:35.705 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:35 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:35.957 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:35 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:35.957 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:35 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:36.209 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:36.210 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:36.535 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:36.535 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:36.825 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:36.825 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:37.123 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:37.123 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:37 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:37.123 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:36 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:37.123 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:37 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:37.403 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:37 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:37.404 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:37 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:37.690 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:37 smithi049 systemd[1]: Stopping Ceph node-exporter.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:38.387 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:38 smithi049 bash[137998]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-node-exporter-a 2024-03-11T22:47:38.387 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:38 smithi049 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-11T22:47:38.387 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:38 smithi049 bash[138057]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-node-exporter-a 2024-03-11T22:47:38.387 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:38 smithi049 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-11T22:47:38.387 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:38 smithi049 systemd[1]: Stopped Ceph node-exporter.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:47:38.644 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:38 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:38.645 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:38 smithi049 systemd[1]: Stopping Ceph alertmanager.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:38.645 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:38 smithi049 bash[61519]: ts=2024-03-11T22:47:38.594Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-11T22:47:38.645 INFO:journalctl@ceph.node-exporter.a.smithi049.stdout:Mar 11 22:47:38 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:39.520 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:39 smithi049 bash[138125]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-alertmanager-a 2024-03-11T22:47:39.521 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:39 smithi049 bash[138184]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-alertmanager-a 2024-03-11T22:47:39.521 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:39 smithi049 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-03-11T22:47:39.521 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:39 smithi049 systemd[1]: Stopped Ceph alertmanager.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:47:39.784 INFO:journalctl@ceph.alertmanager.a.smithi049.stdout:Mar 11 22:47:39 smithi049 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:40.031 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm rm-cluster --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 --force --keep-logs 2024-03-11T22:47:40.197 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:47:45.074 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:44 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.074 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:44 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.075 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:44 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.327 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.327 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.327 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.583 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.583 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.836 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.836 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:45.837 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:45 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:46.154 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:46.154 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:46.155 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:46.502 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:46.502 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:46.503 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:46 smithi187 systemd[1]: Stopping Ceph iscsi.iscsi.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:46.503 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:46 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:47.002 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:46 smithi187 bash[47695]: debug Shutdown received 2024-03-11T22:47:57.486 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:57 smithi187 bash[57420]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-iscsi-iscsi-a 2024-03-11T22:47:57.486 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:57 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-03-11T22:47:57.486 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:57 smithi187 bash[57486]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-iscsi-iscsi-a 2024-03-11T22:47:57.486 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:57 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-03-11T22:47:57.487 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:57 smithi187 systemd[1]: Stopped Ceph iscsi.iscsi.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:47:57.752 INFO:journalctl@ceph.iscsi.iscsi.a.smithi187.stdout:Mar 11 22:47:57 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:57.752 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:57 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:57.752 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:57 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:58.717 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:58 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:58.718 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:58 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:58.718 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:58 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:58.718 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:58 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:47:58.982 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:58 smithi187 systemd[1]: Stopping Ceph node-exporter.b for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:47:59.752 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:59 smithi187 bash[57689]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-node-exporter-b 2024-03-11T22:47:59.752 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:59 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-11T22:47:59.752 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:59 smithi187 bash[57750]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-node-exporter-b 2024-03-11T22:47:59.752 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:59 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-11T22:47:59.752 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:59 smithi187 systemd[1]: Stopped Ceph node-exporter.b for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:48:00.071 INFO:journalctl@ceph.node-exporter.b.smithi187.stdout:Mar 11 22:47:59 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:48:00.071 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:59 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:48:00.071 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:47:59 smithi187 systemd[1]: Stopping Ceph grafana.a for 377df5b0-dff2-11ee-95c8-87774f69a715... 2024-03-11T22:48:00.752 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:48:00 smithi187 bash[57819]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-grafana-a 2024-03-11T22:48:00.752 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:48:00 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-03-11T22:48:00.752 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:48:00 smithi187 bash[57878]: Error response from daemon: No such container: ceph-377df5b0-dff2-11ee-95c8-87774f69a715-grafana-a 2024-03-11T22:48:00.752 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:48:00 smithi187 systemd[1]: ceph-377df5b0-dff2-11ee-95c8-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-03-11T22:48:00.752 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:48:00 smithi187 systemd[1]: Stopped Ceph grafana.a for 377df5b0-dff2-11ee-95c8-87774f69a715. 2024-03-11T22:48:01.144 INFO:journalctl@ceph.grafana.a.smithi187.stdout:Mar 11 22:48:00 smithi187 systemd[1]: /etc/systemd/system/ceph-377df5b0-dff2-11ee-95c8-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-11T22:48:01.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-11T22:48:01.411 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-11T22:48:01.423 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-11T22:48:01.425 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/crash to /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942/remote/smithi049/crash 2024-03-11T22:48:01.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/crash -- . 2024-03-11T22:48:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/crash: Cannot open: No such file or directory 2024-03-11T22:48:01.464 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now 2024-03-11T22:48:01.466 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/crash to /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942/remote/smithi187/crash 2024-03-11T22:48:01.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/crash -- . 2024-03-11T22:48:01.478 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /var/lib/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/crash: Cannot open: No such file or directory 2024-03-11T22:48:01.478 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now 2024-03-11T22:48:01.479 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-11T22:48:01.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-11T22:48:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:2024-03-11T22:20:00.000232+0000 mon.a (mon.0) 2541 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-03-11T22:48:01.524 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-11T22:48:01.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[SEC\]' /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-11T22:48:01.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]' /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-11T22:48:01.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[WRN\]' /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-11T22:48:01.690 INFO:teuthology.orchestra.run.smithi049.stdout:2024-03-11T22:20:00.000232+0000 mon.a (mon.0) 2541 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-03-11T22:48:01.690 INFO:tasks.cephadm:Compressing logs... 2024-03-11T22:48:01.690 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-11T22:48:01.734 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-11T22:48:01.742 INFO:teuthology.orchestra.run.smithi049.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-03-11T22:48:01.748 INFO:teuthology.orchestra.run.smithi187.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-03-11T22:48:01.754 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mgr.y.log 2024-03-11T22:48:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.0.log 2024-03-11T22:48:01.755 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.2.log 2024-03-11T22:48:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.a.log 2024-03-11T22:48:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.cephadm.log 2024-03-11T22:48:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.3.log 2024-03-11T22:48:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.1.log 2024-03-11T22:48:01.757 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.3.log: gzip 89.0% -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log 2024-03-11T22:48:01.758 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.cephadm.log.gz 2024-03-11T22:48:01.758 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-volume.log 2024-03-11T22:48:01.759 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.c.log 2024-03-11T22:48:01.761 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.7.log 2024-03-11T22:48:01.762 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.6.log 2024-03-11T22:48:01.762 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.cephadm.log 2024-03-11T22:48:01.763 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.5.log 2024-03-11T22:48:01.763 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/tcmu-runner.log 2024-03-11T22:48:01.764 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.5.log: 81.7% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.cephadm.log.gz 2024-03-11T22:48:01.764 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mgr.x.log 2024-03-11T22:48:01.764 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log 2024-03-11T22:48:01.764 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/tcmu-runner.log: 68.0% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/tcmu-runner.log.gz 2024-03-11T22:48:01.764 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-volume.log 2024-03-11T22:48:01.766 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.audit.log 2024-03-11T22:48:01.766 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.b.log 2024-03-11T22:48:01.766 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.4.log 2024-03-11T22:48:01.769 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-volume.log: 93.4% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log.gz 2024-03-11T22:48:01.770 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.audit.log 2024-03-11T22:48:01.772 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.b.log: 88.0% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.log.gz 2024-03-11T22:48:01.773 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-11T22:48:01.773 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.c.log: 91.0% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-volume.log.gz 2024-03-11T22:48:01.774 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-client.rgw.foo.a.log 2024-03-11T22:48:01.779 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.4.log: 92.6% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mgr.x.log.gz 2024-03-11T22:48:01.780 INFO:teuthology.orchestra.run.smithi187.stderr: 90.9% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-volume.log.gz 2024-03-11T22:48:01.781 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.audit.log.gz 2024-03-11T22:48:01.785 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-11T22:48:01.786 INFO:teuthology.orchestra.run.smithi187.stderr: 85.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-11T22:48:01.808 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-client.rgw.foo.a.log: /var/log/ceph/cephadm.log: 95.1% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph.audit.log.gz 2024-03-11T22:48:01.829 INFO:teuthology.orchestra.run.smithi049.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-11T22:48:01.867 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-client.rgw.foo.a.log.gz 2024-03-11T22:48:02.338 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mgr.y.log.gz 2024-03-11T22:48:03.144 INFO:teuthology.orchestra.run.smithi187.stderr: 92.6% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.b.log.gz 2024-03-11T22:48:03.265 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.c.log.gz 2024-03-11T22:48:05.314 INFO:teuthology.orchestra.run.smithi049.stderr: 91.6% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-mon.a.log.gz 2024-03-11T22:48:09.856 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.0.log.gz 2024-03-11T22:48:09.876 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.2.log.gz 2024-03-11T22:48:09.917 INFO:teuthology.orchestra.run.smithi187.stderr: 93.8% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.7.log.gz 2024-03-11T22:48:09.993 INFO:teuthology.orchestra.run.smithi187.stderr: 93.8% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.6.log.gz 2024-03-11T22:48:10.738 INFO:teuthology.orchestra.run.smithi187.stderr: 93.9% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.4.log.gz 2024-03-11T22:48:10.777 INFO:teuthology.orchestra.run.smithi187.stderr: 93.8% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.5.log.gz 2024-03-11T22:48:10.779 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-03-11T22:48:10.779 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m9.040s 2024-03-11T22:48:10.779 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m34.517s 2024-03-11T22:48:10.779 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m1.313s 2024-03-11T22:48:11.189 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.3.log.gz 2024-03-11T22:48:11.418 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/377df5b0-dff2-11ee-95c8-87774f69a715/ceph-osd.1.log.gz 2024-03-11T22:48:11.418 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-11T22:48:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m9.683s 2024-03-11T22:48:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m39.814s 2024-03-11T22:48:11.419 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m1.275s 2024-03-11T22:48:11.420 INFO:tasks.cephadm:Archiving logs... 2024-03-11T22:48:11.420 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942/remote/smithi049/log 2024-03-11T22:48:11.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-11T22:48:15.896 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942/remote/smithi187/log 2024-03-11T22:48:15.896 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-11T22:48:20.214 INFO:tasks.cephadm:Removing cluster... 2024-03-11T22:48:20.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo cephadm rm-cluster --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 --force 2024-03-11T22:48:20.386 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:48:21.810 DEBUG:teuthology.orchestra.run.smithi187:> sudo cephadm rm-cluster --fsid 377df5b0-dff2-11ee-95c8-87774f69a715 --force 2024-03-11T22:48:21.978 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: 377df5b0-dff2-11ee-95c8-87774f69a715 2024-03-11T22:48:23.355 INFO:tasks.cephadm:Teardown complete 2024-03-11T22:48:23.355 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-11T22:48:23.366 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-11T22:48:23.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-11T22:48:23.369 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-11T22:48:23.428 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-11T22:48:23.440 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-11T22:48:23.441 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-11T22:48:23.443 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-11T22:48:23.454 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2024-03-11T22:48:23.454 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2024-03-11T22:48:23.454 INFO:teuthology.orchestra.run.smithi049.stdout:*hv01.front.sepi 44.4.53.2 2 u 131 128 377 0.133 -7.086 1.242 2024-03-11T22:48:23.454 INFO:teuthology.orchestra.run.smithi049.stdout:+hv02.front.sepi 63.231.80.2 3 u 16 128 377 0.123 +0.047 0.728 2024-03-11T22:48:23.454 INFO:teuthology.orchestra.run.smithi049.stdout:+hv03.front.sepi 74.6.168.72 3 u 20 128 377 0.130 +0.035 0.565 2024-03-11T22:48:23.454 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-11T22:48:23.455 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-03-11T22:48:23.455 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-03-11T22:48:23.456 INFO:teuthology.orchestra.run.smithi187.stdout:*hv01.front.sepi 44.4.53.2 2 u 14 128 377 0.170 -5.619 0.428 2024-03-11T22:48:23.456 INFO:teuthology.orchestra.run.smithi187.stdout:+hv02.front.sepi 63.231.80.2 3 u 86 128 377 0.168 +0.646 0.243 2024-03-11T22:48:23.456 INFO:teuthology.orchestra.run.smithi187.stdout:+hv03.front.sepi 74.6.168.72 3 u 83 128 377 0.184 -0.001 0.127 2024-03-11T22:48:23.456 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-11T22:48:23.457 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-11T22:48:23.468 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-11T22:48:23.469 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-11T22:48:23.483 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-11T22:48:23.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-11T22:48:23.508 INFO:teuthology.task.internal:Duration was 3661.595028 seconds 2024-03-11T22:48:23.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-11T22:48:23.522 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-11T22:48:23.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-11T22:48:23.525 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-11T22:48:23.560 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-11T22:48:23.560 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-03-11T22:48:23.560 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-11T22:48:23.610 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-03-11T22:48:23.610 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-11T22:48:23.620 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-11T22:48:23.620 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-11T22:48:23.654 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-11T22:48:23.725 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-11T22:48:23.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-11T22:48:23.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-11T22:48:23.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-11T22:48:23.949 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-11T22:48:23.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-11T22:48:23.959 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-11T22:48:23.974 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-11T22:48:23.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-11T22:48:24.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-11T22:48:24.009 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-03-11T22:48:24.029 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-03-11T22:48:24.056 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-11T22:48:24.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-11T22:48:24.068 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-11T22:48:24.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-11T22:48:24.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-11T22:48:24.111 INFO:teuthology.task.internal:Transferring archived files... 2024-03-11T22:48:24.112 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942/remote/smithi049 2024-03-11T22:48:24.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-11T22:48:24.159 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942/remote/smithi187 2024-03-11T22:48:24.159 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-11T22:48:24.183 INFO:teuthology.task.internal:Removing archive directory... 2024-03-11T22:48:24.184 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-11T22:48:24.186 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-11T22:48:24.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-11T22:48:24.244 INFO:teuthology.task.internal:Not uploading archives. 2024-03-11T22:48:24.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-11T22:48:24.282 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-11T22:48:24.282 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-11T22:48:24.284 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-11T22:48:24.288 INFO:teuthology.orchestra.run.smithi049.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 11 22:48 /home/ubuntu/cephtest 2024-03-11T22:48:24.290 INFO:teuthology.orchestra.run.smithi187.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 11 22:48 /home/ubuntu/cephtest 2024-03-11T22:48:24.292 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-11T22:48:24.301 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-11T22:48:24.330 INFO:teuthology.nuke:Checking targets against current locks 2024-03-11T22:48:24.352 DEBUG:teuthology.nuke:shortname: smithi049 2024-03-11T22:48:24.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-11T22:48:24.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-11 21:36:34.473368', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDq6Jp+Jpy1mZulEafdt+/jRF01q1gQ+AU1DSVb4CgSijPPq2SPtntHuMpBCuYRR+Scc/EgUk6oVbXCTRI58BqQ='} 2024-03-11T22:48:24.378 DEBUG:teuthology.nuke:shortname: smithi187 2024-03-11T22:48:24.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-11T22:48:24.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-11_21:08:02-orch-squid-distro-default-smithi/7591942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-11 21:36:34.471396', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLYFMuTAiJq1vsAZh/Vru1rCJJNcrplW2PhH8Mk3LQY+o19fqKyUmwuHYECAWTMx4vyR5VK8iM5kTNysFzIYBg='} 2024-03-11T22:48:24.425 INFO:teuthology.orchestra.console.smithi049:Power off 2024-03-11T22:48:24.425 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T22:48:24.449 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-03-11T22:48:24.449 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:48:24.466 INFO:teuthology.orchestra.console.smithi187:Power off 2024-03-11T22:48:24.466 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T22:48:24.475 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-03-11T22:48:24.488 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-03-11T22:48:24.488 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:48:24.512 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-11T22:48:28.477 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:48:28.513 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:48:28.586 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-03-11T22:48:28.623 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-03-11T22:48:32.591 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:48:32.624 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T22:48:32.702 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-03-11T22:48:32.734 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-03-11T22:48:32.803 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-03-11T22:48:32.835 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-03-11T22:48:32.939 INFO:teuthology.run:Summary data: description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} duration: 3661.5950276851654 failure_reason: '"2024-03-11T22:20:00.000232+0000 mon.a (mon.0) 2541 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-03-11T22:48:32.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T22:48:33.020 INFO:teuthology.run:FAIL